ManualTrigger Automate

For HackerNews, this manual-triggered workflow automates the extraction and analysis of comments from a selected story, leveraging advanced clustering and AI insights. It efficiently organizes comments into meaningful groups, identifies key community sentiments, and exports detailed insights to Google Sheets, enhancing understanding of user feedback and trends.

7/8/2025
36 nodes
Complex
manualcomplexhackernewssplitoutlangchainfiltergooglesheetsexecuteworkflowtriggerexecuteworkflowsticky noteadvancedapiintegration
Categories:
Web Scraping & Data ExtractionData Processing & AnalysisBusiness Process AutomationManual TriggeredComplex Workflow
Integrations:
HackerNewsSplitOutLangChainFilterGoogleSheetsExecuteWorkflowTriggerExecuteWorkflowSticky Note

Target Audience

Target Audience


- Data Analysts: Individuals looking to analyze community feedback on Hacker News stories.
- Developers: Those who want to integrate Hacker News data into their applications or workflows.
- Researchers: Academics and professionals studying online community dynamics and sentiment.
- Product Managers: Professionals seeking insights into user opinions and trends based on comments from Hacker News.
- Marketers: Individuals interested in understanding customer sentiment and feedback from tech-savvy communities.

Problem Solved

Problem Solved


This workflow addresses the challenge of extracting, analyzing, and summarizing comments from Hacker News stories. It automates the process of gathering comments, clustering them for insights, and generating actionable summaries, thereby saving time and providing valuable community insights without manual effort.

Workflow Steps

Workflow Steps


1. Manual Trigger: Initiates the workflow when the user clicks 'Test workflow'.
2. Set Variables: Defines the story_id for the Hacker News article to be analyzed.
3. Clear Existing Comments: Deletes any previous comments associated with the story ID in the Qdrant vector store to ensure fresh data.
4. Fetch Comments: Uses the Hacker News API to retrieve comments for the specified story, including nested replies.
5. Split Out Comments: Separates the retrieved comments into individual entries for further processing.
6. Store Comments in Qdrant: Inserts the comments into the Qdrant vector store for efficient querying and analysis.
7. Find Comments: Retrieves comments from the Qdrant vector store based on the provided story ID.
8. Apply K-means Clustering: Groups comments into clusters based on their content to identify common themes.
9. Get Payload of Points: Fetches the detailed content of the clustered comments from Qdrant.
10. Generate Insights: Uses a language model to summarize the clustered comments and determine the overall sentiment.
11. Prep Output: Formats the insights and comments for export.
12. Export to Google Sheets: Appends the insights and comments to a specified Google Sheet for easy access and sharing.

Customization Guide

Customization Guide


- Change Story ID: Update the story_id in the 'Set Variables' node to analyze different Hacker News stories.
- Adjust Clustering Parameters: Modify the number of clusters in the K-means algorithm to refine how comments are grouped based on your needs.
- Customize Google Sheets Output: Alter the columns in the 'Export To Sheets' node to include additional metadata or insights as required.
- Integrate Additional Data Sources: Expand the workflow by integrating other APIs or data sources to enrich the analysis further.
- Modify Language Model Prompts: Tailor the prompts in the 'Information Extractor' node to adjust the style and focus of the insights generated.