ManualTrigger Automate

Automate data extraction and feed generation on ManualTrigger, seamlessly retrieving episode links and content from specified web pages, while eliminating duplicates for efficient processing. This workflow enhances data management and delivery, providing a streamlined RSS feed with structured information for easy consumption.

7/8/2025
11 nodes
Medium
webhookmediumhtmlextractitemlistsrespondtowebhookadvancedapiintegrationcodecustom
Categories:
Webhook TriggeredMedium Workflow
Integrations:
HtmlExtractItemListsRespondToWebhook

Target Audience

This workflow is ideal for:
- Podcasters looking to automate the extraction and distribution of their episode links.
- Developers who want to integrate podcast data into their applications or websites.
- Content Creators who need a streamlined way to generate RSS feeds from their media content.
- Marketers aiming to promote podcasts by automating the feed update process.

Problem Solved

This workflow addresses the challenge of manually gathering episode links and creating an RSS feed for podcasts. It automates the entire process, saving time and reducing the potential for errors by:
- Extracting episode links from a specified overview page.
- Removing duplicate links to ensure a clean output.
- Fetching detailed episode information and generating a well-structured RSS feed automatically.

Workflow Steps

  • Manual Trigger: The workflow starts when the user clicks 'execute'.
    2. Get Overview Page: It retrieves the overview page of a specified podcast episode.
    3. Extract Links: Links to individual episodes are extracted from the overview page using HTML selectors.
    4. Split Out Lists: The extracted links are split into individual items for further processing.
    5. Remove Duplicate Links: Any duplicate links are filtered out to ensure uniqueness.
    6. Get Episode Page: For each link, the corresponding episode page is fetched.
    7. Extract Script: A specific script tag is extracted from the episode page, which contains JSON data.
    8. Parse JSON: The extracted script is parsed to convert it into a usable JSON format.
    9. Define Feed Items: The parsed data is used to create RSS feed items, including title, description, and media information.
    10. Serve Feed: Finally, the generated RSS feed is served as a response to the initial webhook request.

    • Customization Guide

    Users can customize this workflow by:
    - Changing the Overview URL: Modify the URL in the 'Get overview page' node to point to a different podcast.
    - Adjusting CSS Selectors: Update the CSS selectors in the 'Extract links' and 'Extract script' nodes to match the structure of the new podcast's web pages.
    - Modifying Feed Item Structure: Alter the function code in the 'Define feed items' node to change the format or content of the RSS feed, such as adding new fields or changing the XML structure.
    - Adding Additional Nodes: Integrate more nodes for additional processing, such as sending notifications or storing data in a database.