🧹 Archive (delete) duplicate items from a Notion database

Target Audience

- Notion Users: Individuals or teams managing databases in Notion who need to maintain data integrity by removing duplicates.
- Project Managers: Professionals looking to streamline their project management processes by ensuring only unique entries are retained.
- Data Analysts: Users who analyze data and require a clean dataset for reporting and insights.
- Automation Enthusiasts: Those interested in automating repetitive tasks within Notion to save time and reduce manual errors.

Problem Solved

This workflow addresses the issue of duplicate entries in Notion databases. Duplicates can lead to confusion, miscommunication, and inaccurate data analysis. By automatically identifying and archiving duplicate items based on a specified property, users can maintain a clean and organized database, ensuring that only one copy of each item remains.

Workflow Steps

1. Trigger: The workflow can be initiated either daily or when a new page is added to the database.
2. Get Pages: It retrieves all pages from the specified Notion database, preparing the data for further processing.
3. Format Items: Each item is formatted to include relevant properties, specifically the property used for identifying duplicates.
4. Aggregate Items: The workflow aggregates all items to prepare them for duplicate detection.
5. Filter Duplicates: A code node processes the data to find duplicates based on the specified property, storing them for archiving.
6. Archive Pages: Finally, the identified duplicates are archived in Notion, effectively removing them from active view while keeping the database organized.

Customization Guide

- Database Selection: Modify the databaseId in the 'Get pages from database' node to point to your desired Notion database.
- Property to Check: In the 'Format items properly' node, set the property_to_check to the attribute you want to use for identifying duplicates (e.g., title, email, etc.).
- Triggers: Choose between the daily schedule or the real-time trigger based on your workflow needs. You can enable or disable either trigger as required.
- Additional Logic: Customize the filtering logic in the 'Filter duplicates' node if you have specific criteria for what constitutes a duplicate.