Web site scraper for LLMs with Airtop
Recursive Web Scraping Use Case Automating web scraping with recursive depth is ideal for collecting content across multiple linked pages—perfect for content aggregation, lead generation, or research projects. What This Automation Does This automation reads a list of URLs from a Google Sheet, scrapes each page, stores the content in a document, and adds newly discovered links back to the sheet. It continues this process for a specified number of iterations based on the defined scr
At a glance
Web site scraper for LLMs with Airtop is a ready-made n8n workflow you import as a workflow JSON file — no build required. It connects UNSUPPORTED_SLUG_FORMAT. It's free to download. Follow the 5-step import below to go live in minutes.
- Platform
- n8n
- Connects
- UNSUPPORTED_SLUG_FORMAT
- Modules
- 18
- Price
- Free
- Version
- v1.0

About this workflow
Recursive Web Scraping Use Case Automating web scraping with recursive depth is ideal for collecting content across multiple linked pages—perfect for content aggregation, lead generation, or research projects. What This Automation Does This automation reads a list of URLs from a Google Sheet, scrapes each page, stores the content in a document, and adds newly discovered links back to the sheet. It continues this process for a specified number of iterations based on the defined scraping depth. Input Parameters: - Seed URL: The starting URL to begin the scraping process. Example: - Links must contain: Restricts the links to those that contain this specified string. Example: - Depth: The number of iterations (layers of links) to scrape beyond the initial set. Example: 3 How It Works 1. Starts by reading the Seed URL from the Google Sheet. 2. Scrapes each page and saves its content to the specified document. 3. Extracts new links from each page that match the Links must contain string, appends them to the Google Sheet. 4. Repeats steps 2–3 for the number of times specified by Depth - 1. Setup Requirements 1. Airtop API Key — free to generate. 2. Credentials set up for Google Docs (requires creating a project on Google Console). Read how to. 3. Credentials set up for Google Spreadsheet. Next Steps - Add Filtering Rules: Filter which links to follow based on domain, path, or content type. - Combine with Scheduler: Run this automation on a schedule to continuously explore newly discovered pages. - Export Structured Data: Extend the process to store extracted data in a CSV or database for analysis. Read more about website scraping for LLMS
How to import this n8n workflow
- 1
Download the workflow JSON file after purchase.
- 2
Open n8n → click the menu → Import from File.
- 3
Select the downloaded JSON and import.
- 4
Set up credentials for each node that requires them.
- 5
Click Execute Workflow to test, then activate.
Setup guide
Setup guide included
Purchase to unlock the full step-by-step guide
Related N8n workflows
Cold Email Automation
Aggregate crypto and stock market news feed from multiple sources
Get stats, shorten URLs 🛠️ Yourls Tool MCP Server 💪 all 3 operations
AI-Powered Research with Jina AI Deep Search
Turn your Android device's WiFi on when you enter a specified area
Clone voices from text to speech with Zyphra Zonos API
Design UI projects 🎨🖼️ with Google Stitch via Telegram using MCP and Gemini AI
Scrape event data from 10times with Bright Data MCP, AI & Google Sheets
Reviews
No reviews yet
Be the first to buy and share your experience.
Leave a review
Sign in to share your experience with this workflow.
Create a free account to purchase workflows.
- JSON blueprint — instant download
- Setup guide PDF included
- 5 downloads · valid 30 days
- Works with n8n
Need help setting this up?
Book a 3-hour live setup session with an Agility consultant.
- Configure live on Google Meet / Zoom
- Free follow-up if workflow has defects
- Platform expert assigned to you