CITYSCRAPER

Advanced Multi-Site Aggregator Engine

One engine. One mission. Nationwide yard sale data.

CITYSCRAPER TERMINAL

// DATA PIPELINES

// ENGINE CAPABILITIES

Real-Time Scraping

Automated collection every 4 hours across all pipelines

Supabase Storage

PostgreSQL-backed with full-text search and geo queries

Multi-Site Push

One scrape feeds YardShoppers.com automatically

API-Key Protected

Every endpoint locked behind authentication

Live Dashboard

Monitor scrape health, data volume, and push status

Error Recovery

Auto-retry with exponential backoff on failures