Aggregate, Scrape & Analyze
E-Commerce Markets in Real-Time
A secure multi-source scraper that concurrently extracts product listings, processes statistical price distributions, and generates AI reports into clean offline PDFs.
Concurrent Scraper
Fetches product listings concurrently across OLX, Daraz, PriceOye, Telemart, Shophive, iShopping, and Megapk.
Server-Sent Events (SSE)
Streams scraping logs and progress updates in real-time from the backend thread straight to your screen.
AI Synthesis Engine
Compares platforms, calculates price benchmarks, detects outlier deals, and outputs smart e-commerce strategies.
Offline PDF Reports
Automatically packages price charts, statistics, and AI summaries into clean, print-ready PDF documents.
System Architecture & Data Flow
How the Next.js frontend, Flask backend threads, databases, and AI API integrations synchronize.
Next.js Web UI
A responsive dashboard built with TypeScript, NextUI, and Recharts. Users enter products and view real-time feedback.
- POST /scrapper/start
- SSE EventListener
- Recharts Render
Flask/FastAPI API
Spawns background scraping threads, handles token auth, writes results to DB, and compiles PDF reports.
- Threading Execution
- SSE Log Streamer
- ReportLab PDF Writer
Database & Models
Stores scraping jobs, parameters, logs, and user API credentials. Integrates with LLMs to generate market analysis.
- SQLAlchemy Models
- Gemini / HF / GPT
- Local Analytics
Real-Time Pakistani E-Commerce Aggregator
Our scrapper extracts real-time prices directly from mainstream shopping platforms including OLX, Daraz, PriceOye, Telemart, Shophive, iShopping, and Megapk. By aggregating this data into a standardized structure, it solves the problem of manual cross-referencing to find the best deal.
Ready to run a scraping job?
Log in to your workspace, select target websites, enter keywords, and generate your first AI market intelligence report.