Get the most out of your competitive intelligence with our comprehensive guides and tutorials.
Start by entering any e-commerce website URL in the main input field. The platform will automatically detect the store's technology stack.
Select whether you want to detect technologies only, scrape products only, or do both. Technology detection is always free!
The platform will analyze the website and display results. For product scraping, this may take a few minutes depending on the catalog size.
Once complete, you can export products as a Shopify-compatible CSV file, or share the technology report via a permanent URL.
The platform provides several key areas for competitive intelligence:
Main scraping tool - enter a URL to detect technologies and extract products.
Save and manage product collections for future reference. (Basic+)
Track price changes and catalog updates over time. (Basic+)
Shareable technology reports at /tech/domain.com with historical tracking.
Different features are available depending on your subscription tier. Free users have access to the Scanner, Technology Detection, and User Guides. Basic tier and above unlock CSV export, dataset saving, and Product Intelligence features. Admin tiers have access to the admin panel for user and system management.
Our technology detection system identifies 3000+ technologies including:
Every domain gets a permanent shareable URL:
These reports include historical snapshots, showing how a website's technology stack changes over time.
Extract complete product catalogs including:
| Tier | Products/Job |
|---|---|
| Free | 50 products |
| Basic | 500 products |
| Pro | 2,000 products |
| Paid | 2,000 products |
| Admin/Superadmin | 50,000 products |
The Website Spider crawls every page of a site from a single starting URL. Unlike product scraping, it is platform-agnostic — it works on any website and captures page-level data useful for SEO audits, content mapping, and link analysis.
| Setting | Description |
|---|---|
| Max Depth | How many link-hops from the start URL (1–5). Depth 1 = start page only; depth 2 = start page + all pages directly linked from it. |
| Max Pages | Hard cap on total pages crawled. Capped by your plan (Free: 100, Basic: 500, Pro: 2,000, Paid: 5,000). |
| Delay | Pause between requests (0–5,000ms). A polite crawl rate protects the target site and avoids rate limiting. |
| Exclude Patterns | Skip URLs matching any of these strings (one per line). Useful for ignoring /cart, /checkout, or pagination parameters. |
| Respect robots.txt | Honour the target site's robots.txt crawl rules (recommended on by default). |
| Seed from sitemap | Use the site's sitemap.xml to discover pages before crawling, ensuring important URLs are not missed. |
| Export Format | Download results as CSV, JSON, or Markdown. |
| Tier | Max Pages / Crawl |
|---|---|
| Free | 100 pages |
| Basic | 500 pages |
| Pro | 2,000 pages |
| Paid / API | 5,000 pages |
Once a crawl completes, click Save to Dataset to store the full page list for future reference. Spider datasets are labelled with a purple badge on the Datasets page and export a dedicated CSV with all page-level fields.
We support automatic product extraction from these platforms:
The platform automatically detects which e-commerce system a website uses and applies the optimal extraction strategy:
Yes! Technology detection is always free and unlimited. Only product scraping counts against your usage limits.
After scraping completes, click the "Download CSV" button. The file is formatted for direct import into Shopify's product importer. Note: CSV export requires Basic tier or higher.
After scraping completes, click the Save to Dataset button to save products for future reference. You can view and manage all saved datasets from the "My Datasets" page. This feature requires Basic tier or higher.
Product Intelligence is an advanced analytics feature that tracks price history, detects catalog changes, and provides competitive insights across domains. It shows price increases/decreases, new products, and removed products over time. Available for Basic tier and above.
Some websites block automated requests or use advanced anti-bot protection. Our platform uses intelligent fetcher escalation with TLS spoofing and headless browsers for protected sites. If scraping fails, try the technology detection to still get valuable insights.
GTIN (Global Trade Item Number) is a unique product identifier used worldwide. We extract these when available to help with product matching across different retailers.
Currently, we focus on individual e-commerce stores. Marketplace support is on our roadmap for future development.
Each domain stores up to 50 historical snapshots. Click "Refresh Scan" on the tech report page to get the latest data.
We automatically detect currency from site metadata (JSON-LD, hreflang tags, TLD) and display prices with proper formatting. Supported currencies include: USD, EUR, GBP, AUD, CAD, COP, BRL, MXN, ARS, CLP, PEN, JPY, KRW, INR, ZAR, and more. Each currency uses its native formatting (e.g., Colombian Pesos show as $531.000 with period thousands separator).
We offer Free, Basic, Pro, and Paid tiers. Free users can scan up to 50 products per job (200/month). Basic and above unlock CSV export, dataset saving, and Product Intelligence features. See the tier table above for full details.