Skip to content

spider-rs/spider-example-tech-detector

Repository files navigation

Spider Tech Detector

Detect what technologies any website uses -- frameworks, CMS, analytics, CDNs, and more -- using Spider Cloud, the fastest web crawling infrastructure.

Deploy with Vercel

Live Demo: https://tech-detector.spider.cloud

Spider Tech Detector

Features

  • Detect 50+ technology signatures across any website
  • 14 detection categories: Framework, Library, CMS, Analytics, CDN, Hosting, UI, Payment, Support, Security, Monitoring, Feature Flags, A/B Testing, Marketing
  • Confidence scores for each detected technology
  • Sortable and filterable results table
  • Real-time JSONL streaming results via Spider Cloud API
  • Export reports as JSON, CSV, or Markdown
  • Supabase authentication (GitHub & Discord)
  • Cross-app switcher to jump between all Spider Cloud tools with the current URL pre-filled

Getting Started

Prerequisites

  • Node.js 18+
  • A Spider Cloud account with API credits
  • Supabase project for authentication

Setup

  1. Clone the repository:
git clone https://github.com/spider-rs/spider-tech-detector.git
cd spider-tech-detector
  1. Install dependencies:
npm install
  1. Configure environment variables:
cp .env.local .env

Edit .env and add your Supabase and Spider Cloud credentials:

NEXT_PUBLIC_SUPABASE_URL=your_supabase_url
NEXT_PUBLIC_SUPABASE_ANON_KEY=your_supabase_anon_key
NEXT_PUBLIC_API_URL=https://api.spider.cloud
  1. Run the development server:
npm run dev

Open http://localhost:3001 in your browser.

Tech Stack

Related Spider Cloud Tools

Tool URL
Dead Link Checker dead-link-checker.spider.cloud
A11y Checker a11y-checker.spider.cloud
Security Scanner security-scanner.spider.cloud
Schema Validator schema-validator.spider.cloud
Knowledge Base knowledge-base.spider.cloud
Perf Runner perf-runner.spider.cloud
Content Translator content-translator.spider.cloud
Diff Monitor diff-monitor.spider.cloud
Sitemap Generator sitemap-generator.spider.cloud
Link Graph link-graph.spider.cloud

License

MIT

About

Detect what technologies any website uses — frameworks, CMS, analytics, CDNs, and more. Powered by Spider Cloud.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors