Repositories list

• spider

  Public
  Web crawler and scraper for Rust

  rustcrawlerautomation+ 7

  rustcrawlerautomationspiderweb-crawlerscrapingweb-scrapingindexerheadless-chromeai-agent

  Rust

  •

  MIT License

  •184•2.3k•3•1•Updated Mar 17, 2026Mar 17, 2026

• llm_models

  Public
  Auto-updated registry of LLM model capabilities (vision, audio, etc.)

  Rust

  •

  MIT License

  •0•1•0•0•Updated Mar 17, 2026Mar 17, 2026

• firewall

  Public
  Firewall for Rust

  rustblacklistnetworking+ 3

  rustblacklistnetworkingfirewalladblockadguard

  Rust

  •

  MIT License

  •0•1•0•0•Updated Mar 16, 2026Mar 16, 2026

• chromey

  Public
  Chrome DevTools Protocol for Rust

  automationcdpheadless-chrome+ 1

  automationcdpheadless-chromechrome-devtools-protocol

  Rust

  •

  Apache License 2.0

  •10•41•1•2•Updated Mar 15, 2026Mar 15, 2026

• ua_generator

  Public
  Pre-compiled random real User-Agents. Updated weekly for windows, mac, linux, and android

  useragentuser-agent-stringua-generator

  useragentuser-agent-stringua-generator

  Rust

  •

  MIT License

  •7•37•0•0•Updated Mar 15, 2026Mar 15, 2026

• spider_transformations

  Public
  HTML transformation library for Rust

  html-to-markdowntransform-datahtml-transformation

  html-to-markdowntransform-datahtml-transformation

  Rust

  •

  MIT License

  •0•2•0•0•Updated Mar 12, 2026Mar 12, 2026

• spider-browser

  Public
  Reliable, fast, and efficient Remote Browser for AI

  browserpuppeteerplaywright

  browserpuppeteerplaywright

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 9, 2026Mar 9, 2026

• spider_fingerprint

  Public

  spider-rs/spider_fingerprint’s past year of commit activity
  The fingerprinting library for Rust

  emulationheadlessfingerprint

  emulationheadlessfingerprint

  Rust

  •

  MIT License

  •3•13•0•0•Updated Mar 9, 2026Mar 9, 2026

• spider-clients

  Public
  Python, Javascript, and Rust libraries for the Spider Cloud API.

  crawlerscraperai+ 7

  crawlerscraperaispiderhtml-to-markdownweb-scrapingai-agentssupabaseai-scrapingllm-webcrawler

  Rust

  •

  MIT License

  •9•23•0•0•Updated Mar 7, 2026Mar 7, 2026

• http-global-cache

  Public
  A global cache to use for http.

  Rust

  •0•0•0•0•Updated Mar 6, 2026Mar 6, 2026

• spider-google-sheets

  Public
  Google Sheets add-on for web scraping, AI extraction, and search powered by the Spider API

  spiderseospreadsheet+ 5

  spiderseospreadsheetgoogle-sheetsweb-scrapingapps-scriptgoogle-sheets-addonai-extraction

  TypeScript

  •0•0•0•0•Updated Mar 5, 2026Mar 5, 2026

• n8n-nodes-spider

  Public
  Spider n8n community node — crawl, scrape, and extract structured data from any website inside your n8n workflows.

  automationaispider+ 7

  automationaispiderweb-scrapingdata-extractionweb-crawlingworkflow-automationn8nn8n-noden8n-community-node

  TypeScript

  •0•0•0•0•Updated Mar 3, 2026Mar 3, 2026

• spider-example-archiver

  Public
  Crawl and archive websites in a VSCode-like code viewer. Powered by Spider Cloud.

  reactsyntax-highlightingnextjs+ 10

  reactsyntax-highlightingnextjsweb-crawlerweb-scrapingindexeddbmonaco-editorweb-archivetailwindcsscode-viewer+ 3

  TypeScript

  •

  MIT License

  •1•7•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-seo-auditor

  Public
  Audit SEO elements like titles, meta tags, and headings. Powered by Spider Cloud.

  reactnextjsseo+ 10

  reactnextjsseoweb-crawlerweb-scrapingmeta-tagsseo-analysisseo-toolstailwindcssseo-audit+ 3

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-link-graph

  Public
  Visualize internal link structure as an interactive force-directed graph. Powered by Spider Cloud.

  reactcanvasnextjs+ 11

  reactcanvasnextjsweb-crawlerweb-scrapinggraph-visualizationnetwork-visualizationinternal-linksforce-directed-graphtailwindcss+ 4

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-perf-runner

  Public
  Analyze page sizes, resources, and web performance metrics. Powered by Spider Cloud.

  reactperformanceweb-performance+ 11

  reactperformanceweb-performancenextjsweb-crawlerweb-scrapingpage-speedperformance-testingtailwindcsspage-size+ 4

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-sitemap-generator

  Public
  Generate visual sitemaps and export as XML. Powered by Spider Cloud.

  reactsitemapnextjs+ 10

  reactsitemapnextjsseoweb-crawlerweb-scrapingxml-sitemapsitemap-generatortailwindcsssite-structure+ 3

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-knowledge-base

  Public
  Build a searchable knowledge base from crawled websites. Powered by Spider Cloud.

  reactsearch-enginedocumentation+ 10

  reactsearch-enginedocumentationnextjsweb-crawlerweb-scrapingindexeddbfull-text-searchknowledge-baseweb-archive+ 3

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-diff-monitor

  Public
  Track website content changes over time with visual diffs. Powered by Spider Cloud.

  reactdiffnextjs+ 10

  reactdiffnextjsweb-crawlerweb-scrapingchange-detectiontailwindcssweb-diffwebsite-monitoringsupabase+ 3

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-content-extractor

  Public
  Extract structured content, images, and links from websites. Powered by Spider Cloud.

  reactnextjsweb-crawler+ 8

  reactnextjsweb-crawlerweb-scraperweb-scrapinghtml-parserdata-extractionstructured-datacontent-extractiontailwindcss+ 1

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-content-translator

  Public
  Convert web content between HTML, markdown, and plain text. Powered by Spider Cloud.

  reactmarkdownnextjs+ 10

  reactmarkdownnextjshtml-to-markdownweb-crawlertext-extractionweb-scrapinghtml-parserformat-convertertailwindcss+ 3

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-a11y-checker

  Public
  Audit websites for accessibility issues and WCAG compliance. Powered by Spider Cloud.

  reactaccessibilityscreen-reader+ 11

  reactaccessibilityscreen-readernextjsweb-crawlera11yariaweb-scrapingwcagweb-accessibility+ 4

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-schema-validator

  Public
  Validate JSON-LD structured data and Schema.org markup on any website. Powered by Spider Cloud.

  reactspidernextjs+ 7

  reactspidernextjsseoweb-crawlerschema-orgjson-ldstructured-datarich-resultsspider-cloud

  TypeScript

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-security-scanner

  Public
  Scan security headers on any website — CSP, HSTS, X-Frame-Options, and more. Powered by Spider Cloud.

  reactcsphsts+ 7

  reactcsphstsspidernextjsweb-crawlerweb-securitysecurity-scannersecurity-headersspider-cloud

  TypeScript

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-tech-detector

  Public
  Detect what technologies any website uses — frameworks, CMS, analytics, CDNs, and more. Powered by Spider Cloud.

  reactspidernextjs+ 6

  reactspidernextjsweb-crawlercms-detectiontech-stackframework-detectiontechnology-detectionspider-cloud

  TypeScript

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-dead-link-checker

  Public
  Crawl websites and find broken or dead links. Powered by Spider Cloud.

  reactlink-checkernextjs+ 11

  reactlink-checkernextjsseoweb-crawlerweb-scrapingbroken-linksdead-linkstailwindcsshttp-status+ 4

  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• spider-example-screenshots-viewer

  Public
  TypeScript

  •

  MIT License

  •0•0•0•0•Updated Mar 2, 2026Mar 2, 2026

• web-scraping-examples

  Public
  Ready-to-run web scraping examples — Amazon, Google, YouTube, Reddit, LinkedIn, Zillow, Airbnb, and more. Built with spider-browser SDK.

  scrapertypescriptexamples+ 17

  scrapertypescriptexamplesweb-crawlerweb-scrapinggoogle-scraperbrowser-automationlinkedin-scraperreddit-scraperheadless-browser+ 10

  TypeScript

  •0•0•0•0•Updated Feb 18, 2026Feb 18, 2026

• spider-browser-dataset

  Public
  Web scraping examples & browser automation benchmark — 21 ready-to-run scrapers for Amazon, Google, YouTube, Reddit, LinkedIn, Zillow, and more. 999-URL dataset…

  benchmarkscrapertypescript+ 17

  benchmarkscrapertypescriptweb-crawlerdatasetweb-scrapinggoogle-scraperbrowser-automationlinkedin-scraperreddit-scraper+ 10

  0•2•0•0•Updated Feb 17, 2026Feb 17, 2026

• spider_skills

  Public
  Web automation skills, tactics, and strategies for Spider

  Rust

  •1•0•0•0•Updated Feb 16, 2026Feb 16, 2026