scraper — independent software & tools

31 independent scraper listings the big search engines bury.

• kari

  github · Free · by Dhairya3391

  Kari just a tui for getting media from providers and playing it in your media player with nice to have features.

• social-media-scraper-skill

  github · Free · by expropriationhoorayhenry64

  Extract and summarize social media content from platforms like Instagram, TikTok, X, and YouTube using Claude Code.

• job-hunter

  github · Free · by frangelbarrera

  Automated job scraping pipeline for security engineer roles. Python + GitHub Actions + Gemini API.

• ohara2

  github · Free · by hashamcomp-tech

  Self-hosted personal library for scraped web novels — read online or offline, no ads, no tracking.

• ccrawl-cli

  github · Free · by tamnd

  A fast, friendly command line for Common Crawl: URL index search, WARC fetch, Parquet columnar queries, and dataset building.

• apify

  npm · Free · by GitHub Actions

  The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• apify-client

  npm · Free · by GitHub Actions

  Apify API client for JavaScript

• @crawlee/core

  npm · Free · by GitHub Actions

  The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

• domparser-rs

  npm · Free · by xusd320

  A super fast html parser and manipulator written in rust.

• firecrawl-cli

  npm · Free · by GitHub Actions

  Command-line interface for Firecrawl. Scrape, crawl, and extract data from any website directly from your terminal.

• google-news-url-decoder

  npm · Free · by zindont

  A Node.js library to decode Google News URLs to their original source URLs.

• google-play-scraper

  npm · Free · by facundoolano

  scrapes app data from google play store

• @mendable/firecrawl-js

  npm · Free · by hello_sideguide

  JavaScript SDK for Firecrawl API

• openbrand

  npm · Free · by ethanjyx

  Extract brand assets (logos, colors, backdrops) from any website URL

• tiktok-live-connector

  npm · Free · by GitHub Actions

  Node.js library to receive live stream chat events like comments and gifts from TikTok LIVE.

• twitter-openapi-typescript

  npm · Free · by fa0311

  Implementation of Twitter internal API in TypeScript

• url-metadata

  npm · Free · by laurengarcia

  Fetch a URL and scrape its metadata using Node.js or the browser. Can parse metadata from HTML strings or Response objects as well.

• @vreden/youtube_scraper

  npm · Free · by vredenofficiall

  A simple YouTube video downloader for audio and video formats with resolusi and quality.

• Fentry-AutoCrate

  github · Free · by brittojo7n

  This is a pre-configured script with GitHub Actions workflow to automatically claim the "Regular Crate" on fentry

• Scrapling

  github · Free · by Fabianusromarioyeuyanan123

  Simplify web scraping by extracting data from modern websites with an easy-to-use Python library designed for efficiency and clarity.

• Discord-Joiner-Token-Scraper

  github · Free · by romulusharish

  🤖 Automate Discord server joins using user tokens, streamlining bulk invitations while providing structured responses for each token processed.

• sri-lanka-software-jobs

  github · Free · by Senadeera-NK

  🚀 Automated Software Engineering Job Tracker for Sri Lanka. Scrapes and categorizes Intern, Associate, and SE roles daily using Java (Jsoup) and GitHub Actions. Centralizing the SL tech job market for developers.

• API-Header-Spoofer

  github · Free · by tensei3san

• webustler

  github · Free · by titan77champion

  🌐 Extract clean, LLM-ready markdown from any URL, including Cloudflare-protected sites, with this effective MCP server for web scraping.

• app-store-scraper

  npm · Free · by facundoolano

  scrape data from the itunes app store

• @bochilteam/scraper

  npm · Free · by bochilgaming

  Browserless scraper module

• cheerio

  npm · Free · by feedic

  The fast, flexible & elegant library for parsing and manipulating HTML and XML.

• htmlmetaparser

  npm · Free · by blakeembrey

  A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and AppLinks.

• robots-parser

  npm · Free · by samclarke

  A specification compliant robots.txt parser with wildcard (*) matching support.

• unfurl.js

  npm · Free · by jacktuck

  Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based

• website-scraper

  npm · Free · by GitHub Actions

  Download website to a local directory (including all css, images, js, etc.)