An advanced, highly evasive web scraping framework built on Node.js and Playwright. Designed to reliably bypass modern anti-bot systems, this scraper employs a 12-layer fingerprint masking system, human-like interaction emulation, and automated CAPTCHA solving to ensure seamless data extraction.
A 12-layer initialization script masks your scraper from every major bot detection vector:
- WebDriver Concealment: Native
navigator.webdriverremoval. - Plugin Spoofing: Injects 5 realistic PDF Plugin objects (
navigator.plugins). - Hardware Spoofing: Randomizes
navigator.hardwareConcurrency(8) andnavigator.deviceMemory(8). - Network Emulation: Fakes realistic
navigator.connectionprofiles (e.g., 4G / 50ms RTT). - Screen & Viewport: Randomizes across 7 common resolutions per session, spoofing
availWidth/Height,colorDepth, andpixelDepth. - Browser Engine Masking: Full
window.chromeinjection (loadTimes, csi, app, runtime). - Hardware Acceleration: WebGL vendor/renderer spoofing (e.g., forces Intel, hides SwiftShader).
- Media & Canvas Noise: Injects unique cryptographic noise into Canvas (
toDataURL/getImageData) and AudioContext (getChannelData) per session. - Permissions API: Spoofs notification permissions to return
"prompt". - Prototype Patching: Overrides
Function.prototype.toStringto return[native code]for all patched functions.
- NopeCHA Integration: Automatically solves hCaptcha, reCAPTCHA, Turnstile, FunCAPTCHA, and AWS WAF challenges.
- Note: Allows up to 100 requests/day on the free tier without an API key.
- Proxifly CDN: Built-in support for 3,000+ proxies with auto-refresh every 5 minutes.
- Header Matching: Dynamically aligns
Sec-CH-UA,Sec-Fetch-*,Accept-*, andCache-Controlheaders with the active User-Agent.
- 12 Realistic Profiles: Seamlessly rotates between genuine Chrome, Firefox, Safari, and Edge environments.
- Cross-Platform: Supports Windows, macOS, Linux, iOS, and Android emulation.
- Mouse Movements: Natural, Bézier-curve based cursor tracking.
- Scrolling: Randomized scroll behavior executed after page load.
- Smart Delays: Randomized 1–3s pre-request delays, 0.8–2s post-load delays, and jittered retry logic.
- Modern Headless Mode: Utilizes Playwright's
--headless=new(Chrome 112+)—completely invisible to detection but fully supports extensions.
Ensure you have Node.js installed on your machine.
- Clone the repository and navigate to the project directory:
git clone https://github.com/yourusername/stealth-scraper.git
cd stealth-scraper
- Install the required dependencies:
npm install express playwright cors axios adm-zip
Basic Run:
node server.js
Run with NopeCHA Premium (Unlimited): To unlock higher limits, run the server with your NopeCHA API key:
NOPECHA_KEY=your_api_key_here node server.js
- Express - Lightweight web server framework.
- Playwright - Browser automation.
- Axios - Promise-based HTTP client.
- CORS - Cross-Origin Resource Sharing middleware.
- Adm-zip - Zip file creation and extraction.
This tool is intended for educational purposes and authorized data extraction only. Users are responsible for complying with the Terms of Service of any website they interact with. The developers assume no liability for misuse.