Web Scraping Examples

1005 ready-to-run web scraping scripts for popular websites, organized by 32 categories. Built with spider-browser — a browser automation SDK with stealth mode and anti-bot bypass.

Quick Start

npm install
SPIDER_API_KEY=sk-... npx tsx ecommerce/amazon-scraper.ts

Get a free API key at spider.cloud.

Categories

Category	Scripts	Example Sites
E-Commerce	97	Abercrombie, Academy sports, Adidas...
Finance	66	Aave, Ally financial, Arbiscan...
News	66	Abcnews, Aljazeera, Apnews...
AI & Developer	60	Ansible galaxy, Arxiv ai, Aws docs...
Travel	55	Agoda, Airbnb, Alaska airlines...
Automotive	45	Advance auto parts, Audi, Auto blog...
Sports & Fitness	35	Action network, Baseball reference, Basketball reference...
Education	35	Amazon books, Babbel, Blackboard...
International	35	About you, Allegro, Auchan...
Jobs	35	Angellist, Builtin, Careerbuilder...
Real Estate	30	Apartments, Century21, Coldwellbanker...
Social	30	Bereal, Bluesky, Clubhouse...
Health	30	Betterhelp, Calm, Cdc...
Food	30	Allrecipes, Amazon fresh, Beyondmenu...
Gaming & Esports	30	Curseforge, Epic games store, Eurogamer...
Government & Legal	30	Above the law, Avvo, Ballotpedia...
Fashion & Beauty	30	Asos fashion, Bershka, Boohoo...
Reviews	26	Alternativeto, Amazon reviews, Angi reviews...
SaaS & B2B	25	Airtable, Asana, Atlassian marketplace...
Science & Research	25	Acm digital library, Arxiv, Biorxiv...
Classifieds & Marketplace	20	1stdibs, Carousell, Chairish...
Directories & Listings	20	Angi directory, Apollo io, Bbb...
Photography & Design	20	500px, Adobe stock, Artstation...
Music & Podcasts	20	Allmusic, Apple music, Apple podcasts...
Events & Tickets	20	10times, Allevents, Axs...
Search	17	Baidu, Bing, Brave search...
Home Services	15	Angi, Bark, Buildzoom...
Logistics & Shipping	15	17track, Aftership, Dhl...
Weather & Environment	15	Accuweather, Airnow, Climate gov...
Telecom	12	Att, Centurylink, Cox...
Media	8	Goodreads, Imdb, Rottentomatoes...
Pets	8	Adopt a pet, Barkbox, Chewy pets...

Examples

E-Commerce (97 scripts)

Script	Target
abercrombie-scraper.ts	abercrombie
academy-sports-scraper.ts	academy sports
adidas-scraper.ts	adidas
adorama-scraper.ts	adorama
aliexpress-scraper.ts	aliexpress
allbirds-scraper.ts	allbirds
amazon-scraper.ts	amazon
anthropologie-scraper.ts	anthropologie
asics-scraper.ts	asics
asos-scraper.ts	asos
away-scraper.ts	away
banana-republic-scraper.ts	banana republic
bath-and-body-works-scraper.ts	bath and body works
bestbuy-scraper.ts	bestbuy
bh-photo-scraper.ts	bh photo
birkenstock-scraper.ts	birkenstock
bombas-scraper.ts	bombas
brooklinen-scraper.ts	brooklinen
brooks-running-scraper.ts	brooks running
calvin-klein-scraper.ts	calvin klein
carhartt-scraper.ts	carhartt
casper-scraper.ts	casper
chewy-scraper.ts	chewy
coach-scraper.ts	coach
columbia-sportswear-scraper.ts	columbia sportswear
converse-scraper.ts	converse
costco-scraper.ts	costco
crate-and-barrel-scraper.ts	crate and barrel
crocs-scraper.ts	crocs
dicks-sporting-goods-scraper.ts	dicks sporting goods
dollar-shave-club-scraper.ts	dollar shave club
dr-martens-scraper.ts	dr martens
ebay-scraper.ts	ebay
etsy-scraper.ts	etsy
everlane-scraper.ts	everlane
free-people-scraper.ts	free people
gamestop-scraper.ts	gamestop
gap-scraper.ts	gap
glossier-scraper.ts	glossier
goat-scraper.ts	goat
harrys-scraper.ts	harrys
hm-scraper.ts	hm
homedepot-scraper.ts	homedepot
ikea-scraper.ts	ikea
jcpenney-scraper.ts	jcpenney
jcrew-scraper.ts	jcrew
kate-spade-scraper.ts	kate spade
kohls-scraper.ts	kohls
levis-scraper.ts	levis
lowes-scraper.ts	lowes
lululemon-scraper.ts	lululemon
macys-scraper.ts	macys
mercari-scraper.ts	mercari
michael-kors-scraper.ts	michael kors
michaels-scraper.ts	michaels
new-balance-scraper.ts	new balance
newegg-scraper.ts	newegg
nike-scraper.ts	nike
nordstrom-rack-scraper.ts	nordstrom rack
nordstrom-scraper.ts	nordstrom
old-navy-scraper.ts	old navy
overstock-scraper.ts	overstock
patagonia-scraper.ts	patagonia
petco-scraper.ts	petco
petsmart-scraper.ts	petsmart
poshmark-scraper.ts	poshmark
pottery-barn-scraper.ts	pottery barn
puma-scraper.ts	puma
purple-scraper.ts	purple
ralph-lauren-scraper.ts	ralph lauren
rei-scraper.ts	rei
samsclub-scraper.ts	samsclub
sephora-scraper.ts	sephora
shein-scraper.ts	shein
shopify-scraper.ts	shopify
stockx-scraper.ts	stockx
target-scraper.ts	target
temu-scraper.ts	temu
the-north-face-scraper.ts	the north face
thredup-scraper.ts	thredup
tiffany-scraper.ts	tiffany
tjmaxx-scraper.ts	tjmaxx
tommy-hilfiger-scraper.ts	tommy hilfiger
ulta-beauty-scraper.ts	ulta beauty
under-armour-scraper.ts	under armour
uniqlo-scraper.ts	uniqlo
urban-outfitters-scraper.ts	urban outfitters
vans-scraper.ts	vans
victorias-secret-scraper.ts	victorias secret
walmart-scraper.ts	walmart
warby-parker-scraper.ts	warby parker
wayfair-scraper.ts	wayfair
west-elm-scraper.ts	west elm
williams-sonoma-scraper.ts	williams sonoma
wish-scraper.ts	wish
zappos-scraper.ts	zappos
zara-scraper.ts	zara

Finance (66 scripts)

Script	Target
aave-scraper.ts	aave
ally-financial-scraper.ts	ally financial
arbiscan-scraper.ts	arbiscan
bankrate-scraper.ts	bankrate
barrons-scraper.ts	barrons
benzinga-scraper.ts	benzinga
binance-scraper.ts	binance
blackrock-scraper.ts	blackrock
blockchain-com-scraper.ts	blockchain com
bloomberg-scraper.ts	bloomberg
bscscan-scraper.ts	bscscan
charles-schwab-scraper.ts	charles schwab
cnbc-scraper.ts	cnbc
coinbase-scraper.ts	coinbase
coingecko-scraper.ts	coingecko
coinmarketcap-scraper.ts	coinmarketcap
compound-finance-scraper.ts	compound finance
credit-karma-scraper.ts	credit karma
crunchbase-scraper.ts	crunchbase
defi-llama-scraper.ts	defi llama
dune-analytics-scraper.ts	dune analytics
etherscan-scraper.ts	etherscan
ethplorer-scraper.ts	ethplorer
etrade-scraper.ts	etrade
fidelity-scraper.ts	fidelity
financial-times-scraper.ts	financial times
finviz-scraper.ts	finviz
google-finance-scraper.ts	google finance
gurufocus-scraper.ts	gurufocus
interactive-brokers-scraper.ts	interactive brokers
investing-scraper.ts	investing
investopedia-scraper.ts	investopedia
kiplinger-scraper.ts	kiplinger
kraken-scraper.ts	kraken
lendingtree-scraper.ts	lendingtree
macrotrends-scraper.ts	macrotrends
marketwatch-scraper.ts	marketwatch
messari-scraper.ts	messari
mint-scraper.ts	mint
morningstar-scraper.ts	morningstar
motley-fool-scraper.ts	motley fool
nerdwallet-scraper.ts	nerdwallet
openinsider-scraper.ts	openinsider
personal-capital-scraper.ts	personal capital
polygonscan-scraper.ts	polygonscan
robinhood-scraper.ts	robinhood
sec-edgar-scraper.ts	sec edgar
seeking-alpha-scraper.ts	seeking alpha
simply-wall-st-scraper.ts	simply wall st
sofi-scraper.ts	sofi
solscan-scraper.ts	solscan
stock-analysis-scraper.ts	stock analysis
stockx-finance-scraper.ts	stockx finance
stockx-scraper.ts	stockx
td-ameritrade-scraper.ts	td ameritrade
thestreet-scraper.ts	thestreet
token-terminal-scraper.ts	token terminal
tradingview-scraper.ts	tradingview
uniswap-scraper.ts	uniswap
vanguard-scraper.ts	vanguard
wallethub-scraper.ts	wallethub
wealthfront-scraper.ts	wealthfront
webull-scraper.ts	webull
whale-wisdom-scraper.ts	whale wisdom
yahoo-finance-scraper.ts	yahoo finance
zacks-scraper.ts	zacks

News (66 scripts)

Script	Target
abcnews-scraper.ts	abcnews
aljazeera-scraper.ts	aljazeera
apnews-scraper.ts	apnews
arstechnica-scraper.ts	arstechnica
axios-scraper.ts	axios
bbc-news-scraper.ts	bbc news
bloomberg-news-scraper.ts	bloomberg news
bloomberg-scraper.ts	bloomberg
cbsnews-scraper.ts	cbsnews
cnet-scraper.ts	cnet
cnn-scraper.ts	cnn
daily-beast-scraper.ts	daily beast
dailymail-scraper.ts	dailymail
defense-one-scraper.ts	defense one
dw-scraper.ts	dw
economist-scraper.ts	economist
engadget-scraper.ts	engadget
forbes-scraper.ts	forbes
foreign-affairs-scraper.ts	foreign affairs
foreign-policy-scraper.ts	foreign policy
foxnews-scraper.ts	foxnews
france24-scraper.ts	france24
google-news-scraper.ts	google news
hackernews-scraper.ts	hackernews
huffpost-scraper.ts	huffpost
independent-scraper.ts	independent
japantimes-scraper.ts	japantimes
mashable-scraper.ts	mashable
mother-jones-scraper.ts	mother jones
national-review-scraper.ts	national review
nbcnews-scraper.ts	nbcnews
newyorker-scraper.ts	newyorker
npr-scraper.ts	npr
nytimes-scraper.ts	nytimes
politico-scraper.ts	politico
propublica-scraper.ts	propublica
quartz-scraper.ts	quartz
reason-scraper.ts	reason
restofworld-scraper.ts	restofworld
reuters-scraper.ts	reuters
rollingstone-scraper.ts	rollingstone
salon-scraper.ts	salon
scmp-scraper.ts	scmp
semafor-scraper.ts	semafor
skynews-scraper.ts	skynews
slate-scraper.ts	slate
techcrunch-ai-scraper.ts	techcrunch ai
techcrunch-scraper.ts	techcrunch
theatlantic-scraper.ts	theatlantic
thediplomat-scraper.ts	thediplomat
theguardian-scraper.ts	theguardian
thehill-scraper.ts	thehill
theinformation-scraper.ts	theinformation
theintercept-scraper.ts	theintercept
thenation-scraper.ts	thenation
theverge-scraper.ts	theverge
timesofindia-scraper.ts	timesofindia
usatoday-scraper.ts	usatoday
vanityfair-scraper.ts	vanityfair
verge-scraper.ts	verge
vice-scraper.ts	vice
vox-scraper.ts	vox
washingtonpost-scraper.ts	washingtonpost
weekly-standard-scraper.ts	weekly standard
wired-scraper.ts	wired
wsj-scraper.ts	wsj

AI & Developer (60 scripts)

Script	Target
ansible-galaxy-scraper.ts	ansible galaxy
arxiv-ai-scraper.ts	arxiv ai
aws-docs-scraper.ts	aws docs
bitbucket-scraper.ts	bitbucket
chatgpt-scraper.ts	chatgpt
chrome-web-store-scraper.ts	chrome web store
claude-api-scraper.ts	claude api
cloudflare-scraper.ts	cloudflare
codewars-scraper.ts	codewars
cohere-scraper.ts	cohere
crates-io-scraper.ts	crates io
devto-scraper.ts	devto
digitalocean-scraper.ts	digitalocean
docker-hub-scraper.ts	docker hub
firebase-scraper.ts	firebase
fly-io-scraper.ts	fly io
github-scraper.ts	github
gitlab-scraper.ts	gitlab
google-colab-scraper.ts	google colab
gradio-scraper.ts	gradio
groq-scraper.ts	groq
hacker-news-scraper.ts	hacker news
hackerrank-scraper.ts	hackerrank
hashnode-scraper.ts	hashnode
heroku-scraper.ts	heroku
homebrew-scraper.ts	homebrew
huggingface-scraper.ts	huggingface
indie-hackers-scraper.ts	indie hackers
jetbrains-marketplace-scraper.ts	jetbrains marketplace
kaggle-scraper.ts	kaggle
langchain-scraper.ts	langchain
leetcode-scraper.ts	leetcode
llamaindex-scraper.ts	llamaindex
medium-tech-scraper.ts	medium tech
mistral-ai-scraper.ts	mistral ai
mlflow-scraper.ts	mlflow
mozilla-addons-scraper.ts	mozilla addons
netlify-scraper.ts	netlify
npm-scraper.ts	npm
ollama-scraper.ts	ollama
openai-scraper.ts	openai
paperswithcode-scraper.ts	paperswithcode
perplexity-labs-scraper.ts	perplexity labs
postman-scraper.ts	postman
product-hunt-scraper.ts	product hunt
programmableweb-scraper.ts	programmableweb
pypi-scraper.ts	pypi
railway-scraper.ts	railway
rapidapi-scraper.ts	rapidapi
render-scraper.ts	render
replicate-scraper.ts	replicate
stackoverflow-scraper.ts	stackoverflow
streamlit-scraper.ts	streamlit
supabase-scraper.ts	supabase
terraform-registry-scraper.ts	terraform registry
together-ai-scraper.ts	together ai
vercel-ai-sdk-scraper.ts	vercel ai sdk
vercel-scraper.ts	vercel
vscode-marketplace-scraper.ts	vscode marketplace
wandb-scraper.ts	wandb

Travel (55 scripts)

Script	Target
agoda-scraper.ts	agoda
airbnb-scraper.ts	airbnb
alaska-airlines-scraper.ts	alaska airlines
alltrails-scraper.ts	alltrails
american-airlines-scraper.ts	american airlines
amtrak-scraper.ts	amtrak
atlas-obscura-scraper.ts	atlas obscura
avis-scraper.ts	avis
best-western-scraper.ts	best western
booking-scraper.ts	booking
budget-scraper.ts	budget
cheapflights-scraper.ts	cheapflights
cruise-critic-scraper.ts	cruise critic
delta-airlines-scraper.ts	delta airlines
enterprise-scraper.ts	enterprise
expedia-scraper.ts	expedia
flightaware-travel-scraper.ts	flightaware travel
flightradar24-travel-scraper.ts	flightradar24 travel
frontier-airlines-scraper.ts	frontier airlines
getyourguide-scraper.ts	getyourguide
google-flights-scraper.ts	google flights
google-hotels-scraper.ts	google hotels
hertz-scraper.ts	hertz
hilton-scraper.ts	hilton
hopper-scraper.ts	hopper
hostelworld-scraper.ts	hostelworld
hotels-scraper.ts	hotels
hyatt-scraper.ts	hyatt
ihg-scraper.ts	ihg
jetblue-scraper.ts	jetblue
kayak-scraper.ts	kayak
kiwi-scraper.ts	kiwi
lonely-planet-scraper.ts	lonely planet
marriott-scraper.ts	marriott
momondo-scraper.ts	momondo
national-car-rental-scraper.ts	national car rental
norwegian-air-scraper.ts	norwegian air
orbitz-scraper.ts	orbitz
priceline-scraper.ts	priceline
rome2rio-scraper.ts	rome2rio
ryanair-scraper.ts	ryanair
seat-guru-scraper.ts	seat guru
skyscanner-scraper.ts	skyscanner
southwest-airlines-scraper.ts	southwest airlines
spirit-airlines-scraper.ts	spirit airlines
trainline-scraper.ts	trainline
travelocity-scraper.ts	travelocity
trip-scraper.ts	trip
tripadvisor-scraper.ts	tripadvisor
trivago-scraper.ts	trivago
turo-scraper.ts	turo
united-airlines-scraper.ts	united airlines
viator-scraper.ts	viator
vrbo-scraper.ts	vrbo
wyndham-scraper.ts	wyndham

Automotive (45 scripts)

Script	Target
advance-auto-parts-scraper.ts	advance auto parts
audi-scraper.ts	audi
auto-blog-scraper.ts	auto blog
autotempest-scraper.ts	autotempest
autotrader-scraper.ts	autotrader
autozone-scraper.ts	autozone
bmw-scraper.ts	bmw
bring-a-trailer-scraper.ts	bring a trailer
car-and-driver-scraper.ts	car and driver
carbuzz-scraper.ts	carbuzz
carfax-scraper.ts	carfax
cargurus-scraper.ts	cargurus
carmax-scraper.ts	carmax
cars-com-scraper.ts	cars com
carvana-scraper.ts	carvana
copart-scraper.ts	copart
edmunds-scraper.ts	edmunds
ford-scraper.ts	ford
green-car-reports-scraper.ts	green car reports
hemmings-scraper.ts	hemmings
honda-scraper.ts	honda
iihs-scraper.ts	iihs
iseecars-scraper.ts	iseecars
jalopnik-scraper.ts	jalopnik
jd-power-auto-scraper.ts	jd power auto
kelley-blue-book-scraper.ts	kelley blue book
lucid-motors-scraper.ts	lucid motors
mercedes-benz-scraper.ts	mercedes benz
motor-authority-scraper.ts	motor authority
motortrend-scraper.ts	motortrend
nhtsa-scraper.ts	nhtsa
oreilly-auto-parts-scraper.ts	oreilly auto parts
porsche-scraper.ts	porsche
repairpal-scraper.ts	repairpal
rivian-scraper.ts	rivian
road-and-track-scraper.ts	road and track
rockauto-scraper.ts	rockauto
shift-scraper.ts	shift
tesla-scraper.ts	tesla
the-drive-scraper.ts	the drive
tire-rack-scraper.ts	tire rack
topspeed-scraper.ts	topspeed
toyota-scraper.ts	toyota
truecar-scraper.ts	truecar
vroom-scraper.ts	vroom

Sports & Fitness (35 scripts)

Script	Target
action-network-scraper.ts	action network
baseball-reference-scraper.ts	baseball reference
basketball-reference-scraper.ts	basketball reference
bleacher-report-scraper.ts	bleacher report
boxing-scene-scraper.ts	boxing scene
cbs-sports-scraper.ts	cbs sports
cycling-news-scraper.ts	cycling news
deadspin-scraper.ts	deadspin
draftkings-scraper.ts	draftkings
espn-scraper.ts	espn
fanduel-scraper.ts	fanduel
fbref-scraper.ts	fbref
flashscore-scraper.ts	flashscore
golf-digest-scraper.ts	golf digest
mlb-scraper.ts	mlb
mma-fighting-scraper.ts	mma fighting
nba-scraper.ts	nba
nfl-scraper.ts	nfl
nhl-scraper.ts	nhl
odds-shark-scraper.ts	odds shark
peloton-sports-scraper.ts	peloton sports
pro-football-reference-scraper.ts	pro football reference
runners-world-scraper.ts	runners world
sb-nation-scraper.ts	sb nation
sofascore-scraper.ts	sofascore
sporting-news-scraper.ts	sporting news
sports-reference-scraper.ts	sports reference
strava-scraper.ts	strava
swimming-world-scraper.ts	swimming world
tennis-channel-scraper.ts	tennis channel
the-athletic-scraper.ts	the athletic
transfermarkt-scraper.ts	transfermarkt
ufc-scraper.ts	ufc
whoscored-scraper.ts	whoscored
yahoo-sports-scraper.ts	yahoo sports

Education (35 scripts)

Script	Target
amazon-books-scraper.ts	amazon books
babbel-scraper.ts	babbel
blackboard-scraper.ts	blackboard
brilliant-scraper.ts	brilliant
canvas-lms-scraper.ts	canvas lms
chegg-scraper.ts	chegg
ck12-scraper.ts	ck12
class-central-scraper.ts	class central
codecademy-scraper.ts	codecademy
coursera-scraper.ts	coursera
datacamp-scraper.ts	datacamp
duolingo-scraper.ts	duolingo
edx-scraper.ts	edx
freecodecamp-scraper.ts	freecodecamp
google-scholar-scraper.ts	google scholar
jstor-scraper.ts	jstor
kajabi-scraper.ts	kajabi
khan-academy-scraper.ts	khan academy
linkedin-learning-scraper.ts	linkedin learning
masterclass-scraper.ts	masterclass
memrise-scraper.ts	memrise
mit-opencourseware-scraper.ts	mit opencourseware
openstax-scraper.ts	openstax
pluralsight-scraper.ts	pluralsight
podia-scraper.ts	podia
project-gutenberg-scraper.ts	project gutenberg
quizlet-scraper.ts	quizlet
ratemyprofessors-scraper.ts	ratemyprofessors
rosetta-stone-scraper.ts	rosetta stone
scholastic-scraper.ts	scholastic
skillshare-scraper.ts	skillshare
teachable-scraper.ts	teachable
ted-talks-scraper.ts	ted talks
thinkific-scraper.ts	thinkific
udemy-scraper.ts	udemy

International (35 scripts)

Script	Target
about-you-scraper.ts	about you
allegro-scraper.ts	allegro
auchan-scraper.ts	auchan
blibli-scraper.ts	blibli
bol-com-scraper.ts	bol com
bukalapak-scraper.ts	bukalapak
carrefour-scraper.ts	carrefour
cdiscount-scraper.ts	cdiscount
coles-scraper.ts	coles
coupang-scraper.ts	coupang
daraz-scraper.ts	daraz
emag-scraper.ts	emag
flipkart-scraper.ts	flipkart
fnac-scraper.ts	fnac
gumtree-scraper.ts	gumtree
jd-com-scraper.ts	jd com
jumia-scraper.ts	jumia
lazada-scraper.ts	lazada
lidl-scraper.ts	lidl
mercado-libre-scraper.ts	mercado libre
noon-scraper.ts	noon
olx-scraper.ts	olx
otto-scraper.ts	otto
ozon-scraper.ts	ozon
pinduoduo-scraper.ts	pinduoduo
rakuten-scraper.ts	rakuten
shopee-scraper.ts	shopee
souq-scraper.ts	souq
taobao-scraper.ts	taobao
tokopedia-scraper.ts	tokopedia
trade-me-scraper.ts	trade me
trendyol-scraper.ts	trendyol
wildberries-scraper.ts	wildberries
woolworths-scraper.ts	woolworths
zalando-scraper.ts	zalando

Jobs (35 scripts)

Script	Target
angellist-scraper.ts	angellist
builtin-scraper.ts	builtin
careerbuilder-scraper.ts	careerbuilder
dice-scraper.ts	dice
dice-tech-jobs-scraper.ts	dice tech jobs
fiverr-scraper.ts	fiverr
flexjobs-scraper.ts	flexjobs
freelancer-scraper.ts	freelancer
glassdoor-scraper.ts	glassdoor
google-jobs-scraper.ts	google jobs
greenhouse-scraper.ts	greenhouse
guru-scraper.ts	guru
handshake-scraper.ts	handshake
hired-scraper.ts	hired
icims-scraper.ts	icims
indeed-scraper.ts	indeed
jobvite-scraper.ts	jobvite
ladders-scraper.ts	ladders
lensa-scraper.ts	lensa
lever-scraper.ts	lever
linkedin-jobs-scraper.ts	linkedin jobs
monster-jobs-scraper.ts	monster jobs
monster-scraper.ts	monster
randstad-scraper.ts	randstad
remoteok-scraper.ts	remoteok
roberthalf-scraper.ts	roberthalf
simplyhired-scraper.ts	simplyhired
snagajob-scraper.ts	snagajob
toptal-scraper.ts	toptal
upwork-scraper.ts	upwork
wellfound-scraper.ts	wellfound
weworkremotely-scraper.ts	weworkremotely
workday-scraper.ts	workday
ziprecruiter-jobs-scraper.ts	ziprecruiter jobs
ziprecruiter-scraper.ts	ziprecruiter

Real Estate (30 scripts)

Script	Target
apartments-scraper.ts	apartments
century21-scraper.ts	century21
coldwellbanker-scraper.ts	coldwellbanker
commercialcafe-scraper.ts	commercialcafe
compass-scraper.ts	compass
domain-scraper.ts	domain
foreclosure-scraper.ts	foreclosure
homelight-scraper.ts	homelight
homes-scraper.ts	homes
homesnap-scraper.ts	homesnap
hotpads-scraper.ts	hotpads
idealista-scraper.ts	idealista
immoscout24-scraper.ts	immoscout24
kw-scraper.ts	kw
landwatch-scraper.ts	landwatch
loopnet-scraper.ts	loopnet
movoto-scraper.ts	movoto
offerpad-scraper.ts	offerpad
opendoor-scraper.ts	opendoor
propertyshark-scraper.ts	propertyshark
realtor-scraper.ts	realtor
redfin-scraper.ts	redfin
remax-scraper.ts	remax
rent-scraper.ts	rent
rightmove-scraper.ts	rightmove
rockethomes-scraper.ts	rockethomes
sothebysrealty-scraper.ts	sothebysrealty
trulia-scraper.ts	trulia
zillow-scraper.ts	zillow
zoopla-scraper.ts	zoopla

Social (30 scripts)

Script	Target
bereal-scraper.ts	bereal
bluesky-scraper.ts	bluesky
clubhouse-scraper.ts	clubhouse
devto-social-scraper.ts	devto social
discord-scraper.ts	discord
facebook-scraper.ts	facebook
instagram-scraper.ts	instagram
kick-social-scraper.ts	kick social
lemon8-scraper.ts	lemon8
linkedin-scraper.ts	linkedin
mastodon-scraper.ts	mastodon
medium-scraper.ts	medium
nextdoor-social-scraper.ts	nextdoor social
pinterest-scraper.ts	pinterest
quora-scraper.ts	quora
reddit-scraper.ts	reddit
signal-scraper.ts	signal
slack-scraper.ts	slack
snapchat-scraper.ts	snapchat
substack-scraper.ts	substack
telegram-scraper.ts	telegram
threads-scraper.ts	threads
tiktok-social-scraper.ts	tiktok social
truth-social-scraper.ts	truth social
tumblr-scraper.ts	tumblr
twitch-social-scraper.ts	twitch social
twitter-scraper.ts	twitter
vk-scraper.ts	vk
whatsapp-scraper.ts	whatsapp
youtube-social-scraper.ts	youtube social

Health (30 scripts)

Script	Target
betterhelp-scraper.ts	betterhelp
calm-scraper.ts	calm
cdc-scraper.ts	cdc
clinicaltrials-gov-scraper.ts	clinicaltrials gov
cvs-scraper.ts	cvs
drugs-com-scraper.ts	drugs com
epocrates-scraper.ts	epocrates
everyday-health-scraper.ts	everyday health
fitbit-scraper.ts	fitbit
garmin-connect-scraper.ts	garmin connect
goodrx-scraper.ts	goodrx
healthgrades-scraper.ts	healthgrades
healthline-scraper.ts	healthline
mayo-clinic-scraper.ts	mayo clinic
medical-news-today-scraper.ts	medical news today
medlineplus-scraper.ts	medlineplus
medscape-scraper.ts	medscape
myfitnesspal-scraper.ts	myfitnesspal
nih-scraper.ts	nih
noom-scraper.ts	noom
one-medical-scraper.ts	one medical
peloton-scraper.ts	peloton
psychology-today-scraper.ts	psychology today
pubmed-health-scraper.ts	pubmed health
rxlist-scraper.ts	rxlist
teladoc-scraper.ts	teladoc
vitals-scraper.ts	vitals
walgreens-scraper.ts	walgreens
webmd-scraper.ts	webmd
zocdoc-scraper.ts	zocdoc

Food (30 scripts)

Script	Target
allrecipes-scraper.ts	allrecipes
amazon-fresh-scraper.ts	amazon fresh
beyondmenu-scraper.ts	beyondmenu
blue-apron-scraper.ts	blue apron
bon-appetit-scraper.ts	bon appetit
caviar-scraper.ts	caviar
chownow-scraper.ts	chownow
cookpad-scraper.ts	cookpad
doordash-scraper.ts	doordash
eater-scraper.ts	eater
eatstreet-scraper.ts	eatstreet
epicurious-scraper.ts	epicurious
food-network-scraper.ts	food network
food52-scraper.ts	food52
freshdirect-scraper.ts	freshdirect
grubhub-scraper.ts	grubhub
hellofresh-scraper.ts	hellofresh
instacart-scraper.ts	instacart
just-eat-scraper.ts	just eat
kroger-scraper.ts	kroger
menupages-scraper.ts	menupages
opentable-scraper.ts	opentable
postmates-scraper.ts	postmates
resy-scraper.ts	resy
seamless-scraper.ts	seamless
serious-eats-scraper.ts	serious eats
simplyrecipes-scraper.ts	simplyrecipes
tasty-scraper.ts	tasty
ubereats-scraper.ts	ubereats
zomato-scraper.ts	zomato

Gaming & Esports (30 scripts)

Script	Target
curseforge-scraper.ts	curseforge
epic-games-store-scraper.ts	epic games store
eurogamer-scraper.ts	eurogamer
gamefaqs-scraper.ts	gamefaqs
gamespot-scraper.ts	gamespot
gg-deals-scraper.ts	gg deals
giant-bomb-scraper.ts	giant bomb
gog-scraper.ts	gog
hltv-scraper.ts	hltv
howlongtobeat-scraper.ts	howlongtobeat
ign-scraper.ts	ign
isthereanydeal-scraper.ts	isthereanydeal
kick-scraper.ts	kick
kotaku-scraper.ts	kotaku
liquipedia-scraper.ts	liquipedia
metacritic-scraper.ts	metacritic
modrinth-scraper.ts	modrinth
nexus-mods-scraper.ts	nexus mods
nintendo-life-scraper.ts	nintendo life
opgg-scraper.ts	opgg
pc-gamer-scraper.ts	pc gamer
polygon-scraper.ts	polygon
pure-xbox-scraper.ts	pure xbox
push-square-scraper.ts	push square
rawg-scraper.ts	rawg
rock-paper-shotgun-scraper.ts	rock paper shotgun
speedrun-scraper.ts	speedrun
steam-scraper.ts	steam
steamdb-scraper.ts	steamdb
twitch-gaming-scraper.ts	twitch gaming

Government & Legal (30 scripts)

Script	Target
above-the-law-scraper.ts	above the law
avvo-scraper.ts	avvo
ballotpedia-scraper.ts	ballotpedia
bls-scraper.ts	bls
casetext-scraper.ts	casetext
census-bureau-scraper.ts	census bureau
congress-gov-scraper.ts	congress gov
courtlistener-scraper.ts	courtlistener
data-gov-scraper.ts	data gov
fec-scraper.ts	fec
federal-register-scraper.ts	federal register
findlaw-scraper.ts	findlaw
govtrack-scraper.ts	govtrack
irs-scraper.ts	irs
justia-scraper.ts	justia
law-com-scraper.ts	law com
legalzoom-scraper.ts	legalzoom
lexisnexis-scraper.ts	lexisnexis
medicare-scraper.ts	medicare
nolo-scraper.ts	nolo
opensecrets-scraper.ts	opensecrets
pacer-scraper.ts	pacer
regulations-gov-scraper.ts	regulations gov
rocket-lawyer-scraper.ts	rocket lawyer
sam-gov-scraper.ts	sam gov
sec-edgar-government-scraper.ts	sec edgar government
ssa-scraper.ts	ssa
usa-gov-scraper.ts	usa gov
uspto-scraper.ts	uspto
westlaw-scraper.ts	westlaw

Fashion & Beauty (30 scripts)

Script	Target
asos-fashion-scraper.ts	asos fashion
bershka-scraper.ts	bershka
boohoo-scraper.ts	boohoo
cos-scraper.ts	cos
depop-fashion-scraper.ts	depop fashion
farfetch-scraper.ts	farfetch
fashion-nova-scraper.ts	fashion nova
gilt-scraper.ts	gilt
glossier-fashion-scraper.ts	glossier fashion
hm-fashion-scraper.ts	hm fashion
lyst-scraper.ts	lyst
mango-scraper.ts	mango
massimo-dutti-scraper.ts	massimo dutti
matchesfashion-scraper.ts	matchesfashion
mytheresa-scraper.ts	mytheresa
net-a-porter-scraper.ts	net a porter
other-stories-scraper.ts	other stories
prettylittlething-scraper.ts	prettylittlething
primark-scraper.ts	primark
pull-and-bear-scraper.ts	pull and bear
revolve-scraper.ts	revolve
rue-la-la-scraper.ts	rue la la
sephora-fashion-scraper.ts	sephora fashion
shein-fashion-scraper.ts	shein fashion
ssense-scraper.ts	ssense
stitchfix-scraper.ts	stitchfix
therealreal-scraper.ts	therealreal
ulta-scraper.ts	ulta
vogue-scraper.ts	vogue
zara-fashion-scraper.ts	zara fashion

Reviews (26 scripts)

Script	Target
alternativeto-scraper.ts	alternativeto
amazon-reviews-scraper.ts	amazon reviews
angi-reviews-scraper.ts	angi reviews
bbb-reviews-scraper.ts	bbb reviews
bbb-scraper.ts	bbb
birdeye-scraper.ts	birdeye
capterra-scraper.ts	capterra
consumer-reports-scraper.ts	consumer reports
consumeraffairs-scraper.ts	consumeraffairs
facebook-reviews-scraper.ts	facebook reviews
foursquare-reviews-scraper.ts	foursquare reviews
g2-scraper.ts	g2
getapp-scraper.ts	getapp
google-reviews-scraper.ts	google reviews
influenster-scraper.ts	influenster
jd-power-scraper.ts	jd power
pissedconsumer-scraper.ts	pissedconsumer
producthunt-scraper.ts	producthunt
sitejabber-scraper.ts	sitejabber
software-advice-scraper.ts	software advice
sourceforge-scraper.ts	sourceforge
tripadvisor-reviews-scraper.ts	tripadvisor reviews
trustpilot-scraper.ts	trustpilot
trustradius-scraper.ts	trustradius
wirecutter-scraper.ts	wirecutter
yelp-scraper.ts	yelp

SaaS & B2B (25 scripts)

Script	Target
airtable-scraper.ts	airtable
asana-scraper.ts	asana
atlassian-marketplace-scraper.ts	atlassian marketplace
aws-marketplace-scraper.ts	aws marketplace
bubble-scraper.ts	bubble
canva-scraper.ts	canva
clickup-scraper.ts	clickup
confluence-scraper.ts	confluence
figma-scraper.ts	figma
freshworks-scraper.ts	freshworks
hubspot-scraper.ts	hubspot
intercom-scraper.ts	intercom
jira-scraper.ts	jira
linear-scraper.ts	linear
miro-scraper.ts	miro
monday-scraper.ts	monday
notion-scraper.ts	notion
retool-scraper.ts	retool
salesforce-appexchange-scraper.ts	salesforce appexchange
shopify-app-store-scraper.ts	shopify app store
slack-app-directory-scraper.ts	slack app directory
trello-scraper.ts	trello
webflow-scraper.ts	webflow
zapier-scraper.ts	zapier
zendesk-scraper.ts	zendesk

Science & Research (25 scripts)

Script	Target
acm-digital-library-scraper.ts	acm digital library
arxiv-scraper.ts	arxiv
biorxiv-scraper.ts	biorxiv
connected-papers-scraper.ts	connected papers
dimensions-scraper.ts	dimensions
elsevier-scraper.ts	elsevier
frontiers-scraper.ts	frontiers
google-scholar-science-scraper.ts	google scholar science
ieee-xplore-scraper.ts	ieee xplore
mdpi-scraper.ts	mdpi
medrxiv-scraper.ts	medrxiv
nature-scraper.ts	nature
orcid-scraper.ts	orcid
plos-one-scraper.ts	plos one
pubmed-scraper.ts	pubmed
researchgate-scraper.ts	researchgate
sciencedirect-scraper.ts	sciencedirect
scite-scraper.ts	scite
scopus-scraper.ts	scopus
semantic-scholar-scraper.ts	semantic scholar
springer-scraper.ts	springer
ssrn-scraper.ts	ssrn
taylor-francis-scraper.ts	taylor francis
web-of-science-scraper.ts	web of science
wiley-scraper.ts	wiley

Classifieds & Marketplace (20 scripts)

Script	Target
1stdibs-scraper.ts	1stdibs
carousell-scraper.ts	carousell
chairish-scraper.ts	chairish
craigslist-scraper.ts	craigslist
decluttr-scraper.ts	decluttr
depop-classifieds-scraper.ts	depop classifieds
facebook-marketplace-scraper.ts	facebook marketplace
gazelle-scraper.ts	gazelle
grailed-scraper.ts	grailed
kidizen-scraper.ts	kidizen
letgo-scraper.ts	letgo
mercari-classifieds-scraper.ts	mercari classifieds
nextdoor-scraper.ts	nextdoor
offerup-scraper.ts	offerup
poshmark-classifieds-scraper.ts	poshmark classifieds
rebag-scraper.ts	rebag
swappa-scraper.ts	swappa
thredup-classifieds-scraper.ts	thredup classifieds
tradesy-scraper.ts	tradesy
vinted-scraper.ts	vinted

Directories & Listings (20 scripts)

Script	Target
angi-directory-scraper.ts	angi directory
apollo-io-scraper.ts	apollo io
bbb-scraper.ts	bbb
cb-insights-scraper.ts	cb insights
clearbit-scraper.ts	clearbit
crunchbase-directory-scraper.ts	crunchbase directory
dnb-scraper.ts	dnb
foursquare-scraper.ts	foursquare
hotfrog-scraper.ts	hotfrog
hunter-io-scraper.ts	hunter io
kompass-scraper.ts	kompass
lusha-scraper.ts	lusha
manta-scraper.ts	manta
mapquest-scraper.ts	mapquest
owler-scraper.ts	owler
pitchbook-scraper.ts	pitchbook
superpages-scraper.ts	superpages
white-pages-scraper.ts	white pages
yellow-pages-scraper.ts	yellow pages
zoominfo-scraper.ts	zoominfo

Photography & Design (20 scripts)

Script	Target
500px-scraper.ts	500px
adobe-stock-scraper.ts	adobe stock
artstation-scraper.ts	artstation
behance-scraper.ts	behance
canva-templates-scraper.ts	canva templates
creative-market-scraper.ts	creative market
deviantart-scraper.ts	deviantart
dribbble-scraper.ts	dribbble
envato-elements-scraper.ts	envato elements
figma-community-scraper.ts	figma community
flickr-scraper.ts	flickr
getty-images-scraper.ts	getty images
graphicriver-scraper.ts	graphicriver
pexels-scraper.ts	pexels
pixabay-scraper.ts	pixabay
reshot-scraper.ts	reshot
shutterstock-scraper.ts	shutterstock
smugmug-scraper.ts	smugmug
stocksnap-scraper.ts	stocksnap
unsplash-scraper.ts	unsplash

Music & Podcasts (20 scripts)

Script	Target
allmusic-scraper.ts	allmusic
apple-music-scraper.ts	apple music
apple-podcasts-scraper.ts	apple podcasts
audiomack-scraper.ts	audiomack
bandcamp-scraper.ts	bandcamp
chartable-scraper.ts	chartable
deezer-scraper.ts	deezer
discogs-scraper.ts	discogs
genius-scraper.ts	genius
lastfm-scraper.ts	lastfm
listen-notes-scraper.ts	listen notes
musicbrainz-scraper.ts	musicbrainz
pocket-casts-scraper.ts	pocket casts
podcast-index-scraper.ts	podcast index
podchaser-scraper.ts	podchaser
setlistfm-scraper.ts	setlistfm
soundcloud-music-scraper.ts	soundcloud music
spotify-music-scraper.ts	spotify music
tidal-scraper.ts	tidal
youtube-music-scraper.ts	youtube music

Events & Tickets (20 scripts)

Script	Target
10times-scraper.ts	10times
allevents-scraper.ts	allevents
axs-scraper.ts	axs
bandsintown-scraper.ts	bandsintown
bizzabo-scraper.ts	bizzabo
cvent-scraper.ts	cvent
dice-events-scraper.ts	dice events
eventbrite-scraper.ts	eventbrite
fever-scraper.ts	fever
hopin-scraper.ts	hopin
live-nation-scraper.ts	live nation
luma-scraper.ts	luma
meetup-scraper.ts	meetup
seatgeek-scraper.ts	seatgeek
songkick-scraper.ts	songkick
splash-scraper.ts	splash
stubhub-scraper.ts	stubhub
ticketmaster-scraper.ts	ticketmaster
vivid-seats-scraper.ts	vivid seats
whova-scraper.ts	whova

Search (17 scripts)

Script	Target
baidu-scraper.ts	baidu
bing-scraper.ts	bing
brave-search-scraper.ts	brave search
duckduckgo-scraper.ts	duckduckgo
ecosia-scraper.ts	ecosia
google-api.ts	google api
google-images-scraper.ts	google images
google-maps-scraper.ts	google maps
google-play-scraper.ts	google play
google-scholar-scraper.ts	google scholar
google-scholar-search-scraper.ts	google scholar search
google-search-scraper.ts	google search
google-shopping-scraper.ts	google shopping
google-trends-scraper.ts	google trends
perplexity-scraper.ts	perplexity
yahoo-search-scraper.ts	yahoo search
yandex-scraper.ts	yandex

Home Services (15 scripts)

Script	Target
angi-scraper.ts	angi
bark-scraper.ts	bark
buildzoom-scraper.ts	buildzoom
craftjack-scraper.ts	craftjack
fixr-scraper.ts	fixr
handy-scraper.ts	handy
homeadvisor-scraper.ts	homeadvisor
homeguide-scraper.ts	homeguide
homeserve-scraper.ts	homeserve
houzz-scraper.ts	houzz
mr-handyman-scraper.ts	mr handyman
networx-scraper.ts	networx
porch-scraper.ts	porch
taskrabbit-scraper.ts	taskrabbit
thumbtack-scraper.ts	thumbtack

Logistics & Shipping (15 scripts)

Script	Target
17track-scraper.ts	17track
aftership-scraper.ts	aftership
dhl-scraper.ts	dhl
easypost-scraper.ts	easypost
fedex-scraper.ts	fedex
flightaware-scraper.ts	flightaware
flightradar24-scraper.ts	flightradar24
freightwaves-scraper.ts	freightwaves
maersk-scraper.ts	maersk
marinetraffic-scraper.ts	marinetraffic
shipbob-scraper.ts	shipbob
shippo-scraper.ts	shippo
shipstation-scraper.ts	shipstation
ups-scraper.ts	ups
usps-scraper.ts	usps

Weather & Environment (15 scripts)

Script	Target
accuweather-scraper.ts	accuweather
airnow-scraper.ts	airnow
climate-gov-scraper.ts	climate gov
dark-sky-scraper.ts	dark sky
iqair-scraper.ts	iqair
noaa-scraper.ts	noaa
nws-scraper.ts	nws
openweathermap-scraper.ts	openweathermap
tomorrow-io-scraper.ts	tomorrow io
ventusky-scraper.ts	ventusky
weather-com-scraper.ts	weather com
weather-underground-scraper.ts	weather underground
weatherbug-scraper.ts	weatherbug
weatherspark-scraper.ts	weatherspark
windy-scraper.ts	windy

Telecom (12 scripts)

Script	Target
att-scraper.ts	att
centurylink-scraper.ts	centurylink
cox-scraper.ts	cox
cricket-wireless-scraper.ts	cricket wireless
google-fi-scraper.ts	google fi
mint-mobile-scraper.ts	mint mobile
spectrum-scraper.ts	spectrum
t-mobile-scraper.ts	t mobile
us-mobile-scraper.ts	us mobile
verizon-scraper.ts	verizon
visible-scraper.ts	visible
xfinity-scraper.ts	xfinity

Media (8 scripts)

Script	Target
goodreads-scraper.ts	goodreads
imdb-scraper.ts	imdb
rottentomatoes-scraper.ts	rottentomatoes
soundcloud-scraper.ts	soundcloud
spotify-scraper.ts	spotify
tiktok-scraper.ts	tiktok
twitch-scraper.ts	twitch
youtube-scraper.ts	youtube

Pets (8 scripts)

Script	Target
adopt-a-pet-scraper.ts	adopt a pet
barkbox-scraper.ts	barkbox
chewy-pets-scraper.ts	chewy pets
petco-pets-scraper.ts	petco pets
petfinder-scraper.ts	petfinder
petsmart-pets-scraper.ts	petsmart pets
rover-scraper.ts	rover
wag-scraper.ts	wag

How It Works

Every example connects to a pre-warmed browser via Spider's cloud, navigates to the target URL, and extracts structured data.

extractFields — Single-element extraction

Best for product pages where each field maps to one CSS selector:

const data = await page.extractFields({
  title: "#productTitle",
  price: ".a-price .a-offscreen",
  image: { selector: "#landingImage", attribute: "src" },
});
// { title: "AirPods Pro", price: "$189.99", image: "https://..." }

evaluate — List extraction

Best for search results and listings where you iterate over repeating elements:

const data = await page.evaluate(`(() => {
  const items = [];
  document.querySelectorAll(".product").forEach(el => {
    const name = el.querySelector(".name")?.textContent?.trim();
    const price = el.querySelector(".price")?.textContent;
    if (name) items.push({ name, price });
  });
  return JSON.stringify(items);
})()`);

Features

• Stealth browsing — Bypass Akamai, PerimeterX, DataDome, and Cloudflare
• CAPTCHA solving — Automatic CAPTCHA resolution when captcha: "solve" is set
• Pre-warmed browsers — Skip cold start, connect to ready browsers in ~5s

SDKs

spider-browser is available for TypeScript, Python, and Rust:

npm install spider-browser        # TypeScript
pip install spider-browser        # Python
cargo add spider-browser          # Rust

Related

• spider-browser — The SDK powering these examples
• spider.cloud — Browser fleet & web scraping API

License

MIT