Best web scraping tools on Reddit

28 reviews from r/Kotlin, r/MarketingMentor, r/Stocks_Picks and 5 more subreddits

28 reviews from
and
By Brand
/
By Product
#1

Bright Data

5.0
(7)
"They have a bunch of scraper APIs for all the popular websites like Amazon, LinkedIn, Facebook, Instagram, etc."
·
"Coupled with their robust network of proxies covering pretty much every major location in the world."
·
"You'd be getting a vast and diverse pool of ethically sourced IPs to work with."
·
"Reliable resi proxies, and plug and play scraper"
·
"Bright Data offers up-to-date ready-made datasets for major e-commerce platforms, reducing reliance on manual work."
·
"The web scraper IDE provides ready-made scraping templates and is regularly updated to keep up with site changes."
·
"Brightdata is the gold standard for web scraping."
#2

Jsoup

5.0
(4)
"JSoup is a great library, powerful and well-designed API."
·
"Jsoup is very convenient to use and was updated recently."
·
"Jsoup is great for html parsing and supports CSS selectors."
·
"Jsoup is mostly an HTML parser and is easy to use + efficient."
#3

HtmlUnit

3.3
(3)
"HtmlUnit can deal with Javascript websites, but requires more resources."
·
"HtmlUnit can be very temperamental and requires workarounds."
·
"HtmlUnit is not created for scraping but testing."
#4

Selenium

3.5
(2)
"Selenium is really good and it supports Java."
·
"Selenium is messy to set up and can be difficult to detect from the server side."
#5

rvest

5.0
(1)
"Rvest or beautiful soup"
#6

Beautiful Soup

5.0
(1)
"Rvest or beautiful soup"
#7

Sapiengraph

5.0
(1)
"Sapiengraph is the way to go. It is a no-code Google sheet add on wherein you can retrieve data by using formulas :) You should check it out!"
#8

Newsdata.io

5.0
(1)
"Newsdata.io is a JSON-based news API that scraps news data from 3000+ reliable news websites in 30+ languages and more than 7 categories."
#9

ScrapeStorm

5.0
(1)
"I prefer ScrapeStorm because it's a tool that doesn't require coding and programming at all, with full visualization."
#10

Thunderbit

5.0
(1)
"It's a Chrome extension that's even easier to use than Instant Data Scraper. The cool thing about Thunderbit is that it uses AI, so you don't have to manually select or edit anything."
#11

Soax

5.0
(1)
"An AI Scraper that can scrape from hundreds or thousands of different domains automatically."
#12

Listly.io

5.0
(1)
"The web scraper I use is Listly.io, it's pretty powerful since it can do an arrange of things and has easy step by step tutorials on how to use the software!"
#13

Skrape{it}

5.0
(1)
"I would definitely go for skrape{it}."
#14

Crexi

4.0
(1)
"Just pay for crexi"
#15

Scrapfly

4.0
(1)
"It has a decent success rate."
#16

Jaunt

4.0
(1)
"Jaunt is a very lightweight parser library."

Discover your audience

GummySearch is an audience research toolkit for 130,000 unique communities on Reddit.

If you are looking for startup problems to solve, want to validate your idea or find your first customers online, GummySearch is for you.

Sign up for free, get community insights in minutes.

Tell me more
Get started
Audience Research