Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
topoftheforts
on Sept 15, 2023
|
parent
|
context
|
favorite
| on:
Show HN: I built a dataset of 25k+ Gumroad product...
Yes just webscraping. Just used Laravel, cause that's what I'm most familiar with. The site is Laravel + AlpineJS (with Vite)
AbstractAirways
on Sept 15, 2023
[–]
I tried to scrape them and found they had some pretty robust anti-scraping implemented. Did you have to do anything to overcome it?
mateuszbuda
on Sept 15, 2023
|
parent
|
next
[–]
Exactly, did you build your own solution for this, maybe based on open source projects, or do you rely on external service for scraping? I'm curious too since I'm developing a web scraping API product (
https://scrapingfish.com
).
KomoD
on Sept 15, 2023
|
parent
|
prev
[–]
What measures?
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
