Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Tales - a block tolerant web scraper that runs on top of aws and rackspace
(
github.com/calufa
)
3 points
by
_hfqa
on Feb 15, 2013
|
hide
|
past
|
favorite
|
4 comments
rachelbythebay
on Feb 15, 2013
[–]
>> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).
And people wonder why the AWS machines get filtered.
_hfqa
on Feb 17, 2013
|
parent
[–]
this is why jcoulds will be supported soon.
rachelbythebay
on Feb 17, 2013
|
root
|
parent
[–]
And people will wonder why the jclouds machines get filtered.
It's not the "where". It's the "what".
_hfqa
on Feb 17, 2013
|
root
|
parent
[–]
I am just enabling. For me it's not the "what". Its the "who".
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
And people wonder why the AWS machines get filtered.