> So I built a scraper that hits the UK government's mandatory Fuel Finder API every 10 minutes and stores every price change. 90k records across 7,700 stations since January.
Only 1 change per station per week on average? Fewer than I expected. Not sure I'd call it a scraper, myself.
Europeans seem to be far more comfortable with Pigovian taxes than Americans. Or does it even come up for discussion when people are referencing the retail price at the pump?
fair point on scraper, it's more of an ingest pipeline really. the 90k is total price records across 7,700 stations since january, stations update a few times a week on average. the 10 min polling catches every move when it happens. the value is in the per-station, history over time, not the raw volume.
Reminds me of the 1990 Amiga game Nuclear War. Characters included Infidel Castro, Mao the Pun, Ronnie Raygun, Ghanji, Gorbachef, Colonel Khadaffy, and of course Ayatollah Kookamamie. https://www.lemonamiga.com/game/nuclear-war
> By this server's count, you are visitor number Warning: include(visitor_count.php): Failed to open stream: No such file or directory in /home/public/kagi.com/index.php on line 6!
I was pleasantly surprised by the age verification. "Based on the age of your Apple account you are verified as being at least 18 years old". Done. Tempus fugit.
Only 1 change per station per week on average? Fewer than I expected. Not sure I'd call it a scraper, myself.
157p/L national average is about 8 USD/G.
reply