Back
Similar todos
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
See similar todos

No replies yet

fixed Pandas issue and I have better, cleaner data now
See similar todos

No replies yet

🐼 reading up on the Python Pandas library since it makes scraping HTML tables easy peasy
See similar todos

No replies yet

more Pandas updates and I built out a reverse scraper which makes it easier to say what values you want on a page and then it builds out the CSS selectors backwards.
See similar todos

No replies yet

working on some scraping for data analysis #linkhandy
See similar todos

No replies yet

working on some a few scrapers for pulling in data vs. just using sheets #daysuntillatenight
See similar todos

No replies yet

Learned a bit more about Pandas DataFrames
See similar todos

No replies yet

finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.
See similar todos

No replies yet

worked on how to test/keep a scraping project updated more easily
See similar todos

No replies yet

updated pandas backend for #daysuntillatenight
See similar todos

No replies yet

worked on another data importer using the new python spatula library. It's not bad, but proving to be a bit more difficult to get my 10+ year old project synced than I'd like
See similar todos

No replies yet

re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
See similar todos

No replies yet

some data scraping and analysis #life
See similar todos

No replies yet

late night hacking on a scraper project and mostly getting the UI updated
See similar todos

No replies yet

continue work on scrapers #pagesonpages
See similar todos

No replies yet

🍔 built a project scraper over lunch that I don't hate. I used sqlite-utils with mixed results. might just port it back to django and call it a day
See similar todos
did a little bit more django-fsm hacking by adding it to a page scraper project #mylife
See similar todos

No replies yet

dusted off my scraper project and shared it with a few machines
See similar todos

No replies yet

overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
See similar todos

No replies yet

refactored a scraper app to use django-q more effectively
See similar todos

No replies yet