Back
Similar todos
started switching some nasty scraping code project over to Pandas because it works so damn well
updated pandas backend for #daysuntillatenight
more Pandas updates and I built out a reverse scraper which makes it easier to say what values you want on a page and then it builds out the CSS selectors backwards.
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
More data cleanup #sparkbase
data cleaning #datamachine
improve some data #beachnearby
finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.
improve data #beachnearby
fixed a bug where data is missing #metrics
Updated the way I process the scraping data to minimize errors #bagsoup
fix some old data #japandev
🐼 reading up on the Python Pandas library since it makes scraping HTML tables easy peasy
tons of spreadsheet data cleanup #lfk
worked on another data importer using the new python spatula library. It's not bad, but proving to be a bit more difficult to get my 10+ year old project synced than I'd like
found a nice offline copy for pypi data so diving into that to figure out what makes sense to import in #djangopackages