Back
Similar todos
partially rewrote fetch_pypi_data() and started on some tests to make it easier to figure out #djangopackages
finished pypi refactor of #djangopackages
worked on another data importer using the new python spatula library. It's not bad, but proving to be a bit more difficult to get my 10+ year old project synced than I'd like
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
🚜 refactored pypi stats generation script to show a progress bar and to throttle self #djangopackages
more Pandas updates and I built out a reverse scraper which makes it easier to say what values you want on a page and then it builds out the CSS selectors backwards.
fixed a #djangopackages bug and started working on adding pypa/packaging support vs. rolling my own
finished a few python based wikipedia and google news scripts for fetching content #mylife
finished pypi tests and deployed fixes #djangopackages
started switching some nasty scraping code project over to Pandas because it works so damn well
worked on packages that are no longer on pypi or never were #djangopackages
🐼 reading up on the Python Pandas library since it makes scraping HTML tables easy peasy
- figure out how to fork the django-pattern-library and replace the index page with my own version ✅ #experimentingnewtool
📝 Worked on #djangopackages to rewrite/augment how package states are pulled from PyPI to help improve the overall accuracy of the data.
🐍 worked on a new python + django in the Fortune 500 project today as a soone to be released spreadsheet as a website data project #fortune500
working on some a few scrapers for pulling in data vs. just using sheets #daysuntillatenight
🍔 built a project scraper over lunch that I don't hate. I used sqlite-utils with mixed results. might just port it back to django and call it a day
pulled in a new csv scraper data for #daysuntillatenight
dusted off some old machine learning / text parsing code to dabble with tonight #mylife
did a little bit more django-fsm hacking by adding it to a page scraper project #mylife