Back
Similar todos
wrote some failing tests and ended up fixing several pypi bugs #djangopackages
found a nice offline copy for pypi data so diving into that to figure out what makes sense to import in #djangopackages
finished pypi refactor of #djangopackages
finished pypi tests and deployed fixes #djangopackages
More working on getting pypi testing coverage up. This is one of the most problematic areas. #djangopackages
fixed a #djangopackages bug and started working on adding pypa/packaging support vs. rolling my own
📝 Worked on #djangopackages to rewrite/augment how package states are pulled from PyPI to help improve the overall accuracy of the data.
🚜 refactored pypi stats generation script to show a progress bar and to throttle self #djangopackages
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
worked on how to test/keep a scraping project updated more easily
started adding some tests to make fixing random license and other bugs easier #djangopackages
working on some scraping for data analysis #linkhandy
finished a few python based wikipedia and google news scripts for fetching content #mylife
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
updated scraper logic to fix tags and author information along with some easy to update tests to make this much easier to find/fix next time around
Wrote some tests #progrs
- wrap up the branch abt using forked PyGitHub to do a create repo from template and try to figure out how to write sane tests (put this under research and file under to be blogged in future) ✅ #greendeploy
🚜 Refactored several private python packages to standardize on a new testing/install setup #revsys
Work on getting tests data #oneclicktest
finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.