Back
Similar todos
did a little bit more django-fsm hacking by adding it to a page scraper project #mylife
refactored a scraper app to use django-q more effectively
worked on another data importer using the new python spatula library. It's not bad, but proving to be a bit more difficult to get my 10+ year old project synced than I'd like
late night hacking on a scraper project and mostly getting the UI updated
🤖 wrote a form bot over lunch to take a url and give me a Django form to help port some old projects
🐍 worked on a new python + django in the Fortune 500 project today as a soone to be released spreadsheet as a website data project #fortune500
deep dived on building a SQLite based static website generator mostly to play with a better template caching mechanism.
✏ wrote a new conference scraper over lunch #conf
🏀 worked on a new side project over lunch and converted a static website into a data rich jekyll website. #daysuntillatenight
wrote a SqliteDict class to help do some heavy lifting on a few projects #mylife
refactored new project to use django-q and hooks which made the project start to update itself more than I was updating it.
🐘 moved wayback scraper to its own database and app to cut backup/restore time down
deep dived into a django/python porting project and got quite a bit more done than I expected to. #mylife
finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.
🔨 update celery scraper tasks to be Django friendly
✏️ researched bringing back an older Django project that was super useful 7 to 10 years ago #mylife
dusted off my build django project and updated templates and the backend to be easier to maintain
worked on how to test/keep a scraping project updated more easily
finished out more meetings but made a quick MVP Django Docker tool that I hadn't thought of perviously #mylife
🔨 Updates scraper-proxy tool and rewriting/refactoring from the ground up to handle structured data