🐍 worked on a quick reusable web spider since everything else is overkill

get crawler working with html based structured data #joopie

coding with Claude -- used to save me time, now feels like it's slower than doing everything from scratch #life

create worker pool to improve performence for crawlers #joopie

trying out cursor #knifegeek

reimplement core crawler in nodejs and puppetteer for javascript rendering #joopie

fixed crawler bug to generate slugs #sportstechjobs

fix lookoutbot crawler for wip.chat

finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.