Back
Similar todos
rewrote one of the running website scrapers to use playwright so that the JS bits get rendered
See similar todos

No replies yet

🔨 working on docker performance tasks on my hosting setup #mylife
See similar todos

No replies yet

Successfully moved scraper from reading json from the puppeteer output to getting a POST request after the process is done! 💪 (less problems with messy output :S) #bagsoup
See similar todos

No replies yet

worked on job website tests on one of the scrapers
See similar todos

No replies yet

increase workers to process scrapers faster #reva
See similar todos

No replies yet

more scraper work and I finally figured out how to work around a few issues I couldn't quite wrap my brain around.
See similar todos

No replies yet

speed up scraping script
See similar todos

No replies yet

tested scraper api, & planned out the flow #remote3
See similar todos

No replies yet

worked on how to test/keep a scraping project updated more easily
See similar todos

No replies yet

🛠 moved the two last crons running on my laptop to a remote server (they were using puppeteer to control a chromium instance) #life
See similar todos

No replies yet

check why scrapping stopped to wprk #capgo
See similar todos

No replies yet

re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
See similar todos

No replies yet

The chromiums mini server seems to be working fine so I'm gonna start using it for all scraping tasks, will see... 🫣 took me 2 hours to setup because chromiums refused to listen on public ip no matter what I'd do and ended using socat #servers
See similar todos

No replies yet

make run scrapping for a bit and try to debug it
See similar todos

No replies yet

down the rabbit hole investigating issue with scrapers #reva
See similar todos

No replies yet

Work on automated web scraping #pagesonpages
See similar todos

No replies yet

write first prototype automated web scraper #pagesonpages
See similar todos

No replies yet

See Watchdog for X running in production! Manually provisioned an EC2 instance and set up docker compose for the chromium container, easier than fighting with Kamal under a time crunch #watchdog !private
See similar todos

No replies yet

wrote a job scraper because why not?
See similar todos

No replies yet

late night hacking on a scraper project and mostly getting the UI updated
See similar todos

No replies yet