Back
Similar todos
Load previous page…
Shipped few more UX fixes for 
#nichewit and started deep dive into more accurate and reliable scraping/prompting
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
borrowed an iMac from friend to scrape data from clubhouse for a different friend
recorded 3 hours of deep work and kicked of simplification of the code for my project 
#learnwebdev
Kind of scatterbrained today. Spent time chatting with someone who could act as a consultant if I try to develop a module for rally-the-troops.com as a way to build confidence with pure-JS UIs, as a stepping stone towards a second attempt at working on my rap-IDE idea. Also spent some time chatting back-and-forth with a local YouTuber, it looks like my concept for a video won't fit into his particular video style.
build more scrapers 
#pagesonpages
built two more article scrapers using spatula. It's really nice.
did another 3 hours of client work to get ahead. also worked on my code gen tool a little too to speed things up
do some scrapping 
#honesttribe
finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
🎧 giving talkingsopranos.simplecast.co… a listen while coding 
#mylife
Work on automated web scraping #pagesonpages
Only got ~5hrs of sleep after two double espressos yesterday, so I took a Lycopene capsule...signed up for a LinkedIn Premium free trial so I could send a message to a Kasikorn backend engineer to ask why users can't export their transaction history in CSV format...removed the 'Blog' link on nw.com b/c I don't have the WordPress blog up and I never really used the blog that much, added a link to my email address instead so people can contact me...started going through the Kasikorn API "Slip Verification" challenges...got the first one done...the second one requires I have SSL set up on my domain and not through Cloudflare...discovered while doing that that my whatdo site is returning a 404 if I try to sign in...got GoLand's db tool connecting to the digital ocean postgres db b/c I noticed that wasn't set up yet...install postgres on my macbook b/c something got messed up and somehow it seemed to not be installed...got all the db problems fixed, don't know how that happened...now having a CORS issue when running locally, all this stuff was working, IDK how it all broke...ok I remember now, I YOLO'd the backend code and disabled the existing router to get the Line echo bot working...sent an email to another local YouTuber to ask if I can be in a video with him...installed cursor and tried using it for a simple refactor task to get a sense of how it works...figured out a way (thanks to ChatGPT) to get the Line callback handler working while also not breaking the existing routes...went for a massage to give my brain cells some time to recover...used cursor some more and I get the hype, this is really cool, I'm surprised Jetbrains hasn't copied it yet...after a long while I finally got my whatdo backend working properly again (auth + user middleware working), it was a good learning experience with cursor and Go...got a GitHub Action set up so my DO dokku VPS will update when I push to main, so now both frontend and backend will update automatically when I push to GitHub...ending the day on this banger set: www.youtube.com/watch?v=d2340… Tomorrow: I need to bill hours to my client to make $, I want to try to finish the KBank API challenge to see if I can do the Slip Verification, I want to email another YouTuber, if I have any time left over I want to keep going with that Line/ChatGPT bot and try to make a frontend interface for it.
finding bugs in my scrapers on 
#devopsprojectshq