recrawl site #rewardsflights

continue on crawler update

write crawler who checks if there is ANY link on a given directory which is do-follow - already corrected some mistakes in my guide with the help of it #backlio

changed crawler so i can keep css from workdays #sportstechjobs

refactor crawler #cardmapr

used cursor/claude to rewrite a crawler for weegee into a new format. It was insanely fast. It had some things wrong but due to good e2e tests I spotted it immediately and could correct it.

#thecompaniesapi prepare new batch of websites to visit for our robot :)

Improve article parsing for "challenging" websites #ktool

improve load speed and page size #joils