Back
Similar todos
#thecompaniesapi lots of cleanups on the bot ; continuing sources rework ; prepare api <=> bot communication ; working towards enabling on-demand scans for our users
working on some scraping for data analysis #linkhandy
#thecompaniesapi well, also implemented billable one-time actions for users ; users can now comeup with any domain and get enriched data, ever growing database!
save metadata to databse instead of scraping it live on the client #wipmusic
working on some a few scrapers for pulling in data vs. just using sheets #daysuntillatenight
Test run paylocity scraper and get new jobs added to db 🥹🥹 #plumberjobs
✏ more work on new scraper to get more events #conf
#thecompaniesapi add storage pipeline for our new extraction feature; add endpoints to our storage server to automatically build fine tuning datasets from our production extraction
some data scraping and analysis #life
#thecompaniesapi pushing towards new schema implementation ; still working on containerizing the whole infra to improve stability ; enable user/team tagged jobs for credits consumption
release #crisp automations ai data management into beta
pulled in a new csv scraper data for #daysuntillatenight
new scrapers for #sportsjobs
#thecompaniesapi making all fields sortable in our companies table ; also adding `Synced At` field as our database is now live-updated; last mile before clients can see the db grow in live!
Run csv parser to feed the database with tons of new products, now in production #dill
relaunched the scraping machine #thecompaniesapi
🐘 moved wayback scraper to its own database and app to cut backup/restore time down