add job post ids, job post user_ids, job post company emails into companies.db when creating company profile so we can prefill their profiles #remoteok
don’t use APIFlash to make screenshot of page if over >3 tags because there’s too many infinite combos of job tags that we reach quota of 100,000 screenshots quickly #remoteok
see robot add first company to db from job post, enriched with Clearbit API data like location, tech stack, industry, employee count etc. to build company profiles from later #remoteok
change hardcoded line breaks with ‘\n’ in job post for JS to parse in Markdown (not real linebreaks) into real linebreaks for Google’s crawler to read better #remoteok
make checkIfSourcedJobClosed.php follow 301 and 302 redirects and then check the final URL if it’s a 404 or 410 to see if job is closed or not #remoteok