New to WIP?

We're a group of makers shipping together. We help each other stay accountable and reach our goals.

Apply for access
Other questions
Reccomendations on CRM especially simple ones 4 answers
Emails: Use a service or do it yourself? 14 answers
I have thousands of pages to index on Google. How to do this without ruining my domain rep? 6 answers
Have you A/B tested a Stripe Climate enabled checkout vs. regular checkout? 4 answers
Back
 Question
Asked

i want to fetch how many followers i have on a biz dashboard like klipfolio for a platform that has no api, ex: qoura, how would i do that?


Logan Honeycutt
@growwithlogan

👋 Join WIP to participate

A service like www.import.io lets you scrape publicly available data that have no API.

Whether you can show that on your dashboard depends on which service you're using. I'm not familiar with them nor have I used Import.io recently, but I imagine they allow for a JSON output which you can then import in your dashboard tool.

 Reply

If you're a developer you can also create your own scraper. A tool like SelectorGadget lets you easily generate a CSS selector that points to the data you need. You just need to write a script that extract the data based on that CSS selector.

 Reply

You can try giving Puppeteer a shot. It is a Headless Chrome which you can use to visit to the page you need & scrape all the data you need.

Similar question - What do you use for Web Scraping? has some other options than Puppeteer :)

 Reply