New to WIP?

We're a group of makers shipping together. We help each other stay accountable and reach our goals.

Apply for access
Other questions
🤔 What do you do for marketing? Be the first to reply
🎨 Freelance designers. When and how. 2 answers
What steps are included in your CI pipeline you should have added sooner? 11 answers
AI to work with a lot of data (two usecases) 8 answers
Back
 Question
Asked

i want to fetch how many followers i have on a biz dashboard like klipfolio for a platform that has no api, ex: qoura, how would i do that?


Logan Honeycutt
@growwithlogan

👋 Join WIP to participate

A service like www.import.io lets you scrape publicly available data that have no API.

Whether you can show that on your dashboard depends on which service you're using. I'm not familiar with them nor have I used Import.io recently, but I imagine they allow for a JSON output which you can then import in your dashboard tool.

 Reply

If you're a developer you can also create your own scraper. A tool like SelectorGadget lets you easily generate a CSS selector that points to the data you need. You just need to write a script that extract the data based on that CSS selector.

 Reply

You can try giving Puppeteer a shot. It is a Headless Chrome which you can use to visit to the page you need & scrape all the data you need.

Similar question - What do you use for Web Scraping? has some other options than Puppeteer :)

 Reply