What do you use for Web Scraping?

Question

Wojciech Gabryś · Accepted Answer

There's even a Scraper as a Service: https://page.rest/ (discovered some time ago by @pugson – thanks mate! 🙌)

Austin Grandt · Answer

I am a big fan of the Beautiful Soup python package. Tons of flexibility and super easy to learn and use

https://www.crummy.com/software/BeautifulSoup/

Lenilson 🚀 · Answer

Nokogiri. https://github.com/sparklemotion/nokogiri

Jakub Juszczak · Answer

Cheerio: 
https://github.com/cheeriojs/cheerio

Julien Hany · Answer

If it's important for your business build your own scraper system with Python and Beautifulsoup, if it's not, you use SaaS solution like https://www.apify.com/

Andreas Pizsa · Answer

https://www.npmjs.com/package/x-ray

Go to Homepage	`g` `h`
Go to Done Todos	`g` `d`
Go to Questions	`g` `q`
Compose a New Todo	`n`
Go to Search	`/`
Show this dialog	`?`

What do you use for Web Scraping?

Keyboard Shortcuts