You could use Scrapy (docs.scrapy.org/en/latest/int…) and the storage could be done in practically any storage of your choice (doc.scrapy.org/en/latest/topi…)