Hey Ben, welcome to WIP. I like your project, i was doing some similar work that uses LLM to help me look for a specific type of information from various sources, and generate weekly reports. It is a great idea to generalize this workflow and offer it through an API.

Have you thought about (or have tried) using muti-agent in your pipeline?