Thanks for the response!
I find turbopuffer to be a great vector store. Using gemini-embedding-001 at the moment. It's working great. The only issue I've had to solve was to maintain an embeddingscache of the documents with timestamps for lastupdated, and SH256 of the content to prevent duplicates. Storing the SH256 of the vectors are also useful apparently, as some people have suggested.
Thanks for the response!
I find turbopuffer to be a great vector store. Using gemini-embedding-001 at the moment. It's working great. The only issue I've had to solve was to maintain an embeddingscache of the documents with timestamps for lastupdated, and SH256 of the content to prevent duplicates. Storing the SH256 of the vectors are also useful apparently, as some people have suggested.