#thecompaniesapi continue on phi3; hell of a refactor

#thecompaniesapi tests are over; phi3 is what we need; dropping lots of python code in favor of a single inference process to govern them all

#thecompaniesapi continue working on phi3 ; first steps of subdomain support & association ; rewrite most of our AI impl

#thecompaniesapi few iterations on our ai flows, trying phi3

#thecompaniesapi maintenance on the bot ; send back test csv to a big ai company that want to use our api ; start migration to phi3 for ou AI stack

#thecompaniesapi start working on fine tuning as phi3 cannot stop hallucinating even though its a lot faster, heard it would possibly change everything for our usecase so its worth trying

#thecompaniesapi continue work on phi, lots of iterations, kinda exhausted lately

#thecompaniesapi continue r&d on phi3, trying idea refinement from structured text content, then pipe to inference flow, unknown territories 🤣

continue analyzing data

#thecompaniesapi deploy new bot ; add per-company sync on robot ; continue tests on phi3

#thecompaniesapi improving results from phi3 is a tedious task, but if it pays off we get rid of a ton of problems

finally move on with current data project #indie

#thecompaniesapi quantize phi3.5 to 4bit to use it in our inference server; same model size but 128k context length instead of 4k, I can now process huge chunks of texts without relying on batching

#thecompaniesapi port back my ai wrapper improvements on our existing llama stack and prepare fine tuning for phi3

#thecompaniesapi port back my ai wrapper improvements on our existing llama stack and prepare fine tuning for phi3

#thecompaniesapi run my phi3-128k flow using llama3.1 and the results are mind blowing, it's insane how good llama is at conserving context and original purpose even when supplied with thousands of tokens; also shipped multiple hotfixes in robot UI; about to merge a month of work and then hop on fine tuning

#thecompaniesapi work on phi3 again :) continue my search for the best prompt

check the data transformed

scrape phase2 #codelibclub

get back to PH work