RT @johnjnay: Building LLM Applications For Production

-Key challenges of productionizing:
Prompt eval / versioning / optimization
Backward compatibility
Tuning
Cost

-How to compose multiple tasks w/ control flows