About monitoring and observability in LLM applications, focusing on Langfuse, a tool that helps track system behavior, prevent issues, and enhance future performance for LLM projects.
Explore the unique challenges of serving LLMs, understnding their techniques, and demonstrate solutions using vLLM.
Recap my presentation in DevFest Cloud Bangkok 2023 which show how to integrate of Ray with VertexAI, known as Ray on VertexAI, and demonstrate its application in LLMOps within the VertexAI ecosystem.
Introduce Yatai, a machine learning platform for scalable model deployment. In this article, discuss its features, its role in the MLOps lifecycle, and provide a demo showcasing its capabilities.
Sharing on securing Kafka clusters with TLS/SSL, building on the ideas introduced by the Mil Data Engineer from CJ Express Group (TILDI). Also detail why avoiding ANONYMOUS as a superuser is crucial for securing Kafka components like Kafka UI, Kafka Connect, and Kafka Connector.