Building Trust in Generative AI: Accuracy and Automation | Nirhoshan Sivaroopan | Conf42 DevOps 2025
Read the abstract ➤ https://www.conf42.com/DevOps_2025_Nirhoshan_Sivaroopan_ai_accuracy_trust Other sessions at this event ➤ https://www.conf42.com/devops2025 Join Circle ➤ https://conf42.circle.so/checkout/subscribe Chapters 00:00 Introduction to the Speaker and Topic 00:12 Importance of Accuracy in Generative AI 01:01 Automating Accuracy Evaluation 01:33 Generative AI with and without Context 02:47 Retrieval-Augmented Generation (RAG) Pattern 03:52 Metrics for Evaluating RAG Applications 05:21 Context Recall and Precision 08:25 Evaluating the Generator: Faithfulness and Semantic Similarity 09:48 Key Stages of Accuracy Evaluation 10:29 Dataset Preparation and Metrics Computation 12:48 Integrating Accuracy Evaluation into CI/CD Pipeline 15:58 Challenges in Accuracy Evaluation 17:29 Conclusion and Final Thoughts