Evaluate a RAG system for medication prescriptions
This workflow tests and evaluates an RAG system that provides medication prescriptions to patients, based on their symptoms and diagnosed disease.
It features a test set generator that creates a test set of questions with varying complexity (e.g., simple, complex, distracting, situational and double types) to comprehensively test the RAG system's capabilities.
It features an evaluator that assesses the correctness of the RAG system's answers by comparing them to the reference answers contained in the automatically generated test set of questions. The main purpose of this evaluation is to help identify the weakest components in a RAG system.