Skip to content

Commit 3d4653c

Browse files
committed
formating
1 parent 4b503c3 commit 3d4653c

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

articles/ai-studio/concepts/evaluation-metrics-built-in.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -249,10 +249,14 @@ For groundedness, we provide two versions:
249249

250250
Our definition and grading rubrics to be used by the large language model judge to score this metric:
251251

252+
**Definition:**
253+
252254
| Groundedness for RAG QA | Groundedness for summarization |
253255
|---|-----|
254256
| Groundedness refers to how well an answer is anchored in the provided context, evaluating its relevance, accuracy, and completeness based exclusively on that context. It assesses the extent to which the answer directly and fully addresses the question without introducing unrelated or incorrect information. The scale ranges from 1 to 5, with higher numbers indicating greater groundedness. | Groundedness refers to how faithfully a response adheres to the information provided in the context, ensuring that all content is directly supported by the context without introducing unsupported information or omitting critical details. It evaluates the fidelity and precision of the response in relation to the source material. |
255257

258+
**Ratings:**
259+
256260
| Rating| Groundedness for RAG QA | Groundedness for summarization |
257261
|--|--|--|
258262
| Groundedness: 1| **[Groundedness: 1] (Completely Unrelated Response)** <br> </br> **Definition**: An answer that doesn't relate to the question or the context in any way. It fails to address the topic, provides irrelevant information, or introduces completely unrelated subjects. | **[Groundedness: 1] (Completely Ungrounded Response)** <br> </br> **Definition**: The response is entirely unrelated to the context, introducing topics or information that have no connection to the provided material. |
@@ -261,7 +265,6 @@ Our definition and grading rubrics to be used by the large language model judge
261265
| Groundedness: 4 | **[Groundedness: 4] (Partially Correct Response)** <br></br> **Definition**: An answer that provides a correct response to the question but is incomplete or lacks specific details mentioned in the context. It captures some of the necessary information but omits key elements needed for a full understanding. | **[Groundedness: 4] (Incomplete Response Missing Critical Details)** <br></br> **Definition**: The response contains information from the context but omits essential details that are necessary for a comprehensive understanding of the main point. |
262266
| Groundedness: 5 | **[Groundedness: 5] (Fully Correct and Complete Response)** <br></br> **Definition**: An answer that thoroughly and accurately responds to the question, including all relevant details from the context. It directly addresses the question with precise information, demonstrating complete understanding without adding extraneous information. | **[Groundedness: 5] (Fully Grounded and Complete Response)** <br></br> **Definition**: The response is entirely based on the context, accurately and thoroughly conveying all essential information without introducing unsupported details or omitting critical points. |
263267

264-
265268
### AI-assisted: Retrieval
266269

267270
| Score characteristics | Score details |

0 commit comments

Comments
 (0)