# Share a Ragas Evaluation — RAG Scores Someone Can Argue With

Canonical: https://commareports.com/share-ragas-report
Published: 2026-09-15

> Ragas returns a DataFrame of per-sample scores. Render it to HTML, publish it to Comma, and the RAG evaluation becomes a link where domain experts can comment per row.

# Share a Ragas evaluation

Ragas gives a RAG pipeline something it badly needs: numbers. Faithfulness,
answer relevancy, context precision — computed per sample, aggregated at the
end.

The aggregate is what ends up in the standup. The per-sample rows are where
the actual finding lives, and they end up in a notebook nobody else opens.

## Render the per-sample table

```python
from ragas import evaluate
from ragas.metrics import faithfulness, answer_relevancy, context_precision

result = evaluate(dataset, metrics=[faithfulness, answer_relevancy, context_precision])

df = result.to_pandas()
styled = (
    df.style
      .background_gradient(subset=["faithfulness", "answer_relevancy"], cmap="RdYlGn")
      .format(precision=3)
)
styled.to_html("ragas.html")
```

The gradient is not decoration — it is what makes the twelve bad rows findable
in a table of four hundred. See also
[sharing a pandas DataFrame as HTML](/share-pandas-dataframe-html).

## Publish it

Drag `ragas.html` into [the app](https://commareports.com/), or from the eval
job:

```bash
curl -fsS -X PATCH "https://commareports.com/api/v1/reports/$REPORT_ID" \
  -H "Authorization: Bearer $COMMA_API_TOKEN" \
  -H "Content-Type: application/json" \
  -d "$(jq -n --rawfile html ragas.html \
        --arg title "RAG eval — $(date +%F)" '{title: $title, html: $html}')"
```

## The metric is a proxy; the expert is the judge

A faithfulness score of 0.62 is not a verdict. It might be a hallucination, or
it might be the metric penalising a correct answer that paraphrased the
source. Deciding which requires someone who knows the domain — the support
lead, the clinician, the compliance officer — and that person is not going to
run your notebook.

- **Anchored threads** on the row: "this is retrieving the 2019 policy doc; it
  should be excluded from the index." Recorded next to the sample. See
  [commenting on HTML](/comment-on-html).
- **Revisions**, so a prompt change is evaluated as a diff between two
  published runs rather than two screenshots.
- **A [routine](/features/routines/scheduled-html-reports)** to re-run the
  eval on a schedule as the corpus drifts.
- **Access per report** — eval sets usually contain real user questions; keep
  them private or team-scoped. See the [sharing model](/docs/sharing).

## Limits

- **Entry HTML: 5 MB.** Assets: 25 MB per file, 250 MB and 500 files total.
  A table with full retrieved contexts gets large fast — truncate the context
  column or publish a sample for the shareable view.
- **60 requests/minute per token.**

## Try it

Comma is free — unlimited reports, unlimited commenters, unlimited revision
history.

**[Publish an eval report →](https://commareports.com/)**

### Related

- [Share a promptfoo report](/share-promptfoo-report) · [Share an Inspect AI log](/share-inspect-ai-log)
- [Share a DeepEval report](/share-deepeval-report) · [Share a Giskard report](/share-giskard-report)
- [Share a pandas DataFrame as HTML](/share-pandas-dataframe-html) · [Scheduled reports](/features/routines/scheduled-html-reports)