langcheck.metrics.reference_based_text_quality#
- langcheck.metrics.reference_based_text_quality.exact_match(generated_outputs: list[str] | str, reference_outputs: list[str] | str, prompts: list[str] | str | None = None) MetricValue[int] [source]#
Checks if the generated outputs exact matches with the reference outputs. This metric takes on binary 0 or 1 values.
- Parameters:
generated_outputs – The model generated output(s) to evaluate
reference_outputs – The reference output(s)
prompts – The prompts used to generate the output(s). Prompts are optional metadata and not used to calculate the metric.
- Returns:
An
MetricValue
object