---
title: "What is validity report?"
description: "A validity report states, for one run, how many environments were verified, which failed, and whether each failure belonged to the environment or the task."
url: "https://www.promigence.ai/glossary/validity-report"
site: "Promigence"
---

# What is validity report?

A validity report states, for one run, how many environments were verified, which failed, and whether each failure belonged to the environment or the task.

It answers a question most teams running evaluations cannot: how many of the environments behind this number were actually working. Without it, an environment that failed to install is indistinguishable from an agent that failed the task.

In reinforcement learning the consequence is worse than a wrong chart, the training loop updates on a failure that never really happened. Promigence returns a report after every run and keeps a flight recorder so a flagged failure can be opened.

## Related
- https://www.promigence.ai/glossary/verified-environment
- https://www.promigence.ai/glossary/poisoned-reward
- https://www.promigence.ai/glossary/flight-recorder