| Version | Supported |
|---|---|
| 0.1.x | Yes |
If you discover a security vulnerability, please report it responsibly:
- Do NOT open a public GitHub issue
- Email security@hasna.com with details
- Include steps to reproduce if possible
- Allow reasonable time for a fix before public disclosure
open-evals stores all run history in a local SQLite database. No data is sent to external servers unless you explicitly configure an LLM-as-judge that calls an external API.
API keys for judge models (Anthropic, OpenAI) are read from environment variables — never stored in eval case files or the database.
- SQLite database is stored at
~/.hasna/evals/evals.db - Eval case files are plain JSONL — never include secrets in them
- Judge reasoning and verdicts are stored in the database
- Set
EVALS_DB_PATHto a location with restricted permissions - Use environment variables for all API keys (
ANTHROPIC_API_KEY,OPENAI_API_KEY) - Review generated eval cases before running them against production endpoints