Good shape overall. A few tweaks would push it into the top tier.
Evaluate and improve models and agents using environments
Documentation
91
Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.
→ Add setup instructions, code style notes, and how to run tests.
README documents how to install the project.
README is present.
Licensed under Apache-2.0.
Engineering
72
No linter or formatter config found.
→ Add a linter config such as .eslintrc.json, .prettierrc, ruff.toml, or .golangci.yml to enforce consistent code style.
CI is configured (.github/workflows/_build_container.yml).
Test files detected (benchmarks/hotpotqa_closedbook/tests).
Lockfile present (uv.lock). Installs are reproducible.
Issue or PR templates present.
Project health
100
Dependency manifest found (pyproject.toml).
Repository has a description.
Actively maintained (pushed within the last month).
.gitignore present.
Repository health signals
Activity, community, and responsiveness at scan time
Activity
- —Commits (30d / 90d)
- 195Forks
- 5Releaseslatest 20d ago
Community
- —Community health
- —authors own >50% of commits
- 996Watchers
Responsiveness
- 17d 4hMedian issue response
- 3hMedian PR merge time
- 446Open issues
Repository files32 root entries
- .claude
- .codex
- .githubGood: CI is configured (.github/workflows/_build_container.yml).Good: Issue or PR templates present.
- benchmarksGood: Test files detected (benchmarks/hotpotqa_closedbook/tests).
- cache
- data
- docs
- environments
- example_environments
- fern
- nemo_gym
- resources_servers
- responses_api_agents
- responses_api_models
- results
- scripts
- tests
- .dockerignore
- .gitignoreGood: .gitignore present.
- .pre-commit-config.yaml
- .python-versionGood: Environment pinned via .python-version.
- ATTRIBUTIONS.md
- CLAUDE.md
- CODE_OF_CONDUCT.mdGood: Code of conduct present.
- codecov.yml
- CONTRIBUTING.mdIssue: Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.Fix: Add setup instructions, code style notes, and how to run tests.Issue: Contributing guide lacks a setup section (−12 pts).Fix: Show new contributors how to get a local dev environment running.Issue: Contributing guide lacks a code style section (−8 pts).Fix: Describe your linting/formatting rules and how to run them.Issue: Contributing guide lacks a testing section (−8 pts).Fix: Show contributors how to run the test suite (e.g. npm test, pytest, cargo test).Issue: Contributing guide lacks a PR workflow section (−8 pts).Fix: Explain how to fork, branch, and open a pull request so contributors know what to expect.Good: Contributing guide includes code examples.
- LICENSEGood: Licensed under Apache-2.0.
- Makefile
- pyproject.tomlGood: Dependency manifest found (pyproject.toml).
- README.mdGood: README is present.Good: README is well structured with multiple sections.Good: README includes screenshots or visuals. Great for first impressions.Good: README has code examples.Good: README links to a live demo or deployed app.Good: README includes status badges.Good: README documents how to install the project.Good: README documents how to run the project.
- SECURITY.mdGood: Security policy present.
- uv.lockGood: Lockfile present (uv.lock). Installs are reproducible.