open-thoughts/openthoughts-agent
Grade a repo

0

/ 100

GradeC

Good shape overall. A few tweaks would push it into the top tier.

Data recipes and robust infrastructure for training AI agents

Documentation97
Engineering51
Health96
Python225Apache-2.0today

Documentation

97

Contributing guide5pt78

Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.

→ Add setup instructions, code style notes, and how to run tests.

README12pt100

README is present.

Install and run instructions9pt100

README documents how to install the project.

License6pt100

Licensed under Apache-2.0.

Engineering

51

Linting and formatting5pt0

No linter or formatter configured.

→ Add [tool.ruff] to pyproject.toml. Ruff handles linting and formatting in one tool and replaces flake8, isort, and black.

Issue and PR templates6pt0

No issue or PR templates found (−100 pts).

→ Add .github/ISSUE_TEMPLATE/ with bug_report.md and feature_request.md to guide contributors. It dramatically improves issue quality.

CI/CD14pt40

CI is configured (.github/workflows/submodules-nightly.yml).

Tests18pt80

Test files detected (data/all_puzzles/test_generate.py).

Reproducibility6pt80

Lockfile present (uv.lock). Installs are reproducible.

Project health

96

Dependency manifest6pt86

Dependency manifest found (pyproject.toml).

Repository metadata5pt100

Repository has a description.

Activity5pt100

Actively maintained (pushed within the last month).

Housekeeping3pt100

.gitignore present.

Repository health signals

Activity, community, and responsiveness at scan time

Activity

  • -
    Commits (30d / 90d)
  • 29
    Forks
  • 0
    Releases

Community

  • -
    Community health
  • -
    authors own >50% of commits
  • 225
    Watchers

Responsiveness

  • 8d 24h
    Median issue response
  • 5d 5h
    Median PR merge time
  • 4
    Open issues
Repository files33 root entries
  • .claude
  • .github
    Good: CI is configured (.github/workflows/submodules-nightly.yml).
  • assets
  • baselines
  • chat_templates
  • data
    Good: Test files detected (data/all_puzzles/test_generate.py).
    Good: Environment pinned via data/frontiersmith/templates/Dockerfile.
  • database
  • docker
  • docs
  • eval
  • hpc
  • notebook
  • notes
  • prm
  • rl
  • schema
  • scripts
  • sft
  • tests
  • .agents
  • .beta9ignore
  • .dockerignore
  • .gitignore
    Good: .gitignore present.
  • .gitmodules
  • build_support.py
  • CLAUDE.md
  • CONTRIBUTING.md
    Issue: Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.Fix: Add setup instructions, code style notes, and how to run tests.
    Good: Contributing guide includes setup/install instructions.
    Issue: Contributing guide lacks a code style section (−8 pts).Fix: Describe your linting/formatting rules and how to run them.
    Issue: Contributing guide lacks a testing section (−8 pts).Fix: Show contributors how to run the test suite (e.g. npm test, pytest, cargo test).
    Good: Contributing guide describes the PR/review workflow.
    Good: Contributing guide includes code examples.
  • err.txt
  • LICENSE.txt
    Good: Licensed under Apache-2.0.
  • pyproject.toml
    Good: Dependency manifest found (pyproject.toml).
  • README.md
    Good: README is present.
    Good: README is well structured with multiple sections.
    Good: README includes screenshots or visuals. Great for first impressions.
    Good: README has code examples.
    Good: README links to a live demo or deployed app.
    Good: README includes status badges.
    Good: README documents how to install the project.
    Good: README documents how to run the project.
  • setup.py
  • uv.lock
    Good: Lockfile present (uv.lock). Installs are reproducible.