morganlinton/vulcanbench

0

/ 100

Documentation100
Engineering90
Health100
Python13Apache-2.01d ago
Grade a repo

Well engineered for its size. A portfolio piece worth showing off.

Open source, clear, transparent, real world llm benchmarks

Outstanding. A score of 95/100 puts this repo in a very small tier of truly well-engineered projects.

Documentation

100

README12pt100

README is present.

Install and run instructions9pt100

README documents how to install the project.

License6pt100

Licensed under Apache-2.0.

Contributing guide5pt100

Contributing guide is detailed and thorough.

Engineering

90

Tests18pt80

Test files detected (harness/agent/test_commands.py).

Reproducibility6pt80

Lockfile present (dashboard/package-lock.json). Installs are reproducible.

CI/CD14pt100

CI is configured (.github/workflows/ci.yml).

Linting and formatting5pt100

Linter or formatter configured (dashboard/eslint.config.mjs).

Issue and PR templates6pt100

Issue or PR templates present.

Project health

100

Dependency manifest6pt100

Dependency manifest found (pyproject.toml).

Repository metadata5pt100

Repository has a description.

Activity5pt100

Actively maintained (pushed within the last month).

Housekeeping3pt100

.gitignore present.

Repository health signals

Activity, community, and responsiveness at scan time

Activity

  • —
    Commits (30d / 90d)
  • 2
    Forks
  • 1
    Releaseslatest 4d ago

Community

  • —
    Community health
  • —
    authors own >50% of commits
  • 13
    Watchers

Responsiveness

  • —
    Median issue response
  • —
    Median PR merge time
  • 0
    Open issues
Repository files27 root entries
  • .cursor
  • .github
    Good: CI is configured (.github/workflows/ci.yml).
    Good: Issue or PR templates present.
  • alembic
  • backend
    Good: Environment pinned via backend/Dockerfile.
  • dashboard
    Good: Linter or formatter configured (dashboard/eslint.config.mjs).
    Good: Lockfile present (dashboard/package-lock.json). Installs are reproducible.
  • docs
  • harness
    Good: Test files detected (harness/agent/test_commands.py).
  • sandbox
  • scripts
  • tasks
  • tests
  • .dockerignore
  • .env.example
  • .gitattributes
  • .gitignore
    Good: .gitignore present.
  • .pre-commit-config.yaml
  • alembic.ini
  • CHANGELOG.md
  • CONTRIBUTING.md
    Good: Contributing guide is detailed and thorough.
    Good: Contributing guide includes setup/install instructions.
    Good: Contributing guide describes code style expectations.
    Good: Contributing guide explains how to run tests.
    Good: Contributing guide describes the PR/review workflow.
    Good: Contributing guide includes code examples.
  • docker-compose.prod.yml
  • docker-compose.yml
  • LICENSE
    Good: Licensed under Apache-2.0.
  • Makefile
  • NOTICE
  • pyproject.toml
    Good: Dependency manifest found (pyproject.toml).
  • README.md
    Good: README is present.
    Good: README is well structured with multiple sections.
    Good: README includes screenshots or visuals. Great for first impressions.
    Good: README has code examples.
    Good: README links to a live demo or deployed app.
    Good: README includes status badges.
    Good: README documents how to install the project.
    Good: README documents how to run the project.
  • SECURITY.md
    Good: Security policy present.