open-thoughts/openthoughts-agent
Grade a repo

74

/ 100

GradeC

Good shape overall. A few tweaks would push it into the top tier.

Top 41% of 5,156 graded repos

Data recipes and robust infrastructure for training AI agents

Documentation97
Engineering51
Health96
Python233Apache-2.01mo ago

Top fixes

Highest-impact changes first, ranked by point weight

16 to address
  1. 1
    Tests18pt

    Wire your tests to a documented command (e.g. a test script in your build config) so the suite is reproducible.

  2. 2
    CI/CD14pt

    Add a step like `run: npm test`, `run: pytest`, or `run: tox` to your workflow file.

  3. 3
    CI/CD14pt

    Add `pull_request:` to the workflow `on:` triggers.

  4. 4
    CI/CD14pt

    Add a lint step to catch style issues automatically.

Working through the fixes? Let every push regrade itself.

The free GitHub App rescans this repo on every push and posts the grade as a commit check, so the score climbs without coming back to rescan by hand.

Install the GitHub App

Scorecard

Every check, grouped by category and sorted worst-first

Documentation

97

Contributing guide5pt78

Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.

→ Add setup instructions, code style notes, and how to run tests.

README12pt100

README is present.

Install and run instructions9pt100

README documents how to install the project.

License6pt100

Licensed under Apache-2.0.

Engineering

51

Linting and formatting5pt0

No linter or formatter configured.

→ Add [tool.ruff] to pyproject.toml. Ruff handles linting and formatting in one tool and replaces flake8, isort, and black.

Issue and PR templates6pt0

No issue or PR templates found (−100 pts).

→ Add .github/ISSUE_TEMPLATE/ with bug_report.md and feature_request.md to guide contributors. It dramatically improves issue quality.

CI/CD14pt40

CI is configured (.github/workflows/submodules-nightly.yml).

Tests18pt80

Test files detected (data/all_puzzles/test_generate.py).

Reproducibility6pt80

Lockfile present (uv.lock). Installs are reproducible.

Project health

96

Dependency manifest6pt86

Dependency manifest found (pyproject.toml).

Repository metadata5pt100

Repository has a description.

Activity5pt100

Actively maintained (pushed within the last month).

Housekeeping3pt100

.gitignore present.

Repository health signals

Activity, community, and responsiveness at scan time

Activity

  • 379 / 694
    Commits (30d / 90d)
  • 31
    Forks
  • 0
    Releases

Community

  • 50% - Fair
    Community health
  • 1 bus factorlow
    author own >50% of commits
  • 233
    Watchers

Responsiveness

  • 8d 24h
    Median issue response
  • 5d 5h
    Median PR merge time
  • 4
    Open issues
Repository files33 root entries
  • .claude
  • .github
    Good: CI is configured (.github/workflows/submodules-nightly.yml).
  • assets
  • baselines
  • chat_templates
  • data
    Good: Test files detected (data/all_puzzles/test_generate.py).
    Good: Environment pinned via data/frontiersmith/templates/Dockerfile.
  • database
  • docker
  • docs
  • eval
  • hpc
  • notebook
  • notes
  • prm
  • rl
  • schema
  • scripts
  • sft
  • tests
  • .agents
  • .beta9ignore
  • .dockerignore
  • .gitignore
    Good: .gitignore present.
  • .gitmodules
  • build_support.py
  • CLAUDE.md
  • CONTRIBUTING.md
    Issue: Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.Fix: Add setup instructions, code style notes, and how to run tests.
    Good: Contributing guide includes setup/install instructions.
    Issue: Contributing guide lacks a code style section (−8 pts).Fix: Describe your linting/formatting rules and how to run them.
    Issue: Contributing guide lacks a testing section (−8 pts).Fix: Show contributors how to run the test suite (e.g. npm test, pytest, cargo test).
    Good: Contributing guide describes the PR/review workflow.
    Good: Contributing guide includes code examples.
  • err.txt
  • LICENSE.txt
    Good: Licensed under Apache-2.0.
  • pyproject.toml
    Good: Dependency manifest found (pyproject.toml).
  • README.md
    Good: README is present.
    Good: README is well structured with multiple sections.
    Good: README includes screenshots or visuals. Great for first impressions.
    Good: README has code examples.
    Good: README links to a live demo or deployed app.
    Good: README includes status badges.
    Good: README documents how to install the project.
    Good: README documents how to run the project.
  • setup.py
  • uv.lock
    Good: Lockfile present (uv.lock). Installs are reproducible.
RepoGrade badge preview

Add this badge to your README

It updates automatically each time the repo is re-graded.

[![RepoGrade](https://www.repo-grade.com/api/badge/open-thoughts/openthoughts-agent)](https://www.repo-grade.com/report/open-thoughts/openthoughts-agent)

More graded Python repos