openinfer-project/openinfer
Grade a repo

0

/ 100

GradeA

Polished and well engineered. Punching above its star count.

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Documentation92
Engineering96
Health100
Rust481Apache-2.0today

Outstanding. A score of 96/100 puts this repo in a very small tier of truly well-engineered projects.

Documentation

92

Contributing guide5pt69

Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.

→ Add setup instructions, code style notes, and how to run tests.

Install and run instructions9pt90

README documents how to install the project.

README12pt100

README is present.

License6pt100

Licensed under Apache-2.0.

Engineering

96

Reproducibility6pt70

Lockfile present (Cargo.lock). Installs are reproducible.

Tests18pt100

Test files detected (openinfer-comm/tests).

CI/CD14pt100

CI is configured (.github/workflows/ci.yml).

Linting and formatting5pt100

Rust linting configured (openinfer-comm/rustfmt.toml, cargo fmt in CI).

Issue and PR templates6pt100

Issue or PR templates present.

Project health

100

Dependency manifest6pt100

Dependency manifest found (Cargo.toml).

Repository metadata5pt100

Repository has a description.

Activity5pt100

Actively maintained (pushed within the last month).

Housekeeping3pt100

.gitignore present.

Repository health signals

Activity, community, and responsiveness at scan time

Activity

  • -
    Commits (30d / 90d)
  • 70
    Forks
  • 1
    Releaseslatest 15d ago

Community

  • -
    Community health
  • -
    authors own >50% of commits
  • 481
    Watchers

Responsiveness

  • 20h
    Median issue response
  • <1h
    Median PR merge time
  • 67
    Open issues
Repository files47 root entries
  • .agents
  • .claude
  • .codex
  • .github
    Good: CI is configured (.github/workflows/ci.yml).
    Good: Issue or PR templates present.
  • bench_snapshots
  • docs
  • kvbm
  • openinfer-bench
  • openinfer-build
  • openinfer-comm
    Good: Test files detected (openinfer-comm/tests).
    Good: Rust linting configured (openinfer-comm/rustfmt.toml, cargo fmt in CI).
  • openinfer-core
  • openinfer-cupti
  • openinfer-deepseek-v2-lite
  • openinfer-deepseek-v4
  • openinfer-dynamo-backend
  • openinfer-dynamo-frontend
  • openinfer-engine
  • openinfer-kernels
  • openinfer-kimi-k2
  • openinfer-kv-cache
  • openinfer-kv-offload
  • openinfer-qwen3-4b
  • openinfer-qwen35-4b
  • openinfer-sample
  • openinfer-server
  • openinfer-sim
  • openinfer-vllm-frontend
  • openinfer-vllm-support
  • scripts
  • test_data
  • tests
  • tools
  • .gitignore
    Good: .gitignore present.
  • .gitmodules
  • .pre-commit-config.yaml
  • AGENTS.md
  • Cargo.lock
    Good: Lockfile present (Cargo.lock). Installs are reproducible.
  • Cargo.toml
    Good: Dependency manifest found (Cargo.toml).
  • CLAUDE.md
  • CONTRIBUTING.md
    Issue: Contributing guide is too short for full depth credit (−6 pts). 400+ words earns the full +12 pts.Fix: Add setup instructions, code style notes, and how to run tests.
    Issue: Contributing guide lacks a setup section (−12 pts).Fix: Show new contributors how to get a local dev environment running.
    Issue: Contributing guide lacks a code style section (−8 pts).Fix: Describe your linting/formatting rules and how to run them.
    Good: Contributing guide explains how to run tests.
    Good: Contributing guide describes the PR/review workflow.
    Issue: Contributing guide has no code examples (−5 pts).Fix: Add code blocks showing example commands for setup, running tests, and submitting a PR.
  • LICENSE
    Good: Licensed under Apache-2.0.
  • logo.png
  • NOTICE
  • NOTICE_DYNAMO
  • README.md
    Good: README is present.
    Good: README is well structured with multiple sections.
    Good: README includes screenshots or visuals. Great for first impressions.
    Good: README has code examples.
    Good: README links to a live demo or deployed app.
    Good: README includes status badges.
    Good: README documents how to install the project.
    Good: README documents how to run the project.
  • rust-toolchain.toml
  • THIRD_PARTY_LICENSES_DYNAMO.txt