← Back
kklounge/nano-infer
Open-source AI ToolStatus: Published — critical fields verified, some fields unverified
kklounge/nano-infer: A from-scratch LLM inference engine for Qwen2/Qwen3: paged KV cache, continuous batching, chunked prefill, prefix caching, Triton kernels, CUDA graphs, OpenAI-compatible API
- A from-scratch LLM inference engine for Qwen2/Qwen3: paged KV cache, continuous batching, chunked prefill, prefix caching, Triton kernels, CUDA graphs, OpenAI-compatible API
Request operator identity verification
Risk
No known risk within the verified fields.
12
All fields
6
Verified
0
Verified empty
6
Unverified
Open-source AI Tool details
Repository
| Repository | https://github.com/kklounge/nano-infer |
| Ecosystem | github |
| Package | kklounge/nano-infer |
| Publisher | kklounge |
| License | MIT |
| Latest release | UNKNOWN |
| Status | ACTIVE |
| Homepage | UNKNOWN |
| Documentation | UNKNOWN |
Runtime
| Platforms | UNKNOWN |
| Runtime requirements | UNKNOWN |
| Installation | UNKNOWN |
Critical Evidence
| Field | Status | Last checked / observed / Freshness | Confidence | Evidence |
|---|---|---|---|---|
| Pricing | UNKNOWN | Not obtained | Not obtained | 0 |
| Availability | UNKNOWN | Not obtained | Not obtained | 0 |
| Language | UNKNOWN | Not obtained | Not obtained | 0 |
| Integration | UNKNOWN | Not obtained | Not obtained | 0 |
| Deployment | UNKNOWN | Not obtained | Not obtained | 0 |
| Commercial use | Verified | 2026-11-14 | Not obtained | 1 |
Functional Evidence
| Field | Status | Last checked / observed / Freshness | Confidence | Evidence |
|---|---|---|---|---|
| Capability | UNKNOWN | Not obtained | Not obtained | 0 |
| Automation behavior | UNKNOWN | Not obtained | Not obtained | 0 |
| Input | UNKNOWN | Not obtained | Not obtained | 0 |
| Output | UNKNOWN | Not obtained | Not obtained | 0 |
Change history
- 2026-11-14 Published (some fields unverified)
Registered metadata
| archived | ACTIVE |
| canonical_repository | https://github.com/kklounge/nano-infer |
| documentation_url | UNKNOWN |
| entity_kind | OPEN_SOURCE_AI_TOOL |
| homepage_url | UNKNOWN |
| installation | None |
| latest_release | UNKNOWN |
| license | MIT |
| package_ecosystem | github |
| package_identifier | kklounge/nano-infer |
| platforms | None |
| publisher | kklounge |
| runtime_requirements | None |
Field verification (12 fields)
| Field | Status | Confidence | Value | Last checked / observed | Evidence |
|---|---|---|---|---|---|
| archived | ✓ Verified | Not obtained | ACTIVE | 2026-11-14 | |
| canonical_repository | ✓ Verified | Not obtained | https://github.com/kklounge/nano-infer | 2026-11-14 | |
| documentation_url | ? Unverified | Not obtained | UNKNOWN | 2026-11-14 | No evidence |
| homepage_url | ? Unverified | Not obtained | UNKNOWN | 2026-11-14 | No evidence |
| installation | ? Unverified | Not obtained | None | 2026-11-14 | No evidence |
| latest_release | ? Unverified | Not obtained | UNKNOWN | 2026-11-14 | No evidence |
| license | ✓ Verified | Not obtained | MIT | 2026-11-14 | |
| package_ecosystem | ✓ Verified | Not obtained | github | 2026-11-14 | |
| package_identifier | ✓ Verified | Not obtained | kklounge/nano-infer | 2026-11-14 | |
| platforms | ? Unverified | Not obtained | None | 2026-11-14 | No evidence |
| publisher | ✓ Verified | Not obtained | kklounge | 2026-11-14 | |
| runtime_requirements | ? Unverified | Not obtained | None | 2026-11-14 | No evidence |