SignalRashin logo

SignalRashin

日本語
← Back

SapnilPatel/llm-inference-optimizer

Open-source AI Tool
Status: Published — critical fields verified, some fields unverified
SapnilPatel/llm-inference-optimizer: High-throughput, low-latency LLM inference platform for LLaMA-3 & Mistral — dynamic batching, KV-cache optimization, FP16/BF16 mixed precision, tensor parallelism, with PyTorch profiling, Prometheus/Grafana observability, Docker & Kubernetes (HPA) deployment.
- High-throughput, low-latency LLM inference platform for LLaMA-3 & Mistral — dynamic batching, KV-cache optimization, FP16/BF16 mixed precision, tensor parallelism, with PyTorch profiling, Prometheus/Grafana observability, Docker & Kubernetes (HPA) deployment.

Request operator identity verification

Risk

No known risk within the verified fields.

12
All fields
6
Verified
0
Verified empty
6
Unverified

Open-source AI Tool details

Repository

Repositoryhttps://github.com/SapnilPatel/llm-inference-optimizer
Ecosystemgithub
PackageSapnilPatel/llm-inference-optimizer
PublisherSapnilPatel
LicenseMIT
Latest releaseUNKNOWN
StatusACTIVE
HomepageUNKNOWN
DocumentationUNKNOWN

Runtime

PlatformsUNKNOWN
Runtime requirementsUNKNOWN
InstallationUNKNOWN

Critical Evidence

FieldStatusLast checked / observed / FreshnessConfidenceEvidence
PricingUNKNOWNNot obtainedNot obtained0
AvailabilityUNKNOWNNot obtainedNot obtained0
LanguageUNKNOWNNot obtainedNot obtained0
IntegrationUNKNOWNNot obtainedNot obtained0
DeploymentUNKNOWNNot obtainedNot obtained0
Commercial useVerified2026-11-19Not obtained1

Functional Evidence

FieldStatusLast checked / observed / FreshnessConfidenceEvidence
CapabilityUNKNOWNNot obtainedNot obtained0
Automation behaviorUNKNOWNNot obtainedNot obtained0
InputUNKNOWNNot obtainedNot obtained0
OutputUNKNOWNNot obtainedNot obtained0

Change history

  • 2026-11-19 Published (some fields unverified)

Registered metadata

archivedACTIVE
canonical_repositoryhttps://github.com/SapnilPatel/llm-inference-optimizer
documentation_urlUNKNOWN
entity_kindOPEN_SOURCE_AI_TOOL
homepage_urlUNKNOWN
installationNone
latest_releaseUNKNOWN
licenseMIT
package_ecosystemgithub
package_identifierSapnilPatel/llm-inference-optimizer
platformsNone
publisherSapnilPatel
runtime_requirementsNone

Field verification (12 fields)

FieldStatusConfidenceValueLast checked / observedEvidence
archived✓ VerifiedNot obtainedACTIVE
2026-11-19
canonical_repository✓ VerifiedNot obtainedhttps://github.com/SapnilPatel/llm-inference-optimizer
2026-11-19
documentation_url? UnverifiedNot obtainedUNKNOWN
2026-11-19
No evidence
homepage_url? UnverifiedNot obtainedUNKNOWN
2026-11-19
No evidence
installation? UnverifiedNot obtainedNone
2026-11-19
No evidence
latest_release? UnverifiedNot obtainedUNKNOWN
2026-11-19
No evidence
license✓ VerifiedNot obtainedMIT
2026-11-19
package_ecosystem✓ VerifiedNot obtainedgithub
2026-11-19
package_identifier✓ VerifiedNot obtainedSapnilPatel/llm-inference-optimizer
2026-11-19
platforms? UnverifiedNot obtainedNone
2026-11-19
No evidence
publisher✓ VerifiedNot obtainedSapnilPatel
2026-11-19
runtime_requirements? UnverifiedNot obtainedNone
2026-11-19
No evidence