Search results for inference
Searching…
Keyboard: / search · j k move · Enter open · n p page
LLM inference in C/C++ with minimal dependencies.
LLM inference in C/C++ with minimal dependencies.
- Stack fit
- C++
- 62% of the codebase
- License
- MIT
- Activity
- Commits this week
- 0 days since last commit
- Tags
- inference
- Topics overlap your query
C++MIT61.3kForks 8.7kUpdated 1h agoHealth 97 Excellent
A high-throughput and memory-efficient inference engine for LLMs.
A high-throughput and memory-efficient inference engine for LLMs.
- Stack fit
- Python
- 82% of the codebase
- License
- Apache-2.0
- Activity
- Commits this week
- 0 days since last commit
- Tags
- inference
- Topics overlap your query
PythonApache-2.022.8kForks 3.2kUpdated 3h agoHealth 98 Excellent
Get up and running with large language models locally.
Get up and running with large language models locally.
- Stack fit
- Go
- 78% of the codebase
- License
- MIT
- Activity
- Commits this week
- 0 days since last commit
- Tags
- local-inference
- Topics overlap your query
GoMIT76.2kForks 5.7kUpdated 1h agoHealth 100 Excellent
Robust speech recognition via large-scale weak supervision.
PythonMIT63.4kUpdated 1mo agoHealth 46 At risk