Search results for llm
Searching…
Keyboard: / search · j k move · Enter open · n p page
A high-throughput and memory-efficient inference engine for LLMs.
A high-throughput and memory-efficient inference engine for LLMs.
- Stack fit
- Python
- 82% of the codebase
- License
- Apache-2.0
- Activity
- Commits this week
- 0 days since last commit
- Tags
- llm
- Topics overlap your query
PythonApache-2.022.8kForks 3.2kUpdated 3h agoHealth 98 Excellent
LLM inference in C/C++ with minimal dependencies.
LLM inference in C/C++ with minimal dependencies.
- Stack fit
- C++
- 62% of the codebase
- License
- MIT
- Activity
- Commits this week
- 0 days since last commit
- Tags
- llm
- Topics overlap your query
C++MIT61.3kForks 8.7kUpdated 1h agoHealth 97 Excellent
Build context-aware reasoning applications and AI agents.
Build context-aware reasoning applications and AI agents.
- Stack fit
- Python
- 96% of the codebase
- License
- MIT
- Activity
- Commits this week
- 0 days since last commit
- Tags
- llm
- Topics overlap your query
PythonMIT88kForks 13.8kUpdated 1h agoHealth 100 Excellent
Get up and running with large language models locally.
GoMIT76.2kUpdated 1h agoHealth 100 Excellent
User-friendly self-hosted web UI for local and remote LLMs.
SvelteMIT26.9kUpdated 3h agoHealth 94 Excellent
The AI-native open-source embedding database.
PythonApache-2.014.2kUpdated 11h agoHealth 90 Excellent