GitWorld

Search / vllm-project

vllm-project/vllm

GitHubSample

A high-throughput and memory-efficient inference engine for LLMs.

Open on GitHub

Sample dataset — host unavailable

Alternatives to vllm

Matched on shared topics and language across every indexed host — similarity, not endorsement.

  1. ollama/ollamaGitHub

    Get up and running with large language models locally.

    GoMITStars 76.2kUpdated 1h agoHealth 100 Excellent

  2. ggerganov/llama.cppGitHub

    LLM inference in C/C++ with minimal dependencies.

    C++MITStars 61.3kUpdated 1h agoHealth 97 Excellent

  3. crates/modelccrates.io

    Rust CLI that compiles LLM weights (GGUF, Safetensors, ONNX, PyTorch) into a single .modelc artifact and serves a local OpenAI-compatible inference API with Metal GPU and CPU SIMD acceleration.

    RustNo licenseStars 1Updated 30d agoHealth — Not enough data

  4. npm/rawhqnpm

    RAW CLI — #1 GPU & bare metal servers for AI companies. Deploy vLLM, Ollama, Llama, CUDA inference. CPU from $9/mo, GPU from $304/mo. 90% cheaper than AWS.

    JavaScriptMITStars 3Updated 1mo agoHealth — Not enough data

  5. @ruvector/ruvllmnpm

    Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference

    JavaScriptMIT OR Apache-2.0Stars 0Updated 11d agoHealth — Not enough data

  6. crates/forgellm-codegen-metalcrates.io

    Metal GPU code generation for Apple Silicon inference in ForgeLLM

    RustNo licenseStars 1Updated 6mo agoHealth — Not enough data