DeepInfer

Explore and get started

Use the project's own documentation for supported platforms, dependencies and installation steps. The README and release notes are maintained by deepseek-ai.

• Read the README and setup instructionsFeatures, prerequisites, examples and documentation links.
• Browse releases and changelogsPublished versions and the changes made between releases.
• Check licence and usage termsApache-2.0 is the licence reported by GitHub; read the repository terms before use.
• Read pull requestsProposed changes and development discussions.

Development context

These are observations of work in the repository. They do not establish quality, security or support commitments.

Total commits on default branch

5

Open pull requests

190

Closed issues, lifetime

No issue tracker

Median time to close an issue

Unavailable

Median time to merge a pull request

1.0 days

Close and merge times use up to 20 most recently updated closed issues or merged pull requests. They omit unresolved work and are context, not a maintenance score. Sample limits.

Explore the same category

Other projects in Local AI Inference, ordered by shared topics and then name. These are discovery links, not equivalence claims.

• PPabhi245y/PS5LM-Plus

  llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

• LLAlexsJones/llmfit

  TUI that inspects your CPU, RAM, GPU and VRAM and tells you which open models and quantizations will run well. It can also benchmark real tokens per second.

• DSantirez/ds4

  "DwarfStar", a small native inference engine from Redis creator antirez for DeepSeek V4 Flash/PRO, GLM 5.x and Qwen3.8 on Metal, CUDA and ROCm.

• PScobanov/PS5LM

  llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8