omlx

Read the source on GitHub Project homepage

What it does

An editorial selection.

Mac menu-bar LLM server with continuous batching and a hot RAM / cold SSD KV cache.

Why it is listed

Pin everyday models, auto-swap heavier ones, and keep long contexts cached across conversations on Apple Silicon.

GitHub describes it as: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Counts were observed on 27/10/2026, 23:15:40 UTC. Observations older than 36 hours are excluded from current movement rankings.

Repository at a glance

Stars: 23,106
Forks: 2,070
Open issues: 386
Merged PRs: 1,221
Commits, last 30 days: 652
Stars, 7 days: unavailable
Stars, 30 days: unavailable

Counts observed on 27/10/2026, 23:15:40 UTC. Growth uses complete dated windows; see Methodology.

History

History: 2 observations, 2026-10-27 to 2026-10-28. Dots are observations; lines connect consecutive daily observations only.

Project details

Language: Python
Licence: Apache-2.0
Created: 13 Feb 2026
Last push: 27 Oct 2026
Latest release: v0.7.3rc1 · 27 Oct 2026
Category: Local AI Inference
Topics: apple-silicon inference-server llm macos mlx openai-api
Observed: 2026-10-27 23:15:40 UTC

Explore and get started

Use the project's own documentation for supported platforms, dependencies and installation steps. The README and release notes are maintained by jundot.

Read the README and setup instructionsFeatures, prerequisites, examples and documentation links.
Browse releases and changelogsPublished versions and the changes made between releases.
Check licence and usage termsApache-2.0 is the licence reported by GitHub; read the repository terms before use.
Read pull requestsProposed changes and development discussions.
Browse reported issuesKnown problems, feature requests and maintainer responses.

Development context

These are observations of work in the repository. They do not establish quality, security or support commitments.

Total commits on default branch: 3,519
Open pull requests: 185
Closed issues, lifetime: 1,900
Median time to close an issue: 1.8 days
Median time to merge a pull request: 0.5 days

Close and merge times use up to 20 most recently updated closed issues or merged pull requests. They omit unresolved work and are context, not a maintenance score. Sample limits.

Other projects in Local AI Inference, ordered by shared topics and then name. These are discovery links, not equivalence claims.