MLX Omni Server is a model inference serving system designed for Apple Silicon (M1-M4 chips). It leverages Apple’s MLX framework for hardware-accelerated local inference and implements OpenAI and Anthropic API-compatible endpoints, allowing drop-in replacement with existing SDKs. The server supports a complete AI suite including chat, speech-to-speech, text-to-speech, image generation, and embeddings.