lucienhuangfu/eLLM
A Rust-based LLM inference framework that runs large language models on Intel Xeon CPUs with AMX acceleration.
Not currently ranked — collecting fresh signals.
star history
eLLM is an inference runtime built specifically for CPU servers (Intel Xeon/EPYC) that eliminates the need for GPUs or NPUs. It achieves low latency by computing attention head by head and runs full Prefill end to end. The framework is designed to be vLLM API compatible, allowing integration with existing ecosystems while targeting GPU-consistent numerical results.
Frequently asked
- What is lucienhuangfu/eLLM?
- A Rust-based LLM inference framework that runs large language models on Intel Xeon CPUs with AMX acceleration.
- Is eLLM open source?
- Yes — lucienhuangfu/eLLM is open source, released under the Apache-2.0 license.
- What language is eLLM written in?
- lucienhuangfu/eLLM is primarily written in Rust.
- How popular is eLLM?
- lucienhuangfu/eLLM has 424 stars on GitHub.
- Where can I find eLLM?
- lucienhuangfu/eLLM is on GitHub at https://github.com/lucienhuangfu/eLLM.