SciSharp/LLamaSharp
A C#/.NET library for efficient local LLM inference using llama.cpp with CPU/GPU acceleration.
Not currently ranked — collecting fresh signals.
star history
LLamaSharp is a cross-platform library that enables running LLaMA and LLaVA models on local devices with efficient inference on both CPU and GPU backends. It provides higher-level APIs and built-in RAG support for deploying large language models in .NET applications. The library integrates with Microsoft Semantic Kernel and kernel-memory, and supports multiple backends including CUDA and Vulkan.
Frequently asked
- What is SciSharp/LLamaSharp?
- A C#/.NET library for efficient local LLM inference using llama.cpp with CPU/GPU acceleration.
- Is LLamaSharp open source?
- Yes — SciSharp/LLamaSharp is open source, released under the MIT license.
- What language is LLamaSharp written in?
- SciSharp/LLamaSharp is primarily written in C#.
- How popular is LLamaSharp?
- SciSharp/LLamaSharp has 3.7k stars on GitHub.
- Where can I find LLamaSharp?
- SciSharp/LLamaSharp is on GitHub at https://github.com/SciSharp/LLamaSharp.