OllamaSharp 3.0.9
See the version list below for details.
dotnet add package OllamaSharp --version 3.0.9
NuGet\Install-Package OllamaSharp -Version 3.0.9
<PackageReference Include="OllamaSharp" Version="3.0.9" />
paket add OllamaSharp --version 3.0.9
#r "nuget: OllamaSharp, 3.0.9"
// Install OllamaSharp as a Cake Addin #addin nuget:?package=OllamaSharp&version=3.0.9 // Install OllamaSharp as a Cake Tool #tool nuget:?package=OllamaSharp&version=3.0.9
<p align="center"> <img alt="ollama" height="200px" src="https://github.com/awaescher/OllamaSharp/blob/main/Ollama.png"> </p>
OllamaSharp 🦙
OllamaSharp provides .NET bindings for the Ollama API, simplifying interaction with Ollama both locally and remotely.
Features
- Ease of use: Interact with Ollama in just a few lines of code.
- API endpoint coverage: Support for all Ollama API endpoints including chats, embeddings, listing models, pulling and creating new models, and more.
- Real-time streaming: Stream responses directly to your application.
- Progress reporting: Get real-time progress feedback on tasks like model pulling.
- Support for vision models and tools (function calling).
Usage
OllamaSharp wraps every Ollama API endpoint in awaitable methods that fully support response streaming.
The following list shows a few simple code examples.
ℹ Try our full-featured Ollama API client app OllamaSharpConsole to interact with your Ollama instance.
Initializing
// set up the client
var uri = new Uri("http://localhost:11434");
var ollama = new OllamaApiClient(uri);
// select a model which should be used for further operations
ollama.SelectedModel = "llama3.1:8b";
Listing all models that are available locally
var models = await ollama.ListLocalModels();
Pulling a model and reporting progress
await foreach (var status in ollama.PullModel("llama3.1:405b"))
Console.WriteLine($"{status.Percent}% {status.Status}");
Generating a completion directly into the console
await foreach (var stream in ollama.Generate("How are you today?"))
Console.Write(stream.Response);
Building interactive chats
var chat = new Chat(ollama);
while (true)
{
var message = Console.ReadLine();
await foreach (var answerToken in chat.Send(message))
Console.Write(answerToken);
}
// messages including their roles and tool calls will automatically be tracked within the chat object
// and are accessible via the Messages property
Credits
Icon and name were reused from the amazing Ollama project.
I would like to thank all the contributors who take the time to improve OllamaSharp. First and foremost mili-tan, who always keeps OllamaSharp in sync with the Ollama API. ❤
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
.NET Core | netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
.NET Standard | netstandard2.0 is compatible. netstandard2.1 was computed. |
.NET Framework | net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
MonoAndroid | monoandroid was computed. |
MonoMac | monomac was computed. |
MonoTouch | monotouch was computed. |
Tizen | tizen40 was computed. tizen60 was computed. |
Xamarin.iOS | xamarinios was computed. |
Xamarin.Mac | xamarinmac was computed. |
Xamarin.TVOS | xamarintvos was computed. |
Xamarin.WatchOS | xamarinwatchos was computed. |
-
.NETStandard 2.0
- Microsoft.Bcl.AsyncInterfaces (>= 8.0.0)
- System.Text.Json (>= 8.0.4)
NuGet packages (7)
Showing the top 5 NuGet packages that depend on OllamaSharp:
Package | Downloads |
---|---|
Microsoft.KernelMemory.AI.Ollama
Provide access to Ollama LLM models in Kernel Memory to generate embeddings and text |
|
Microsoft.SemanticKernel.Connectors.Ollama
Semantic Kernel connector for Ollama. Contains services for text generation, chat completion and text embeddings. |
|
Atc.SemanticKernel.Connectors.Ollama
Atc.SemanticKernel.Connectors.Ollama contains a connector for integrating with local llms through Ollama. |
|
JinHao.CodeEase.DesignerManagement.Application
Package Description |
|
Dependify.Aspire.Hosting.Ollama
Ollama support for .NET Aspire. |
GitHub repositories (4)
Showing the top 4 popular GitHub repositories that depend on OllamaSharp:
Repository | Stars |
---|---|
microsoft/kernel-memory
RAG architecture: index and query any data using LLM and natural language, track sources, show citations, asynchronous memory patterns.
|
|
dotnet/ai-samples
|
|
platformplatform/PlatformPlatform
🚀 Pre-alpha state. A platform designed for building enterprise-grade, multi-tenant products using Azure, .NET, React, TypeScript, Infrastructure as Code, etc.
|
|
lindexi/lindexi_gd
博客用到的代码
|
Version | Downloads | Last updated |
---|---|---|
4.0.0-preview.8 | 51 | 10/17/2024 |
3.0.14 | 1,104 | 10/16/2024 |
3.0.13 | 34 | 10/16/2024 |
3.0.12 | 2,844 | 10/14/2024 |
3.0.11 | 1,095 | 10/9/2024 |
3.0.10 | 5,027 | 10/4/2024 |
3.0.9 | 70 | 10/4/2024 |
3.0.8 | 7,306 | 9/26/2024 |
3.0.7 | 12,102 | 9/12/2024 |
3.0.6 | 1,123 | 9/11/2024 |
3.0.5 | 768 | 9/11/2024 |
3.0.4 | 18,533 | 9/6/2024 |
3.0.3 | 92 | 9/6/2024 |
3.0.2 | 209 | 9/5/2024 |
3.0.1 | 12,927 | 9/2/2024 |
3.0.0 | 1,611 | 8/26/2024 |
2.1.3 | 2,391 | 8/23/2024 |
2.1.2 | 1,948 | 8/19/2024 |
2.1.1 | 4,043 | 8/5/2024 |
2.0.15 | 62 | 8/5/2024 |
2.0.14 | 87 | 8/3/2024 |
2.0.13 | 1,547 | 7/29/2024 |
2.0.12 | 93 | 7/28/2024 |
2.0.11 | 99 | 7/28/2024 |
2.0.10 | 3,361 | 7/12/2024 |
2.0.9 | 85 | 7/12/2024 |
2.0.8 | 119 | 7/12/2024 |
2.0.7 | 1,431 | 7/10/2024 |
2.0.6 | 3,068 | 6/25/2024 |
2.0.5 | 94 | 6/25/2024 |
2.0.4 | 548 | 6/24/2024 |
2.0.3 | 94 | 6/24/2024 |
2.0.2 | 129 | 6/24/2024 |
2.0.1 | 3,624 | 6/5/2024 |
1.1.13 | 168 | 6/5/2024 |
1.1.12 | 326 | 6/4/2024 |
1.1.11 | 281 | 6/2/2024 |
1.1.10 | 823 | 5/31/2024 |
1.1.9 | 5,838 | 5/15/2024 |
1.1.8 | 1,343 | 5/10/2024 |
1.1.7 | 108 | 5/10/2024 |
1.1.5 | 102 | 5/10/2024 |
1.1.4 | 142 | 5/10/2024 |
1.1.3 | 102 | 5/10/2024 |
1.1.2 | 103 | 5/10/2024 |
1.1.1 | 2,946 | 3/27/2024 |
1.1.0 | 1,713 | 1/8/2024 |
1.0.4 | 282 | 12/27/2023 |
1.0.3 | 319 | 11/30/2023 |
1.0.2 | 286 | 11/5/2023 |
1.0.1 | 177 | 10/16/2023 |
1.0.0 | 1,373 | 10/16/2023 |