文件列表:

.devcontainer/ (0, 2023-11-13)
.devcontainer/devcontainer.json (583, 2023-11-13)
.editorconfig (30249, 2023-11-13)
CONTRIBUTING.md (5393, 2023-11-13)
LICENSE (1086, 2023-11-13)
Samples/ (0, 2023-11-13)
Samples/Plans/ (0, 2023-11-13)
Samples/Plans/Summarize.json (2019, 2023-11-13)
Samples/Plans/Summarize_Topics_ElementAt.json (3049, 2023-11-13)
... ...

# Semantic-Fleet [](https://www.nuget.org/packages/MyIA.SemanticKernel.Connectors.AI.Oobabooga/) [](https://www.nuget.org/packages/MyIA.SemanticKernel.Connectors.AI.MultiConnector/) ## Overview Semantic-Fleet is a repository designed to extend the capabilities of [Semantic Kernel](https://github.com/microsoft/semantic-kernel). It focuses on providing connectors to small large language models (e.g. Llamas), and to provide tools for distributing work to a fleet of models, with ChatGPT serving as the captain of the fleet. This repository is more than just a collection of existing connectors; it's a platform for future innovations in the .NET ecosystem for AI. ### Important: Change in Compatibility with Oobabooga We would like to inform our users that due to recent changes in the Oobabooga API (see [commit 454fcf3 from 13/11/2023](https://github.com/oobabooga/text-generation-webui/commit/454fcf39a95691f5e375c48fbc6fe6aa96f0c738)), **any versions of Oobabooga beyond this commit will no longer be supported by `semantic-fleet`**. The designer of Oobabooga has replaced the traditional API with a new one modeled after OpenAI's API. Unfortunately, we have not yet had the opportunity to update our bridge to be compatible with these changes. We are actively working to ensure compatibility in future releases, but for now, we recommend our users to: 1. **Avoid updating Oobabooga beyond the specified commit** if you wish to continue using `semantic-fleet` without interruption. 2. Stay tuned for our future updates for the support of the new Oobabooga API. We appreciate your understanding and patience as we work through these changes. ## What's On Deck? ### Oobabooga Connector A robust connector that currently covers the main Oobabooga's specific blocking and streaming completion and chat APIs. **Learn More**: - [Installing Oobabooga and Configuring Multi-Start Scripts](./docs/OOBABOOGA.md) - [Oobabooga Connector Guide](./dotnet/src/Connectors/Connectors.AI.Oobabooga/README.md) - Don't forget to check-out [notebooks](./dotnet/notebooks/README.md). They provide a great overview of what's possible with our published connectors. #### Installation Install the package via NuGet: ```bash dotnet add package MyIA.SemanticKernel.Connectors.AI.Oobabooga ``` In .Net interactive : ```csharp #r "nuget: MyIA.SemanticKernel.Connectors.AI.Oobabooga" ``` #### Quick Start Different settings are used for text and chat completion, both in blocking and streaming modes. Here's a quick example for text completion: ```csharp var settings = new OobaboogaTextCompletionSettings(endpoint: new Uri("http://localhost/"), blockingPort: 5000, streamingPort: 5005); var oobabooga = new OobaboogaTextCompletion(settings); // Get text completions var completions = await oobabooga.GetCompletionsAsync("Hello, world!", new OobaboogaCompletionRequestSettings()); ``` ### MultiConnector Why stick to one when you can have many? MultiConnector lets you integrate multiple LLMs seamlessly, optimizing for speed and cost. It intelligently offloads tasks from a primary, more expensive connector to a secondary, more cost-effective one without sacrificing reliability nor performance. **Learn More**: [MultiConnector Guide](./dotnet/src/IntegrationTests/Connectors/MultiConnector/README.md) #### Installation Install the package via NuGet: ```bash dotnet add package MyIA.SemanticKernel.Connectors.AI.MultiConnector ``` In .Net interactive : ```csharp #r "nuget: MyIA.SemanticKernel.Connectors.AI.MultiConnector ``` #### Quick Start Multiconnector has many settings controlling how to route text completion calls, and how to autmatically sample completions from a primary connector, test, evaluate and update the routing settings to use secondary connectors. ```csharp var settings = new MultiTextCompletionSettings(); // (...) Creating a primary openAiNamedCompletion and secondary oobaboogaCompletions var builder = Microsoft.SemanticKernel.Kernel.Builder; builder.WithMultiConnectorCompletionService( serviceId: null, settings: settings, mainTextCompletion: openAiNamedCompletion, setAsDefault: true, analysisTaskCancellationToken: cleanupToken.Token, otherCompletions: oobaboogaCompletions.ToArray()); var kernel = builder.Build(); // Get text completion from primary connector first var result = await kernel.RunAsync(semanticFunctionOrPlan, contextVariables, cancellationToken: cleanupToken.Token).ConfigureAwait(false); // (...) Peform analysis manually or automatically depending on settings // Get text completion from secondary connectors var optimizedResult = await kernel.RunAsync(semanticFunctionOrPlan, contextVariables, cancellationToken: cleanupToken.Token).ConfigureAwait(false); ``` For a detailed overview of how to fill the gaps, please refer to the notebooks and integration tests. ## Notebooks Want a overview of what's possible with our published connectors? Our .Net interactive notebooks are a great place to start. **Learn More**: [Notebooks Guide](./dotnet/notebooks/README.md) ## Future Directions - **Open AI API**: Oobabooga offers a dedicated extension mimicking Open AI API. It extends support to embeddings and image generation models. This will be available as a separate package. - **Probabilistic MultiConnector**: We will be adding some Infer.Net magic to make MultiConnector even smarter. More specifically, the following examples will be merged and integrated into the model vetting process. - [Student Skills](https://dotnet.github.io/infer/userguide/Student%20skills.html) - [Assessing People's Skills](https://mbmlbook.com/LearningSkills.html) - [Difficulty vs Ability](https://dotnet.github.io/infer/userguide/Difficulty%20versus%20ability.html) - [Calibrating reviews](https://dotnet.github.io/infer/userguide/Calibrating%20reviews%20of%20conference%20submissions.html) - **Spark.Net Integration**: Get ready to host a cluster of mini local LLMs. ## NuGet Packages We'll be providing NuGet packages for both the Oobabooga Connector and MultiConnector for easier integration into your projects. Here is the [Nuget Package for Oobabooga connector](https://www.nuget.org/packages/MyIA.SemanticKernel.Connectors.AI.Oobabooga/) And here is the [Nuget Package for Multiconnector](https://www.nuget.org/packages/MyIA.SemanticKernel.Connectors.AI.Multiconnector/) ## Contributing Got something to add? We'd love to see it. Check out our [contributing guidelines](./CONTRIBUTING.md). Got something you'd like to get added? Do you want those future features already? We'd love you to [get in touch](https://github.com/MyIntelligenceAgency) !

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：