Microsoft Releases Azure AI Inference SDK For .NET
Written by Kay Ewbank   
Thursday, 26 September 2024

Microsoft has introduced an Azure AI Inference SDK for .NET. The SDK can be used to access and use AI models from the Azure AI Model Catalog for inference tasks like chat in .NET applications.

The SDK joins other recent additions by Microsoft including the OpenAI library for .NET and the AI Toolkit for Visual Studio Code.

net2

The Model Catalog in Azure AI Studio can be used to browse through AI models and deploy them, either to Managed Compute or as a Serverless API.  The model catalog was first introduced in early 2023, featuring a "curated selection of open-source models". The latest version of the catalog includes models from a range of providers including Azure OpenAI Service, Mistral, Meta, Cohere, NVIDIA, and Hugging Face. In addition to deploying existing models, users can request new ones.

Microsoft says the advantage of the catalog is that serverless API deployments remove the complexity of having to host and provision the hardware to run the models. When deploying models with serverless API, you don't need quota to host them and you are billed per token.

The language models from the catalog come with default configurations of Azure AI Content Safety moderation filters which detect harmful content.

ai model catalog

The models in the catalog are organized into three collections: Curated by Azure AI, Azure OpenAI Models, and Open Models from Hugging Face Hub. 

The Curated by Azure AI collection is a collection of non-Microsoft models optimized for the Azure platform. The Azure OpenAI Models are Microsoft-specific models available exclusively through Azure OpenAI Service. The final group are the Open Models from Hugging Face Hub. This extensive collection is made up of hundreds of models from Hugging Face for real-time inference.

If you can't find the model you want, you can request a new model via an online form and hope that it's popular enough to be developed.

The Azure AI Inference SDK for .NET is available now.

net2

More Information

What is the Azure AI Model Catalog?

Related Articles

Azure Data Box Improves Offline Data Migration

Microsoft Goes All Out On Generative AI

Azure AI And Pgvector Run Generative AI Directly On Postgres

Microsoft Updates Azure Cognitive Services

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Ilya Sutskever Raise $1 Billion To Research Safe AI
11/09/2024

Safe Superintelligence, the company co-founded by Ilya Sutskever after he resigned from Open AI, has raised $1billion in cash funding, despite the fact that it intends not to release any products [ ... ]



OpenAI o1 Thinks Before It Answers
13/09/2024

OpenAI has unveiled a new series of AI models that can reason through complex task and solve hard problems. The first fruit of OpenAI's "Strawberry Project", o1-preview is now available in ChatGP [ ... ]


More News

kotlin book

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 26 September 2024 )