Skip to content

Commit 75f4e8d

Browse files
Updates AI sections
1 parent f6a4f1e commit 75f4e8d

File tree

1 file changed

+27
-8
lines changed

1 file changed

+27
-8
lines changed

docs/core/whats-new/dotnet-9/overview.md

Lines changed: 27 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -62,30 +62,49 @@ The Microsoft.ML.Tokenizers library provides .NET developer with capabilities fo
6262
The latest release introduces significant new capabilities:
6363

6464
- Tokenizers
65+
- Byte-Level BPE
6566
- SentencePiece
6667
- WordPiece
67-
- BERT
68-
- CodeGen
6968
- Built-in tokenizers for the following models:
7069
- GPT (3, 3.5, 4, 4o, o1)
7170
- Llama
7271
- Phi
72+
- BERT
73+
- CodeGen
7374

7475
### Tensors
7576

76-
<!-- TODO -->
77+
In .NET 9, `TensorPrimitives` and the new `Tensor<T>` type expand AI capabilities by enabling efficient encoding, manipulation, and computation of multi-dimensional data.
78+
79+
Improvements in the latest release of System.Numerics.Tensors include:
7780

78-
### Microsoft.Extensions.AI
81+
#### TensorPrimitives
7982

80-
<!-- TODO -->
83+
- **Expanded Method Scope:** Increased from 40 to nearly 200 overloads, now including numerical operations similar to `Math`, `MathF`, and `INumber<T>`, but for spans of values.
84+
- **Performance Enhancements:** Many operations are now SIMD-optimized for better performance.
85+
- **Generic Overloads:** Supports any T that implements a certain interface, expanding beyond just spans of float values in .NET
8186

82-
### Microsoft.Extensions.VectorData
87+
#### Tensor
8388

84-
<!-- TODO -->
89+
- Builds on top of `TensorPrimitives` for efficient math operations.
90+
- Provides efficient interop with AI libraries (ML.NET, TorchSharp, ONNX Runtime) using zero copies where possible.
91+
- Enables easy and efficient data manipulation with indexing and slicing operations.
92+
93+
### Microsoft.Extensions.AI & Microsoft.Extensions.VectorData
94+
95+
.NET 9 introduces a unified layer of C# abstractions through Microsoft.Extensions.AI and Microsoft.Extensions.VectorData. These abstractions facilitate interaction with AI services, including small and large language models (SLMs and LLMs), embeddings, vector stores, and middleware.
8596

8697
## ML.NET
8798

88-
ML.NET is an open-source, cross-platform framework that enables integration of custom machine-learning models into .NET applications. The latest version, ML.NET 4.0, adds [additional tokenizer support](../../../machine-learning/whats-new/overview.md#additional-tokenizer-support) for tokenizers such as Tiktoken and models such as Llama and CodeGen. <!--Add info about `Tensor<T>` here and in what's new for ML.NET.-->
99+
ML.NET is an open-source, cross-platform framework that enables integration of custom machine-learning models into .NET applications.
100+
101+
ML.NET 4.0 brings the following improvements:
102+
103+
- New ways to programatically configure `MLContext` options.
104+
- Load ONNX models as `Stream`.
105+
- DataFrame improvements.
106+
- (Experimental) TorchSharp ports of Llama and Phi family of models.
107+
- (Experimental) CausalLM pipeline APIs
89108

90109
## .NET Aspire
91110

0 commit comments

Comments
 (0)