You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/core/whats-new/dotnet-9/overview.md
+27-8Lines changed: 27 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -62,30 +62,49 @@ The Microsoft.ML.Tokenizers library provides .NET developer with capabilities fo
62
62
The latest release introduces significant new capabilities:
63
63
64
64
- Tokenizers
65
+
- Byte-Level BPE
65
66
- SentencePiece
66
67
- WordPiece
67
-
- BERT
68
-
- CodeGen
69
68
- Built-in tokenizers for the following models:
70
69
- GPT (3, 3.5, 4, 4o, o1)
71
70
- Llama
72
71
- Phi
72
+
- BERT
73
+
- CodeGen
73
74
74
75
### Tensors
75
76
76
-
<!-- TODO -->
77
+
In .NET 9, `TensorPrimitives` and the new `Tensor<T>` type expand AI capabilities by enabling efficient encoding, manipulation, and computation of multi-dimensional data.
78
+
79
+
Improvements in the latest release of System.Numerics.Tensors include:
77
80
78
-
###Microsoft.Extensions.AI
81
+
#### TensorPrimitives
79
82
80
-
<!-- TODO -->
83
+
-**Expanded Method Scope:** Increased from 40 to nearly 200 overloads, now including numerical operations similar to `Math`, `MathF`, and `INumber<T>`, but for spans of values.
84
+
-**Performance Enhancements:** Many operations are now SIMD-optimized for better performance.
85
+
-**Generic Overloads:** Supports any T that implements a certain interface, expanding beyond just spans of float values in .NET
81
86
82
-
###Microsoft.Extensions.VectorData
87
+
#### Tensor
83
88
84
-
<!-- TODO -->
89
+
- Builds on top of `TensorPrimitives` for efficient math operations.
90
+
- Provides efficient interop with AI libraries (ML.NET, TorchSharp, ONNX Runtime) using zero copies where possible.
91
+
- Enables easy and efficient data manipulation with indexing and slicing operations.
.NET 9 introduces a unified layer of C# abstractions through Microsoft.Extensions.AI and Microsoft.Extensions.VectorData. These abstractions facilitate interaction with AI services, including small and large language models (SLMs and LLMs), embeddings, vector stores, and middleware.
85
96
86
97
## ML.NET
87
98
88
-
ML.NET is an open-source, cross-platform framework that enables integration of custom machine-learning models into .NET applications. The latest version, ML.NET 4.0, adds [additional tokenizer support](../../../machine-learning/whats-new/overview.md#additional-tokenizer-support) for tokenizers such as Tiktoken and models such as Llama and CodeGen. <!--Add info about `Tensor<T>` here and in what's new for ML.NET.-->
99
+
ML.NET is an open-source, cross-platform framework that enables integration of custom machine-learning models into .NET applications.
100
+
101
+
ML.NET 4.0 brings the following improvements:
102
+
103
+
- New ways to programatically configure `MLContext` options.
104
+
- Load ONNX models as `Stream`.
105
+
- DataFrame improvements.
106
+
- (Experimental) TorchSharp ports of Llama and Phi family of models.
0 commit comments