You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
NEAR AI Cloud provides access to leading AI models, each optimized for different use cases — from advanced reasoning and tool calling to long-context processing and multilingual tasks. All models run in secure TEE environments with transparent, pay-per-use pricing.
15
+
NEAR AI Cloud provides access to leading AI models, each optimized for different use cases ranging from advanced reasoning and tool calling to long-context processing and multilingual tasks. All models run in secure TEE environments with transparent, pay-per-use pricing.
16
16
17
17
## Quick Reference
18
18
@@ -27,6 +27,13 @@ NEAR AI Cloud provides access to leading AI models, each optimized for different
When you use traditional AI services, your data passes through systems controlled by cloud providers and AI companies. Your prompts, the AI's responses, and even the processing of your requests are all visible to these third parties. This creates serious privacy concerns for sensitive applications.
16
+
When you use traditional AI services, your data passes through systems controlled by cloud providers and AI companies. Your prompts, the AI's responses, and even the processing of your requests are all visible to these third parties. This creates serious security concerns for sensitive applications.
17
17
18
-
**Private inference solves this problem.** It ensures that AI computations happen in a completely isolated environment where no one—not the cloud provider, not the model provider, not even NEAR—can access your data. At the same time, you can independently verify that your requests were actually processed in this secure environment through cryptographic attestation.
18
+
**Private inference solves this problem.** It ensures that AI computations happen in a completely isolated environment where no one—not the cloud provider, not the model provider, not even NEAR AI can access your data. At the same time, you can independently verify that your requests were actually processed in this secure environment through cryptographic attestation.
19
19
20
20
This guide explains how NEAR AI Cloud implements private inference using Trusted Execution Environments (TEEs), the architecture that protects your data, and the security guarantees you can rely on.
21
21
22
22
---
23
23
24
24
## What is Private Inference?
25
25
26
-
Private inference is a method of running AI models where both your input data and the model's outputs remain completely hidden from everyone except you—even while the computation happens on remote servers you don't control.
26
+
Private inference is a method of running AI models where both your input data and the model's outputs remain completely hidden from everyone except the user and client even while the computation happens on remote servers you don't control.
27
27
28
28
Traditional cloud AI services require you to trust that providers won't access your data. Private inference eliminates this need for trust by using hardware-based security that makes it technically impossible for anyone to see your data, even with physical access to the servers.
29
29
@@ -56,7 +56,7 @@ NEAR AI Cloud's private inference provides three core guarantees:
56
56
</div>
57
57
<divclassName="feature-highlight-content">
58
58
<h3>Production Performance</h3>
59
-
<p>Hardware-accelerated TEEs with NVIDIA H200 GPUs deliver high-throughput inference with minimal latency overhead, making private inference practical for real-world applications.</p>
59
+
<p>Hardware-accelerated TEEs with <ahref="https://www.nvidia.com/en-us/data-center/solutions/confidential-computing/"target="_blank">NVIDIA Confidential Computing</a> deliver high-throughput inference with minimal latency overhead, making private inference practical for real-world applications.</p>
60
60
</div>
61
61
</div>
62
62
</div>
@@ -69,13 +69,13 @@ NEAR AI Cloud's private inference provides three core guarantees:
69
69
70
70
NEAR AI Cloud combines Intel TDX and NVIDIA TEE technologies to create isolated, secure environments for AI computation:
Each TEE environment generates cryptographic proofs of its integrity and configuration, enabling independent verification of the secure execution environment.
80
80
81
81
### The Inference Process
@@ -104,26 +104,7 @@ When you make a request to NEAR AI Cloud, your data flows through a secure pipel
104
104
105
105
## Architecture Overview
106
106
107
-
NEAR AI Cloud operates through a distributed architecture consisting of an LLM Gateway and a network of Private LLM Nodes:
NEAR AI Cloud operates through a distributed architecture consisting of an LLM Gateway and a network of Private LLM Nodes.
127
108
128
109
### Private LLM Nodes
129
110
@@ -151,32 +132,32 @@ The LLM Gateway serves as the central orchestration layer:
151
132
152
133
NEAR AI Cloud's private inference implements multiple layers of security to protect your data:
153
134
154
-
-**Hardware-Level Isolation**
135
+
-**Hardware-Level Isolation** :
155
136
TEEs create isolated execution environments enforced at the hardware level, preventing unauthorized access to memory and computation even from privileged system administrators or cloud providers.
156
137
157
-
-**Secure Communication**
138
+
-**Secure Communication** :
158
139
All communication between your applications and the LLM infrastructure uses end-to-end encryption, protecting data in transit from network-level attacks.
159
140
160
-
-**Cryptographic Attestation**
141
+
-**Cryptographic Attestation** :
161
142
Every TEE environment generates cryptographic proofs that verify the integrity of the execution environment, allowing you to independently confirm your computations occurred in a genuine, unmodified TEE.
162
143
163
-
-**Result Authentication**
144
+
-**Result Authentication** :
164
145
All AI outputs are cryptographically signed inside the TEE before leaving the secure environment, ensuring the authenticity and integrity of responses.
165
146
166
147
### Threat Protection
167
148
168
149
NEAR AI Cloud's architecture protects against common attack vectors:
169
150
170
-
-**Malicious Infrastructure Providers**
151
+
-**Malicious Infrastructure Providers** :
171
152
Hardware-enforced TEE isolation prevents cloud infrastructure providers from accessing your prompts, model weights, or inference results, even with physical access to servers.
172
153
173
-
-**Network-Based Attacks**
154
+
-**Network-Based Attacks** :
174
155
End-to-end encryption protects your data during transmission, preventing man-in-the-middle attacks and network eavesdropping.
175
156
176
-
-**Model Extraction Attempts**
157
+
-**Model Extraction Attempts** :
177
158
Model weights remain encrypted and isolated within the TEE, making extraction computationally infeasible even for attackers with privileged system access.
178
159
179
-
**Result Tampering**
160
+
**Result Tampering** :
180
161
Cryptographic signatures generated inside the TEE ensure that responses cannot be modified in transit without detection, maintaining the integrity of AI outputs.
[NEAR AI Cloud](https://cloud.near.ai) operates in Trusted Execution Environments (TEEs) which use cryptographic proofs to verify that your private AI conversations actually happened in secure, isolated environments - not on compromised systems or with unauthorized access.
13
+
[NEAR AI Cloud](https://cloud.near.ai) operates in Trusted Execution Environments (TEEs) which use cryptographic proofs to verify that your private AI conversations actually happened in secure, isolated environments that are not on compromised systems or with unauthorized access.
14
14
15
15
This section will show you step-by-step processes for checking these proofs, validating digital signatures, and confirming that your AI interactions haven't been tampered with.
title: NEAR AI Cloud - Private, Verifiable AI Platform
4
+
sidebar_label: Home
5
+
slug: /
6
+
description: Deploy and scale powerful language models on TEE-enabled GPUs with on-chain guarantees. Fully private, verifiable, and user-owned AI platform.
title="NEAR AI Cloud - Private, Verifiable AI Platform"
48
-
description="Deploy and scale powerful language models on TEE-enabled GPUs with on-chain guarantees. Fully private, verifiable, and user-owned AI platform."
49
-
>
39
+
<>
50
40
<HomepageHeader/>
51
41
<main>
52
42
<divclassName="container margin-vert--lg">
53
43
<divclassName="row">
54
-
<divclassName="col col--8 col--offset-2">
44
+
<divclassName="col">
55
45
<divclassName="markdown">
56
46
<divclassName={styles.lead}>
57
47
<pclassName={styles.leadCopy}>
58
48
NEAR AI runs the models you trust in secure Trusted
59
49
Execution Environments (TEEs), ensuring your data stays
60
50
completely private. Model providers, cloud providers, and
61
-
NEAR cannot access, view, or use your data for training —
62
-
your information remains yours alone.
51
+
NEAR AI cannot access, view, or use your data for training.
52
+
<br/>
53
+
<center><strong>Your information remains yours.</strong></center>
63
54
</p>
64
55
</div>
65
56
<divclassName={clsx("row",styles.featureRow)}>
@@ -134,6 +125,6 @@ export default function Home() {
0 commit comments