Skip to content

Commit d657a0a

Browse files
committed
feat: benchmarking operator page
1 parent 9c4e779 commit d657a0a

File tree

2 files changed

+122
-0
lines changed

2 files changed

+122
-0
lines changed

pages/operators/_meta.ts

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@ const meta: Meta = {
1515
},
1616
operator: "Running an operator",
1717
pricing: "Pricing",
18+
benchmarking: "Blueprint Benchmarking",
1819
"-- Eigenlayer AVS Operators": {
1920
type: "separator",
2021
title: "Eigenlayer AVS Operators",

pages/operators/benchmarking.mdx

Lines changed: 121 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,121 @@
1+
---
2+
title: Understanding Benchmarking
3+
---
4+
5+
# Understanding Benchmarking
6+
7+
As a Tangle Network operator, you should understand how the network benchmarks your system to determine pricing for blueprints. This guide explains the automated benchmarking process and how it affects the quotes generated for your node.
8+
9+
## What is Blueprint Benchmarking?
10+
11+
Blueprint benchmarking is an automated process that measures your system's capabilities to determine:
12+
13+
- The cost to run specific blueprints on your node
14+
- The resource allocation for different blueprint types
15+
- Your node's competitive position in the operator marketplace
16+
17+
When users request quotes from your node, Tangle's pricing engine uses these benchmark results to calculate fair prices based on your hardware profile.
18+
19+
## How Benchmarking Works
20+
21+
The benchmarking process happens automatically in two key phases:
22+
23+
### 1. During Operator Registration
24+
25+
When you register as an operator, the Tangle Network automatically runs baseline benchmarks on your system:
26+
27+
- Your node's hardware capabilities are measured
28+
- A baseline profile is created for your specific hardware
29+
- This profile is stored by blueprint ID in the network
30+
- The profile is used whenever quotes are requested from your node
31+
32+
### 2. During Blueprint Execution
33+
34+
While blueprints run on your node, the system automatically monitors resource usage:
35+
36+
- Measurements are taken before blueprint execution starts
37+
- Ongoing monitoring occurs during blueprint runtime
38+
- Final measurements capture the state after completion
39+
- This data can be used for future pricing calculations
40+
41+
## Resources That Are Automatically Measured
42+
43+
The benchmarking system automatically collects metrics on these key resources:
44+
45+
| Resource | What's Measured Automatically | Why It Matters |
46+
| ----------- | ----------------------------------------- | ------------------------------------------- |
47+
| **CPU** | Utilization, Available cores, Performance | Primary factor in blueprint execution speed |
48+
| **Memory** | Available RAM, Usage patterns | Determines capacity for complex operations |
49+
| **Storage** | Available space, Read/write speeds | Affects data processing capabilities |
50+
| **Network** | Connection quality, Bandwidth | Impacts communication performance |
51+
| **GPU** | Utilization, Memory (when applicable) | Important for specialized workloads |
52+
53+
These metrics are relevant to the [Pricing Configuration](./pricing/overview.mdx#pricing-configuration) used by the network:
54+
55+
```toml
56+
# Minimal example of how metrics map to pricing
57+
[blueprint.resources]
58+
cpu = { count = 8, price_per_unit = "0.001" }
59+
memory = { count = 16384, price_per_unit = "0.00005" }
60+
storage = { count = 1024000, price_per_unit = "0.00002" }
61+
```
62+
63+
## How Benchmarking Affects Your Node's Quotes
64+
65+
The benchmark results directly influence how the pricing engine generates quotes:
66+
67+
1. When a user requests a blueprint quote from your node, the system retrieves your benchmark profile
68+
2. It applies the blueprint's resource requirements to your profile
69+
3. It calculates the quote using this formula:
70+
71+
```
72+
Quote = Base Resource Cost × Time Multiplier × Security Commitment Factor
73+
```
74+
75+
Where:
76+
77+
- **Base Resource Cost**: Derived from your node's benchmarking results
78+
- **Time Multiplier**: Adjusts cost based on how long the service will run
79+
- **Security Commitment Factor**: Based on the asset security commitments required by the request
80+
81+
### Example Scenario
82+
83+
For example, when a user requests a blueprint using 2 CPU cores, 4GB RAM, and 50GB storage for 24 hours, the pricing engine might calculate the following (note that these values are examples and do not necessarily reflect real costs):
84+
85+
```
86+
CPU: 2 cores × $0.00001 per core-second × 24 hours (in blocks) = $4.32
87+
Memory: 4096 MB × $0.000005 per MB-second × 24 hours (in blocks) = $1.024
88+
Storage: 51200 MB × $0.000002 per MB-second × 24 hours (in blocks) = $0.512
89+
90+
Base Resource Cost = $6.256
91+
```
92+
93+
The final quote would then be adjusted based on network conditions and security requirements.
94+
95+
## Viewing Benchmark Information
96+
97+
Depending upon the service or blueprint being run, you may have information or metrics available to view. This will be accessible where you submitted your request and job, but it will depend upon the blueprint in question.
98+
99+
## Frequently Asked Questions
100+
101+
**Q: Do I need to manually run benchmarks?**
102+
A: No, the benchmarking process is fully automated. It runs during registration and periodically thereafter.
103+
104+
**Q: Can I improve my benchmark scores?**
105+
A: While you can't directly modify the benchmarking process, upgrading your hardware or optimizing your system can indirectly improve your node's performance.
106+
107+
**Q: How often are benchmarks updated?**
108+
A: Benchmarks are initially created during registration and may be updated periodically or when significant system changes are detected.
109+
110+
**Q: Do benchmark results affect which jobs I receive?**
111+
A: Yes, users may choose operators based partly on performance metrics derived from benchmarks.
112+
113+
## Related Information
114+
115+
To learn more about operating on the Tangle Network, you may want to review:
116+
117+
- [Pricing Strategies](/operators/pricing)
118+
- [Node Configuration](/operators/node-basics)
119+
- [Monitoring Your Node](/operators/monitoring)
120+
121+
Understanding the benchmarking process helps you better appreciate how the Tangle Network determines pricing for blueprints running on your node.

0 commit comments

Comments
 (0)