Skip to content

Commit b26fb1f

Browse files
authored
format
1 parent 636223f commit b26fb1f

File tree

1 file changed

+8
-8
lines changed

1 file changed

+8
-8
lines changed

README.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -869,18 +869,18 @@ From [K8s cluster components](https://kubernetes.io/docs/concepts/architecture/)
869869
- **Edge computing**: Processing data closer to sources to reduce latency
870870
- **AI acceleration**: Specialized hardware (GPUs, TPUs, NPUs) for machine learning workloads
871871
- **Key technologies**: Azure Functions, AWS Lambda, TensorFlow, PyTorch, CUDA
872-
- Serverless (FaaSFunction as a Service) internals:
872+
- Serverless (FaaS: Function as a Service) internals:
873873
- Triggers: HTTP, queues, events, timers; scale‑to‑zero + cold starts; concurrency controls per instance.
874874
- Isolation: containers, sandboxed runtimes, or micro‑VMs (virtual machines; e.g., Firecracker); per‑request billing, idempotency + retries with DLQs (Dead‑Letter Queues).
875875
- Portable model: Knative Serving/Eventing (revisions, activator, autoscaler); CloudEvents for event metadata.
876876
- Edge computing:
877877
- Constraints: intermittent links, limited CPU/GPU (Graphics Processing Unit), data locality/privacy; patterns: streaming, windowed analytics, feature extraction at source.
878-
- Tooling: lightweight K8s (Kubernetes) distributions (k3s, AKS Edge), device plugins, OTA (Over‑The‑Air) updates, attestation (TPMTrusted Platform Module/TEETrusted Execution Environment).
878+
- Tooling: lightweight K8s (Kubernetes) distributions (k3s, AKS Edge), device plugins, OTA (Over‑The‑Air) updates, attestation (TPM: Trusted Platform Module/TEE: Trusted Execution Environment).
879879
- Protocols: MQTT (Message Queuing Telemetry Transport), OPC‑UA (Open Platform Communications Unified Architecture), gRPC (gRPC Remote Procedure Calls); 5G MEC (Multi‑access Edge Computing) for low‑latency ingress; local caches and twin models.
880880
- AI acceleration:
881-
- Hardware: GPUs (Graphics Processing Units; CUDA cores, Tensor Cores; FP32/FP16/BF16floating‑point formats/INT88‑bit integer), TPUs (Tensor Processing Units), NPUs (Neural Processing Units); memory bandwidth and interconnect (NVLink, PCIePeripheral Component Interconnect Express, InfiniBand/RDMARemote Direct Memory Access) dominate throughput.
882-
- Scheduling: K8s device plugins, GPU sharing (MPSMulti‑Process Service), partitioning (MIGMulti‑Instance GPU), NUMA (Non‑Uniform Memory Access) alignment; topology‑aware placement.
883-
- Inference pipelines: model formats (ONNXOpen Neural Network Exchange), runtimes (ONNX Runtime, TensorRT), servers (Triton), quantization/pruning/distillation for latency/cost.
881+
- Hardware: GPUs (Graphics Processing Units; CUDA cores, Tensor Cores; FP32/FP16/BF16: floating‑point formats/INT8: 8‑bit integer), TPUs (Tensor Processing Units), NPUs (Neural Processing Units); memory bandwidth and interconnect (NVLink, PCIe: Peripheral Component Interconnect Express, InfiniBand/RDMA: Remote Direct Memory Access) dominate throughput.
882+
- Scheduling: K8s device plugins, GPU sharing (MPS: Multi‑Process Service), partitioning (MIG: Multi‑Instance GPU), NUMA (Non‑Uniform Memory Access) alignment; topology‑aware placement.
883+
- Inference pipelines: model formats (ONNX: Open Neural Network Exchange), runtimes (ONNX Runtime, TensorRT), servers (Triton), quantization/pruning/distillation for latency/cost.
884884
- Data plane: zero‑copy, pinned memory, batching, dynamic shapes; autoscale on QPS (Queries Per Second)/latency SLOs (Service Level Objectives).
885885

886886
</details>
@@ -895,12 +895,12 @@ From [K8s cluster components](https://kubernetes.io/docs/concepts/architecture/)
895895
- **Tools**: Grid carbon intensity APIs, Microsoft Sustainability Calculator
896896
- **Standards**: ISO 14064, GHG Protocol, Carbon Disclosure Project
897897
- Signals and objectives:
898-
- Carbon intensity (grid gCO₂/kWhgrams of CO₂ per kilowatt‑hour): average vs marginal; real‑time + forecasts by region; combine with electricity price and datacenter PUE (Power Usage Effectiveness)/WUE (Water Usage Effectiveness).
898+
- Carbon intensity (grid gCO₂/kWh: grams of CO₂ per kilowatt‑hour): average vs marginal; real‑time + forecasts by region; combine with electricity price and datacenter PUE (Power Usage Effectiveness)/WUE (Water Usage Effectiveness).
899899
- Workload classes: deferrable (batch/ETL/ML training), movable (geo‑flex), latency‑critical (pin, optimize).
900900
- Scheduling and controls:
901901
- Time shifting: run deferrable jobs in low‑carbon windows (cron + forecasts).
902902
- Geo shifting: place in cleaner regions (multi‑region queues, policy‑aware schedulers).
903-
- Power/perf: DVFS (Dynamic Voltage and Frequency Scaling) and power caps (e.g., RAPLRunning Average Power Limit), right‑size CPU/mem, consolidate to idle whole hosts, sleep states off‑peak.
903+
- Power/perf: DVFS (Dynamic Voltage and Frequency Scaling) and power caps (e.g., RAPL: Running Average Power Limit), right‑size CPU/mem, consolidate to idle whole hosts, sleep states off‑peak.
904904
- Kubernetes patterns:
905905
- Scheduler plugins/extenders to weigh carbon score; KEDA (Kubernetes‑based Event‑Driven Autoscaling) for event‑driven pause/resume; PriorityClasses to preempt non‑critical work.
906906
- Node labels for region/zone/carbon buckets; topology spread to pack/shed; carbon‑aware HPA (Horizontal Pod Autoscaler) inputs via external metrics.
@@ -909,7 +909,7 @@ From [K8s cluster components](https://kubernetes.io/docs/concepts/architecture/)
909909
- Governance: budgets/quotas per team; dashboards and alerts on kgCO₂e (kilograms of CO₂ equivalent) per service.
910910
- Tooling and standards:
911911
- Data sources: grid carbon APIs (forecast + realtime); sustainability calculators/dashboards.
912-
- Frameworks: GHG (Greenhouse Gas) Protocol scopes 1–3; ISO (International Organization for Standardization) 14064; disclosures (CDPCarbon Disclosure Project) and internal SLOs (Service Level Objectives; energy/SKU selection).
912+
- Frameworks: GHG (Greenhouse Gas) Protocol scopes 1–3; ISO (International Organization for Standardization) 14064; disclosures (CDP: Carbon Disclosure Project) and internal SLOs (Service Level Objectives; energy/SKU selection).
913913

914914
</details>
915915

0 commit comments

Comments
 (0)