Skip to content

Latest commit

 

History

History
148 lines (115 loc) · 4.37 KB

README.md

File metadata and controls

148 lines (115 loc) · 4.37 KB

talos cluster setup

nodes

k8s-cp

This is a control plane node

  • MAC: 00:1e:06:45:0b:cd
  • IP: 10.0.7.54
  • CPU: Intel Celeron J4105 (Gemini Lake, 4 cores, 4 threads)
  • RAM: 32GB
  • Disk: host - 500GB - /dev/nvme0n1
  • GPU: Intel UHD Graphics 600 (Gen 9.5, 12 EUs, QuickSync Gen 9.5) - present but not configured for workloads

k8s-0

2025-01-02: retired this node as it was replaced by k8s-cp

k8s-a

This is a worker node that runs via proxmox VM on nas.home

  • MAC: BC:24:11:F1:D5:9B (hard-coded)
  • IP: 10.0.7.51
  • CPU: Intel Core i5-9500T (Coffee Lake, 4 cores allocated from 6-core host, 4 threads, host passthrough)
  • RAM: VM - 32GB
  • Disk: VM - 200GB - /dev/sda
  • Disk: SSD for ceph - 1TB /dev/sdb - (/dev/disk/by-id/wwn-0x5002538c000fc6fd passthrough from the host)
  • GPU: Intel UHD Graphics 630 (Coffee Lake, Gen 9.5, 24 EUs, QuickSync Gen 9.5) via Intel GVT-g passthrough
    • Because I will probably forget this, the i915-GVTg_V5_1 mdev device is possible to use only because the BIOS setting for the GPU memory were increased from the default value to the max value.
    • The benefit of using a 'larger' (smaller suffix number) mdev device is that it has more memory/compute capacity than the smaller mdev devices and will improve transocindg performance. See here and here for more information
sudo qm create 502 \
  --name k8s-a \
  --ostype l26 \
  --machine q35 \
  --memory 32768 \
  --cores 4 \
  --cpu host \
  --agent "enabled=1,fstrim_cloned_disks=1" \
  --bios ovmf \
  --net0 "model=virtio,macaddr=BC:24:11:F1:D5:9B,bridge=br0" \
  --scsihw virtio-scsi-single \
  --efidisk0 "ssdtank-proxmox:1,efitype=4m" \
  --scsi0 "ssdtank-proxmox:200,backup=0,iothread=1,ssd=1,discard=on" \
  --ide2 tank-proxmox:iso/metal-amd64.iso,media=cdrom \
  --hostpci0 "0000:00:02.0,mdev=i915-GVTg_V5_1,pcie=1" \
  --scsi1 "/dev/disk/by-id/wwn-0x5002538c000fc6fd,backup=0,iothread=1,ssd=1,discard=on"

k8s-b

This is a worker node, bare-metal

  • MAC: 00:02:c9:57:5c:a8
  • IP: 10.0.7.52
  • CPU: Intel Core i3-7100 (Kaby Lake, 2 cores, 4 threads)
  • RAM: 32GB
  • Disk: host - 500GB - /dev/nvme0n1
  • Disk: SSD for ceph - 2TB /dev/sda - (/dev/disk/by-id/wwn-0x5002538c000fc709)
  • GPU: Intel HD Graphics 630 (Kaby Lake, Gen 9.5, 24 EUs, QuickSync Gen 9)

k8s-c

This is a worker node, bare-metal

  • MAC: ac:1f:6b:6f:27:5f
  • IP: 10.0.7.53
  • CPU: Intel Xeon D-1518 (Broadwell-DE, 8 cores, 8 threads)
  • RAM: 64GB
  • Disk: host - 1TB - /dev/nvme0n1
  • Disk: SSD for ceph - 2TB /dev/sda - (/dev/disk/by-id/wwn-0x5002538c000cdf0f)
  • GPU: ASPEED AST2400 BMC (not suitable for compute workloads)

k8s-d

2025-01-02: retired this node as it was repurposed for the control plane

k8s-e

This is a worker node, bare-metal

  • MAC: 00:02:c9:55:b4:26
  • IP: 10.0.7.55
  • CPU: AMD Ryzen 3 3200G (Zen+, 4 cores, 4 threads)
  • RAM: 32GB
  • Disk: host - 256GB - /dev/sdb
  • Disk: SSD for ceph = 2TB - /dev/sda - note this is /dev/sda - (/dev/disk/by-id/wwn-0x5002538c000e0a55)
  • GPU: AMD Radeon Vega 8 Graphics (integrated)

k8s-f

This is a worker node, bare-metal

  • MAC: 68:1d:ef:34:d8:1a
  • IP: 10.0.7.56
  • CPU: Intel N100 (Alder Lake-N, 4 cores, 4 threads)
  • RAM: 16GB
  • Disk: host - 1TB - /dev/nvme0n1
  • GPU: Intel UHD Graphics (Gen 12 Xe, 24 EUs, QuickSync Gen 12 with AV1 encode/decode)

k8s-g

This is a worker node, bare-metal

  • MAC: 68:1d:ef:34:66:3f
  • IP: 10.0.7.57
  • CPU: Intel N100 (Alder Lake-N, 4 cores, 4 threads)
  • RAM: 16GB
  • Disk: host - 1TB - /dev/nvme0n1
  • GPU: Intel UHD Graphics (Gen 12 Xe, 24 EUs, QuickSync Gen 12 with AV1 encode/decode)

k8s-h

This is a worker node, bare-metal

  • MAC: 68:1d:ef:34:d9:c7
  • IP: 10.0.7.58
  • CPU: Intel N100 (Alder Lake-N, 4 cores, 4 threads)
  • RAM: 16GB
  • Disk: host - 1TB - /dev/nvme0n1
  • GPU: Intel UHD Graphics (Gen 12 Xe, 24 EUs, QuickSync Gen 12 with AV1 encode/decode)

k8s-i

This is a worker node, bare-metal

  • MAC: 98:fa:9b:04:47:b9
  • IP: 10.0.7.59
  • CPU: Intel Core i5-8500T (Coffee Lake, 6 cores, 6 threads)
  • RAM: 16GB
  • Disk: host - 128GB - /dev/nvme0n1
  • Disk: SSD for ceph - 1TB /dev/sda - (/dev/disk/by-id/wwn-0x5002538800374ff9)
  • GPU: Intel UHD Graphics 630 (Coffee Lake, Gen 9.5, 24 EUs, QuickSync Gen 9.5)