diff --git a/docs/epyc.lstopo.svg b/docs/epyc.lstopo.svg index 6c0d2ec..4b13ca6 100644 --- a/docs/epyc.lstopo.svg +++ b/docs/epyc.lstopo.svg @@ -1,7 +1,7 @@ - - - Machine (126GB total) + + + Machine (252GB total) Package L#0 @@ -153,18 +153,18 @@ PU L#127 P#127 - NUMANode L#0 P#0 (126GB) + NUMANode L#0 P#0 (252GB) 7.9 - 4.0 - - 0.2 - - 1.0 - + 3.9 + + 0.2 + + 1.0 + @@ -178,52 +178,56 @@ + 3.9 - - PCI 43:00.0 - - - - 0.2 - - - - - - - PCI 46:00.0 - - - - 1.0 - - 1.0 - - - PCI 48:00.0 - - Net eno1 - - PCI 48:00.1 - - Net eno2 + + PCI 42:00.0 + + Block nvme1n1 + 3726 GB + + + + 0.2 + + + + + + + PCI 45:00.0 + + + + 1.0 + + 1.0 + + + PCI 47:00.0 + + Net nat-lan + + PCI 47:00.1 + + Net wan MemoryModule MemoryModule - - MemoryModule - - MemoryModule - - MemoryModule - - MemoryModule - - MemoryModule - - MemoryModule - - Host: epyc - Date: Mon 05 Jun 2023 03:19:33 PM UTC + + MemoryModule + + MemoryModule + + MemoryModule + + MemoryModule + + MemoryModule + + MemoryModule + + Host: epyc + Date: Mon 04 Mar 2024 12:28:26 AM UTC diff --git a/docs/epyc.md b/docs/epyc.md index bd39c52..e26978d 100644 --- a/docs/epyc.md +++ b/docs/epyc.md @@ -1,20 +1,25 @@ # epyc ``` -System: Host: epyc Kernel: 6.1.31 x86_64 bits: 64 compiler: gcc v: 12.2.0 - parameters: initrd=\efi\nixos\11cjvasd1nh1dk783alsa14v4w00d467-initrd-linux-6.1.31-initrd.efi - init=/nix/store/9lnrp5ryf7gh3j94q8xn39zyl21kaw9f-nixos-system-epyc-23.05.419.3a70dd92993/init +System: Host: epyc Kernel: 6.7.7 x86_64 bits: 64 compiler: gcc v: 12.3.0 + parameters: initrd=\efi\nixos\48dkb2vcxwmxxfk7wpl0qx884ibz5gk5-initrd-linux-6.7.7-initrd.efi + init=/nix/store/vz6r23gya5q3b8lr1yiadkv6h5lcjmmz-nixos-system-epyc-23.11pre-git/init + console=tty0 console=ttyS0,115200 pci=realloc console=ttyS1,115200n8 console=tty1 loglevel=4 - Console: N/A Distro: NixOS 23.05 (Stoat) + Console: N/A Distro: NixOS 23.11 (Tapir) Machine: Type: Server System: Supermicro product: Super Server v: 0123456789 serial: 0123456789 Chassis: type: 17 v: 0123456789 serial: 0123456789 Mobo: Supermicro model: H12SSL-i v: 1.01 serial: WM21AS601818 UEFI: American Megatrends v: 2.4 date: 04/14/2022 -Memory: RAM: total: 125.64 GiB used: 2.32 GiB (1.8%) +Memory: RAM: total: 251.54 GiB used: 4.56 GiB (1.8%) Array-1: capacity: 4 TiB note: check slots: 8 EC: Multi-bit ECC max-module-size: 512 GiB note: est. - Device-1: DIMMA1 size: No Module Installed - Device-2: DIMMB1 size: No Module Installed + Device-1: DIMMA1 size: 64 GiB speed: 3200 MT/s type: DDR4 + detail: synchronous registered (buffered) bus-width: 64 bits total: 72 bits + manufacturer: Samsung part-no: M393A8G40AB2-CWE serial: H0S100013847D8748B + Device-2: DIMMB1 size: 64 GiB speed: 3200 MT/s type: DDR4 + detail: synchronous registered (buffered) bus-width: 64 bits total: 72 bits + manufacturer: Samsung part-no: M393A8G40AB2-CWE serial: H0MK00013847D79D40 Device-3: DIMMC1 size: 64 GiB speed: 3200 MT/s type: DDR4 detail: synchronous registered (buffered) bus-width: 64 bits total: 72 bits manufacturer: Samsung part-no: M393A8G40AB2-CWE serial: Y10R120249249E38E1 @@ -27,7 +32,7 @@ Memory: RAM: total: 125.64 GiB used: 2.32 GiB (1.8%) Device-8: DIMMH1 size: No Module Installed PCI Slots: Slot: 1 type: x16 PCI Express 4 x16 CPU SLOT1 PCI-E 4.0 X16 status: Available length: Long - Slot: 2 type: x8 PCI Express 4 x8 CPU SLOT2 PCI-E 4.0 X8 status: In Use length: Long + Slot: 2 type: x8 PCI Express 4 x8 CPU SLOT2 PCI-E 4.0 X8 status: Available length: Long Slot: 3 type: x16 PCI Express 4 x16 CPU SLOT3 PCI-E 4.0 X16 status: Available length: Long Slot: 4 type: x8 PCI Express 4 x8 CPU SLOT4 PCI-E 4.0 X8 status: Available length: Long @@ -40,16 +45,16 @@ PCI Slots: Slot: 1 type: x16 PCI Express 4 x16 CPU SLOT1 PCI-E 4.0 X16 status: A Slot: N/A type: x4 M.2 Socket 3 PCI-E M.2-M1 status: Available length: Short Slot: N/A type: x4 M.2 Socket 3 PCI-E M.2-M2 status: Available length: Short CPU: Info: 64-Core model: AMD EPYC 7763 socket: SP3 bits: 64 type: MT MCP arch: Zen 3 - family: 19 (25) model-id: 1 stepping: 1 microcode: A0011CE cache: L1: 4 MiB L2: 32 MiB + family: 19 (25) model-id: 1 stepping: 1 microcode: A0011D3 cache: L1: 4 MiB L2: 32 MiB L3: 256 MiB - flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm bogomips: 627203 + flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm bogomips: 627200 Speed: 2450 MHz min/max: 1500/2450 MHz base/boost: 2450/3525 boost: enabled volts: 1.1 V ext-clock: 100 MHz Core speeds (MHz): 1: 2450 2: 2450 3: 2450 4: 2450 5: 2450 6: 2450 7: 2450 8: 2450 9: 2450 10: 2450 11: 2450 12: 2450 13: 2450 14: 2450 - 15: 2450 16: 2450 17: 2450 18: 2450 19: 2450 20: 2450 21: 1799 22: 2450 23: 2450 + 15: 2450 16: 2450 17: 2450 18: 2450 19: 2450 20: 2450 21: 2450 22: 2450 23: 2450 24: 2450 25: 2450 26: 2450 27: 2450 28: 2450 29: 2450 30: 2450 31: 2450 32: 2450 33: 2450 34: 2450 35: 2450 36: 2450 37: 2450 38: 2450 39: 2450 40: 2450 41: 2450 - 42: 2450 43: 2450 44: 3525 45: 2450 46: 2450 47: 2450 48: 2450 49: 2450 50: 2450 + 42: 2450 43: 2450 44: 2450 45: 3525 46: 2450 47: 2450 48: 2450 49: 2450 50: 2450 51: 2450 52: 2450 53: 2450 54: 2450 55: 2450 56: 2450 57: 2450 58: 2450 59: 2450 60: 2450 61: 2450 62: 2450 63: 2450 64: 2450 65: 2450 66: 2450 67: 2450 68: 2450 69: 2450 70: 2450 71: 2450 72: 2450 73: 2450 74: 2450 75: 2450 76: 2450 77: 2450 @@ -57,14 +62,16 @@ CPU: Info: 64-Core model: AMD EPYC 7763 socket: SP3 bits: 64 type: MT MCP 87: 2450 88: 2450 89: 2450 90: 2450 91: 2450 92: 2450 93: 2450 94: 2450 95: 2450 96: 2450 97: 2450 98: 2450 99: 2450 100: 2450 101: 2450 102: 2450 103: 2450 104: 2450 105: 2450 106: 2450 107: 2450 108: 2450 109: 2450 110: 2450 111: 2450 112: 2450 - 113: 2450 114: 2450 115: 2450 116: 2450 117: 2450 118: 1799 119: 2450 120: 2450 + 113: 2450 114: 2450 115: 2450 116: 2450 117: 2450 118: 2450 119: 2450 120: 2450 121: 2450 122: 2450 123: 2450 124: 2450 125: 2450 126: 2450 127: 2450 128: 2450 - Vulnerabilities: Type: itlb_multihit status: Not affected + Vulnerabilities: Type: gather_data_sampling status: Not affected + Type: itlb_multihit status: Not affected Type: l1tf status: Not affected Type: mds status: Not affected Type: meltdown status: Not affected Type: mmio_stale_data status: Not affected Type: retbleed status: Not affected + Type: spec_rstack_overflow mitigation: Safe RET Type: spec_store_bypass mitigation: Speculative Store Bypass disabled via prctl Type: spectre_v1 mitigation: usercopy/swapgs barriers and __user pointer sanitization Type: spectre_v2 mitigation: Retpolines, IBPB: conditional, IBRS_FW, STIBP: always-on, @@ -72,50 +79,47 @@ CPU: Info: 64-Core model: AMD EPYC 7763 socket: SP3 bits: 64 type: MT MCP Type: srbds status: Not affected Type: tsx_async_abort status: Not affected Graphics: Device-1: ASPEED Graphics Family vendor: Super Micro H12SSL-i driver: ast v: kernel - bus-ID: 46:00.0 chip-ID: 1a03:2000 class-ID: 0300 + bus-ID: 45:00.0 chip-ID: 1a03:2000 class-ID: 0300 Display: server: No display server data found. Headless machine? tty: N/A Message: Advanced graphics data unavailable in console for root. Audio: Message: No device data found. -Network: Device-1: Intel 82599ES 10-Gigabit SFI/SFP+ Network driver: N/A modules: ixgbe - port: 1000 bus-ID: 43:00.0 chip-ID: 8086:10fb class-ID: 0200 +Network: Device-1: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe vendor: Super Micro H12SSL-i + driver: tg3 v: kernel port: N/A bus-ID: 47:00.0 chip-ID: 14e4:165f class-ID: 0200 + IF: nat-lan state: up speed: 1000 Mbps duplex: full mac: 3c:ec:ef:7e:bd:c8 + IP v4: 10.32.65.13/20 type: dynamic scope: global + IP v6: fe80::3eec:efff:fe7e:bdc8/64 virtual: proto kernel_ll scope: link Device-2: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe vendor: Super Micro H12SSL-i - driver: tg3 v: kernel port: 2000 bus-ID: 48:00.0 chip-ID: 14e4:165f class-ID: 0200 - IF: eno1 state: up speed: 1000 Mbps duplex: full mac: 3c:ec:ef:7e:bd:c8 - IP v4: 10.32.65.13/20 type: dynamic noprefixroute scope: global broadcast: 10.32.79.255 - IP v6: fe80::3eec:efff:fe7e:bdc8/64 scope: link - Device-3: Broadcom NetXtreme BCM5720 Gigabit Ethernet PCIe vendor: Super Micro H12SSL-i - driver: tg3 v: kernel port: 2000 bus-ID: 48:00.1 chip-ID: 14e4:165f class-ID: 0200 - IF: eno2 state: up speed: 1000 Mbps duplex: full mac: 3c:ec:ef:7e:bd:c9 - IP v4: 169.254.249.6/16 type: noprefixroute scope: global broadcast: 169.254.255.255 - IP v6: 2001:470:ca5e:dee:587c:7a50:f36c:cae8/64 type: temporary dynamic scope: global - IP v6: 2001:470:ca5e:dee:3eec:efff:fe7e:bdc9/64 type: dynamic mngtmpaddr noprefixroute - scope: global - IP v6: fe80::3eec:efff:fe7e:bdc9/64 scope: link - IF-ID-1: enp74s0f3u1u2c2 state: unknown speed: -1 duplex: half mac: be:3a:f2:b6:05:9f - IP v4: 169.254.3.1/24 type: dynamic noprefixroute scope: global - broadcast: 169.254.3.255 - IP v6: fe80::bc3a:f2ff:feb6:59f/64 scope: link + driver: tg3 v: kernel port: N/A bus-ID: 47:00.1 chip-ID: 14e4:165f class-ID: 0200 + IF: wan state: up speed: 1000 Mbps duplex: full mac: 3c:ec:ef:7e:bd:c9 + IP v6: 2001:bc8:38ee:100::500/128 scope: global + IP v6: fe80::3eec:efff:fe7e:bdc9/64 virtual: proto kernel_ll scope: link + IF-ID-1: enp73s0f3u1u2c2 state: down mac: be:3a:f2:b6:05:9f WAN IP: 82.65.118.1 Bluetooth: Device-1: Insyde RNDIS/Ethernet Gadget type: USB driver: rndis_host v: kernel bus-ID: 7-1.2:4 chip-ID: 0b1f:03ee class-ID: 0a00 Report: This feature requires one of these tools: hciconfig/bt-adapter -Drives: Local Storage: total: 6.19 TiB used: 2.08 GiB (0.0%) - ID-1: /dev/nvme0n1 maj-min: 259:1 vendor: Samsung model: MZWLJ7T6HALA-00AU3 +Drives: Local Storage: total: 9.82 TiB used: 1.06 TiB (10.7%) + ID-1: /dev/nvme0n1 maj-min: 259:2 vendor: Samsung model: MZWLJ7T6HALA-00AU3 size: 6.19 TiB block-size: physical: 512 B logical: 512 B rotation: SSD - serial: S5RTNG0T110589 rev: EPK96R5Q temp: 44 Celsius C scheme: GPT - SMART: yes health: PASSED on: 24 hrs cycles: 44 read-units: 1,449,016 [741 GB] - written-units: 13,364,537 [6.84 TB] -Partition: ID-1: / raw-size: 6.18 TiB size: 6.18 TiB (100.00%) used: 2.04 GiB (0.0%) fs: btrfs + serial: S5RTNG0T110589 rev: EPK96R5Q temp: 40 Celsius C scheme: GPT + SMART: yes health: PASSED on: 273d 5h cycles: 113 read-units: 192,543,495 [98.5 TB] + written-units: 258,494,659 [132 TB] + ID-2: /dev/nvme1n1 maj-min: 259:0 vendor: Intel model: SSDPE2KX040T8 size: 3.64 TiB + block-size: physical: 512 B logical: 512 B speed: 31.6 Gb/s lanes: 4 rotation: SSD + serial: PHLJ940301WZ4P0DGN rev: VDV10131 temp: 33 Celsius C + SMART: yes health: PASSED on: 2y 188d 9h cycles: 36 read-units: 9,478,214,631 [4.85 PB] + written-units: 9,225,614,032 [4.72 PB] +Partition: ID-1: / raw-size: 6.18 TiB size: 6.18 TiB (100.00%) used: 1.06 TiB (17.1%) fs: btrfs block-size: 4096 B dev: /dev/dm-0 maj-min: 254:0 mapped: nixroot - ID-2: /boot raw-size: 1023 MiB size: 1021 MiB (99.80%) used: 37 MiB (3.6%) fs: vfat - block-size: 512 B dev: /dev/nvme0n1p1 maj-min: 259:2 + ID-2: /boot raw-size: 1023 MiB size: 1021 MiB (99.80%) used: 23.9 MiB (2.3%) fs: vfat + block-size: 512 B dev: /dev/nvme0n1p1 maj-min: 259:3 Swap: Kernel: swappiness: 60 (default) cache-pressure: 100 (default) ID-1: swap-1 type: partition size: 8 GiB used: 0 KiB (0.0%) priority: -2 - dev: /dev/nvme0n1p2 maj-min: 259:3 + dev: /dev/nvme0n1p2 maj-min: 259:4 Sensors: Message: No ipmi sensor data found. Message: No sensor data found. Is lm-sensors configured? -Info: Processes: 1010 Uptime: 20h 25m wakeups: 0 Init: systemd v: 253 - target: multi-user.target tool: systemctl Compilers: gcc: 12.2.0 Packages: - nix-default: 0 nix-sys: 268 lib: 47 nix-usr: 0 Client: Sudo v: 1.9.13p3 inxi: 3.3.04 +Info: Processes: 1226 Uptime: N/A wakeups: 0 Init: systemd v: 254 target: multi-user.target + tool: systemctl Compilers: gcc: 12.3.0 Packages: nix-default: 0 nix-sys: 415 lib: 65 + nix-usr: 0 Client: Sudo v: 1.9.15p2 inxi: 3.3.04 ``` ![hardware topology](epyc.lstopo.svg)