Zeitpunkt Nutzer Delta Tröts TNR Titel Version maxTL Di 08.10.2024 00:00:02 7.193 -2 648.351 90,1 NerdCulture 4.2.13 1.000 Mo 07.10.2024 00:00:10 7.195 -1 647.793 90,0 NerdCulture 4.2.13 1.000 So 06.10.2024 00:01:09 7.196 -1 647.168 89,9 NerdCulture 4.2.13 1.000 Sa 05.10.2024 00:00:05 7.197 0 646.565 89,8 NerdCulture 4.2.13 1.000 Fr 04.10.2024 00:01:14 7.197 -1 645.738 89,7 NerdCulture 4.2.13 1.000 Do 03.10.2024 00:01:11 7.198 +7.198 644.985 89,6 NerdCulture 4.2.13 1.000 Mi 02.10.2024 00:00:06 0 -7.200 0 0,0 0 Di 01.10.2024 00:01:15 7.200 -3 643.758 89,4 NerdCulture 4.2.13 1.000 Mo 30.09.2024 00:01:15 7.203 -2 643.128 89,3 NerdCulture 4.2.12 1.000 So 29.09.2024 00:01:09 7.205 0 642.447 89,2 NerdCulture 4.2.12 1.000
ij (@ij) · 08/2018 · Tröts: 7.851 · Folger: 2.162
Di 08.10.2024 09:48
Uhm, the other day I change my #Ceph setup that way, that I now use #FRR & #OSPF to utilize both links in my 3-node setup. So each node has a dedicated 10 GbE link to its neighbours, forming a ring (or triangle).
Then I also changed my setup and added a SSD as my WAL/DB device for my OSDs (2 TB SSD split into 2x 1 TB for WAL/DB, one for each OSD).
Although I see a slight speed increase in recovery speed, the increase is still below the expected performance: only 100-150 MB/s in most cases with 2x Seagate Exos X18 18 TB drives. Each drive can deliver up to 270 MB/s, according to technical datasheet.
So, I would expect to see more like 200-400 MB/s.
MTU is 9000 bytes .
ceph -s reports:
recovery: 182 MiB/s, 8 keys/s, 144 objects/s
Any ideas how to increase the speed?
Screenshot of Ceph stats in Proxmox showing Recovery/Rebalance speed of about 113 MiB/s
Screenshot of Ceph Status in Proxmox showing the PGs being remapped.
[Öffentlich] Antw.: 0 Wtrl.: 0 Fav.: 0