J’ai voulu changer un disque du RAID : un SAS « DELL 900 GB ST900MM0006 » par un SATA « KINGSTON SA400S37960G A To »
Mais il n’y a pas de reconstruction …
Information du RAID :
# megacli -ldinfo -lALL -aALL Adapter 0 -- Virtual Drive Information: Virtual Drive: 0 (Target Id: 0) Name :900GbRd5 RAID Level : Primary-5, Secondary-0, RAID Level Qualifier-3 Size : 4.089 TB Sector Size : 512 Parity Size : 837.75 GB State : Degraded Strip Size : 64 KB Number Of Drives : 6 Span Depth : 1 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disk's Default Encryption Type : None Default Power Savings Policy: Controller Defined Current Power Savings Policy: None Can spin up in 1 minute: Yes LD has drives that support T10 power conditions: Yes LD's IO profile supports MAX power savings with cached writes: No Bad Blocks Exist: No Is VD Cached: Yes Cache Cade Type : Read Only Virtual Drive: 1 (Target Id: 1) Name :2TbRd1iw RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 1.818 TB Sector Size : 512 Mirror Data : 1.818 TB State : Optimal Strip Size : 64 KB Number Of Drives : 2 Span Depth : 1 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disk's Default Encryption Type : None Default Power Savings Policy: Controller Defined Current Power Savings Policy: None Can spin up in 1 minute: Yes LD has drives that support T10 power conditions: No LD's IO profile supports MAX power savings with cached writes: No Bad Blocks Exist: No Is VD Cached: Yes Cache Cade Type : Read Only Exit Code: 0x00 # perccli64 /c0 /eall /sall show CLI Version = 007.0529.0000.0000 Sep 18, 2018 Operating system = Linux 6.8.12-5-pve Controller = 0 Status = Success Description = Show Drive Information Succeeded. Drive Information : ================= ---------------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ---------------------------------------------------------------------------------- 32:0 0 Onln 0 837.75 GB SAS HDD N N 512B ST900MM0006 U - 32:1 1 GHS - 893.75 GB SATA SSD N N 512B KINGSTON SA400S37960G U - 32:2 2 Onln 0 837.75 GB SAS HDD N N 512B ST900MM0006 U - 32:3 3 Onln 1 1.818 TB SATA HDD N N 512B ST2000VN003-3CW102 U - 32:4 4 Onln 0 837.75 GB SAS HDD N N 512B ST900MM0006 U - 32:5 5 Onln 0 837.75 GB SAS HDD N N 512B ST900MM0006 U - 32:6 6 Onln 0 837.75 GB SAS HDD N N 512B ST900MM0006 U - 32:7 7 Onln 1 1.818 TB SATA HDD N N 512B ST2000VN003-3CW102 U - ---------------------------------------------------------------------------------- EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface Med-Media Type|SED-Self Encrypting Drive|PI-Protection Info SeSz-Sector Size|Sp-Spun|U-Up|D-Down/PowerSave|T-Transition|F-Foreign UGUnsp-Unsupported|UGShld-UnConfigured shielded|HSPShld-Hotspare shielded CFShld-Configured shielded|Cpybck-CopyBack|CBShld-Copyback Shielded # megacli -PDList -aAll Adapter #0 Enclosure Device ID: 32 Slot Number: 0 Drive's position: DiskGroup: 0, Span: 0, Arm: 0 Enclosure position: 1 Device Id: 0 WWN: 5000C5007E266648 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 838.362 GB [0x68cb9e30 Sectors] Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors] Coerced Size: 837.75 GB [0x68b80000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: LS0C Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c5007e266649 SAS Address(1): 0x0 Connected Port Number: 2(path0) Inquiry Data: SEAGATE ST900MM0006 LS0CS0N2SHEW FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :25C (77.00 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 1 Enclosure position: 1 Device Id: 1 WWN: 50026b7785868c60 Sequence Number: 10 Media Error Count: 0 Other Error Count: 150 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Hotspare Information: Type: Global, is revertible Raw Size: 894.252 GB [0x6fc81ab0 Sectors] Non Coerced Size: 893.752 GB [0x6fb81ab0 Sectors] Coerced Size: 893.75 GB [0x6fb80000 Sectors] Sector Size: 0 Firmware state: Hotspare, Spun Up Device Firmware Level: 70.5 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221106000000 Connected Port Number: 1(path0) Inquiry Data: 50026B7785868C60 KINGSTON SA400S37960G SHFK70.5 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Solid State Device Drive: Not Certified Drive Temperature : N/A PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 2 Drive's position: DiskGroup: 0, Span: 0, Arm: 2 Enclosure position: 1 Device Id: 2 WWN: 5000C5007F6CEAE4 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 838.362 GB [0x68cb9e30 Sectors] Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors] Coerced Size: 837.75 GB [0x68b80000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: LS0C Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c5007f6ceae5 SAS Address(1): 0x0 Connected Port Number: 3(path0) Inquiry Data: SEAGATE ST900MM0006 LS0CS0N3AYB9 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :24C (75.20 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 3 Drive's position: DiskGroup: 1, Span: 0, Arm: 0 Enclosure position: 1 Device Id: 3 WWN: 5000c500e76415ef Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 1.819 TB [0xe8e088b0 Sectors] Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors] Coerced Size: 1.818 TB [0xe8d00000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: SC60 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221104000000 Connected Port Number: 4(path0) Inquiry Data: ZWD0FNZ4ST2000VN003-3CW102 SC60 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive: Not Certified Drive Temperature :22C (71.60 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 4 Drive's position: DiskGroup: 0, Span: 0, Arm: 3 Enclosure position: 1 Device Id: 4 WWN: 5000C5007F21B7B8 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 838.362 GB [0x68cb9e30 Sectors] Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors] Coerced Size: 837.75 GB [0x68b80000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: LS0C Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c5007f21b7b9 SAS Address(1): 0x0 Connected Port Number: 7(path0) Inquiry Data: SEAGATE ST900MM0006 LS0CS0N3553B FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :26C (78.80 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 5 Drive's position: DiskGroup: 0, Span: 0, Arm: 4 Enclosure position: 1 Device Id: 5 WWN: 5000C5007F212928 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 838.362 GB [0x68cb9e30 Sectors] Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors] Coerced Size: 837.75 GB [0x68b80000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: LS0C Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c5007f212929 SAS Address(1): 0x0 Connected Port Number: 6(path0) Inquiry Data: SEAGATE ST900MM0006 LS0CS0N357QD FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :24C (75.20 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 6 Drive's position: DiskGroup: 0, Span: 0, Arm: 5 Enclosure position: 1 Device Id: 6 WWN: 5000C5007F21A7A4 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 838.362 GB [0x68cb9e30 Sectors] Non Coerced Size: 837.862 GB [0x68bb9e30 Sectors] Coerced Size: 837.75 GB [0x68b80000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: LS0C Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c5007f21a7a5 SAS Address(1): 0x0 Connected Port Number: 5(path0) Inquiry Data: SEAGATE ST900MM0006 LS0CS0N355D8 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :24C (75.20 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 7 Drive's position: DiskGroup: 1, Span: 0, Arm: 1 Enclosure position: 1 Device Id: 7 WWN: 5000c500e7641717 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 1.819 TB [0xe8e088b0 Sectors] Non Coerced Size: 1.818 TB [0xe8d088b0 Sectors] Coerced Size: 1.818 TB [0xe8d00000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: SC60 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221100000000 Connected Port Number: 0(path0) Inquiry Data: ZWD0FP6VST2000VN003-3CW102 SC60 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive: Not Certified Drive Temperature :22C (71.60 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No Exit Code: 0x00 # megacli -PdGetMissing -a0 Adapter 0 - Missing Physical drives No. Array Row Size Expected 0 0 1 857856 MB Exit Code: 0x00
J’ai mis le disque en HotSpare pour que le Rebuild se fasse :
# megacli -PDHSP -Set -PhysDrv [32:1] -a0 Adapter: 0: Set Physical Drive at EnclId-32 SlotId-1 as Hot Spare Success. Exit Code: 0x00
Impossible de forcer le ReBuild :
# megacli -PDRbld -Start PhysDrv[32:1] -a0 Cannot Rebuild Physical Drive at Enclosure - 32, Slot - 1. FW error description: The specified device is in a state that doesn't support the requested command. Exit Code: 0x32
Export des logs
# megacli -AdpEventLog -GetEvents -f /root/raid.log -aALL
Dans les logs
Time: Sun Jan 19 07:29:35 2025 Code: 0x00000071 Class: 0 Locale: 0x02 Event Description: Unexpected sense: PD 01(e0x20/s1) Path 4433221106000000, CDB: 4d 00 46 00 00 00 00 00 04 00, Sense: 5/24/00 Event Data: =========== Device ID: 1 Enclosure Index: 32 Slot Number: 1 CDB Length: 10 CDB Data: 004d 0000 0046 0000 0000 0000 0000 0000 0004 0000 0000 0000 0000 0000 0000 0000 Sense Length: 18 Sense Data: 0070 0000 0005 0000 0000 0000 0000 000a 0000 0000 0000 0000 0024 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000 0000
Visiblement il manque une information :
# megacli -PdReplaceMissing -PhysDrv[32:1] -Array0 -row1 -a0 Adapter: 0: Failed to replace Missing PD at Array 0, Row 1. FW error description: The specified device is in a state that doesn't support the requested command. Exit Code: 0x32 # megacli -PDHSP -Rmv -PhysDrv [32:1] -a0 Adapter: 0: Remove Physical Drive at EnclId-32 SlotId-1 as Hot Spare Success. Exit Code: 0x00 # megacli -PdReplaceMissing -PhysDrv[32:1] -Array0 -row1 -a0 Adapter: 0: Failed to replace Missing PD at Array 0, Row 1. FW error description: The specified physical drive does not have the appropriate attributes to complete the requested command. Exit Code: 0x26 # megacli -CfgForeign -Scan -a0 There is no foreign configuration on controller 0. Exit Code: 0x00 # megacli -PDMakeGood -PhysDrv [32:1] -Force -a0 Adapter: 0: Failed to change PD state at EnclId-32 SlotId-1. Exit Code: 0x01
Quand je regarde la doc : Exit Code: 0x26, which means « Unable to use SATA(SAS) drive to replace SAS(SATA) ». Voir ici : https://www.thomas-krenn.com/de/wiki/MegaCLI_Error_Messages
A suivre.