I noticed this in my logs today:
May 22 14:04:39 bast smartd[1577]: Device: /dev/ad0, Failed SMART usage Attribute: 9 Power_On_Hours.
Oh. Really?
I looked at the output of smartctl and found:
$ sudo smartctl -a /dev/ad0 Password: smartctl 5.41 2011-06-09 r3365 [FreeBSD 8.2-STABLE i386] (local build) Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net === START OF INFORMATION SECTION === Model Family: Maxtor DiamondMax Plus D740X Device Model: MAXTOR 6L040J2 Serial Number: 662134439059 Firmware Version: AR1.0400 User Capacity: 40,027,029,504 bytes [40.0 GB] Sector Size: 512 bytes logical/physical Device is: In smartctl database [for details use: -P show] ATA Version is: 5 ATA Standard is: ATA/ATAPI-5 T13 1321D revision 1 Local Time is: Wed May 22 14:08:38 2013 UTC SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED See vendor-specific Attribute list for marginal Attributes. General SMART Values: Offline data collection status: (0x00) Offline data collection activity was never started. Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 34) seconds. Offline data collection capabilities: (0x1b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. No Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. No General Purpose Logging support. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 20) minutes. SMART Attributes Data Structure revision number: 11 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x0029 100 253 020 Pre-fail Offline - 0 3 Spin_Up_Time 0x0027 081 080 020 Pre-fail Always - 2490 4 Start_Stop_Count 0x0032 100 100 008 Old_age Always - 134 5 Reallocated_Sector_Ct 0x0033 100 100 020 Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 093 023 Pre-fail Always - 0 9 Power_On_Hours 0x0012 001 001 001 Old_age Always FAILING_NOW 66453 10 Spin_Retry_Count 0x0026 100 100 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0013 100 100 020 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 008 Old_age Always - 125 13 Read_Soft_Error_Rate 0x000b 100 100 023 Pre-fail Always - 0 194 Temperature_Celsius 0x0022 079 074 042 Old_age Always - 56 195 Hardware_ECC_Recovered 0x001a 055 002 000 Old_age Always - 456209276 196 Reallocated_Event_Count 0x0010 100 100 020 Old_age Offline - 0 197 Current_Pending_Sector 0x0032 100 100 020 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 253 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x001a 200 200 000 Old_age Always - 0 SMART Error Log Version: 1 ATA Error Count: 1 CR = Command Register [HEX] FR = Features Register [HEX] SC = Sector Count Register [HEX] SN = Sector Number Register [HEX] CL = Cylinder Low Register [HEX] CH = Cylinder High Register [HEX] DH = Device/Head Register [HEX] DC = Device Command Register [HEX] ER = Error register [HEX] ST = Status register [HEX] Powered_Up_Time is measured from power on, and printed as DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes, SS=sec, and sss=millisec. It "wraps" after 49.710 days. Error 1 occurred at disk power-on lifetime: 17912 hours (746 days + 8 hours) When the command that caused the error occurred, the device was in an unknown state. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 59 5e 63 89 7a e2 Error: UNC 94 sectors at LBA = 0x027a8963 = 41584995 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- c8 02 00 c1 88 7a e2 7a 00:00:59.670 READ DMA c8 02 08 f7 85 7a e2 7a 00:00:59.670 READ DMA c8 02 08 ef 85 7a e2 7a 00:00:59.665 READ DMA c8 02 08 47 84 7a e2 7a 00:00:59.665 READ DMA c8 02 08 37 84 7a e2 7a 00:00:59.664 READ DMA SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 62979 - # 2 Extended offline Completed without error 00% 51193 - # 3 Extended offline Completed without error 00% 38670 - # 4 Short offline Completed without error 00% 38670 - Device does not support Selective Self Tests/Logging
This HDD is part of a gmirror:
$ gmirror status
Name Status Components
mirror/gm0 COMPLETE ad0
ad2
How’s ad2 doing?
$ sudo smartctl -a /dev/ad2
smartctl 5.41 2011-06-09 r3365 [FreeBSD 8.2-STABLE i386] (local build)
Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.7 and 7200.7 Plus
Device Model: ST380011A
Serial Number: 5JVB4B3T
Firmware Version: 3.06
User Capacity: 80,026,361,856 bytes [80.0 GB]
Sector Size: 512 bytes logical/physical
Device is: In smartctl database [for details use: -P show]
ATA Version is: 6
ATA Standard is: ATA/ATAPI-6 T13 1410D revision 2
Local Time is: Wed May 22 14:12:49 2013 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 430) seconds.
Offline data collection
capabilities: (0x5b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
No General Purpose Logging support.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 58) minutes.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 056 052 006 Pre-fail Always - 215189318
3 Spin_Up_Time 0x0003 098 098 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 6
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 082 060 030 Pre-fail Always - 175440254
9 Power_On_Hours 0x0032 082 082 000 Old_age Always - 16083
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 118
194 Temperature_Celsius 0x0022 049 050 000 Old_age Always - 49
195 Hardware_ECC_Recovered 0x001a 056 052 000 Old_age Always - 215189318
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 197 000 Old_age Always - 11
200 Multi_Zone_Error_Rate 0x0000 100 253 000 Old_age Offline - 0
202 Data_Address_Mark_Errs 0x0032 100 253 000 Old_age Always - 0
SMART Error Log Version: 1
ATA Error Count: 13 (device log contains only the most recent five errors)
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.
Error 13 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
84 51 01 74 f8 50 e0 Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 04 71 f8 50 e0 00 00:02:44.362 READ DMA EXT
ef 03 45 01 55 aa e0 00 00:02:44.331 SET FEATURES [Set transfer mode]
ef 03 0a 01 55 aa e0 00 00:02:44.300 SET FEATURES [Set transfer mode]
91 00 3f 01 55 aa 0f 00 00:02:44.269 INITIALIZE DEVICE PARAMETERS [OBS-6]
ec 00 01 01 55 aa a0 00 00:02:44.238 IDENTIFY DEVICE
Error 12 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
84 51 01 74 f8 50 e0 Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 04 71 f8 50 e0 00 00:02:08.404 READ DMA EXT
ef 03 45 01 55 aa e0 00 00:01:24.665 SET FEATURES [Set transfer mode]
ef 03 0a 01 55 aa e0 00 00:01:24.664 SET FEATURES [Set transfer mode]
91 00 3f 01 55 aa 0f 00 00:01:24.664 INITIALIZE DEVICE PARAMETERS [OBS-6]
ec 00 01 01 55 aa a0 00 00:01:24.663 IDENTIFY DEVICE
Error 11 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
84 51 01 74 f8 50 e9 Error: ICRC, ABRT 1 sectors at LBA = 0x0950f874 = 156301428
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
c8 00 04 71 f8 50 e9 00 00:00:20.864 READ DMA
c6 00 10 00 00 00 e0 00 00:01:24.665 SET MULTIPLE MODE
ef 02 00 00 00 00 e0 00 00:01:24.664 SET FEATURES [Enable write cache]
ef aa 00 00 00 00 e0 00 00:01:24.664 SET FEATURES [Enable read look-ahead]
ef 03 45 00 00 00 e0 00 00:01:24.663 SET FEATURES [Set transfer mode]
Error 10 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
84 51 01 74 f8 50 e0 Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 04 71 f8 50 e0 00 00:00:20.864 READ DMA EXT
ef 03 45 01 55 aa e0 00 00:00:20.833 SET FEATURES [Set transfer mode]
ef 03 0a 01 55 aa e0 00 00:00:20.802 SET FEATURES [Set transfer mode]
91 00 3f 01 55 aa 0f 00 00:00:08.052 INITIALIZE DEVICE PARAMETERS [OBS-6]
ec 00 01 01 55 aa a0 00 00:00:00.000 IDENTIFY DEVICE
Error 9 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
When the command that caused the error occurred, the device was active or idle.
After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
84 51 01 74 f8 50 e0 Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484
Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
25 00 04 71 f8 50 e0 00 00:00:46.414 READ DMA EXT
ef 03 45 01 55 aa e0 00 00:00:46.384 SET FEATURES [Set transfer mode]
ef 03 0a 01 55 aa e0 00 00:01:50.367 SET FEATURES [Set transfer mode]
91 00 3f 01 55 aa 0f 00 00:01:50.335 INITIALIZE DEVICE PARAMETERS [OBS-6]
ec 00 01 01 55 aa a0 00 00:01:50.305 IDENTIFY DEVICE
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Extended offline Completed without error 00% 12652 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
That seems OK. Regardless of the status, I can do nothing for a week. I’m out of town.
I do have several Toshiba 3TB drives which I can replace this with. The system in question is running FreeBSD 8.2-STABLE. I’d upgrade it to 9.x and probably run a ZFS root system.
