May 222013
 

I noticed this in my logs today:

May 22 14:04:39 bast smartd[1577]: Device: /dev/ad0, Failed SMART usage Attribute: 9 Power_On_Hours.

Oh. Really?

I looked at the output of smartctl and found:

$ sudo smartctl -a /dev/ad0
Password:
smartctl 5.41 2011-06-09 r3365 [FreeBSD 8.2-STABLE i386] (local build)
Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Maxtor DiamondMax Plus D740X
Device Model:     MAXTOR 6L040J2
Serial Number:    662134439059
Firmware Version: AR1.0400
User Capacity:    40,027,029,504 bytes [40.0 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   5
ATA Standard is:  ATA/ATAPI-5 T13 1321D revision 1
Local Time is:    Wed May 22 14:08:38 2013 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(   34) seconds.
Offline data collection
capabilities: 			 (0x1b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					No Conveyance Self-test supported.
					No Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					No General Purpose Logging support.
Short self-test routine 
recommended polling time: 	 (   2) minutes.
Extended self-test routine
recommended polling time: 	 (  20) minutes.

SMART Attributes Data Structure revision number: 11
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x0029   100   253   020    Pre-fail  Offline      -       0
  3 Spin_Up_Time            0x0027   081   080   020    Pre-fail  Always       -       2490
  4 Start_Stop_Count        0x0032   100   100   008    Old_age   Always       -       134
  5 Reallocated_Sector_Ct   0x0033   100   100   020    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000b   100   093   023    Pre-fail  Always       -       0
  9 Power_On_Hours          0x0012   001   001   001    Old_age   Always   FAILING_NOW 66453
 10 Spin_Retry_Count        0x0026   100   100   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0013   100   100   020    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   008    Old_age   Always       -       125
 13 Read_Soft_Error_Rate    0x000b   100   100   023    Pre-fail  Always       -       0
194 Temperature_Celsius     0x0022   079   074   042    Old_age   Always       -       56
195 Hardware_ECC_Recovered  0x001a   055   002   000    Old_age   Always       -       456209276
196 Reallocated_Event_Count 0x0010   100   100   020    Old_age   Offline      -       0
197 Current_Pending_Sector  0x0032   100   100   020    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x001a   200   200   000    Old_age   Always       -       0

SMART Error Log Version: 1
ATA Error Count: 1
	CR = Command Register [HEX]
	FR = Features Register [HEX]
	SC = Sector Count Register [HEX]
	SN = Sector Number Register [HEX]
	CL = Cylinder Low Register [HEX]
	CH = Cylinder High Register [HEX]
	DH = Device/Head Register [HEX]
	DC = Device Command Register [HEX]
	ER = Error register [HEX]
	ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 1 occurred at disk power-on lifetime: 17912 hours (746 days + 8 hours)
  When the command that caused the error occurred, the device was in an unknown state.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 59 5e 63 89 7a e2  Error: UNC 94 sectors at LBA = 0x027a8963 = 41584995

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  c8 02 00 c1 88 7a e2 7a      00:00:59.670  READ DMA
  c8 02 08 f7 85 7a e2 7a      00:00:59.670  READ DMA
  c8 02 08 ef 85 7a e2 7a      00:00:59.665  READ DMA
  c8 02 08 47 84 7a e2 7a      00:00:59.665  READ DMA
  c8 02 08 37 84 7a e2 7a      00:00:59.664  READ DMA

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     62979         -
# 2  Extended offline    Completed without error       00%     51193         -
# 3  Extended offline    Completed without error       00%     38670         -
# 4  Short offline       Completed without error       00%     38670         -

Device does not support Selective Self Tests/Logging

This HDD is part of a gmirror:

$ gmirror status
      Name    Status  Components
mirror/gm0  COMPLETE  ad0
                      ad2

How’s ad2 doing?

$ sudo smartctl -a /dev/ad2
smartctl 5.41 2011-06-09 r3365 [FreeBSD 8.2-STABLE i386] (local build)
Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 7200.7 and 7200.7 Plus
Device Model:     ST380011A
Serial Number:    5JVB4B3T
Firmware Version: 3.06
User Capacity:    80,026,361,856 bytes [80.0 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   6
ATA Standard is:  ATA/ATAPI-6 T13 1410D revision 2
Local Time is:    Wed May 22 14:12:49 2013 UTC
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)	Offline data collection activity
					was completed without error.
					Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)	The previous self-test routine completed
					without error or no self-test has ever 
					been run.
Total time to complete Offline 
data collection: 		(  430) seconds.
Offline data collection
capabilities: 			 (0x5b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					No Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:            (0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:        (0x01)	Error logging supported.
					No General Purpose Logging support.
Short self-test routine 
recommended polling time: 	 (   1) minutes.
Extended self-test routine
recommended polling time: 	 (  58) minutes.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   056   052   006    Pre-fail  Always       -       215189318
  3 Spin_Up_Time            0x0003   098   098   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       6
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   082   060   030    Pre-fail  Always       -       175440254
  9 Power_On_Hours          0x0032   082   082   000    Old_age   Always       -       16083
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       118
194 Temperature_Celsius     0x0022   049   050   000    Old_age   Always       -       49
195 Hardware_ECC_Recovered  0x001a   056   052   000    Old_age   Always       -       215189318
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   197   000    Old_age   Always       -       11
200 Multi_Zone_Error_Rate   0x0000   100   253   000    Old_age   Offline      -       0
202 Data_Address_Mark_Errs  0x0032   100   253   000    Old_age   Always       -       0

SMART Error Log Version: 1
ATA Error Count: 13 (device log contains only the most recent five errors)
	CR = Command Register [HEX]
	FR = Features Register [HEX]
	SC = Sector Count Register [HEX]
	SN = Sector Number Register [HEX]
	CL = Cylinder Low Register [HEX]
	CH = Cylinder High Register [HEX]
	DH = Device/Head Register [HEX]
	DC = Device Command Register [HEX]
	ER = Error register [HEX]
	ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 13 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  84 51 01 74 f8 50 e0  Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 04 71 f8 50 e0 00      00:02:44.362  READ DMA EXT
  ef 03 45 01 55 aa e0 00      00:02:44.331  SET FEATURES [Set transfer mode]
  ef 03 0a 01 55 aa e0 00      00:02:44.300  SET FEATURES [Set transfer mode]
  91 00 3f 01 55 aa 0f 00      00:02:44.269  INITIALIZE DEVICE PARAMETERS [OBS-6]
  ec 00 01 01 55 aa a0 00      00:02:44.238  IDENTIFY DEVICE

Error 12 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  84 51 01 74 f8 50 e0  Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 04 71 f8 50 e0 00      00:02:08.404  READ DMA EXT
  ef 03 45 01 55 aa e0 00      00:01:24.665  SET FEATURES [Set transfer mode]
  ef 03 0a 01 55 aa e0 00      00:01:24.664  SET FEATURES [Set transfer mode]
  91 00 3f 01 55 aa 0f 00      00:01:24.664  INITIALIZE DEVICE PARAMETERS [OBS-6]
  ec 00 01 01 55 aa a0 00      00:01:24.663  IDENTIFY DEVICE

Error 11 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  84 51 01 74 f8 50 e9  Error: ICRC, ABRT 1 sectors at LBA = 0x0950f874 = 156301428

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  c8 00 04 71 f8 50 e9 00      00:00:20.864  READ DMA
  c6 00 10 00 00 00 e0 00      00:01:24.665  SET MULTIPLE MODE
  ef 02 00 00 00 00 e0 00      00:01:24.664  SET FEATURES [Enable write cache]
  ef aa 00 00 00 00 e0 00      00:01:24.664  SET FEATURES [Enable read look-ahead]
  ef 03 45 00 00 00 e0 00      00:01:24.663  SET FEATURES [Set transfer mode]

Error 10 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  84 51 01 74 f8 50 e0  Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 04 71 f8 50 e0 00      00:00:20.864  READ DMA EXT
  ef 03 45 01 55 aa e0 00      00:00:20.833  SET FEATURES [Set transfer mode]
  ef 03 0a 01 55 aa e0 00      00:00:20.802  SET FEATURES [Set transfer mode]
  91 00 3f 01 55 aa 0f 00      00:00:08.052  INITIALIZE DEVICE PARAMETERS [OBS-6]
  ec 00 01 01 55 aa a0 00      00:00:00.000  IDENTIFY DEVICE

Error 9 occurred at disk power-on lifetime: 1047 hours (43 days + 15 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  84 51 01 74 f8 50 e0  Error: ICRC, ABRT 1 sectors at LBA = 0x0050f874 = 5306484

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 04 71 f8 50 e0 00      00:00:46.414  READ DMA EXT
  ef 03 45 01 55 aa e0 00      00:00:46.384  SET FEATURES [Set transfer mode]
  ef 03 0a 01 55 aa e0 00      00:01:50.367  SET FEATURES [Set transfer mode]
  91 00 3f 01 55 aa 0f 00      00:01:50.335  INITIALIZE DEVICE PARAMETERS [OBS-6]
  ec 00 01 01 55 aa a0 00      00:01:50.305  IDENTIFY DEVICE

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     12652         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

That seems OK. Regardless of the status, I can do nothing for a week. I’m out of town.

I do have several Toshiba 3TB drives which I can replace this with. The system in question is running FreeBSD 8.2-STABLE. I’d upgrade it to 9.x and probably run a ZFS root system.

Website Pin Facebook Twitter Myspace Friendfeed Technorati del.icio.us Digg Google StumbleUpon Premium Responsive