{"id":1970,"date":"2007-11-27T09:39:56","date_gmt":"2007-11-27T16:39:56","guid":{"rendered":"http:\/\/www.andreaswacker.com\/blog\/?p=949"},"modified":"2007-11-27T09:39:56","modified_gmt":"2007-11-27T16:39:56","slug":"3ware-16-port-raid-5-with-300gb-western-digital","status":"publish","type":"post","link":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/","title":{"rendered":"3ware 16 port RAID-5 with 300GB Western Digital"},"content":{"rendered":"<p>I am running a 9505 16 port 3ware card with 12 Western Digital 300 GB drives. In \/var\/log\/messages I found<br \/>\n<code><br \/>\nNov  4 10:48:53 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x23268EDA.<br \/>\nNov  4 10:50:19 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x21D88B0F.<br \/>\nNov  4 10:51:27 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x1E71DB4A.<br \/>\nNov  4 10:51:33 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x23289645.<br \/>\nNov  4 11:02:03 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x2111C31E.<br \/>\nNov  4 11:06:00 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x2219A8F3.<br \/>\nNov  4 11:08:52 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x1437A499.<br \/>\nNov  4 11:09:05 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x23455701.<br \/>\nNov  4 11:09:10 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x23455749.<br \/>\nNov  4 11:10:02 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x241F28D3.<br \/>\nNov  4 11:11:54 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x20B6CCC9.<br \/>\nNov  4 11:12:13 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x22277DFD.<br \/>\nNov  4 11:12:13 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x22277D80.<br \/>\nNov  4 11:12:13 her2 kernel: 3w-9xxx: scsi0: AEN: ERROR (0x04:0x0002): Degraded unit:unit=0, port=11.<br \/>\n<\/code><\/p>\n<p>in tw_cli the drive on port 11 got reported as failed:<br \/>\n<code><br \/>\np11    DEVICE-ERROR     u0     298.09 GB   625142448     WD-WCAPD3118453<br \/>\n<\/code><\/p>\n<p>I tried to test the drive via<br \/>\n<code><br \/>\n\/usr\/sbin\/smartctl -t long -d 3ware,11 \/dev\/twa0<br \/>\n\/usr\/sbin\/smartctl -t offline   -d  3ware,11 \/dev\/twa0<br \/>\n\/usr\/sbin\/smartctl -t conveyance  -d  3ware,11 \/dev\/twa0<br \/>\n\/usr\/sbin\/smartctl -t short -d  3ware,11 \/dev\/twa0<br \/>\n<\/code><\/p>\n<p>But<br \/>\n<code><br \/>\n\/usr\/sbin\/smartctl -a -d  3ware,11 \/dev\/twa0<br \/>\n<\/code><\/p>\n<p>did not show many good signs:<br \/>\n<code><br \/>\nSMART Self-test log structure revision number 1<br \/>\nNum  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error<br \/>\n# 1  Short offline       Completed: read failure       90%      6702         396331771<br \/>\n# 2  Conveyance offline  Completed: read failure       90%      6702         396331771<br \/>\n# 3  Extended offline    Completed: read failure       90%      6695         396331771<br \/>\n# 4  Extended offline    Completed: read failure       90%      6695         396331771<br \/>\n# 5  Extended offline    Completed: read failure       90%      6694         396331773<br \/>\n# 6  Extended offline    Completed: read failure       70%      6684         99434677<br \/>\n<\/code><\/p>\n<p>Values like Multi_Zone_Error_Rate and Offline_Uncorrectable as well as Current_Pending_Sector promised nothing good.<\/p>\n<p>In tw_cli I then removed the drive in question from the unit:<br \/>\n<code><br \/>\n maint remove c0 p11<br \/>\n<\/code><\/p>\n<p>The smarctl tests still failed right away. I rescaned the drives in tw_cli:<br \/>\n<code><br \/>\nmaint rescan c0<br \/>\n<\/code><\/p>\n<p> The failed drive was found, and soon after the 3ware controller grabbed it automatically and started the rebuild.<\/p>\n<p>It did so sucessfully. The Current_Pending_Sector value decreased back to 0, and the drive array seems to be functioning<br \/>\nnormal right now.<\/p>\n<p>During one of those pesky spurious rebuilds happening on both 9550SX-16ML  controllers that I am aware<br \/>\nof the drive failed again. This time with an ECC-ERROR . Not enough of a failure it seems that the rebuild would have<br \/>\nfailed. A<br \/>\n<code><br \/>\nmaint rescan c0<br \/>\n<\/code><br \/>\nin tw_cli after the rebuild had finished cleared this error. It&#8217;s noteworthy that the spurious rebuild performance came to a grinding<br \/>\nslowdown after the ECC-ERROR.<\/p>\n<p>When I replaced the failed drive things went back to normal and the system has been fine ever since.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I am running a 9505 16 port 3ware card with 12 Western Digital 300 GB drives. In \/var\/log\/messages I found Nov 4 10:48:53 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x23268EDA. Nov 4 10:50:19 her2 kernel: 3w-9xxx: scsi0: AEN: WARNING (0x04:0x0023): Sector repair completed:port=11, LBA=0x21D88B0F. Nov 4 10:51:27 her2 kernel: 3w-9xxx: scsi0: [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[37,19],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.0 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>RAID Woes: A Tale of Sector Repairs and Drive Failures<\/title>\n<meta name=\"description\" content=\"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"RAID Woes: A Tale of Sector Repairs and Drive Failures\" \/>\n<meta property=\"og:description\" content=\"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\" \/>\n<meta property=\"og:site_name\" content=\"Andreas Wacker\" \/>\n<meta property=\"article:published_time\" content=\"2007-11-27T16:39:56+00:00\" \/>\n<meta name=\"author\" content=\"1\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@_andreaswacker\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"1\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\"},\"author\":{\"name\":\"1\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/691b5221b886b3b09742e476a16e5631\"},\"headline\":\"3ware 16 port RAID-5 with 300GB Western Digital\",\"datePublished\":\"2007-11-27T16:39:56+00:00\",\"dateModified\":\"2007-11-27T16:39:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\"},\"wordCount\":223,\"publisher\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\"},\"articleSection\":[\"misc\",\"technology\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\",\"name\":\"RAID Woes: A Tale of Sector Repairs and Drive Failures\",\"isPartOf\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#website\"},\"datePublished\":\"2007-11-27T16:39:56+00:00\",\"dateModified\":\"2007-11-27T16:39:56+00:00\",\"description\":\"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.andreaswacker.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"3ware 16 port RAID-5 with 300GB Western Digital\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#website\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/\",\"name\":\"Andreas Wacker\",\"description\":\"weblog\",\"publisher\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.andreaswacker.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":[\"Person\",\"Organization\"],\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a\",\"name\":\"Andreas Wacker\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png\",\"contentUrl\":\"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png\",\"width\":248,\"height\":248,\"caption\":\"Andreas Wacker\"},\"logo\":{\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/\"},\"sameAs\":[\"http:\/\/www.andreaswacker.com\",\"https:\/\/www.instagram.com\/_andreaswacker\/\",\"https:\/\/x.com\/_andreaswacker\",\"https:\/\/www.youtube.com\/channel\/UCWwFtVC_HATVr-R5EiNmhHw\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/691b5221b886b3b09742e476a16e5631\",\"name\":\"1\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"caption\":\"1\"},\"url\":\"https:\/\/www.andreaswacker.com\/blog\/author\/1\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"RAID Woes: A Tale of Sector Repairs and Drive Failures","description":"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/","og_locale":"en_US","og_type":"article","og_title":"RAID Woes: A Tale of Sector Repairs and Drive Failures","og_description":"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.","og_url":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/","og_site_name":"Andreas Wacker","article_published_time":"2007-11-27T16:39:56+00:00","author":"1","twitter_card":"summary_large_image","twitter_site":"@_andreaswacker","twitter_misc":{"Written by":"1","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#article","isPartOf":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/"},"author":{"name":"1","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/691b5221b886b3b09742e476a16e5631"},"headline":"3ware 16 port RAID-5 with 300GB Western Digital","datePublished":"2007-11-27T16:39:56+00:00","dateModified":"2007-11-27T16:39:56+00:00","mainEntityOfPage":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/"},"wordCount":223,"publisher":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a"},"articleSection":["misc","technology"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/","url":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/","name":"RAID Woes: A Tale of Sector Repairs and Drive Failures","isPartOf":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#website"},"datePublished":"2007-11-27T16:39:56+00:00","dateModified":"2007-11-27T16:39:56+00:00","description":"A deep dive into RAID-5 troubleshooting. When error messages pile up and drives fail, sometimes persistence pays off.","breadcrumb":{"@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.andreaswacker.com\/blog\/2007\/11\/27\/3ware-16-port-raid-5-with-300gb-western-digital\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.andreaswacker.com\/blog\/"},{"@type":"ListItem","position":2,"name":"3ware 16 port RAID-5 with 300GB Western Digital"}]},{"@type":"WebSite","@id":"https:\/\/www.andreaswacker.com\/blog\/#website","url":"https:\/\/www.andreaswacker.com\/blog\/","name":"Andreas Wacker","description":"weblog","publisher":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.andreaswacker.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":["Person","Organization"],"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/c1f46a348eafeb52ee54843dce18442a","name":"Andreas Wacker","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png","contentUrl":"https:\/\/www.andreaswacker.com\/blog\/wp-content\/uploads\/2024\/06\/awfavion.png","width":248,"height":248,"caption":"Andreas Wacker"},"logo":{"@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/"},"sameAs":["http:\/\/www.andreaswacker.com","https:\/\/www.instagram.com\/_andreaswacker\/","https:\/\/x.com\/_andreaswacker","https:\/\/www.youtube.com\/channel\/UCWwFtVC_HATVr-R5EiNmhHw"]},{"@type":"Person","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/691b5221b886b3b09742e476a16e5631","name":"1","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.andreaswacker.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","caption":"1"},"url":"https:\/\/www.andreaswacker.com\/blog\/author\/1\/"}]}},"_links":{"self":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts\/1970"}],"collection":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/comments?post=1970"}],"version-history":[{"count":0,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/posts\/1970\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/media?parent=1970"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/categories?post=1970"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.andreaswacker.com\/blog\/wp-json\/wp\/v2\/tags?post=1970"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}