# sudo -u hdfs hdfs fsck /
...
/user/oozie/share/lib/sqoop/libthrift-0.9.0.jar: MISSING 1 blocks of total size 347531 B..
/user/oozie/share/lib/sqoop/metrics-core-2.1.2.jar: CORRUPT blockpool BP-766882569-10.15.86.206-1376438928219 block blk_-3018521587264545106
/user/oozie/share/lib/sqoop/metrics-core-2.1.2.jar: MISSING 1 blocks of total size 82445 B...
/user/oozie/share/lib/sqoop/oozie-sharelib-sqoop-3.3.2-cdh4.3.0.jar: CORRUPT blockpool BP-766882569-10.15.86.206-1376438928219 block blk_7722471829539020625
/user/oozie/share/lib/sqoop/oozie-sharelib-sqoop-3.3.2-cdh4.3.0.jar: MISSING 1 blocks of total size 8016 B..Status: CORRUPT
Total size: 1335336357198 B
Total dirs: 161
Total files: 18559 (Files currently being written: 1)
Total blocks (validated): 20714 (avg. block size 64465402 B)
********************************
CORRUPT FILES: 2393
MISSING BLOCKS: 3053
MISSING SIZE: 257848478547 B
CORRUPT BLOCKS: 3053
********************************
Minimally replicated blocks: 17661 (85.26118 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 6805 (32.852177 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.980786
Corrupt blocks: 3053
Missing replicas: 9353 (17.15832 %)
Number of data-nodes: 12
Number of racks: 1
FSCK ended at Fri Sep 13 10:52:34 KST 2013 in 534 milliseconds
The filesystem under path '/' is CORRUPT
# hdfs fsck / -delete (-move는 ./lost+found로 옮긴다고 함)
# hadoop fs -setrep -R 1 /
# sudo -u hdfs hdfs fsck /
....................................................................................................
..................................................................Status: HEALTHY
Total size: 943319967319 B
Total dirs: 161
Total files: 16166 (Files currently being written: 1)
Total blocks (validated): 16648 (avg. block size 56662660 B)
Minimally replicated blocks: 16648 (100.0 %)
Over-replicated blocks: 12841 (77.132385 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 2.2123377
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 12
Number of racks: 1
FSCK ended at Fri Sep 13 10:57:23 KST 2013 in 415 milliseconds
The filesystem under path '/' is HEALTHY
상태는 정상이 되었으나 replication factor는 2.2가 되었다.
# sudo -u hdfs hdfs fsck / -delete
....................................................................................................
..................................................................Status: HEALTHY
Total size: 943319967319 B
Total dirs: 161
Total files: 16166 (Files currently being written: 2)
Total blocks (validated): 16648 (avg. block size 56662660 B)
Minimally replicated blocks: 16648 (100.0 %)
Over-replicated blocks: 3531 (21.209755 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.2190052
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 12
Number of racks: 1
FSCK ended at Fri Sep 13 11:00:18 KST 2013 in 401 milliseconds
The filesystem under path '/' is HEALTHY
조금 나아졌음.
# hadoop fs -setrep -R 1 /
# sudo -u hdfs hdfs fsck /
....................................................................................................
..................................................................Status: HEALTHY
Total size: 943319967319 B
Total dirs: 161
Total files: 16166 (Files currently being written: 2)
Total blocks (validated): 16648 (avg. block size 56662660 B)
Minimally replicated blocks: 16648 (100.0 %)
Over-replicated blocks: 25 (0.1501682 %)
Under-replicated blocks: 0 (0.0 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 1
Average block replication: 1.0015017
Corrupt blocks: 0
Missing replicas: 0 (0.0 %)
Number of data-nodes: 12
Number of racks: 1
FSCK ended at Fri Sep 13 11:01:22 KST 2013 in 400 milliseconds
The filesystem under path '/' is HEALTHY
* http://stackoverflow.com/questions/8800810/hadoop-corrupt-blocks
