WARNING : There are about 34 missing blocks. Please check the log or run fsck.
2014-09-06 23:06
921 查看
'jifeng01:9000'
Started: | Sat Sep 06 22:41:47 CST 2014 |
Version: | 1.2.1, 1503152 |
Compiled: | Mon Jul 22 15:23:09 PDT 2013 by mattf |
jifeng01:9000 Logs
Go back to DFS home
Reported Corrupt Files
blk_-6457274919514896544 /home/jifeng/out/part-m-00004blk_-5584297838940778022 /user/jifeng/output/random-seeds/part-randomSeed
blk_-5243301279492742263 /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929
blk_-3888018766322651506 /home/jifeng/out/part-m-00009
blk_-2853897503049953015 /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml
blk_-2825733319432881440 /home/jifeng/pids/part-m-00007.seq
blk_-2049677542258916799 /user/jifeng/testdata/synthetic_control.data
blk_-1403735329502570594 /user/jifeng/hbase/scores/.tableinfo.0000000001
blk_-1329383103204158484 /user/jifeng/output/clusters-2/_policy
blk_-1092299033788448642 /user/jifeng/hbase/-ROOT-/70236052/.regioninfo
blk_-959108783924676624 /user/jifeng/output/clusters-4/_policy
blk_-824171596733300207 /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml
blk_-703416978362433992 /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat
blk_-68589977821710110 /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001
blk_109205275959958993 /user/jifeng/output/_policy
blk_575730840927164662 /user/jifeng/hbase/hbase.id
blk_928839098900765633 /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob
blk_2369857512018989453 /user/jifeng/output/clusters-3/part-r-00000
blk_3764002349176068586 /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml
blk_3852612576123523390 /home/jifeng/pids/part-m-00003.seq
blk_3910032104823961563 /user/jifeng/output/clusters-0/part-00003
blk_4314247290342042317 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml
blk_5877660712985883910 /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75
blk_5976038500197801228 /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3
blk_7396752195048257419 /user/jifeng/output/clusters-7/part-r-00000
blk_7422539300806584926 /user/jifeng/output/clusters-6/_policy
blk_7768269153299453904 /home/jifeng/pids/part-m-00000.seq
blk_7907833205724261986 /user/jifeng/output/clusters-0/part-00004
blk_8225354003048181368 /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml
blk_8644617765668849324 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat
blk_8725357001115122394 /home/jifeng/out/part-m-00001
blk_9080037511646150766 /user/jifeng/output/clusters-8/part-r-00000
blk_9171939222431302382 /home/jifeng/pids/part-m-00002.seq
Total: At least 33 corrupt file(s)
检查损坏的hdfs文件列表 使用命令可以打印出损坏的文件列表: hadoop fsck
没有冗余备份,只能删除损坏的文件,使用命令: hadoop fsck --delete
[jifeng@jifeng01 hbase-0.94.21]$ hadoop fsck --delete Warning: $HADOOP_HOME is deprecated. FSCK started by jifeng from /10.5.4.54 for path / at Sat Sep 06 23:05:11 CST 2014 . /home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0012/job.jar: Under replicated blk_-4953605809636462967_1091. Target Replicas is 10 but found 3 replica(s). . /home/jifeng/hadoop/tmp/mapred/staging/jifeng/.staging/job_201408132307_0015/job.jar: Under replicated blk_-3894987090632193800_1108. Target Replicas is 10 but found 3 replica(s). ... /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: CORRUPT block blk_928839098900765633 /home/jifeng/out/_logs/history/job_201408190908_0004_1408464096153_jifeng_Sqoop%3A+mysql%5Fjob: MISSING 1 blocks of total size 44200 B.. /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: CORRUPT block blk_-2853897503049953015 /home/jifeng/out/_logs/history/job_201408190908_0004_conf.xml: MISSING 1 blocks of total size 56963 B... /home/jifeng/out/part-m-00001: CORRUPT block blk_8725357001115122394 /home/jifeng/out/part-m-00001: MISSING 1 blocks of total size 8626 B.... /home/jifeng/out/part-m-00004: CORRUPT block blk_-6457274919514896544 /home/jifeng/out/part-m-00004: MISSING 1 blocks of total size 8440 B...... /home/jifeng/out/part-m-00009: CORRUPT block blk_-3888018766322651506 /home/jifeng/out/part-m-00009: MISSING 1 blocks of total size 2287 B.... /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: CORRUPT block blk_-824171596733300207 /home/jifeng/pids/_logs/history/job_201408190908_0003_conf.xml: MISSING 1 blocks of total size 56968 B.. /home/jifeng/pids/part-m-00000.seq: CORRUPT block blk_7768269153299453904 /home/jifeng/pids/part-m-00000.seq: MISSING 1 blocks of total size 7499 B... /home/jifeng/pids/part-m-00002.seq: CORRUPT block blk_9171939222431302382 /home/jifeng/pids/part-m-00002.seq: MISSING 1 blocks of total size 9319 B.. /home/jifeng/pids/part-m-00003.seq: CORRUPT block blk_3852612576123523390 /home/jifeng/pids/part-m-00003.seq: MISSING 1 blocks of total size 9138 B..... /home/jifeng/pids/part-m-00007.seq: CORRUPT block blk_-2825733319432881440 /home/jifeng/pids/part-m-00007.seq: MISSING 1 blocks of total size 86 B.............. /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: CORRUPT block blk_-68589977821710110 /user/jifeng/hbase/-ROOT-/.tableinfo.0000000001: MISSING 1 blocks of total size 728 B... /user/jifeng/hbase/-ROOT-/70236052/.regioninfo: CORRUPT block blk_-1092299033788448642 /user/jifeng/hbase/-ROOT-/70236052/.regioninfo: MISSING 1 blocks of total size 109 B.. /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: CORRUPT block blk_5877660712985883910 /user/jifeng/hbase/-ROOT-/70236052/info/2b90a08782fe439ba863cbcfb977ab75: MISSING 1 blocks of total size 1067 B.... /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: CORRUPT block blk_5976038500197801228 /user/jifeng/hbase/.META./1028785192/info/44e3c834c80b41f08390b810339be4f3: MISSING 1 blocks of total size 1473 B.. /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: CORRUPT block blk_-5243301279492742263 /user/jifeng/hbase/.logs/jifeng01,60020,1439716550094/jifeng01%2C60020%2C1439716550094.1439864189929: MISSING 1 blocks of total size 134 B... /user/jifeng/hbase/hbase.id: CORRUPT block blk_575730840927164662 /user/jifeng/hbase/hbase.id: MISSING 1 blocks of total size 38 B....... /user/jifeng/hbase/scores/.tableinfo.0000000001: CORRUPT block blk_-1403735329502570594 /user/jifeng/hbase/scores/.tableinfo.0000000001: MISSING 1 blocks of total size 1273 B........................... /user/jifeng/output/_policy: CORRUPT block blk_109205275959958993 /user/jifeng/output/_policy: MISSING 1 blocks of total size 194 B.......... /user/jifeng/output/clusters-0/part-00003: CORRUPT block blk_3910032104823961563 /user/jifeng/output/clusters-0/part-00003: MISSING 1 blocks of total size 1891 B.. /user/jifeng/output/clusters-0/part-00004: CORRUPT block blk_7907833205724261986 /user/jifeng/output/clusters-0/part-00004: MISSING 1 blocks of total size 1891 B..... /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: CORRUPT block blk_8225354003048181368 /user/jifeng/output/clusters-1/_logs/history/job_201408221126_0002_conf.xml: MISSING 1 blocks of total size 50269 B...... ...... /user/jifeng/output/clusters-2/_policy: CORRUPT block blk_-1329383103204158484 /user/jifeng/output/clusters-2/_policy: MISSING 1 blocks of total size 194 B.... /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: CORRUPT block blk_8644617765668849324 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_1409048614594_jifeng_Cluster+Iterator+running+iteration+3+over+priorPat: MISSING 1 blocks of total size 13899 B.. /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: CORRUPT block blk_4314247290342042317 /user/jifeng/output/clusters-3/_logs/history/job_201408221126_0004_conf.xml: MISSING 1 blocks of total size 50269 B... /user/jifeng/output/clusters-3/part-r-00000: CORRUPT block blk_2369857512018989453 /user/jifeng/output/clusters-3/part-r-00000: MISSING 1 blocks of total size 7581 B... /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: CORRUPT block blk_-703416978362433992 /user/jifeng/output/clusters-4/_logs/history/job_201408221126_0005_1409048641005_jifeng_Cluster+Iterator+running+iteration+4+over+priorPat: MISSING 1 blocks of total size 13893 B... /user/jifeng/output/clusters-4/_policy: CORRUPT block blk_-959108783924676624 /user/jifeng/output/clusters-4/_policy: MISSING 1 blocks of total size 194 B........... /user/jifeng/output/clusters-6/_policy: CORRUPT block blk_7422539300806584926 /user/jifeng/output/clusters-6/_policy: MISSING 1 blocks of total size 194 B....... /user/jifeng/output/clusters-7/part-r-00000: CORRUPT block blk_7396752195048257419 /user/jifeng/output/clusters-7/part-r-00000: MISSING 1 blocks of total size 7581 B...... /user/jifeng/output/clusters-8/part-r-00000: CORRUPT block blk_9080037511646150766 /user/jifeng/output/clusters-8/part-r-00000: MISSING 1 blocks of total size 7581 B......... /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: CORRUPT block blk_3764002349176068586 /user/jifeng/output/data/_logs/history/job_201408221126_0001_conf.xml: MISSING 1 blocks of total size 49204 B... /user/jifeng/output/random-seeds/part-randomSeed: CORRUPT block blk_-5584297838940778022 /user/jifeng/output/random-seeds/part-randomSeed: MISSING 1 blocks of total size 7750 B... /user/jifeng/testdata/synthetic_control.data: CORRUPT block blk_-2049677542258916799 /user/jifeng/testdata/synthetic_control.data: MISSING 1 blocks of total size 288374 B.Status: CORRUPT Total size: 1304321705 B Total dirs: 121 Total files: 149 Total blocks (validated): 143 (avg. block size 9121130 B) ******************************** CORRUPT FILES: 33 MISSING BLOCKS: 33 MISSING SIZE: 709307 B CORRUPT BLOCKS: 33 ******************************** Minimally replicated blocks: 110 (76.92308 %) Over-replicated blocks: 0 (0.0 %) Under-replicated blocks: 2 (1.3986014 %) Mis-replicated blocks: 0 (0.0 %) Default replication factor: 1 Average block replication: 0.8811189 Corrupt blocks: 33 Missing replicas: 14 (11.111111 %) Number of data-nodes: 3 Number of racks: 1 FSCK ended at Sat Sep 06 23:05:11 CST 2014 in 22 milliseconds The filesystem under path '/' is CORRUPT [jifeng@jifeng01 hbase-0.94.21]$
相关文章推荐
- vivado仿真出错: Please check the Tcl console or log files for more information.
- MS SQL错误:SQL Server failed with error code 0xc0000000 to spawn a thread to process a new login or connection. Check the SQL Server error log and the Windows event logs for information about possible related problems
- MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error
- HDU 4627 There are many unsolvable problem in the world.It could be about one or about zero.But this time it is about bigger number.
- MISCONF Redis is configured to save RDB snapshots, but is currently not able to persist on disk. Commands that may modify the data set are disabled. Please check Redis logs for details about the error
- failed to open the runspace pool. the server manager winrm plug-in might be corrupted or missing
- <<< Tomcat 部署项目There are no resources that can be added or removed from the server
- There are no resources that can be added or removed from the server
- Cannot start session without errors, please check errors given in your PHP and/or webserver log file
- phpMyAdmin-Error:The mbstring extension is missing. Please check your PHP configuration.
- IDEA There is no configured/running web-servers found! Please, run any web-configuration and hit the
- Eclipse There are no resources that can be added or removed from the server.
- Sybase You can't run SELECT INTO in this database. Please check with the Database Owner.
- There are no resources that can be added or removed from the server. .
- Question 13: Which of the following declarations of function main are standard or standard conforming extensions? (Please note t
- Theserver is not reeady for publishing.Please check if the Publishing Tools on the serverare started
- php安装报错:PHP configure: error: build test failed. Please check the config.log
- Android SDK is missing, out of date, or is missing templates. Please ensure you are using SDK versio
- Custom tool error: Failed to generate code for the service reference ××××××. Please check other error and warning messages for details.
- Cannot add PPA: 'ppa:'. Please check that the PPA name or format is correct