Learning Hadoop
2013-07-22 20:01
246 查看
1. bin/hadoop jar hadoop-examples-*.jar grep conf output 'dfs[a-z.]+'
13/07/22 07:59:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/07/22 07:59:46 WARN snappy.LoadSnappy: Snappy native library not loaded
13/07/22 07:59:46 INFO mapred.FileInputFormat: Total input paths to process : 16
13/07/22 07:59:46 INFO mapred.JobClient: Running job: job_local_0001
13/07/22 07:59:46 INFO util.ProcessTree: setsid exited with exit code 0
13/07/22 07:59:46 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@85b4459
13/07/22 07:59:46 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:46 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:46 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:46 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/capacity-scheduler.xml:0+7457
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90a09af
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-policy.xml:0+4644
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90ac0dc
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000002_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/log4j.properties:0+4441
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb9ab
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000003_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-env.sh:0+2237
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb8fb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000004_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-queue-acls.xml:0+2033
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec3ac
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000005_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-metrics2.properties:0+1488
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000005_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebacb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000006_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-client.xml.example:0+1243
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000006_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eba73
13/07/22 07:59:47 INFO mapred.JobClient: map 100% reduce 0%
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000007_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-server.xml.example:0+1195
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000007_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec518
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000008_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/configuration.xsl:0+535
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000008_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb888
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000009_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/taskcontroller.cfg:0+382
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000009_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecdd5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000010_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/fair-scheduler.xml:0+327
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000010_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebcf5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000011_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hdfs-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000011_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebda1
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000012_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/core-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000012_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecaec
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000013_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-site.xml:0+178
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000013_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec195
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000014_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/slaves:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000014_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec712
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000015_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/masters:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000015_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecd87
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Merger: Merging 16 sorted segments
13/07/22 07:59:48 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 54 bytes
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task attempt_local_0001_r_000000_0 is allowed to commit now
13/07/22 07:59:48 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264
13/07/22 07:59:48 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_r_000000_0' done.
13/07/22 07:59:48 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:49 INFO mapred.JobClient: Job complete: job_local_0001
13/07/22 07:59:49 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:49 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Read=26536
13/07/22 07:59:49 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Written=160
13/07/22 07:59:49 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_READ=3029579
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_WRITTEN=3314276
13/07/22 07:59:49 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:49 INFO mapred.JobClient: Map output materialized bytes=146
13/07/22 07:59:49 INFO mapred.JobClient: Map input records=749
13/07/22 07:59:49 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:49 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:49 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:49 INFO mapred.JobClient: Total committed heap usage (bytes)=4527820800
13/07/22 07:59:49 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:49 INFO mapred.JobClient: Map input bytes=26536
13/07/22 07:59:49 INFO mapred.JobClient: SPLIT_RAW_BYTES=1818
13/07/22 07:59:49 INFO mapred.JobClient: Combine input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input groups=2
13/07/22 07:59:49 INFO mapred.JobClient: Combine output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Map output records=2
13/07/22 07:59:49 INFO mapred.FileInputFormat: Total input paths to process : 1
13/07/22 07:59:49 INFO mapred.JobClient: Running job: job_local_0002
13/07/22 07:59:49 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb4bc
13/07/22 07:59:50 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:50 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:50 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:50 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:50 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:50 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264/part-00000:0+148
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_m_000000_0' done.
13/07/22 07:59:50 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82e1723
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Merger: Merging 1 sorted segments
13/07/22 07:59:50 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 52 bytes
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task attempt_local_0002_r_000000_0 is allowed to commit now
13/07/22 07:59:50 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/output
13/07/22 07:59:50 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_r_000000_0' done.
13/07/22 07:59:50 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:50 INFO mapred.JobClient: Job complete: job_local_0002
13/07/22 07:59:50 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:50 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Read=160
13/07/22 07:59:50 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Written=46
13/07/22 07:59:50 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_READ=663158
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_WRITTEN=774250
13/07/22 07:59:50 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:50 INFO mapred.JobClient: Map output materialized bytes=56
13/07/22 07:59:50 INFO mapred.JobClient: Map input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:50 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:50 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:50 INFO mapred.JobClient: Total committed heap usage (bytes)=532684800
13/07/22 07:59:50 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:50 INFO mapred.JobClient: Map input bytes=62
13/07/22 07:59:50 INFO mapred.JobClient: SPLIT_RAW_BYTES=122
13/07/22 07:59:50 INFO mapred.JobClient: Combine input records=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input groups=1
13/07/22 07:59:50 INFO mapred.JobClient: Combine output records=0
13/07/22 07:59:50 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:50 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Map output records=2
13/07/22 07:59:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/07/22 07:59:46 WARN snappy.LoadSnappy: Snappy native library not loaded
13/07/22 07:59:46 INFO mapred.FileInputFormat: Total input paths to process : 16
13/07/22 07:59:46 INFO mapred.JobClient: Running job: job_local_0001
13/07/22 07:59:46 INFO util.ProcessTree: setsid exited with exit code 0
13/07/22 07:59:46 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@85b4459
13/07/22 07:59:46 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:46 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:46 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:46 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/capacity-scheduler.xml:0+7457
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90a09af
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-policy.xml:0+4644
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90ac0dc
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000002_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/log4j.properties:0+4441
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb9ab
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000003_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-env.sh:0+2237
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb8fb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000004_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-queue-acls.xml:0+2033
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec3ac
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000005_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-metrics2.properties:0+1488
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000005_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebacb
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000006_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-client.xml.example:0+1243
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000006_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eba73
13/07/22 07:59:47 INFO mapred.JobClient: map 100% reduce 0%
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000007_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-server.xml.example:0+1195
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000007_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec518
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000008_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/configuration.xsl:0+535
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000008_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb888
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000009_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/taskcontroller.cfg:0+382
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000009_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecdd5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000010_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/fair-scheduler.xml:0+327
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000010_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebcf5
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000011_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hdfs-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000011_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebda1
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000012_0 is done. And is in the process of commiting
13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/core-site.xml:0+178
13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000012_0' done.
13/07/22 07:59:47 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecaec
13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000013_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-site.xml:0+178
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000013_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec195
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000014_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/slaves:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000014_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec712
13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000015_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/masters:0+10
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000015_0' done.
13/07/22 07:59:48 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecd87
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Merger: Merging 16 sorted segments
13/07/22 07:59:48 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 54 bytes
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:48 INFO mapred.LocalJobRunner:
13/07/22 07:59:48 INFO mapred.Task: Task attempt_local_0001_r_000000_0 is allowed to commit now
13/07/22 07:59:48 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264
13/07/22 07:59:48 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_r_000000_0' done.
13/07/22 07:59:48 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:49 INFO mapred.JobClient: Job complete: job_local_0001
13/07/22 07:59:49 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:49 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Read=26536
13/07/22 07:59:49 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:49 INFO mapred.JobClient: Bytes Written=160
13/07/22 07:59:49 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_READ=3029579
13/07/22 07:59:49 INFO mapred.JobClient: FILE_BYTES_WRITTEN=3314276
13/07/22 07:59:49 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:49 INFO mapred.JobClient: Map output materialized bytes=146
13/07/22 07:59:49 INFO mapred.JobClient: Map input records=749
13/07/22 07:59:49 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:49 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:49 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:49 INFO mapred.JobClient: Total committed heap usage (bytes)=4527820800
13/07/22 07:59:49 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:49 INFO mapred.JobClient: Map input bytes=26536
13/07/22 07:59:49 INFO mapred.JobClient: SPLIT_RAW_BYTES=1818
13/07/22 07:59:49 INFO mapred.JobClient: Combine input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:49 INFO mapred.JobClient: Reduce input groups=2
13/07/22 07:59:49 INFO mapred.JobClient: Combine output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:49 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:49 INFO mapred.JobClient: Map output records=2
13/07/22 07:59:49 INFO mapred.FileInputFormat: Total input paths to process : 1
13/07/22 07:59:49 INFO mapred.JobClient: Running job: job_local_0002
13/07/22 07:59:49 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb4bc
13/07/22 07:59:50 INFO mapred.MapTask: numReduceTasks: 1
13/07/22 07:59:50 INFO mapred.MapTask: io.sort.mb = 100
13/07/22 07:59:50 INFO mapred.MapTask: data buffer = 79691776/99614720
13/07/22 07:59:50 INFO mapred.MapTask: record buffer = 262144/327680
13/07/22 07:59:50 INFO mapred.MapTask: Starting flush of map output
13/07/22 07:59:50 INFO mapred.MapTask: Finished spill 0
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264/part-00000:0+148
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_m_000000_0' done.
13/07/22 07:59:50 INFO mapred.Task: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82e1723
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Merger: Merging 1 sorted segments
13/07/22 07:59:50 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 52 bytes
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
13/07/22 07:59:50 INFO mapred.LocalJobRunner:
13/07/22 07:59:50 INFO mapred.Task: Task attempt_local_0002_r_000000_0 is allowed to commit now
13/07/22 07:59:50 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/output
13/07/22 07:59:50 INFO mapred.LocalJobRunner: reduce > reduce
13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_r_000000_0' done.
13/07/22 07:59:50 INFO mapred.JobClient: map 100% reduce 100%
13/07/22 07:59:50 INFO mapred.JobClient: Job complete: job_local_0002
13/07/22 07:59:50 INFO mapred.JobClient: Counters: 21
13/07/22 07:59:50 INFO mapred.JobClient: File Input Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Read=160
13/07/22 07:59:50 INFO mapred.JobClient: File Output Format Counters
13/07/22 07:59:50 INFO mapred.JobClient: Bytes Written=46
13/07/22 07:59:50 INFO mapred.JobClient: FileSystemCounters
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_READ=663158
13/07/22 07:59:50 INFO mapred.JobClient: FILE_BYTES_WRITTEN=774250
13/07/22 07:59:50 INFO mapred.JobClient: Map-Reduce Framework
13/07/22 07:59:50 INFO mapred.JobClient: Map output materialized bytes=56
13/07/22 07:59:50 INFO mapred.JobClient: Map input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce shuffle bytes=0
13/07/22 07:59:50 INFO mapred.JobClient: Spilled Records=4
13/07/22 07:59:50 INFO mapred.JobClient: Map output bytes=46
13/07/22 07:59:50 INFO mapred.JobClient: Total committed heap usage (bytes)=532684800
13/07/22 07:59:50 INFO mapred.JobClient: CPU time spent (ms)=0
13/07/22 07:59:50 INFO mapred.JobClient: Map input bytes=62
13/07/22 07:59:50 INFO mapred.JobClient: SPLIT_RAW_BYTES=122
13/07/22 07:59:50 INFO mapred.JobClient: Combine input records=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input records=2
13/07/22 07:59:50 INFO mapred.JobClient: Reduce input groups=1
13/07/22 07:59:50 INFO mapred.JobClient: Combine output records=0
13/07/22 07:59:50 INFO mapred.JobClient: Physical memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Reduce output records=2
13/07/22 07:59:50 INFO mapred.JobClient: Virtual memory (bytes) snapshot=0
13/07/22 07:59:50 INFO mapred.JobClient: Map output records=2
相关文章推荐
- 单机版搭建Hadoop环境图文教程详解
- hadoop常见错误以及处理方法详解
- hadoop 单机安装配置教程
- Apache Hadoop版本详解
- linux下搭建hadoop环境步骤分享
- hadoop client与datanode的通信协议分析
- hadoop中一些常用的命令介绍
- Hadoop安装感悟
- hadoop安装lzo
- HDFS 文件操作
- 【原创】基于分布式存储的开源系统在实时数据库海量历史数据存储项目上的预研
- 【原创】centos自带网卡驱动不兼容硬件,造成hadoop的datanode节点频繁宕机的解...
- Hadoop入门-单机伪分布式配置
- Fourinone四合一分布式计算框架整体介绍
- sqoop 中文文档 User guide 一
- sqoop 中文文档 User guide 二 import
- sqoop 中文文档 User guide 二 import续
- sqoop 中文文档 User guide 三 export
- sqoop 中文文档 User guide 四 validation
- sqoop 中文文档 User guide 五 job,metastore,merge,codegen