您的位置:首页 > 运维架构

Learning Hadoop

2013-07-22 20:01 246 查看
1. bin/hadoop jar hadoop-examples-*.jar grep conf output 'dfs[a-z.]+'

13/07/22 07:59:45 INFO util.NativeCodeLoader: Loaded the native-hadoop library

13/07/22 07:59:46 WARN snappy.LoadSnappy: Snappy native library not loaded

13/07/22 07:59:46 INFO mapred.FileInputFormat: Total input paths to process : 16

13/07/22 07:59:46 INFO mapred.JobClient: Running job: job_local_0001

13/07/22 07:59:46 INFO util.ProcessTree: setsid exited with exit code 0

13/07/22 07:59:46 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@85b4459

13/07/22 07:59:46 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:46 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:46 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:46 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/capacity-scheduler.xml:0+7457

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90a09af

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000001_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-policy.xml:0+4644

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@90ac0dc

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.MapTask: Finished spill 0

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000002_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/log4j.properties:0+4441

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb9ab

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000003_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-env.sh:0+2237

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb8fb

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000004_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-queue-acls.xml:0+2033

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec3ac

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000005_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hadoop-metrics2.properties:0+1488

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000005_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebacb

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000006_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-client.xml.example:0+1243

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000006_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eba73

13/07/22 07:59:47 INFO mapred.JobClient:  map 100% reduce 0%

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000007_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/ssl-server.xml.example:0+1195

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000007_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec518

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000008_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/configuration.xsl:0+535

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000008_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb888

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000009_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/taskcontroller.cfg:0+382

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000009_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecdd5

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000010_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/fair-scheduler.xml:0+327

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000010_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebcf5

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000011_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/hdfs-site.xml:0+178

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000011_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ebda1

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:47 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:47 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:47 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:47 INFO mapred.Task: Task:attempt_local_0001_m_000012_0 is done. And is in the process of commiting

13/07/22 07:59:47 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/core-site.xml:0+178

13/07/22 07:59:47 INFO mapred.Task: Task 'attempt_local_0001_m_000012_0' done.

13/07/22 07:59:47 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecaec

13/07/22 07:59:47 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:47 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000013_0 is done. And is in the process of commiting

13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/mapred-site.xml:0+178

13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000013_0' done.

13/07/22 07:59:48 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec195

13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000014_0 is done. And is in the process of commiting

13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/slaves:0+10

13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000014_0' done.

13/07/22 07:59:48 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ec712

13/07/22 07:59:48 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:48 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:48 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:48 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:48 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_m_000015_0 is done. And is in the process of commiting

13/07/22 07:59:48 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/conf/masters:0+10

13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_m_000015_0' done.

13/07/22 07:59:48 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82ecd87

13/07/22 07:59:48 INFO mapred.LocalJobRunner:

13/07/22 07:59:48 INFO mapred.Merger: Merging 16 sorted segments

13/07/22 07:59:48 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 54 bytes

13/07/22 07:59:48 INFO mapred.LocalJobRunner:

13/07/22 07:59:48 INFO mapred.Task: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting

13/07/22 07:59:48 INFO mapred.LocalJobRunner:

13/07/22 07:59:48 INFO mapred.Task: Task attempt_local_0001_r_000000_0 is allowed to commit now

13/07/22 07:59:48 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264

13/07/22 07:59:48 INFO mapred.LocalJobRunner: reduce > reduce

13/07/22 07:59:48 INFO mapred.Task: Task 'attempt_local_0001_r_000000_0' done.

13/07/22 07:59:48 INFO mapred.JobClient:  map 100% reduce 100%

13/07/22 07:59:49 INFO mapred.JobClient: Job complete: job_local_0001

13/07/22 07:59:49 INFO mapred.JobClient: Counters: 21

13/07/22 07:59:49 INFO mapred.JobClient:   File Input Format Counters

13/07/22 07:59:49 INFO mapred.JobClient:     Bytes Read=26536

13/07/22 07:59:49 INFO mapred.JobClient:   File Output Format Counters

13/07/22 07:59:49 INFO mapred.JobClient:     Bytes Written=160

13/07/22 07:59:49 INFO mapred.JobClient:   FileSystemCounters

13/07/22 07:59:49 INFO mapred.JobClient:     FILE_BYTES_READ=3029579

13/07/22 07:59:49 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=3314276

13/07/22 07:59:49 INFO mapred.JobClient:   Map-Reduce Framework

13/07/22 07:59:49 INFO mapred.JobClient:     Map output materialized bytes=146

13/07/22 07:59:49 INFO mapred.JobClient:     Map input records=749

13/07/22 07:59:49 INFO mapred.JobClient:     Reduce shuffle bytes=0

13/07/22 07:59:49 INFO mapred.JobClient:     Spilled Records=4

13/07/22 07:59:49 INFO mapred.JobClient:     Map output bytes=46

13/07/22 07:59:49 INFO mapred.JobClient:     Total committed heap usage (bytes)=4527820800

13/07/22 07:59:49 INFO mapred.JobClient:     CPU time spent (ms)=0

13/07/22 07:59:49 INFO mapred.JobClient:     Map input bytes=26536

13/07/22 07:59:49 INFO mapred.JobClient:     SPLIT_RAW_BYTES=1818

13/07/22 07:59:49 INFO mapred.JobClient:     Combine input records=2

13/07/22 07:59:49 INFO mapred.JobClient:     Reduce input records=2

13/07/22 07:59:49 INFO mapred.JobClient:     Reduce input groups=2

13/07/22 07:59:49 INFO mapred.JobClient:     Combine output records=2

13/07/22 07:59:49 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0

13/07/22 07:59:49 INFO mapred.JobClient:     Reduce output records=2

13/07/22 07:59:49 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0

13/07/22 07:59:49 INFO mapred.JobClient:     Map output records=2

13/07/22 07:59:49 INFO mapred.FileInputFormat: Total input paths to process : 1

13/07/22 07:59:49 INFO mapred.JobClient: Running job: job_local_0002

13/07/22 07:59:49 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82eb4bc

13/07/22 07:59:50 INFO mapred.MapTask: numReduceTasks: 1

13/07/22 07:59:50 INFO mapred.MapTask: io.sort.mb = 100

13/07/22 07:59:50 INFO mapred.MapTask: data buffer = 79691776/99614720

13/07/22 07:59:50 INFO mapred.MapTask: record buffer = 262144/327680

13/07/22 07:59:50 INFO mapred.MapTask: Starting flush of map output

13/07/22 07:59:50 INFO mapred.MapTask: Finished spill 0

13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting

13/07/22 07:59:50 INFO mapred.LocalJobRunner: file:/home/yj70978/hadoop/hadoop-1.1.2/grep-temp-827490264/part-00000:0+148

13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_m_000000_0' done.

13/07/22 07:59:50 INFO mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@82e1723

13/07/22 07:59:50 INFO mapred.LocalJobRunner:

13/07/22 07:59:50 INFO mapred.Merger: Merging 1 sorted segments

13/07/22 07:59:50 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 52 bytes

13/07/22 07:59:50 INFO mapred.LocalJobRunner:

13/07/22 07:59:50 INFO mapred.Task: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting

13/07/22 07:59:50 INFO mapred.LocalJobRunner:

13/07/22 07:59:50 INFO mapred.Task: Task attempt_local_0002_r_000000_0 is allowed to commit now

13/07/22 07:59:50 INFO mapred.FileOutputCommitter: Saved output of task 'attempt_local_0002_r_000000_0' to file:/home/yj70978/hadoop/hadoop-1.1.2/output

13/07/22 07:59:50 INFO mapred.LocalJobRunner: reduce > reduce

13/07/22 07:59:50 INFO mapred.Task: Task 'attempt_local_0002_r_000000_0' done.

13/07/22 07:59:50 INFO mapred.JobClient:  map 100% reduce 100%

13/07/22 07:59:50 INFO mapred.JobClient: Job complete: job_local_0002

13/07/22 07:59:50 INFO mapred.JobClient: Counters: 21

13/07/22 07:59:50 INFO mapred.JobClient:   File Input Format Counters

13/07/22 07:59:50 INFO mapred.JobClient:     Bytes Read=160

13/07/22 07:59:50 INFO mapred.JobClient:   File Output Format Counters

13/07/22 07:59:50 INFO mapred.JobClient:     Bytes Written=46

13/07/22 07:59:50 INFO mapred.JobClient:   FileSystemCounters

13/07/22 07:59:50 INFO mapred.JobClient:     FILE_BYTES_READ=663158

13/07/22 07:59:50 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=774250

13/07/22 07:59:50 INFO mapred.JobClient:   Map-Reduce Framework

13/07/22 07:59:50 INFO mapred.JobClient:     Map output materialized bytes=56

13/07/22 07:59:50 INFO mapred.JobClient:     Map input records=2

13/07/22 07:59:50 INFO mapred.JobClient:     Reduce shuffle bytes=0

13/07/22 07:59:50 INFO mapred.JobClient:     Spilled Records=4

13/07/22 07:59:50 INFO mapred.JobClient:     Map output bytes=46

13/07/22 07:59:50 INFO mapred.JobClient:     Total committed heap usage (bytes)=532684800

13/07/22 07:59:50 INFO mapred.JobClient:     CPU time spent (ms)=0

13/07/22 07:59:50 INFO mapred.JobClient:     Map input bytes=62

13/07/22 07:59:50 INFO mapred.JobClient:     SPLIT_RAW_BYTES=122

13/07/22 07:59:50 INFO mapred.JobClient:     Combine input records=0

13/07/22 07:59:50 INFO mapred.JobClient:     Reduce input records=2

13/07/22 07:59:50 INFO mapred.JobClient:     Reduce input groups=1

13/07/22 07:59:50 INFO mapred.JobClient:     Combine output records=0

13/07/22 07:59:50 INFO mapred.JobClient:     Physical memory (bytes) snapshot=0

13/07/22 07:59:50 INFO mapred.JobClient:     Reduce output records=2

13/07/22 07:59:50 INFO mapred.JobClient:     Virtual memory (bytes) snapshot=0

13/07/22 07:59:50 INFO mapred.JobClient:     Map output records=2
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  Learning Hadoop