Win7（64位）上编译、安装、配置、运行hadoop-Ver2.5.2---单机版配置运行

Setting SDK environment relative to C:\Program Files\Microsoft SDKs\Windows\v7.1\.

Targeting Windows 7 x64 Debug

C:\Program Files\Microsoft SDKs\Windows\v7.1>

cd

c:\hdfs

C:\hdfs>mvn package -Pdist,native-win -DskipTests -Dtar

[INFO]Scanning

for

projects...

[INFO]------------------------------------------------------------------------

[INFO]Reactor Build Order:

[INFO]

[INFO]Apache Hadoop Main

[INFO]Apache Hadoop Project POM

[INFO]Apache Hadoop Annotations

[INFO]Apache Hadoop Assemblies

[INFO]Apache Hadoop Project Dist POM

[INFO]Apache Hadoop Maven Plugins

[INFO]Apache Hadoop Auth

[INFO]Apache Hadoop Auth Examples

[INFO]Apache Hadoop Common

[INFO]Apache Hadoop NFS

[INFO]Apache Hadoop Common Project

[INFO]Apache Hadoop HDFS

[INFO]Apache Hadoop HttpFS

[INFO]Apache Hadoop HDFS BookKeeper Journal

[INFO]Apache Hadoop HDFS-NFS

[INFO]Apache Hadoop HDFS Project

[INFO]hadoop-yarn

[INFO]hadoop-yarn-api

[INFO]hadoop-yarn-common

[INFO]hadoop-yarn-server

[INFO]hadoop-yarn-server-common

[INFO]hadoop-yarn-server-nodemanager

[INFO]hadoop-yarn-server-web-proxy

[INFO]hadoop-yarn-server-resourcemanager

[INFO]hadoop-yarn-server-tests

[INFO]hadoop-yarn-client

[INFO]hadoop-yarn-applications

[INFO]hadoop-yarn-applications-distributedshell

[INFO]hadoop-mapreduce-client

[INFO]hadoop-mapreduce-client-core

[INFO]hadoop-yarn-applications-unmanaged-am-launcher

[INFO]hadoop-yarn-site

[INFO]hadoop-yarn-project

[INFO]hadoop-mapreduce-client-common

[INFO]hadoop-mapreduce-client-shuffle

[INFO]hadoop-mapreduce-client-app

[INFO]hadoop-mapreduce-client-hs

[INFO]hadoop-mapreduce-client-jobclient

[INFO]hadoop-mapreduce-client-hs-plugins

[INFO]Apache Hadoop MapReduce Examples

[INFO]hadoop-mapreduce

[INFO]Apache Hadoop MapReduce Streaming

[INFO]Apache Hadoop Distributed Copy

[INFO]Apache Hadoop Archives

[INFO]Apache Hadoop Rumen

[INFO]Apache Hadoop Gridmix

[INFO]Apache Hadoop Data Join

[INFO]Apache Hadoop Extras

[INFO]Apache Hadoop Pipes

[INFO]Apache Hadoop Tools Dist

[INFO]Apache Hadoop Tools

[INFO]Apache Hadoop Distribution

[INFO]Apache Hadoop Client

[INFO]Apache Hadoop Mini-

[INFO]

[INFO]------------------------------------------------------------------------

[INFO]Building Apache Hadoop Main 2.2.0

[INFO]------------------------------------------------------------------------

[INFO]

[INFO]--- maven-enforcer-plugin:1.3.1:enforce (default) @ hadoop-main ---

[INFO]

[INFO]--- maven-site-plugin:3.0:attach-descriptor (attach-descriptor) @ hadoop-main ---

<?

xml

version

=

"1.0"

encoding

=

"UTF-8"

?>

<?

xml-stylesheet

type

=

"text/xsl"

href

=

"configuration.xsl"

?>

<!--

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->

<!-- Put site-specific property overrides in this file. -->

<

configuration

>

<

property

>

<

name

>fs.defaultFS</

name

>

<

value

>hdfs://localhost:9000</

value

>

</

property

>

</

configuration

>

<?

xml

version

=

"1.0"

encoding

=

"UTF-8"

?>

<?

xml-stylesheet

type

=

"text/xsl"

href

=

"configuration.xsl"

?>

<!--

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->

<!-- Put site-specific property overrides in this file. -->

<

configuration

>

<

property

>

<

name

>dfs.replication</

name

>

<

value

>1</

value

>

</

property

>

<

property

>

<

name

>dfs.namenode.name.dir</

name

>

<

value

>file:/hadoop/data/dfs/namenode</

value

>

</

property

>

<

property

>

<

name

>dfs.datanode.data.dir</

name

>

<

value

>file:/hadoop/data/dfs/datanode</

value

>

</

property

>

</

configuration

>

<?

xml

version

=

"1.0"

?>

<!--

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->

<

configuration

>

<

property

>

<

name

>yarn.nodemanager.aux-services</

name

>

<

value

>mapreduce_shuffle</

value

>

</

property

>

<

property

>

<

name

>yarn.nodemanager.aux-services.mapreduce.shuffle.class</

name

>

<

value

>org.apache.hadoop.mapred.ShuffleHandler</

value

>

</

property

>

<

property

>

<

name

>yarn.application.classpath</

name

>

<

value

>

%HADOOP_HOME%\etc\hadoop,

%HADOOP_HOME%\share\hadoop\common\*,

%HADOOP_HOME%\share\hadoop\common\lib\*,

%HADOOP_HOME%\share\hadoop\mapreduce\*,

%HADOOP_HOME%\share\hadoop\mapreduce\lib\*,

%HADOOP_HOME%\share\hadoop\hdfs\*,

%HADOOP_HOME%\share\hadoop\hdfs\lib\*, 

%HADOOP_HOME%\share\hadoop\yarn\*,

%HADOOP_HOME%\share\hadoop\yarn\lib\*

</

value

>

</

property

>

</

configuration

>

<?

xml

version

=

"1.0"

?>

<?

xml-stylesheet

type

=

"text/xsl"

href

=

"configuration.xsl"

?>

<!--

Licensed under the Apache License, Version 2.0 (the "License");

you may not use this file except in compliance with the License.

You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software

distributed under the License is distributed on an "AS IS" BASIS,

WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

See the License for the specific language governing permissions and

limitations under the License. See accompanying LICENSE file.

-->

<!-- Put site-specific property overrides in this file. -->

<

configuration

>

<

property

>

<

name

>mapreduce.framework.name</

name

>

<

value

>yarn</

value

>

</

property

>

</

configuration

>

Microsoft Windows [Version 6.1.7601]

Copyright (c) 2009 Microsoft Corporation.All rights reserved.

C:\Users\abhijitg>

cd

c:\hadoop\bin

c:\hadoop\bin>hdfs namenode -

format

13

/11/03

18:07:47 INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting NameNode

STARTUP_MSG: host = ABHIJITG

/x

.x.x.x

STARTUP_MSG: args = [-

format

]

STARTUP_MSG: version = 2.2.0

STARTUP_MSG: classpath = <classpath jars here>

STARTUP_MSG: build = Unknown -r Unknown; compiled by ABHIJITG on 2013-11-01T13:42Z

STARTUP_MSG: java = 1.7.0_03

************************************************************/

Formatting using clusterid: CID-1af0bd9f-efee-4d4e-9f03-a0032c22e5eb

13

/11/03

18:07:48 INFO namenode.HostFileManager:

read

includes:

HostSet(

)

13

/11/03

18:07:48 INFO namenode.HostFileManager:

read

excludes:

HostSet(

)

13

/11/03

18:07:48 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit=1000

13

/11/03

18:07:48 INFO util.GSet: Computing capacity

for

map BlocksMap

13

/11/03

18:07:48 INFO util.GSet: VM

type

= 64-bit

13

/11/03

18:07:48 INFO util.GSet: 2.0% max memory = 888.9 MB

13

/11/03

18:07:48 INFO util.GSet: capacity= 2^21 = 2097152 entries

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: dfs.block.access.token.

enable

=

false

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: defaultReplication= 1

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: maxReplication= 512

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: minReplication= 1

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: maxReplicationStreams= 2

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: shouldCheckForEnoughRacks= 

false

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: replicationRecheckInterval = 3000

13

/11/03

18:07:48 INFO blockmanagement.BlockManager: encryptDataTransfer = 

false

13

/11/03

18:07:48 INFO namenode.FSNamesystem: fsOwner= ABHIJITG (auth:SIMPLE)

13

/11/03

18:07:48 INFO namenode.FSNamesystem: supergroup = supergroup

13

/11/03

18:07:48 INFO namenode.FSNamesystem: isPermissionEnabled =

true

13

/11/03

18:07:48 INFO namenode.FSNamesystem: HA Enabled:

false

13

/11/03

18:07:48 INFO namenode.FSNamesystem: Append Enabled:

true

13

/11/03

18:07:49 INFO util.GSet: Computing capacity

for

map INodeMap

13

/11/03

18:07:49 INFO util.GSet: VM

type

= 64-bit

13

/11/03

18:07:49 INFO util.GSet: 1.0% max memory = 888.9 MB

13

/11/03

18:07:49 INFO util.GSet: capacity= 2^20 = 1048576 entries

13

/11/03

18:07:49 INFO namenode.NameNode: Caching

file

names occuring

more

than 10

times

13

/11/03

18:07:49 INFO namenode.FSNamesystem: dfs.namenode.safemode.threshold-pct = 0.9990000128746033

13

/11/03

18:07:49 INFO namenode.FSNamesystem: dfs.namenode.safemode.min.datanodes = 0

13

/11/03

18:07:49 INFO namenode.FSNamesystem: dfs.namenode.safemode.extension = 30000

13

/11/03

18:07:49 INFO namenode.FSNamesystem: Retry cache on namenode is enabled

13

/11/03

18:07:49 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry

time

is 600000 millis

13

/11/03

18:07:49 INFO util.GSet: Computing capacity

for

map Namenode Retry Cache

13

/11/03

18:07:49 INFO util.GSet: VM

type

= 64-bit

13

/11/03

18:07:49 INFO util.GSet: 0.029999999329447746% max memory = 888.9 MB

13

/11/03

18:07:49 INFO util.GSet: capacity= 2^15 = 32768 entries

13

/11/03

18:07:49 INFO common.Storage: Storage directory \hadoop\data\dfs\namenode has been successfully formatted.

13

/11/03

18:07:49 INFO namenode.FSImage: Saving image

file

\hadoop\data\dfs\namenode\current\fsimage.ckpt_00000000000000

00000 using no compression

13

/11/03

18:07:49 INFO namenode.FSImage: Image

file

\hadoop\data\dfs\namenode\current\fsimage.ckpt_0000000000000000000 o

f size 200 bytes saved

in

0 seconds.

13

/11/03

18:07:49 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0

13

/11/03

18:07:49 INFO util.ExitUtil: Exiting with status 0

13

/11/03

18:07:49 INFO namenode.NameNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down NameNode at ABHIJITG

/x

.x.x.x

************************************************************/

C:\Users\abhijitg>

cd

c:\hadoop\sbin

c:\hadoop\sbin>start-dfs

C:\Users\abhijitg>

cd

c:\hadoop\sbin

c:\hadoop\sbin>start-yarn

starting yarn daemons

C:\Users\abhijitg>

cd

c:\hadoop\sbin

c:\hadoop\sbin>stop-dfs

SUCCESS: Sent termination signal to the process with PID 876.

SUCCESS: Sent termination signal to the process with PID 3848.

c:\hadoop\sbin>stop-yarn

stopping yarn daemons

SUCCESS: Sent termination signal to the process with PID 5920.

SUCCESS: Sent termination signal to the process with PID 7612.

INFO: No tasks running with the specified criteria.