Hadoop “Failed to set setXIncludeAware(true) for parser” error and how to resolve it
2013-12-03 11:01
561 查看
原文地址: http://caffeinbean.wordpress.com/2011/03/01/hadoop-failed-to-set-setxincludeawaretrue-for-parser-error-and-how-to-resolve-it/
Hadoop is a great piece of technology. But it’s not the technology that helps you solve the great problems. It’s the attitude you gain after absorbing the knowledge, and the courage to attack the problems.
For Hadoop, the “hello world” application is WordCount. Basically you feed a document with the assumption that it can be huge, the map reduce program outputs unique words and their counts. In real life however, the challenges you face is not as trivial. Some
are not yet answered and subject to active exploration and development. Dependency injection is a hot topic for instance. But for this post I’ll focus on a specific problem and present you the solution.
If you ever have to deal with XML in map reduce environment, it’s possible that you get a stacktrace dump similar below.
The reason is that the JDK supplied XML libraries are a bit out of date. In order to get rid of this error, you’ll need to both provide recent versions of Xalan and Xerces with you job configuration, which means you’ll need to make them available in your classpath.
If you’re using maven, (you are using maven for map reduce jobs right?) it’s just a couple of lines to include in the pom file.
The versions for xalan are xerces are specific. You need to supply the versions listed or above.
Hadoop is a great piece of technology. But it’s not the technology that helps you solve the great problems. It’s the attitude you gain after absorbing the knowledge, and the courage to attack the problems.
For Hadoop, the “hello world” application is WordCount. Basically you feed a document with the assumption that it can be huge, the map reduce program outputs unique words and their counts. In real life however, the challenges you face is not as trivial. Some
are not yet answered and subject to active exploration and development. Dependency injection is a hot topic for instance. But for this post I’ll focus on a specific problem and present you the solution.
If you ever have to deal with XML in map reduce environment, it’s possible that you get a stacktrace dump similar below.
If you’re using maven, (you are using maven for map reduce jobs right?) it’s just a couple of lines to include in the pom file.
相关文章推荐
- ERROR org.apache.hadoop.conf.Configuration: Failed to set setXIncludeAware(true) for parser
- Failed to set setXIncludeAware(true) for parser com.caucho.xml.parsers.XmlDocumentBuilderFactory@d83
- Failed to set setXIncludeAware(true) for parser
- Error:Failed to resolve: com.android.support或者Install Repository and sync project问题
- Units Problem: How to read text size as custom attr from xml and set it to TextView in java code
- Notepad++: Load langs.xml failed! — and how to fix it
- 【转】Sys.WebForms.PageRequestManagerParserErrorException - what it is and how to avoid it
- Sys.WebForms.PageRequestManagerParserErrorException - what it is and how to avoid it
- Sys.WebForms.PageRequestManagerParserErrorException - what it is and how to avoid it
- How to resolve such problem :unpack failed: error Missing tree
- Units Problem: How to read text size as custom attr from xml and set it to TextView in java code
- Sys.WebForms.PageRequestManagerParserErrorException - what it is and how to avoid it
- phpBB's Failed Sending Email Errors (and how to resolve)
- Units Problem: How to read text size as custom attr from xml and set it to TextView in java code
- [linux]How to set PATH in shell script, and keep it avaiable even after it exits
- Android Studio不能运行程序,提示信息:Error: Failed to resolve: com.android.support:appcompat-v7:27.+ <a hr
- windows下Eclipse操作MapReduce例子报错:Failed to set permissions of path: \tmp\hadoop-Jerome\mapred\staging\
- How to Design a Good API and Why it Matters
- web.xml is missing and <failOnMissingWebXml> is set to true
- Error:(26, 13) Failed to resolve: com.android.support:appcompat-v7:27.+