dwz入门(1)
2015-08-03 17:01
134 查看
Level: | SEVERE |
Message: | On crawl: NewsSohu You must set the User-Agent and From HTTP header values to acceptable strings. User-Agent: [software-name](+[info-url])[misc] From: [email-address] |
Exception: | org.archive.crawler.framework.exceptions.FatalConfigurationException: unacceptable 'user-agent' or 'from' (correct your configuration). Stacktrace: org.archive.crawler.framework.exceptions.FatalConfigurationException: unacceptable 'user-agent' or 'from' (correct your configuration). at org.archive.crawler.datamodel.CrawlOrder.checkUserAgentAndFrom(CrawlOrder.java:458) at org.archive.crawler.framework.CrawlController.initialize(CrawlController.java:339) at org.archive.crawler.admin.CrawlJob.setupForCrawlStart(CrawlJob.java:853) at org.archive.crawler.admin.CrawlJobHandler.startNextJobInternal(CrawlJobHandler.java:1144) at org.archive.crawler.admin.CrawlJobHandler$3.run(CrawlJobHandler.java:1127) at java.lang.Thread.run(Thread.java:662) |
相关文章推荐
- 数据表的连接
- ACM进阶计划(来自于南阳理工学院)
- Netty 中文介绍
- php中实现精确设置session过期时间的方法
- MSRCR(Multi-Scale Retinex with Color Restore)多尺度Retinex图像增强
- Bugly使用注意
- 《Soft Skill》一书中的好句子
- 关于裁剪系统后启动mount: could not find filesystem '/dev/root'问题
- 微信支付
- 数据结构之栈和队列---队列的基本操作
- hdu 5312 Sequence
- linux上使用LD_DEBUG环境变量查看程序使用哪些库
- 千与千寻
- hdu 3974 Assign the task
- 47.关于gradle的解疑
- 总结CSS3新特性(Animation篇)
- hdu 3917 Road constructions 最大权闭合子图
- php构造函数连接数据库
- LNK1123: 转换到 COFF 期间失败: 文件无效或损坏
- Java学习笔记------如何为文本输入框设置下凹效果?