若泽大数据 www.ruozedata.com

ruozedata


  • 主页

  • 归档

  • 分类

  • 标签

  • 发展历史

  • Suche

生产Flume源码导入IDEA方式

Veröffentlicht am 2019-06-17 | Bearbeitet am 2019-06-20 | in Flume | Aufrufe:

下载flume-ng-1.6.0-cdh5.7.0-src.tar.gz

下载地址:http://archive.cloudera.com/cdh5/cdh/5/flume-ng-1.6.0-cdh5.7.0-src.tar.gz

win安装好maven-3.3.9

解压flume-ng-1.6.0-cdh5.7.0-src.tar.gz并进入解压路径

编译:mvn clean compile

报错

1
2
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-enforcer-plugin:1.0:enforce (clean) on project flume-parent: Some Enforcer rules have failed. Look above for specific messages explaining
why the rule failed. -> [Help 1]

换成以下编译命令,跳过enforcer

mvn clean compile validate -Denforcer.skip=true

报错

1
2
3
4
[ERROR] Failed to execute goal on project flume-ng-morphline-solr-sink: Could not resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-morphline-solr-sink:jar:1.6.0-cdh5.7.0: Fail
ed to collect dependencies at org.kitesdk:kite-morphlines-all:pom:1.0.0-cdh5.7.0 -> org.kitesdk:kite-morphlines-useragent:jar:1.0.0-cdh5.7.0 -> ua_parser:ua-parser:jar:1.3.0: Failed to read artifact d
escriptor for ua_parser:ua-parser:jar:1.3.0: Could not transfer artifact ua_parser:ua-parser:pom:1.3.0 from/to maven-twttr (http://maven.twttr.com): Connect to maven.twttr.com:80 [maven.twttr.com/31.1
3.83.8] failed: Connection timed out: connect -> [Help 1]

flume-ng-morphline-solr-sink我们用不到,可以直接注释掉,在flume-ng-sinks下的pom中找到并注释

1
2
3
4
5
6
7
8
<modules>
<module>flume-hdfs-sink</module>
<module>flume-irc-sink</module>
<module>flume-ng-hbase-sink</module>
<module>flume-ng-elasticsearch-sink</module>
<!--<module>flume-ng-morphline-solr-sink</module> -->
<module>flume-ng-kafka-sink</module>
</modules>

然后重新编译mvn clean compile validate -Denforcer.skip=true,成功

编译

导入IDEA

1

2

3

4

5

6

然后等到导入完毕!

7

导入后没有任何报错,这时我们就可以对源码进行修改了!

ruozedata WeChat Bezahlung
# Flume
生产SparkStreaming数据零丢失最佳实践(含代码)
捷报:连续5周若泽数据第20-21名学员喜捷offer(含面试题)
  • Inhaltsverzeichnis
  • Übersicht

ruozedata

若泽数据优秀博客汇总
155 Artikel
31 Kategorien
74 schlagwörter
RSS
GitHub B站学习视频 腾讯课堂学习视频 官网
  1. 1. 下载flume-ng-1.6.0-cdh5.7.0-src.tar.gz
  2. 2. win安装好maven-3.3.9
  3. 3. 解压flume-ng-1.6.0-cdh5.7.0-src.tar.gz并进入解压路径
  4. 4. 编译:mvn clean compile
  5. 5. 导入IDEA
|
若泽数据
|