streamsets 源码构建

Posted 2020-11-23 rongfengliang

依赖构建工具

git 1.9+ 

oracle jdk  8 

docker 1.10+ 

maven  3.3.9+

nodejs

npm

grunt-cli 

md5sum

预备构建任务

• data collector

git clone   http://github.com/streamsets/datacollector-api

git clone http://github.com/streamsets/datacollector-plugin-api

mvn clean install -DskipTests

• edge

git clone  https://github.com/streamsets/datacollector-edge.git

./gradlew clean dist publishToMavenLocal

编译

• clone 代码

git clone http://github.com/streamsets/datacollector

• 构建(dev)

mvn package -Pdist,ui -DskipTests

• 运行集成测试

mvn install -Pdist -DskipTests

mvn failsafe:integration-test -DfailIfNoTests=false

• release

mvn clean package -Drelease -DskipTests -P-rpm

说明

streamsets 依赖东西多（数据处理组件多），对于国内来说稍有漫长（maven 下载依赖），我运行一个测试跑了快一天，才运行起来

参考资料

https://github.com/streamsets/datacollector/blob/master/BUILD.md