DataX的安装

Posted 2021-01-21 enzodin

DataX的安装

1. 可下载tar包

https://github.com/alibaba/DataX/blob/master/userGuid.md

2. 下载源码自己编译

git clone https://github.com/alibaba/DataX.git
打包
mvn -U clean package assembly:assembly -Dmaven.test.skip=true

遇到错误
[ERROR] Failed to execute goal on project otsstreamreader: Could not resolve dependencies for project com.alibaba.datax:otsstreamreader:jar:1.0.0-SNAPSHOT: Could not find artifact com.aliyun.openservices:tablestore-streamclient:jar:1.0.0-SNAPSHOT -> [Help 1]
快照版本不一致，由于ots基本不会被用到，直接把pom.xml中的<module>ots</module>去掉
也可以更改版本otsstreamreader中的默认版本为0.0.1，改为1.0.0

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-jar-plugin:2.4:jar (default-jar) on project ocswriter: Error assembling JAR: /Users/FengZhen/Desktop/Hadoop/DataX/源码/DataX/ocswriter/pom.xml isn‘t a file. -> [Help 1]
ocs注释掉

继续打包即可。