下载
Seatunnel2.3.1源码
Idea中的目录结构
编译
通过maven进行代码编译
编译命令
mvn clean package -pl seatunnel-dist -am -Dmaven.test.skip=true
编译单个模块命令
mvn clean package -pl seatunnel-examples/seatunnel-engine-examples -am -Dmaven.test.skip=true -T 1C
运行
编译完通过SeaTunnelEngineExample类来运行
这样就运行成功啦
附上配置文件样例
env {
execution.parallelism = 2
job.mode = "BATCH"
}
source {
Jdbc {
url = "jdbc:mysql://xxxxxx:3306/xxxxx"
driver = "com.mysql.cj.jdbc.Driver"
connection_check_timeout_sec = 100
user = "root"
password = "xxxxx"
query = "select * from test"
# partition_column = "id"
# partition_num = 10
}
}
sink {
Redis {
host = xxxxxx
port = 6379
key = "seatunnel_jdbc"
data_type = list
auth = "xxxxxx"
}
}
运行结果
常见问题
java.lang.RuntimeException: Plugin PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='XXXX'} not found.
这种报错是seatunnel-engine-examples模块缺少引用，在pom中引用下对应插件重新编译即可
<dependency>
<groupId>org.apache.seatunnel</groupId>
<artifactId>connector-rabbitmq</artifactId>
<version>${project.version}</version>
</dependency>
mvn clean package -pl seatunnel-dist -am -Dmaven.test.skip=true
