普元数据开发平台 普元数据开发平台
产品介绍
安装部署
快速入门
操作指南
SDK开发指南
FAQ
  • SeaTunnel安装指南
  • 1. 解压seatunnel
  • 2. 修改配置文件
  • 3. 修改拥有者
  • 4. 修改权限
  • 5.启动Seatunnel Server

# SeaTunnel安装指南

Seatunnel 单节点部署时需要和 Dolphinscheduler 的worker节点部署在同一台服务器。

获取介质:

apache-seatunnel-7.0.2-bin.tar.gz

# 1. 解压seatunnel

tar -zxvf apache-seatunnel-7.0.2-bin.tar.gz -C /home/seatunnel

# 2. 修改配置文件

  1. 编辑 ${SEATUNNEL_HOME}/config/hazelcast.yaml文件,修改member-list参数值为集群地址/单节点ip或域名。本手册中文件路径为:/home/seatunnel/apache-seatunnel-7.0.2/config/hazelcast.yaml

vim /home/seatunnel/apache-seatunnel-7.0.2/config/hazelcast.yaml

hazelcast:
  cluster-name: seatunnel
  network:
    rest-api:
      enabled: true
      endpoint-groups:
        CLUSTER_WRITE:
          enabled: true
        DATA:
          enabled: true
    join:
      tcp-ip:
        enabled: true
        member-list:
          - server1
          - server2
          - server3
    port:
      auto-increment: false
      port: 5801
  properties:
    hazelcast.invocation.max.retry.count: 20
    hazelcast.tcp.join.port.try.count: 30
    hazelcast.logging.type: log4j2
    hazelcast.operation.generic.thread.count: 100

hazelcast.yaml

  1. 编辑 ${SEATUNNEL_HOME}/config/hazelcast-client.yaml文件,修改cluster-members参数值为集群地址/单节点ip或域名。本手册中文件路径为:/home/seatunnel/apache-seatunnel-7.0.2/config/hazelcast-client.yaml

vim /home/seatunnel/apache-seatunnel-7.0.2/config/hazelcast-client.yaml

hazelcast-client:
  cluster-name: seatunnel
  properties:
    hazelcast.logging.type: log4j2
  network:
    cluster-members:
      - server1:5801
      - server2:5801
      - server3:5801

hazelcast-client.yaml

  1. 编辑 ${SEATUNNEL_HOME}/config/seatunnel.yaml文件,修改fs.defaultFS参数。本手册中文件路径为:/home/seatunnel/apache-seatunnel-7.0.2/config/seatunnel.yaml

vim /home/seatunnel/apache-seatunnel-7.0.2/config/seatunnel.yaml

  • 当使用HDFS存储文件时,修改fs.defaultFS值为hdfs路径
storage.type: hdfs
fs.defaultFS: hdfs://localhost:9000
  • 当使用LocalFile存储文件时,修改fs.defaultFS值为服务器的本地路径
storage.type: hdfs
fs.defaultFS: file:///

# 3. 修改拥有者

chown -R dws:dws /home/seatunnel

# 4. 修改权限

chmod -R 755 /home/seatunnel

# 5.启动Seatunnel Server

su dws cd /home/seatunnel/apache-seatunnel-7.0.2 ./bin/seatunnel-cluster.sh -d

停止seatunnel Server命令:

su dws cd /home/seatunnel/apache-seatunnel-7.0.2 ./bin/stop-seatunnel-cluster.sh

← Zookeeper安装指南(可选) Primeton DI安装指南 →