Skip to content

Commit b231974

Browse files
author
dapeng
committed
fix
1 parent 4bbe751 commit b231974

File tree

2 files changed

+66
-12
lines changed

2 files changed

+66
-12
lines changed

docs/plugin/mysqlSink.md

Lines changed: 61 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@ CREATE TABLE tableName(
2222

2323
|参数名称|含义|
2424
|----|---|
25-
| tableName| mysql表名称|
25+
| tableName| 结果表名称|
2626
| colName | 列名称|
2727
| colType | 列类型 [colType支持的类型](docs/colType.md)|
2828

@@ -33,21 +33,70 @@ CREATE TABLE tableName(
3333
|type |表名 输出表类型[mysq|hbase|elasticsearch]|||
3434
|url | 连接mysql数据库 jdbcUrl |||
3535
|userName | mysql连接用户名 |||
36-
| password | mysql连接密码|||
37-
| tableName | mysql表名称|||
38-
| parallelism | 并行度设置||1|
39-
40-
## 5.样例:
36+
|password | mysql连接密码|||
37+
|tableName | mysql表名称|||
38+
|parallelism | 并行度设置||1|
39+
|batchNum | flush的大小||100|
40+
|batchWaitInterval | flush的时间间隔,单位ms||1000|
41+
|allReplace| true:新值替换旧值||false|
42+
|updateMode| APPEND:不回撤数据,只下发增量数据,UPSERT:先删除回撤数据,然后更新|||
43+
44+
## 5.完整样例:
4145
```
46+
CREATE TABLE MyTable(
47+
id int,
48+
channel varchar,
49+
pv varchar,
50+
xctime varchar,
51+
name varchar
52+
)WITH(
53+
type ='kafka10',
54+
bootstrapServers ='172.16.8.107:9092',
55+
zookeeperQuorum ='172.16.8.107:2181/kafka',
56+
offsetReset ='latest',
57+
topic ='es_test',
58+
timezone='Asia/Shanghai',
59+
topicIsPattern ='false',
60+
parallelism ='1'
61+
);
62+
4263
CREATE TABLE MyResult(
43-
channel VARCHAR,
44-
pv VARCHAR
64+
pv VARCHAR,
65+
channel VARCHAR
4566
)WITH(
4667
type ='mysql',
47-
url ='jdbc:mysql://172.16.8.104:3306/test?charset=utf8',
68+
url ='jdbc:mysql://172.16.10.134:3306/test',
4869
userName ='dtstack',
4970
password ='abc123',
50-
tableName ='pv2',
71+
tableName ='myresult',
5172
parallelism ='1'
52-
)
53-
```
73+
);
74+
75+
76+
insert
77+
into
78+
MyResult
79+
select
80+
channel,
81+
pv
82+
from
83+
MyTable
84+
```
85+
86+
## 6.结果表数据示例:
87+
```
88+
mysql> desc myresult;
89+
+---------+--------------+------+-----+---------+-------+
90+
| Field | Type | Null | Key | Default | Extra |
91+
+---------+--------------+------+-----+---------+-------+
92+
| channel | varchar(255) | YES | | NULL | |
93+
| pv | varchar(11) | YES | | NULL | |
94+
+---------+--------------+------+-----+---------+-------+
95+
2 rows in set (0.00 sec)
96+
97+
mysql> select * from myresult limit 1;
98+
+---------+------+
99+
| channel | pv |
100+
+---------+------+
101+
| aa | mq6 |
102+
```

docs/plugin/redisSink.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,11 @@ redis5.0
4141
| database | reids 的数据库地址|||
4242
| tableName | redis 的表名称|||
4343
| parallelism | 并行度设置||1|
44+
|timeout| 连接超时时间||10000|
45+
|maxTotal|最大连接数||8|
46+
|maxIdle|最大空闲连接数||8|
47+
|minIdle|最小空闲连接数|||0|
48+
|masterName| 哨兵模式下的masterName|||
4449
4550

4651
## 5.样例:

0 commit comments

Comments
 (0)