Skip to content

Commit 0544cb9

Browse files
Merge pull request #198 from data-integrations/PLUGIN-994
[PLUGIN-994] updated markdown for fetch size in db sources
2 parents 117cbef + d8091c5 commit 0544cb9

File tree

15 files changed

+36
-1
lines changed

15 files changed

+36
-1
lines changed

aurora-mysql-plugin/docs/AuroraMysql-batchsource.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -52,6 +52,9 @@ will be passed to the JDBC driver as connection arguments for JDBC drivers that
5252
back from the query. However, it must match the schema that comes back from the query,
5353
except it can mark fields as nullable and can contain a subset of the fields.
5454

55+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
56+
with the tradeoff of higher memory usage.
57+
5558
Example
5659
------
5760
Suppose you want to read data from an Aurora DB MySQL database named "prod" that is running on

aurora-postgresql-plugin/docs/AuroraPostgres-batchsource.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -54,6 +54,9 @@ disabled.
5454
back from the query. However, it must match the schema that comes back from the query,
5555
except it can mark fields as nullable and can contain a subset of the fields.
5656

57+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
58+
with the tradeoff of higher memory usage.
59+
5760
Example
5861
------
5962
Suppose you want to read data from an Aurora DB PostgreSQL database named "prod" that is running on

cloudsql-mysql-plugin/docs/CloudSQLMySQL-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,8 @@ will be passed to the JDBC driver as connection arguments for JDBC drivers that
5151
back from the query. However, it must match the schema that comes back from the query,
5252
except it can mark fields as nullable and can contain a subset of the fields.
5353

54+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
55+
with the tradeoff of higher memory usage.
5456

5557
Data Types Mapping
5658
------------------

cloudsql-postgresql-plugin/docs/CloudSQLPostgreSQL-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,8 @@ will be passed to the JDBC driver as connection arguments for JDBC drivers that
5151
back from the query. However, it must match the schema that comes back from the query,
5252
except it can mark fields as nullable and can contain a subset of the fields.
5353

54+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
55+
with the tradeoff of higher memory usage.
5456

5557
Examples
5658
--------

db2-plugin/docs/Db2-batchsource.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,9 @@ will be passed to the JDBC driver as connection arguments for JDBC drivers that
5050
back from the query. However, it must match the schema that comes back from the query,
5151
except it can mark fields as nullable and can contain a subset of the fields.
5252

53+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
54+
with the tradeoff of higher memory usage.
55+
5356
Example
5457
------
5558
Suppose you want to read data from DB2 database named "prod" that is running on "localhost", port 50000,

generic-database-plugin/docs/Database-batchsource.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -48,6 +48,9 @@ except it can mark fields as nullable and can contain a subset of the fields.
4848

4949
**Transaction Isolation Level:** The transaction isolation level for queries run by this sink.
5050

51+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
52+
with the tradeoff of higher memory usage.
53+
5154
Example
5255
-------
5356
Suppose you want to read data from PostgreSQL database named "prod" that is running on "localhost" port 5432,

mariadb-plugin/docs/Mariadb-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,8 @@ connections.
7373

7474
**SQL_MODE:** Override the default SQL_MODE session variable used by the server.
7575

76+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
77+
with the tradeoff of higher memory usage.
7678

7779
Data Types Mapping
7880
----------

memsql-plugin/docs/Memsql-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,8 @@ connections.
7171

7272
**Use ANSI Quotes:** Treats " as an identifier quote character and not as a string quote character.
7373

74+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
75+
with the tradeoff of higher memory usage.
7476

7577
Data Types Mapping
7678
----------

mssql-plugin/docs/SqlServer-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -89,6 +89,8 @@ will be passed to the JDBC driver as connection arguments for JDBC drivers that
8989
back from the query. However, it must match the schema that comes back from the query,
9090
except it can mark fields as nullable and can contain a subset of the fields.
9191

92+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
93+
with the tradeoff of higher memory usage.
9294

9395
Data Types Mapping
9496
----------

mysql-plugin/docs/Mysql-batchsource.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,8 @@ connections.
7373

7474
**SQL_MODE:** Override the default SQL_MODE session variable used by the server.
7575

76+
**Fetch Size:** The number of rows to fetch at a time per split. Larger fetch size can result in faster import,
77+
with the tradeoff of higher memory usage.
7678

7779
Data Types Mapping
7880
----------

0 commit comments

Comments
 (0)