Partition tables on dbschema password#

option(key: String, value: String)ДЇor specifying an individual option, and. The class methods of interest for setting Greenplum-Spark Connector options are. You can specify options to the Connector individually or in an options Map. The minimum number of idle connections maintained in the connection pool. Optional, the default value is 10,000 (10 seconds). The amount of time, in milliseconds, after which an inactive connection is considered idle. The maximum number of connections in the connection pool. The name of the Spark worker node network interface on which to start the gpfdist server, or the environment variable name that identifies such. The name of the environment variable whose value identifies the Spark worker node hostname or IP address on which to start the gpfdist server process. Use the Spark worker node host name to specify the gpfdist server address. Optional, by default the Connector uses a random port. The gpfdist server process port number, or the environment variable name that identifies such, on the Spark worker node. Note: The connector.port option is deprecated as of version 1.6.0 and will be removed in a future release. This option is ignored in favor of server.port. When false, the Connector materializes the data set in memory during the write operation. The default value is true the Connector uses an Iterator to optimize memory. When true, the Connector truncates the target table before writing any data. The default value is false the Connector drops and then re-creates the target table before it writes any data. Governs the actions of the Connector when you specify SaveMode.Overwrite on a write operation and the target Greenplum Database table exists. Note: The partitionsPerSegment option is deprecated as of version 1.5.0 and will be removed in a future release. This option is ignored in favor of partitions. The number of Spark partitions per Greenplum Database segment. Optional, the default value is the number of primary segments in the Greenplum Database cluster. This column must be one of the Greenplum Database data types integer, bigint, serial, or bigserial. The name of the Greenplum Database table column to use for Spark partitioning.

Partition tables on dbschema password#

You can omit the password if Greenplum Database is configured to not require a password for the specified user, or if you use kerberos authentication and provide the required authentication properties in the JDBC connection string URL. The Greenplum Database password for the user. Optional, specify only when using a custom JDBC driver. The fully qualified class path of the custom JDBC driver. When writing from Spark to Greenplum Database, the Greenplum-Spark Connector creates the table in dbschema if the table does not already exist. When reading from Greenplum Database, this table or view must reside in the Greenplum Database schema identified in the dbschema option value. The name of the Greenplum Database table. Optional, the default schema is the schema named public. This option also identifies the name of the schema in which the Greenplum-Spark Connector creates temporary external tables. The name of the Greenplum Database schema in which dbtable resides. The JDBC connection string URL see Constructing the Greenplum Database JDBC URL. An option is required unless otherwise specified.

The Greenplum-Spark Connector supports the options identified in the table below. You provide Greenplum Database connection options and the read/write options required by the Greenplum-Spark Connector via generic key-value String pairs.