sqoop报错java.lang.Throwable Message: ERROR: schema "jice" does not exist

Posted 2020-10-06

---恢复内容开始---

Caused by: Exception: java.lang.Throwable Message: ERROR: schema "jice" does not exist
位置：35
Stack trace:
at org.postgresql.core.v3.QueryExecutorImpl (QueryExecutorImpl.java:2102)
at org.postgresql.core.v3.QueryExecutorImpl (QueryExecutorImpl.java:1835)
at org.postgresql.core.v3.QueryExecutorImpl (QueryExecutorImpl.java:257)
at org.postgresql.jdbc2.AbstractJdbc2Statement (AbstractJdbc2Statement.java:500)
at org.postgresql.jdbc2.AbstractJdbc2Statement (AbstractJdbc2Statement.java:388)
at org.postgresql.jdbc2.AbstractJdbc2Statement (AbstractJdbc2Statement.java:273)
at org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer (GenericJdbcFromInitializer.java:257)
at org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer (GenericJdbcFromInitializer.java:61)
at org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer (GenericJdbcFromInitializer.java:47)
at org.apache.sqoop.driver.JobManager$1 (JobManager.java:520)
at org.apache.sqoop.driver.JobManager$1 (JobManager.java:517)
at org.apache.sqoop.utils.ClassUtils (ClassUtils.java:281)
at org.apache.sqoop.driver.JobManager (JobManager.java:516)
at org.apache.sqoop.driver.JobManager (JobManager.java:423)
at org.apache.sqoop.driver.JobManager (JobManager.java:317)
at org.apache.sqoop.handler.JobRequestHandler (JobRequestHandler.java:353)
at org.apache.sqoop.handler.JobRequestHandler (JobRequestHandler.java:114)
at org.apache.sqoop.server.v1.JobServlet (JobServlet.java:84)
at org.apache.sqoop.server.SqoopProtocolServlet (SqoopProto

问题原因：在greenplum和mysql中不太一样，mysql中配置shema为数据库名称没有问题。但是在GP中不需要配置shema就能使用。

去掉shema后运行正常。并且文件的个数与Extractors: 2没有关系。
与Loaders: 2有关系。loaders配置是几就会生成多少个文件。

sqoop:000> update job -n path
Updating job with name path
Please update job:
Name: path

Database source

Schema name:
Table name: path
SQL statement:
Column names:
There are currently 0 values in the list:
element#
Partition column: id
Partition column nullable:
Boundary query:

Incremental read

Check column:
Last value:

Target configuration

Override null value:
Null value:
File format:
0 : TEXT_FILE
1 : SEQUENCE_FILE
2 : PARQUET_FILE
Choose: 0
Compression codec:
0 : NONE
1 : DEFAULT
2 : DEFLATE
3 : GZIP
4 : BZIP2
5 : LZO
6 : LZ4
7 : SNAPPY
8 : CUSTOM
Choose:
Custom codec:
Output directory: /user/sqoop/path
Append mode:

Throttling resources

Extractors: 2
Loaders: 2

Classpath configuration

Extra mapper jars:
There are currently 0 values in the list:
element#
Job was successfully updated with status OK
sqoop:000>

---恢复内容结束---