AWS Data Pipeline RedshiftCopy 活动 没有合适的驱动程序

Posted

技术标签:

【中文标题】AWS Data Pipeline RedshiftCopy 活动 没有合适的驱动程序【英文标题】:AWS Data Pipeline RedshiftCopy activity No suitable drivers 【发布时间】:2017-02-01 06:24:57 【问题描述】:

我正在尝试从 S3 到 Redshift 的 Redshift 复制活动,运行时出现以下错误。

01 Feb 2017 04:08:38,467 [INFO] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.taskrunner.TaskPoller: Executing: amazonaws.datapipeline.activity.RedshiftCopyActivity@63859f83
01 Feb 2017 04:08:38,962 [ERROR] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.database.ConnectionFactory: Unable to establish connection to postgresql:/redshiftHost:5439/trivusdev No suitable driver found for postgresql:/redshiftHost:5439/trivusdev
01 Feb 2017 04:08:39,063 [ERROR] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.database.ConnectionFactory: Unable to establish connection to postgresql:/redshiftHost:5439/trivusdev No suitable driver found for postgresql:/redshiftHost:5439/trivusdev
01 Feb 2017 04:08:39,265 [ERROR] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.database.ConnectionFactory: Unable to establish connection to postgresql:/redshiftHost:5439/trivusdev No suitable driver found for postgresql:/redshiftHost:5439/trivusdev
01 Feb 2017 04:08:39,666 [ERROR] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.database.ConnectionFactory: Unable to establish connection to postgresql:/redshiftHost:5439/trivusdev No suitable driver found for postgresql:/redshiftHost:5439/trivusdev
01 Feb 2017 04:08:40,468 [ERROR] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.database.ConnectionFactory: Unable to establish connection to postgresql:/redshiftHost:5439/trivusdev No suitable driver found for postgresql:/redshiftHost:5439/trivusdev
01 Feb 2017 04:08:40,473 [INFO] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.taskrunner.HeartBeatService: Finished waiting for heartbeat thread @RedshiftLoadActivity_2017-02-01T03:43:47_Attempt=3
01 Feb 2017 04:08:40,473 [INFO] (TaskRunnerService-resource:df-0657690RH3EEUVGYXWE_@Ec2Instance_2017-02-01T03:43:47-0) df-0657690RH3EEUVGYXWE amazonaws.datapipeline.taskrunner.TaskPoller: Work RedshiftCopyActivity took 0:2 to complete

我可以看到有人建议使用 postgresql 驱动程序,而不是 redshift 驱动程序。

但是当我尝试使用 postgresql 驱动程序时,我得到的错误是:

No suitable driver found for postgresql://.....

请建议我应该在哪里进行更正?

【问题讨论】:

【参考方案1】:

事实上没有为 postgresql:/redshiftHost:5439/trivusdev 找到合适的驱动程序 你确定这是正确的 URL,URL 应该如下所示:

jdbc:postgresql://redshiftHost:5439/trivusdev?OpenSourceSubProtocolOverride=true 

我认为您在主持人之前错过了jdbc:../

您可以在这里了解更多信息:Creating a custom Database connection

希望对你有帮助。

【讨论】:

这就是缺少的东西,它现在可以创建连接了。

以上是关于AWS Data Pipeline RedshiftCopy 活动 没有合适的驱动程序的主要内容,如果未能解决你的问题,请参考以下文章

什么是 AWS Data Pipeline

使用 Data Pipeline 在 AWS 中进行批处理文件

AWS:通过使用 amazon-data-pipeline 将数据从 S3 传输到 Redshift 来实现除 COPY 之外的其他功能

AWS Data Pipeline 无法验证 S3 访问 [权限警告]

在 AWS Data Pipeline 中创建聚合表

AWS Data Pipeline 在 emr 活动步骤部分中转义逗号