遇到的问题---airflow on k8s---运行时scheduler报错ImportError: libpq.so.5: cannot open shared object file: No s

Posted 张小凡vip

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了遇到的问题---airflow on k8s---运行时scheduler报错ImportError: libpq.so.5: cannot open shared object file: No s相关的知识,希望对你有一定的参考价值。

情况

之前在k8s中部署了工作流引擎airflow正常稳定运行。

突然有一天没修改任何东西的情况下 重新ci/cd后 pod出现异常。

具体报错如下:

/usr/local/lib/python3.7/dist-packages/airflow/configuration.py:631: DeprecationWarning: Specifying both AIRFLOW_HOME environment variable and airflow_home in the config file is deprecated. Please use only the AIRFLOW_HOME environment variable and remove the config file entry.
  warnings.warn(msg, category=DeprecationWarning)
/usr/local/lib/python3.7/dist-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.25.11) or chardet (3.0.4) doesn\'t match a supported version!
  RequestsDependencyWarning)
[2021-06-21 11:06:40,545] {settings.py:253} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=3600, pid=1
Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 25, in <module>
    from airflow.configuration import conf
  File "/u

以上是关于遇到的问题---airflow on k8s---运行时scheduler报错ImportError: libpq.so.5: cannot open shared object file: No s的主要内容,如果未能解决你的问题,请参考以下文章

airflow的使用

Spark on k8s: 配置和使用ConfigMap

airflow+k8s 多用户-分布式-跨集群-容器化调度

airflow并发慢

获取有关 Airflow on_failure_callback 上下文的异常详细信息

airflow是啥意思