如何修复 GeoDjango OSError:未定义符号?

Posted

技术标签:

【中文标题】如何修复 GeoDjango OSError:未定义符号?【英文标题】:How can i fix a GeoDjango OSError: undefined Symbol? 【发布时间】:2020-04-26 08:54:36 【问题描述】:

几天前进行 yum 升级后,我的 Django 项目出现以下错误

Traceback (most recent call last):
  File "manage.py", line 21, in <module>
    main()
  File "manage.py", line 17, in main
    execute_from_command_line(sys.argv)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/core/management/__init__.py", line 357, in execute
    django.setup()
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/apps/registry.py", line 114, in populate
    app_config.import_models()
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/apps/config.py", line 211, in import_models
    self.models_module = import_module(models_module_name)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib64/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 994, in _gcd_import
  File "<frozen importlib._bootstrap>", line 971, in _find_and_load
  File "<frozen importlib._bootstrap>", line 955, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 665, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/auth/models.py", line 2, in <module>
    from django.contrib.auth.base_user import AbstractBaseUser, BaseUserManager
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/auth/base_user.py", line 47, in <module>
    class AbstractBaseUser(models.Model):
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/models/base.py", line 117, in __new__
    new_class.add_to_class('_meta', Options(meta, app_label))
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/models/base.py", line 321, in add_to_class
    value.contribute_to_class(cls, name)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/models/options.py", line 204, in contribute_to_class
    self.db_table = truncate_name(self.db_table, connection.ops.max_name_length())
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/__init__.py", line 28, in __getattr__
    return getattr(connections[DEFAULT_DB_ALIAS], item)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/utils.py", line 201, in __getitem__
    backend = load_backend(db['ENGINE'])
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/db/utils.py", line 110, in load_backend
    return import_module('%s.base' % backend_name)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib64/python3.6/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/backends/postgis/base.py", line 6, in <module>
    from .features import DatabaseFeatures
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/backends/postgis/features.py", line 1, in <module>
    from django.contrib.gis.db.backends.base.features import BaseSpatialFeatures
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/backends/base/features.py", line 3, in <module>
    from django.contrib.gis.db.models import aggregates
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/models/__init__.py", line 3, in <module>
    import django.contrib.gis.db.models.functions  # NOQA
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/models/functions.py", line 4, in <module>
    from django.contrib.gis.db.models.fields import BaseSpatialField, GeometryField
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/db/models/fields.py", line 3, in <module>
    from django.contrib.gis import forms, gdal
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/forms/__init__.py", line 3, in <module>
    from .fields import (  # NOQA
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/forms/fields.py", line 2, in <module>
    from django.contrib.gis.gdal import GDALException
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/gdal/__init__.py", line 28, in <module>
    from django.contrib.gis.gdal.datasource import DataSource
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/gdal/datasource.py", line 39, in <module>
    from django.contrib.gis.gdal.driver import Driver
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/gdal/driver.py", line 5, in <module>
    from django.contrib.gis.gdal.prototypes import ds as vcapi, raster as rcapi
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/gdal/prototypes/ds.py", line 9, in <module>
    from django.contrib.gis.gdal.libgdal import GDAL_VERSION, lgdal
  File "/home/joincic/GeoRouting/GeoRouting_2/lib/python3.6/site-packages/django/contrib/gis/gdal/libgdal.py", line 47, in <module>
    lgdal = CDLL(lib_path)
  File "/usr/lib64/python3.6/ctypes/__init__.py", line 343, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /usr/gdal30/lib/libgdal.so.26: undefined symbol: GEOSMakeValid_r

该项目在升级前工作正常,并尝试修复错误我安装了 gdal 3.0.2 但它没有工作

我不知道您是否需要有关该项目或有关虚拟机的更多信息,如果需要,您可以问我,我很乐意为您提供任何信息

有什么想法吗?

【问题讨论】:

【参考方案1】:

我与一位客户遇到了完全相同的问题,并研究了原因。因此,虽然 Iczub 的回答很好,但我认为值得解释问题的原因。

就我而言,错误表现如下:

test=> SELECT PostGIS_Full_Version();
ERROR:  could not load library "/usr/pgsql-10/lib/rtpostgis-2.4.so": /usr/gdal30/lib/libgdal.so.26: undefined symbol: GEOSMakeValid_r
CONTEXT:  SQL statement "SELECT public.postgis_gdal_version()"
PL/pgSQL function postgis_full_version() line 33 at SQL statement

解决方法很简单:

# yum remove geos37

对发生的事情的解释:

这是从postgis24_10-2.4.6-3.rhel7.x86_64 (次要)升级到postgis24_10-2.4.8-9.rhel7.x86_64(存储库pgdg10)的结果,它安装了gdal30-libs-3.0.4geos38-3.8.1-1 作为依赖项。

问题的最终原因是之前安装的GEOS版本没有被卸载:

# rpm -qa | grep geos
geos38-3.8.1-1.rhel7.x86_64
geos37-3.7.0-1.rhel7.x86_64

现在这两个包都有一个库libgeos_c.so.1,安装在不同的目录中:

/usr/geos38/lib64/libgeos_c.so.1
/usr/geos37/lib64/libgeos_c.so.1

两个包都通过向/etc/ld.so.conf.d添加一个配置文件将它们的目录放在共享库路径中,所以我们最终在路径上得到了两个同名的库。

不幸的是,来自 GEOS 3.7 的库恰好是搜索路径上的第一个库,因此 libgdal.so.26 错误地加载了该库,从而导致观察到的错误。

谁有过错?

我认为有两个错误:

    GEOS 库 libgeos_c 在 3.7 和 3.8 版本之间存在 ABI 中断,但未能更改库主要版本。

    PGDG RPM 包无法实现这两个 GEOS 包之间的不兼容。切勿同时安装它们。

【讨论】:

你救了我的命...谢谢【参考方案2】:

在我的例子中,yum 有几个启用的 pgdg 存储库,并且 gdal 库是从与 Postgis 不同的 pg 版本安装的。在将启用的 pgdg 存储库减少到只有一个(感兴趣的版本)并重新安装(或更好地擦除和安装)受影响的软件包后,我能够再次将 pg 与 Postgis 一起使用。

如何禁用存储库请参阅How to enable or disable repositories in CentOS。就我而言,相关文件是 /etc/yum.repos.d/pgdg-redhat-all.repo

在升级之前已经存在混合存储库的情况,Postgis 可以正常工作

[test@mytest ~]$ yum list installed | grep -i geos
geos37.x86_64                         3.7.2-2.rhel7                  @pgdg10
[test@mytest ~]$ yum list installed | grep -i gdal
gdal-libs.x86_64                      1.11.4-12.rhel7                @pgdg96
gdal30-libs.x86_64                    3.0.1-4.rhel7                  @pgdg10
[test@mytest ~]$ yum list installed | grep -i postgis
postgis24_96.x86_64                   2.4.8-5.rhel7                  @pgdg96
postgis24_96-client.x86_64            2.4.8-5.rhel7                  @pgdg96

[test@mytest ~]$ yum repolist enabled | grep -i Postgre
pgdg10/7/x86_64      PostgreSQL 10 for RHEL/CentOS 7 - x86_64              1,306
pgdg11/7/x86_64      PostgreSQL 11 for RHEL/CentOS 7 - x86_64              1,162
pgdg12/7/x86_64      PostgreSQL 12 for RHEL/CentOS 7 - x86_64                596
pgdg96/7/x86_64      PostgreSQL 9.6 for RHEL/CentOS 7 - x86_64             1,354


[test@mytest ~]$ psql
psql (9.6.15)

postgres=# CREATE DATABASE test;
CREATE DATABASE
postgres=# \connect test
You are now connected to database "test" as user "test".
test=# CREATE EXTENSION postgis;
CREATE EXTENSION
test=# \connect postgres
You are now connected to database "postgres" as user "test".
postgres=# DROP DATABASE test;
DROP DATABASE

yum update 之后,混合存储库的情况得到了扩展,postgis 出了问题。 (grep 搜索 pgdg 以检测所有受影响的包)

[test@mytest ~]$ yum list installed | grep -i pgdg
CGAL.x86_64                           4.7-1.rhel7.1                  @pgdg11
SFCGAL.x86_64                         1.3.1-2.rhel7                  @pgdg12
SFCGAL-libs.x86_64                    1.3.1-2.rhel7                  @pgdg12
gdal-libs.x86_64                      1.11.4-12.rhel7                @pgdg96
gdal30-libs.x86_64                    3.0.1-4.rhel7                  @pgdg10
geos37.x86_64                         3.7.2-2.rhel7                  @pgdg10
libgeotiff.x86_64                     1.4.0-1.rhel7.1                @pgdg11
libgeotiff15.x86_64                   1.5.1-2.rhel7                  @pgdg12
ogdi.x86_64                           3.2.0-4.rhel7.1                @pgdg11
ogdi41.x86_64                         4.1.0-2.rhel7                  @pgdg10
pgdg-redhat-repo.noarch               42.0-5                         @pgdg10
postgis24_96.x86_64                   2.4.8-5.rhel7                  @pgdg96
...
proj62.x86_64                         6.2.0-1.rhel7                  @pgdg10
[test@mytest ~]$ psql
...
test=# CREATE EXTENSION postgis;
ERROR:  could not load library "/usr/pgsql-9.6/lib/rtpostgis-2.4.so": /usr/gdal30/lib/libgdal.so.26: undefined symbol: GEOSMakeValid_r
test=# 

我尝试重新安装 Postgis,只启用了一个 pgpdg 存储库。这不是重新安装依赖的 geos、gdal、proj 包。所以我删除了所有受影响的软件包并再次安装它们。

[test@mytest ~]$ sudo yum erase CGAL geos37 proj62 proj49 ogdi41
[test@mytest ~]$ sudo yum install postgis24_96

[test@mytest ~]$ yum list installed | grep -i pgdg
CGAL.x86_64                           4.7-1.rhel7                    @pgdg96
SFCGAL.x86_64                         1.3.1-1.rhel7                  @pgdg96
SFCGAL-libs.x86_64                    1.3.1-1.rhel7                  @pgdg96
gdal30-libs.x86_64                    3.0.4-2.rhel7                  @pgdg96
geos38.x86_64                         3.8.0-1.rhel7                  @pgdg96
...
postgis24_96.x86_64                   2.4.8-8.rhel7                  @pgdg96

这是一个硬系统更改,请确保有备份(例如 VM 快照)。还要检查依赖的其他安装(例如 python shapely)是否仍然适用于更改的库或需要重新安装。

【讨论】:

以上是关于如何修复 GeoDjango OSError:未定义符号?的主要内容,如果未能解决你的问题,请参考以下文章

如何修复 Jupyter Notebook pandas 错误(OSError:[WinError 193] %1 不是有效的 Win32 应用程序)

OSError:/usr/lib/libgdal.so.20:未定义符号:sqlite3_column_table_name

无法读取未定义和未处理的承诺拒绝的属性“捕获”

如何获得geodjango的k个最近邻居?

如何在 Webfaction 上已经存在的 postgres 数据库上启用 GeoDjango?

如何在geodjango中转换英里公里