Upgrade to Python 3.10 for CKAN 2.11 compatibility#172
Draft
A-Souhei wants to merge 26 commits intodevelopmentfrom
Draft
Upgrade to Python 3.10 for CKAN 2.11 compatibility#172A-Souhei wants to merge 26 commits intodevelopmentfrom
A-Souhei wants to merge 26 commits intodevelopmentfrom
Conversation
- Update Dockerfile base image from python:3.8 to python:3.10 - Update Pipfile and Pipfile.lock with Python 3.10 compatible packages - Add Python 3.10 compatibility fix for ckanext-authz-service in bootstrap.sh - Update ckanext-validation submodule (removed markupsafe pin)
- Update ckanext-unaids to include icon encoding fixes and tests - Add demo_venv/ to .gitignore to exclude development virtualenv
Contributor
Author
|
@cooper667 @ChasNelson1990 I created a few issues in https://github.com/fjelltopp/adx_develop/issues, I will continue working on them but I pushed the changes for our staging. |
cooper667
reviewed
Jan 16, 2026
Pipfile.lock
Outdated
| "sha256:fb1461c99de4d040666ca0444057b06541e5642f800b71c56e6ea92d6a853a0c" | ||
| ], | ||
| "index": "pypi", | ||
| "markers": "python_version >= '3.11'", |
Contributor
Author
There was a problem hiding this comment.
I will have a look at it soon.
There was a problem hiding this comment.
Don't worry about it for now, I've handled it
- Pin numpy==1.24.4 and pandas==1.5.3 to fix version mismatch error - Remove saml2auth from plugins list in adx_config.ini - Comment out SAML2 configuration settings - Update ckanext-unaids to remove login_register_catch blueprint
- Add ckan.datapusher.callback_url_base = http://ckan:5000 - Update ckanext-unaids submodule with Data Explorer fix
- Add ckanext-geoview v0.3.1 as submodule for GeoJSON/WMS map visualization - Enable geo_view and geojson_view plugins in CKAN config - Add geojson_view to default views for auto-creation on GeoJSON resources - Update Pipfile and lock with new dependency
ckanext-blob-storage: - Fix CKAN 2.11 resource download route conflict - Fix flake8 lint issues ckanext-scheming: - Fix duplicate scheming.presets config declaration error - Add IConfigDeclaration for CKAN 2.11 compatibility - Fix badge class and package_search user context
Updated submodules with CKAN 2.11 compatibility fixes: - ckanext-scheming: url_for helper for resource links - ckanext-unaids: Bootstrap 5 templates, helpers cleanup - ckanext-harvest: route name updates (harvester.*) - ckanext-dhis2harvester: Bootstrap 5, routes, DHIS2 API fallback
- Add saml2auth back to plugins list in adx_config.ini - Uncomment SAML2 configuration settings - Update ckanext-saml2auth with Flask 3.x ava serialization fix - Update ckanext-unaids with login_register_catch blueprint re-enabled
- Update numpy to 1.26.4 (last 1.x version compatible with Python 3.10) - Update pandas to 2.0.3 (compatible with numpy 1.26.4) - Update ckanext-unaids submodule with matching pandas version - Resolves: ImportError: No module named 'numpy.lib.histograms' The error occurred because pandas 2.2.0 requires numpy.lib.histograms, which was removed in numpy 2.0. This pins both packages to compatible versions that work with Python 3.10.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR upgrades the Python version from 3.8 to 3.10 to support CKAN 2.11.4 which requires Python >= 3.9.
Changes
Dockerfile
python:3.8topython:3.10Pipfile & Pipfile.lock
Updated package versions to be compatible with Python 3.10 and CKAN 2.11:
bootstrap.sh
ckanext-authz-servicePython 3.10 compatibility (collections.Iterable→collections.abc.Iterable)Submodules
markupsafe==2.0.1pin that conflicted with CKAN 2.11 requirementsNotes
A few images need upgrades: