IEBH-353: Sync with the latest changes#16
Merged
vmoshynskyi merged 2 commits intomainfrom Nov 26, 2025
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
This PR synchronizes the queue service with the latest changes from the pilot repository, modernizing the codebase with Python 3.10+ features and removing deprecated configuration management patterns.
Key changes include:
- Updated all services (socketio, producer, consumer) to version 2.2.13 with modernized Python type hints
- Removed VaultClient integration in favor of environment variable-based configuration
- Added new
share_dataset_versionpipeline and event type for dataset sharing functionality
Reviewed changes
Copilot reviewed 30 out of 33 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
| socketio/run.py | Reordered imports alphabetically |
| socketio/pyproject.toml | Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic to 1.10.19 |
| socketio/poetry.lock | Updated pydantic from 1.10.2 to 1.10.19 with new file hashes |
| socketio/message_queue.py | Converted % string formatting to f-string |
| socketio/config.py | Removed VaultClient integration and CONFIG_CENTER configuration |
| socketio/Dockerfile | Updated base image from python-3.10.12-v2 to python-3.10.14-v1 |
| socketio/.env.schema | Updated environment variables, removed Vault configuration |
| producer/pyproject.toml | Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic to 1.10.19 |
| producer/producer/config.py | Removed VaultClient integration and updated version |
| producer/producer/components/queue/schemas.py | Modernized type hints, added share_dataset_version event and payload schema |
| producer/producer/components/queue/publisher.py | Modernized type hints from Optional[str] to str | None |
| producer/producer/components/exceptions.py | Changed import from typing.Sequence to collections.abc.Sequence |
| producer/producer/components/broker/views.py | Converted .format() to f-string |
| producer/producer/components/broker/schemas.py | Modernized type hints |
| producer/poetry.lock | Updated pydantic from 1.10.2 to 1.10.19, removed conditional wrapt dependency |
| producer/Dockerfile | Updated base image to python-3.10.14-v1 |
| producer/.env.schema | Removed Vault configuration variables |
| consumer/pyproject.toml | Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic from 1.8.2 to 1.10.19 |
| consumer/poetry.lock | Updated pydantic from 1.8.2 to 1.10.19 with Python 3.7+ support |
| consumer/pipelines/share_dataset_version.py | New pipeline for sharing dataset versions between projects |
| consumer/pipelines/data_delete.py | Modernized type hints |
| consumer/pipelines/data_copy.py | Modernized type hints |
| consumer/pipelines/bids_validate.py | Removed VAULT_URL logging, updated command to use Python module syntax |
| consumer/main.py | Added share_dataset_version handler and routing logic |
| consumer/job.py | Added share_dataset_version_job_obj method, removed Vault env vars, added S3 and Redis credentials |
| consumer/exceptions.py | Changed import from typing.Sequence to collections.abc.Sequence |
| consumer/config.py | Removed VaultClient integration and Vault-related settings, added S3_ACCESS_KEY, S3_SECRET_KEY, REDIS_PASSWORD |
| consumer/Dockerfile | Updated base image to python-3.10.14-v1 |
| consumer/.env.schema | Updated with new required environment variables, removed Vault configuration |
| .pre-commit-config.yaml | Uncommented docformatter hook and updated version to v1.7.7 |
| .github/workflows/hdc-pipeline-socketio.yml | New CI/CD workflow for socketio service |
| .github/workflows/hdc-pipeline-producer.yml | New CI/CD workflow for producer service |
| .github/workflows/hdc-pipeline-consumer.yml | New CI/CD workflow for consumer service |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add the latest changes from the pilot repo.