Skip to content

IEBH-353: Sync with the latest changes#16

Merged
vmoshynskyi merged 2 commits intomainfrom
IEBH-353
Nov 26, 2025
Merged

IEBH-353: Sync with the latest changes#16
vmoshynskyi merged 2 commits intomainfrom
IEBH-353

Conversation

@vmoshynskyi
Copy link
Member

Add the latest changes from the pilot repo.

@github-actions
Copy link

github-actions bot commented Nov 26, 2025

Coverage

Coverage Report
FileStmtsMissCoverMissing
models
   __init__.py00100% 
   singleton.py070%8–9, 11–14, 16
producer
   __init__.py00100% 
   __main__.py050%7, 9, 11–13
   app.py0490%7–18, 20–26, 29–30, 32, 39–41, 43, 46, 48–49, 52, 55–57, 60, 63, 66, 69, 72–73, 76, 79–80, 82–83, 85, 87, 91, 94, 97
   config.py0310%7–8, 10–11, 14, 17–21, 23–24, 26–28, 30–31, 33–34, 36–38, 40–43, 46–49, 52
   logger.py020%7, 9
producer/components
   __init__.py020%7, 9
   exceptions.py0920%7–14, 16, 19, 22, 24–26, 29, 31–33, 36, 38–40, 43, 45, 48, 54, 57–59, 61–63, 65–67, 70, 73–75, 77–79, 81–83, 86, 89–91, 93–95, 97–99, 102, 105–107, 109–111, 113–115, 118, 121–122, 124–126, 128–130, 132–134, 136, 138–140, 147, 150, 153–155, 157–159, 161–163
   schemas.py0230%7–8, 10–11, 14–18, 21–25, 27–30, 33, 36–37, 40, 43
producer/components/broker
   __init__.py020%7, 9
   publish.py0140%7–8, 10, 12, 15–22, 30–31
   schemas.py0130%7, 9–10, 13, 16–22, 25, 28
   views.py0300%7, 9, 11–14, 16, 18, 21–24, 26, 28–30, 32–37, 39–41, 43, 51, 53–55
producer/components/queue
   __init__.py020%7, 9
   exceptions.py0140%7, 9, 12, 15–16, 18–20, 22–24, 26–28
   models.py050%7, 10–13
   publisher.py0210%7–11, 14–21, 25–32
   schemas.py0570%7, 9–10, 12–14, 17–21, 24, 27–29, 31–33, 39–43, 45–46, 49–50, 53–55, 58–68, 71–79, 82–88
   views.py0220%7, 9–12, 14, 16, 19, 24–37
producer/resources
   __init__.py00100% 
   queueConnector.py0210%7, 9–11, 14–17, 19–21, 23, 26–30, 32–33, 35–36
   queuePublisher.py0300%7, 9, 11–13, 15, 18, 21–29, 31, 33–34, 42–45, 49–55
   rabbitMq.py0190%7, 9–11, 14–16, 18–21, 24–27, 29–30, 32–33
tests
   __init__.py00100% 
   test_please_write_us.py00100% 
TOTAL4634610% 

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR synchronizes the queue service with the latest changes from the pilot repository, modernizing the codebase with Python 3.10+ features and removing deprecated configuration management patterns.

Key changes include:

  • Updated all services (socketio, producer, consumer) to version 2.2.13 with modernized Python type hints
  • Removed VaultClient integration in favor of environment variable-based configuration
  • Added new share_dataset_version pipeline and event type for dataset sharing functionality

Reviewed changes

Copilot reviewed 30 out of 33 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
socketio/run.py Reordered imports alphabetically
socketio/pyproject.toml Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic to 1.10.19
socketio/poetry.lock Updated pydantic from 1.10.2 to 1.10.19 with new file hashes
socketio/message_queue.py Converted % string formatting to f-string
socketio/config.py Removed VaultClient integration and CONFIG_CENTER configuration
socketio/Dockerfile Updated base image from python-3.10.12-v2 to python-3.10.14-v1
socketio/.env.schema Updated environment variables, removed Vault configuration
producer/pyproject.toml Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic to 1.10.19
producer/producer/config.py Removed VaultClient integration and updated version
producer/producer/components/queue/schemas.py Modernized type hints, added share_dataset_version event and payload schema
producer/producer/components/queue/publisher.py Modernized type hints from Optional[str] to str | None
producer/producer/components/exceptions.py Changed import from typing.Sequence to collections.abc.Sequence
producer/producer/components/broker/views.py Converted .format() to f-string
producer/producer/components/broker/schemas.py Modernized type hints
producer/poetry.lock Updated pydantic from 1.10.2 to 1.10.19, removed conditional wrapt dependency
producer/Dockerfile Updated base image to python-3.10.14-v1
producer/.env.schema Removed Vault configuration variables
consumer/pyproject.toml Updated version to 2.2.13, Python constraint to >=3.10,<3.11, pydantic from 1.8.2 to 1.10.19
consumer/poetry.lock Updated pydantic from 1.8.2 to 1.10.19 with Python 3.7+ support
consumer/pipelines/share_dataset_version.py New pipeline for sharing dataset versions between projects
consumer/pipelines/data_delete.py Modernized type hints
consumer/pipelines/data_copy.py Modernized type hints
consumer/pipelines/bids_validate.py Removed VAULT_URL logging, updated command to use Python module syntax
consumer/main.py Added share_dataset_version handler and routing logic
consumer/job.py Added share_dataset_version_job_obj method, removed Vault env vars, added S3 and Redis credentials
consumer/exceptions.py Changed import from typing.Sequence to collections.abc.Sequence
consumer/config.py Removed VaultClient integration and Vault-related settings, added S3_ACCESS_KEY, S3_SECRET_KEY, REDIS_PASSWORD
consumer/Dockerfile Updated base image to python-3.10.14-v1
consumer/.env.schema Updated with new required environment variables, removed Vault configuration
.pre-commit-config.yaml Uncommented docformatter hook and updated version to v1.7.7
.github/workflows/hdc-pipeline-socketio.yml New CI/CD workflow for socketio service
.github/workflows/hdc-pipeline-producer.yml New CI/CD workflow for producer service
.github/workflows/hdc-pipeline-consumer.yml New CI/CD workflow for consumer service

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

@vmoshynskyi vmoshynskyi merged commit 68b46b0 into main Nov 26, 2025
6 of 9 checks passed
@vmoshynskyi vmoshynskyi deleted the IEBH-353 branch November 26, 2025 18:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant