IEBH-353: Sync with the latest changes

[vmoshynskyi]

Add the latest changes from the pilot repo.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
__init__.py	0	0	100%
api_registry.py	0	0	100%
config.py	0	1	98%	60
logger.py	0	0	100%
main.py	0	6	82%	32–33, 35, 39–41
namespace.py	0	0	100%
clients
__init__.py	0	0	100%
lineage.py	0	1	85%	19
components
__init__.py	0	0	100%
types.py	0	1	90%	14
components/request
__init__.py	0	0	100%
context.py	0	0	100%
http_client.py	0	0	100%
components/user
__init__.py	0	0	100%
models.py	0	2	96%	61–62
models
__init__.py	0	0	100%
base_models.py	0	0	100%
dataset_models.py	0	0	100%
error_model.py	0	0	100%
file_models.py	0	0	100%
lineage_models.py	0	0	100%
manifest_models.py	0	0	100%
project_models.py	0	0	100%
validation_models.py	0	0	100%
resources
__init__.py	0	0	100%
dependencies.py	0	26	70%	43, 61, 96–97, 99–104, 108, 110–111, 117–123, 125–129, 136
error_handler.py	0	7	83%	22–28
health_check.py	0	8	33%	15–16, 22–27
helpers.py	0	39	74%	62–63, 86–88, 90–93, 95–96, 100–107, 122, 141–143, 166, 179–181, 217–228
validation_service.py	0	23	67%	29–30, 38–43, 64–66, 68–70, 77–79, 84–86, 88–90
resources/authorization
decorator.py	0	4	93%	56–59
exceptions.py	0	0	100%
models.py	0	0	100%
routers
__init__.py	0	0	100%
api_root.py	0	0	100%
routers/v1
__init__.py	0	0	100%
api_dataset.py	0	17	87%	71, 76, 81–84, 87, 92, 94–96, 98, 103, 105, 107, 177–178
api_file.py	0	13	84%	63–65, 67, 69, 72–73, 75–76, 121–124
api_lineage.py	0	0	100%
api_manifest.py	0	28	82%	58–59, 75–77, 83–87, 111–112, 144–149, 164–168, 185–187, 210–211
api_project.py	0	23	87%	88–90, 93–97, 124–126, 165–168, 170, 181–183, 223, 294–296
api_validation.py	0	6	94%	62–64, 89–91
services
__init__.py	0	0	100%
services/dataset
__init__.py	0	0	100%
client.py	0	0	100%
services/project
__init__.py	0	0	100%
client.py	0	0	100%
TOTAL	1542	205	86%

[Copilot]

Pull request overview

This PR synchronizes the codebase with the latest changes from the pilot repository, modernizing the architecture and dependencies while introducing a new request handling abstraction layer.

Key Changes:

• Introduces HTTPClient and RequestContext abstractions to centralize HTTP request handling and header filtering for improved security and maintainability
• Updates Python dependency constraints to 3.10.x only and upgrades major dependencies (FastAPI 0.90→0.115, httpx 0.23→0.27, gunicorn 20.0.4→23.0.0, redis 3.5.3→4.5.5, cryptography 39.0.0→44.0.3)
• Modernizes Python type hints from typing module types to built-in generics (PEP 585/604)
• Removes Vault configuration in favor of simpler environment-based configuration
• Replaces Jenkinsfile CI/CD with GitHub Actions workflow

Reviewed changes

Copilot reviewed 30 out of 31 changed files in this pull request and generated 8 comments.

Show a summary per file

File	Description
pyproject.toml	Updates Python constraint to 3.10.x and upgrades multiple dependencies including FastAPI, httpx, gunicorn, redis, cryptography, and pilot-platform-common
poetry.lock	Reflects dependency updates with new package versions and removal of deprecated packages (aioredis, rfc3986)
app/components/request/http_client.py	Adds new HTTPClient wrapper class to standardize HTTP requests with header management
app/components/request/context.py	Adds RequestContext class to filter and manage request headers for downstream service calls
app/components/request/__init__.py	Adds package initialization file for new request components module
app/services/dataset/client.py	Refactors to use HTTPClient instead of direct AsyncClient, updates imports to use collections.abc
app/routers/v1/api_project.py	Replaces Request parameter with RequestContext in endpoints for better header management
app/routers/v1/api_dataset.py	Updates imports to use modern type hints and passes HTTPClient to helper functions
app/resources/helpers.py	Refactors dataset functions to accept HTTPClient parameter and adds proper error propagation
app/resources/health_check.py	Updates redis import from aioredis to redis.asyncio
app/resources/error_handler.py	Capitalizes docstrings for consistency
app/resources/dependencies.py	Renames parameter from header to headers for clarity
app/resources/validation_service.py	Uses bytes literal instead of encode() for improved readability
app/resources/authorization/decorator.py	Updates to handle both Request and RequestContext objects, modernizes type hints
app/models/project_models.py	Replaces typing.Dict/List with built-in dict/list types
app/models/file_models.py	Improves docstring formatting and modernizes string formatting
app/config.py	Removes Vault configuration, updates version, adds SettingsDependency type alias
app/main.py	Capitalizes docstring for consistency
tests/fixtures/request_context.py	Adds new fixture for RequestContext in tests
tests/fixtures/services/dataset.py	Updates dataset_service_client fixture to use request_context
tests/fixtures/fake.py	Adds headers() method and changes fixture scope from session to function
tests/conftest.py	Registers new request_context fixture plugin
tests/app/components/request/__init__.py	Adds package initialization for request component tests
tests/app/components/request/test_http_client.py	Adds tests for HTTPClient header merging behavior
tests/routers/v1/test_api_file.py	Removes empty parent_path parameter from test URL
tests/routers/v1/test_api_dataset.py	Updates import to use collections.abc.Callable
.github/workflows/hdc-pipeline.yml	Adds new GitHub Actions workflow for HDC CI/CD pipeline
.pre-commit-config.yaml	Updates docformatter version from v1.7.5 to v1.7.7
.env.example	Removes Vault-related configuration variables
Jenkinsfile	Removes deprecated Jenkins pipeline configuration
README.md	Removes trailing newline

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.