IEBH-353: Sync with the latest changes

[vmoshynskyi]

Add the latest changes from the pilot repo.

[Copilot]

Pull Request Overview

This PR synchronizes changes from the pilot repository, including dependency upgrades, Python 3.9+ modernization, and code formatting improvements. The key updates include upgrading fastavro from 1.6.0 to 1.10.0, modernizing type hints to use native Python syntax, removing Vault configuration dependencies, and adding a new HDC CI/CD pipeline.

• Updated fastavro library from 1.6.0 to 1.10.0 with proper Python 3.9+ compatibility
• Modernized type hints throughout the codebase using Python 3.9+ syntax (list, dict, tuple, union types)
• Removed Vault-related configuration code and dependencies
• Added parent_path null handling logic in item queries
• Reformatted Avro schema to follow proper conventions

Reviewed Changes

Copilot reviewed 31 out of 32 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
pyproject.toml	Bumped version to 2.2.10 and updated fastavro to 1.10.0
poetry.lock	Updated lock file with new fastavro version and Poetry 1.8.5
migrations/versions/*.py	Removed blank lines after license headers and capitalized docstrings
app/schemas/metadata.items.avsc	Reformatted JSON and corrected union type ordering per Avro conventions
app/routers/v1/items/crud_lineage_provenance.py	Replaced typing.List with list built-in
app/routers/v1/items/crud_items.py	Modernized type hints and added null parent_path handling
app/routers/v1/items/api_items.py	Updated type hints and converted error messages to f-strings
app/routers/v1/favourites/utils.py	Replaced typing.Union with pipe union syntax
app/routers/v1/attribute_templates/crud.py	Replaced typing.List with list built-in
app/routers/router_utils.py	Changed typing.Callable to collections.abc.Callable
app/models/models_lineage_provenance.py	Converted string formatting to f-strings
app/models/models_items.py	Modernized type hints and improved docstrings
app/models/models_collections.py	Replaced typing.Optional with pipe union syntax
app/models/models_attribute_templates.py	Modernized type hints throughout
app/config.py	Removed Vault configuration code and dependencies
.pre-commit-config.yaml	Enabled docformatter hook at v1.7.7
.github/workflows/hdc-pipeline.yml	Added new HDC CI/CD pipeline workflow
.env.example	Removed Vault-related environment variable examples

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
__main__.py	0	4	0%	7, 9, 11–12
api_registry.py	0	0	100%
app_utils.py	0	0	100%
config.py	0	0	100%
logger.py	0	0	100%
main.py	0	2	89%	46–47
clients
kafka_client.py	0	29	65%	36–42, 49–51, 63–65, 72–74, 97–99, 122–129, 137–138
models
base_models.py	0	0	100%
models_attribute_templates.py	0	0	100%
models_collections.py	0	1	98%	128
models_favourites.py	0	1	97%	24
models_items.py	0	17	90%	44, 52, 161, 175, 183, 189, 195, 201, 206–210, 213, 217–219
models_lineage_provenance.py	0	0	100%
sql_attribute_templates.py	0	0	100%
sql_collections.py	0	0	100%
sql_extended.py	0	0	100%
sql_favourites.py	0	1	96%	45
sql_items.py	0	0	100%
sql_items_collections.py	0	0	100%
sql_lineage.py	0	1	95%	40
sql_provenance.py	0	0	100%
sql_storage.py	0	0	100%
routers
router_exceptions.py	0	0	100%
router_utils.py	0	0	100%
routers/v1/attribute_templates
api_attribute_templates.py	0	17	77%	44–46, 56–58, 68–70, 78–82, 94–96
crud.py	0	1	97%	65
routers/v1/collections
api_collections.py	0	33	75%	60–62, 76–82, 92–94, 108–110, 121, 126–128, 138–140, 148–152, 162–166
crud_collections.py	0	5	95%	44, 56, 90–92
permissions_collections.py	0	1	93%	26
utils.py	0	0	100%
routers/v1/favourites
api_favourites.py	0	14	85%	53–54, 64–65, 75–76, 87–90, 102–103, 113–114
crud_favourites.py	0	7	92%	37–39, 75, 79, 127–128
utils.py	0	0	100%
routers/v1/health
api_health.py	0	22	50%	26–36, 40–47, 60–62
routers/v1/items
api_items.py	0	39	77%	66–67, 90–91, 104–109, 119–124, 136–137, 148–149, 159–162, 172–177, 190, 194–195, 205–206, 223–226
api_lineage_provenance.py	0	2	90%	30–31
crud_items.py	0	49	87%	143, 146–148, 157, 160–164, 166–167, 178, 219, 221, 225–227, 245, 247, 261, 269, 319, 374–376, 378, 386, 391, 393, 395, 399, 407, 409, 413, 415, 421, 423–425, 505, 509, 539, 541, 555, 557, 611, 619, 621
crud_lineage_provenance.py	0	10	82%	23, 26–32, 43, 58
dependencies.py	0	2	84%	20–21
permissions_items.py	0	4	87%	42–43, 47, 60
utils.py	0	1	97%	55
TOTAL	2221	263	88%