IEBH-353: Sync with the latest changes

[vmoshynskyi]

Add the latest changes from the pilot repo.

[Copilot]

Pull request overview

This PR synchronizes the latest changes from the pilot repository, upgrading dependencies and adding support for tracking network origin in activity logs.

• Version bumped from 1.0.2/1.0.3 to 1.0.7 across all services
• Python version constraint updated to >=3.10,<3.11 (lineage handler dropped Python 3.9 support)
• fastavro upgraded from 1.5.2 to 1.10.0
• Added network_origin field to track activity origin across item and dataset activity logs
• Migrated from Jenkinsfile to GitHub Actions workflows for CI/CD
• Code modernization (Union to | syntax, % to f-strings, removed unused imports)

Reviewed changes

Copilot reviewed 17 out of 20 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
tests/test_consumer.py	Changed fixture from yield to return; added network_origin field to activity test payloads and assertions
pyproject.toml	Bumped version to 1.0.7; updated Python constraint to >=3.10,<3.11; upgraded fastavro to 1.10.0
poetry.lock	Updated lock file to reflect Poetry 1.8.5 and new dependency versions including fastavro 1.10.0
metadata_event_handler/pyproject.toml	Same version and dependency updates as root pyproject.toml
metadata_event_handler/poetry.lock	Updated lock file matching root changes
metadata_event_handler/models/ESItemModel.py	Modernized string formatting from % to f-string
metadata_event_handler/models/ESItemActivityModel.py	Added network_origin field to model and to_dict() method
metadata_event_handler/models/ESDatasetActivityModel.py	Added network_origin field to model and to_dict() method
metadata_event_handler/consumer.py	Removed Union import; modernized type hints to use `
lineage_event_handler/pyproject.toml	Bumped version to 1.0.7; updated Python from ^3.9 to >=3.10,<3.11; upgraded fastavro
lineage_event_handler/poetry.lock	Updated lock file with new dependencies and removed conditional typing_extensions dependencies
lineage_event_handler/consumer.py	Removed redundant 'r' mode from open() call
lineage_event_handler/config.py	Removed vault/config center code and related imports; simplified to basic settings
kafka_schemas/metadata.items.avsc	Reformatted JSON and reordered union types to put "null" first (Avro best practice)
kafka_schemas/metadata.items.activity.avsc	Added network_origin field; reordered union types to put "null" first
kafka_schemas/dataset.activity.avsc	Added network_origin field; reordered union types to put "null" first
Jenkinsfile	Removed entire Jenkinsfile (replaced by GitHub Actions)
.pre-commit-config.yaml	Uncommented docformatter hook and updated version to v1.7.7
.github/workflows/hdc-pipeline-metadata.yml	Added new GitHub Actions workflow for metadata event handler CI/CD
.github/workflows/hdc-pipeline-lineage.yml	Added new GitHub Actions workflow for lineage event handler CI/CD

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

[github-actions]

Coverage Report

File	Stmts	Miss	Cover	Missing
__init__.py	0	0	100%
__main__.py	0	6	0%	7, 9–11, 13–14
config.py	0	0	100%
consumer.py	0	20	83%	36, 126–140, 145–148
logger.py	0	0	100%
main.py	0	3	88%	36–38
app
__init__.py	0	0	100%
app/components
__init__.py	0	0	100%
app/components/health
__init__.py	0	0	100%
views.py	0	0	100%
app/dependencies
__init__.py	0	0	100%
elasticsearch.py	0	0	100%
app/models
__init__.py	0	0	100%
base_models.py	0	5	73%	25–27, 30, 33
models_bulk_index.py	0	0	100%
app/routers
__init__.py	0	0	100%
router_exceptions.py	0	0	100%
app/routers/v1
__init__.py	0	0	100%
app/routers/v1/bulk_index
__init__.py	0	0	100%
crud.py	0	0	100%
dependencies.py	0	2	87%	25, 39
utils.py	0	0	100%
views.py	0	16	46%	32–34, 38–50
clients
__init__.py	0	0	100%
elasticsearch.py	0	25	48%	26–27, 32, 42–45, 52–57, 59–60, 62–71
models
ESDatasetActivityModel.py	0	0	100%
ESItemActivityModel.py	0	0	100%
ESItemModel.py	0	1	97%	23
__init__.py	0	0	100%
services
__init__.py	0	0	100%
metadata.py	0	0	100%
project.py	0	0	100%
TOTAL	557	78	86%