Add support for OpenAIRE by jli2025 · Pull Request #299 · geopython/pygeometa

jli2025 · 2025-12-05T14:26:28Z

This PR adds support for openaire metadata. It only supports import (openaire -> mcf).

It can use used for metadata record from the new openaire api: OpenAIRE Graph API

An example openaire metadata record: https://api.openaire.eu/graph/v2/researchProducts?pid=10.3390/proceedings2019030057

pvgenuchten · 2025-12-05T15:20:23Z

Thanx @jli2025 i’ll have a look asap

jli2025 · 2025-12-15T14:17:55Z

Hi @pvgenuchten I just added a commit to fix the identifier issue (when there is no pids) as we discussed.

pvgenuchten · 2026-01-12T15:58:17Z

Code looks really nice @jli2025, some small comments:

I noticed a tag: test at root level of the generated yml, not sure how it was generated?
Is it possible to add a /metadata/datestamp element on the record (maybe with date today, if the imported source does not have it), datestamp seems a required element on mcf

pvgenuchten

added minor fixes

pygeometa/schemas/openaire/__init__.py

pvgenuchten · 2026-01-29T11:36:22Z

@jli2025 Can you extend the plugin to make metadata_ = md.get('results')[0] optional
we can not assume the header/results wrapper is always available (although if it is available, good to unwrap the individual results) -> resolved

initialize update last update on the old openaire api format create mapping for new openaire api update update add new samples remove sample data add project remove run_test script

pvgenuchten

operational now, added a import test

tomkralidis

Great work! Some additional comments/change requests.

tomkralidis · 2026-01-29T12:20:29Z

pygeometa/schemas/openaire/__init__.py

+# those files. Users are asked to read the 3rd Party Licenses
+# referenced with those assets.
+#
+# Copyright (c) 2025 Tom Kralidis, Jiarong Li, Paul van Genuchten


Copyright should be one line per person (who touched the code).

tomkralidis · 2026-01-29T12:20:44Z

pygeometa/schemas/openaire/__init__.py

+#
+# =================================================================
+
+import logging


Alphabetize imports.

tomkralidis · 2026-01-29T12:26:04Z

pygeometa/schemas/openaire/__init__.py

+    return contact_dict
+
+
+def id2url(scheme: str, id: str) -> str:


id -> id_ (id is a Python keyword)

tomkralidis · 2026-01-29T12:26:44Z

pygeometa/schemas/openaire/__init__.py

+
+def id2url(scheme: str, id: str) -> str:
+    """
+    Convert orcid, wikidata, ror or grid value to url


Complete docstring (add :param id:, and :returns:)

tomkralidis · 2026-01-29T12:30:03Z

pygeometa/schemas/openaire/__init__.py

+
+def id2url(scheme: str, id: str) -> str:
+    """
+    Convert orcid, wikidata, ror or grid value to url


scheme2 = scheme.lower() value = None if scheme2 in ['ror', 'grid']: value = id_ elif scheme2 == 'orcid': return f'https://orcid.org/{id_}' elif scheme2 == 'wikidata': value = f'https://www.wikidata.org/wiki/{id_}' elif scheme2 == 'isni': value = f'https://isni.org/isni/{id_}' return value

tomkralidis · 2026-01-29T12:32:08Z

pygeometa/schemas/openaire/__init__.py

+            contactpoint_dict['organization'] = org_name
+            pids = contact.get('pids', [])
+            if pids is not None:
+                for p in pids:


for p in pids: if p.get('scheme').lower() in ['ror', 'grid', 'wikidata', 'isni']: contactpoint_dict['url'] = id2url( p.get('scheme'), p.get('value')) break

tomkralidis · 2026-01-29T12:32:48Z

pygeometa/schemas/openaire/__init__.py

+            if pid is not None and pid.get('id') is not None:
+                pid_scheme = pid.get('id', {}).get('scheme')
+                pid_value = pid.get('id', {}).get('value')
+                if pid_scheme is not None and pid_value is not None:


if None not in [pid_scheme, pid_value]:

tomkralidis · 2026-01-29T12:33:39Z

pygeometa/schemas/openaire/__init__.py

+
+def process_keywords(subjects: list) -> dict:
+    """
+    convert openaire keywords to mcf keywords


Complete docstring (add :param subjects:, :returns:)

tomkralidis · 2026-01-29T12:34:31Z

pygeometa/schemas/openaire/__init__.py

+
+
+def process_id_and_instance(
+        pids: list, originIds: list,


Complete docstring (add :param:'s, :returns:)

tomkralidis · 2026-01-29T12:37:06Z

pygeometa/schemas/openaire/__init__.py

+                mcf['metadata']['hierarchylevel'] = instance_type_
+
+        date_of_collection = metadata_.get('dateOfCollection')
+        if date_of_collection:


Can we test with if date_of_collection is not None:? Needs to be applied a few places in this function where a .get() was called.

pvgenuchten · 2026-01-29T12:42:03Z

actually, maybe we are too friendly here... we should also have a clear case indicating: "This json is not in OpenAire format", else it would parse any json and return an almost empty mcf... in case schema:autodetect is used

actually, the openaire is totally not considered yet when using autodetect, an update is needed elsewhere?
--> this is actually a problem of the schema-org plugin, the schema-org plugin returns empty document when not matching, and then does not continue to next schema to try

- do not require results wrapper - add import test

pvgenuchten force-pushed the openaire branch from 2d84f0b to a66dc30 Compare January 13, 2026 07:55

pvgenuchten approved these changes Jan 13, 2026

View reviewed changes

pygeometa/schemas/openaire/__init__.py Outdated Show resolved Hide resolved

pvgenuchten force-pushed the openaire branch 2 times, most recently from 06ba553 to 82cc422 Compare January 13, 2026 10:17

jli2025 and others added 3 commits January 29, 2026 12:44

init

5494372

initialize update last update on the old openaire api format create mapping for new openaire api update update add new samples remove sample data add project remove run_test script

fix identifier issue

2443c26

remove test string, add datestamp

199c705

pvgenuchten force-pushed the openaire branch 2 times, most recently from 8514419 to 9c41c48 Compare January 29, 2026 12:07

pvgenuchten requested review from pvgenuchten and tomkralidis and removed request for pvgenuchten January 29, 2026 12:09

pvgenuchten approved these changes Jan 29, 2026

View reviewed changes

pvgenuchten force-pushed the openaire branch from 9c41c48 to 510ff2e Compare January 29, 2026 12:24

tomkralidis requested changes Jan 29, 2026

View reviewed changes

pvgenuchten force-pushed the openaire branch from 510ff2e to d5392a4 Compare January 29, 2026 14:14

- rebase to master

8fb4cd8

- do not require results wrapper - add import test

pvgenuchten force-pushed the openaire branch from d5392a4 to 8fb4cd8 Compare January 29, 2026 14:15

Conversation

jli2025 commented Dec 5, 2025

Uh oh!

pvgenuchten commented Dec 5, 2025

Uh oh!

jli2025 commented Dec 15, 2025

Uh oh!

pvgenuchten commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pvgenuchten left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

pvgenuchten commented Jan 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pvgenuchten left a comment

Choose a reason for hiding this comment

Uh oh!

tomkralidis left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

pvgenuchten commented Jan 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

pvgenuchten commented Jan 12, 2026 •

edited

Loading

pvgenuchten commented Jan 29, 2026 •

edited

Loading

pvgenuchten commented Jan 29, 2026 •

edited

Loading