Metadata for OCR models and/or OCR model training sets

[wrznr]

We need to define a set of metadata for OCR models including at least:

• engine (inkl. version)
• parameter setting for training
• reference to OCR model training set
• ...

We need to define a set of metadata for OCR model training sets including at least:

• information on the training materials
• (output) character sets
• license
• ...

[wrznr]

@VolkerHartmann Relevant for GT repository as well as model repository.
@bertsky Relevent for post correction.

Additions to metadata entries and proposals for representation format(s) very much welcome.

[VolkerHartmann]

GT repository
@bertsky: Which attributes will be important for the selection of GT records?
I'm thinking of:

• Font
• Publication date
• Print shop (?) (I have not seen this attribute yet but it could be helpful, couldn't it)
• ...

Model repository
At the moment no collection (for training set) can be created and therefore not referenced. This feature is planned for future versions. Until then all pages/data have to be listed.
How willl the parameter look like? (To be most generic a key-value implementation would be appropriate)
information on the training materials:
Part of the GT metadata. e.g. publishing date, language, fonts, ...

[bertsky]

@VolkerHartmann Sorry, I am not so sure what it is you are asking me for. This issue is about OCR model meta-data, and I already find the list of features for that mentioned by @wrznr in the original post sufficient for post-correction purposes. Are you actually addressing #85 here? And what does "selection of GT records" refer to (the selection of features for GT meta-data records perhaps)?

[VolkerHartmann]

If the list of features is sufficient, that's fine.

[wrznr]

@VolkerHartmann In which format can necessary metadata be sufficiently (i.e. in a formal, machine-readable way) defined?

[VolkerHartmann]

Most formats are easy to parse. I would prefer JSON or XML but key-value pairs are also ok if no hierarchy exists.

[kba]

https://github.com/kba/ocr-models/blob/master/schema/description.schema.yml

[wrznr]

@wrznr develops a proposal based on the above schema.

[wrznr]

@wrznr Push.

[cneud]

Just to let you know that I've been told today that PMML is the widely accepted standard to describe ML models. It is XML-based. Perhaps we can learn/borrow some things from there.