Skip to content

Add logic to discard faulty data #65

@jhanninen

Description

@jhanninen

Especially VP data comes with faulty data, that should be removed from analysis. Operating day values can be multiple days behind the current one, e.g. metros that are not in use but they still send signals. That disturbs monitored vehichle journey analysis, because those faulty updates change the analysis timestamp, and therefore customer can't say based on timestamp information of the analysis whether the data from specified operating day is complete or not.

Faulty data can be discarded after a specific timestamp (operating day should be ready at the latest at 8.00 in Transitdata). Oday values after that should be either removed or moved to a faulty data table.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Moved to AzureDevOpsThis issue has been moved to Azure DevOps backlog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions