Skip to content

Ability to override Nomad's generated log filename #27460

@DamianArado

Description

@DamianArado

Proposal

I was following this doc, and I found out that there is currently no option to override the filename of the logs generated by Nomad (<task-name>.<stdout/stderr>.<index>) with Nomad config.
However, it would be quite helpful if that's also supported using the job definition itself.
In that case, I would just mount alloc/logs somewhere on my vm and then ship log files from there without writing any custom log naming and rotation mechanisms.
So, the whole flow would become quite easier for us.

App emits logs -> files get rotated and saved on VM -> ship to any logs aggregator

Use-cases

For running custom log rotation and log shipping scripts on predictable log filenames.

Attempted Solutions

In Python, I overrode Nomad's in-built log rotation mechanism by using TimedRotatingFileHandler and building a custom log shipping script that runs as a CRON, but it will become cumbersome for me to repeat this for other languages as we run multiple custom dockerized apps on Nomad.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Needs Roadmapping

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions