Skip to content

Semaphore for model deletion and model processing. #91

@mattjhawken

Description

@mattjhawken

Currently models can be taken offline, either due to an expired job or disconnected worker, and any requests still being processed by the model will throw key errors. (eg. _handle_forward in torch_node.py).

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingnodePeer-to-peer node features and optimizations.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions