Skip to content

Support for GPU compute #1

@Kezzsim

Description

@Kezzsim

There have been some issues providing support for GPU compute in Cafe mainly because the CUDA packages on apt appear to be deprecated even for Ubuntu 18 LTS.

Additionally, in environments like RunPod there are additional flags and variables that get called on their other containers like Disco/Stable Diffusion which enable GPU compute for those processes but I am unsure which one of those I should add to the serverless runpod container to get the right results.

  • Docker native GPU bindings (running on local hardware)
  • RunPod GPU bindings

Metadata

Metadata

Assignees

Labels

help wantedExtra attention is needed

Projects

Status

Acknowledged

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions