Skip to content

Prototype CPU support #52

@RAMitchell

Description

@RAMitchell

Legate-dataframe cannot currently run on CPU as it lacks CPU implementations for tasks. libarrow can be used to implement CPU functionality (e.g. csv reading) in the same way libcudf is currently used. libarrow is already a dependancy of legate-dataframe.

A first prototype might contain:

  • The ability to convert from a legate-dataframe column to arrow::Array and back.
  • 1 task (e.g. read_csv) implmented using libarrow
  • A test for this in CI, with a CPU only runner

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions