Search results

Write bash script for execution of whole Pipeline

important

Status: Open.

#8 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 15, 2022

Improve logging of dataset cleaning

invalidThis doesn't seem rightThis doesn't seem right

Nice-to-have

Status: Open.

#7 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 15, 2022

Add german Stopwordslist

Status: Open.

#6 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 15, 2022

Add usage of validation split to cleaning script

Status: Open.

#5 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 15, 2022

Bash script for hole data processing Pipeline

Status: Open.

#4 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 15, 2022

Improve language seperate Datasets within get_hf_datasets_from_parquet.py

Status: Open.

#2 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 13, 2022

Add setup.py usage to README

Status: Open.

#1 In OpenGPTX/olm-datasets;

· Lena-Jurkschat opened on Dec 13, 2022