Updated script to better work with slurm#39

Open

knoriy wants to merge 47 commits intoLAION-AI:mainfrom

Commits on Jun 24, 2022

added new dataset
knoriy
committed

Commits on Jun 27, 2022

added CpVoST
knoriy
committed
removed duplidate dataset
knoriy
committed

Commits on Jun 29, 2022

Commits on Jul 7, 2022

Updated yaml to work with slurm
knoriy
committed
merged laion-main and fixed conflicts
knoriy
committed
move yml file back to root as it is being used by other scripts outside of data_preprocess
knoriy
committed
_
knoriy
committed

Commits on Jul 8, 2022

renamed file
knoriy
committed
removed unwanted text
knoriy
committed

Commits on Jul 11, 2022

_
knoriy
committed
First commit
knoriy
committed
added clause to avoid duplicate calculation
knoriy
committed

Commits on Jul 12, 2022

Screipt to process CREMA-D
knoriy
committed
fixed issue where file were saved in wrong area
knoriy
committed

Commits on Jul 13, 2022

Commits on Aug 2, 2022

fixed error where .json did not conform with audio-dataset
knoriy
committed
processing setup for en-X and x_en
knoriy
committed
processing setup for en-X and x_en
knoriy
committed
setup for eng to X
knoriy
committed

Commits on Aug 11, 2022

Fixed json
knoriy
committed

Commits on Aug 15, 2022

modified to process given language
knoriy
committed

Commits on Aug 16, 2022

Fixed bug when a trailing / is needed
knoriy
committed
processing code for EmoV-DB
knoriy
committed
processing and cleaning old files
knoriy
committed

Commits on Aug 22, 2022

Improved multiprocessing workload, processing improve from 3 it/s to 30000+ it/s
knoriy
committed

Commits on Oct 7, 2022

Merge branch 'LAION-AI:main' into main
knoriy
authored

Commits on Oct 30, 2022

Merge branch 'LAION-AI:main' into main
knoriy
authored

Commits on Dec 5, 2022

add: processor for cv11.0
knoriy
committed
Merge branch 'main' of github.com:knoriy/audio-dataset
knoriy
committed
add: script to process common voice
knoriy
committed
Merge branch 'LAION-AI:main' into main
knoriy
authored

Commits on Jan 13, 2023

updated cmd
knoriy
committed
Merge branch 'main' of github.com:knoriy/audio-dataset
knoriy
committed
automated extrators and updated text
knoriy
committed

Commits on Jan 16, 2023

fix: fixed but laguage was not set correctly, being set as train,test or valid
knoriy
committed

Commits on May 4, 2023

Commits on Jun 19, 2023

backup
knoriy
committed
backup
knoriy
committed

Commits on Jul 5, 2023

updated json file text to include metadata
knoriy
committed
Added meta
knoriy
committed
upload to s3
knoriy
committed

Commits on Jul 7, 2023

added emns dataset
knoriy
committed