Huggingface documentation

[jrlagrone]

Document typical setup for using huggingface data/models

• setting appropriate directories for (defaults to $HOME, which will quickly fill)

  • see environment variables
  • can we set different environment variables based on jobs / projects to be more consistent with cold front projects

• basic usage

  • downloading models (e.g. using git-lfs)
  • examples of transfer learning
  • examples of using existing models
  • running on SuperPOD / M3

Maybe something about considerations of where the data is coming