Hyperparameter Tuning

Thanks for the awesome package, i want to ask how does hyperparameter work in the K-fold paradigm. should i use out of fold data to pre-tune the hyperparameters or use part of the data to pre-tune hyperparameters or should i do hyperparameter selection during each fold of the cv process? thanks 