[NOMERG] PPO update#2

vmoens wants to merge 4 commits intocompsciencelab:maincompsciencelab/torchrl_examples:mainfrom

vmoens:ppo_upgradevmoens/torchrl_examples:ppo_upgradeCopy head branch name to clipboard