chore: bump stable-baselines3 from 1.5.0 to 1.7.0

[dependabot]

Bumps stable-baselines3 from 1.5.0 to 1.7.0.

Release notes

Sourced from stable-baselines3's releases.

Stable-Baselines3 v1.7.0 : non-shared features extractor, bug fixes and quality of life improvements

SB3 Contrib (more algorithms): https://github.com/Stable-Baselines-Team/stable-baselines3-contrib RL Zoo3 (training framework): https://github.com/DLR-RM/rl-baselines3-zoo

To upgrade:

pip install stable_baselines3 sb3_contrib rl_zoo3 --upgrade

or simply (rl zoo depends on SB3 and SB3 contrib):

pip install rl_zoo3 --upgrade

Warning Shared layers in MLP policy (mlp_extractor) are now deprecated for PPO, A2C and TRPO. This feature will be removed in SB3 v1.8.0 and the behavior of net_arch=[64, 64] will create separate networks with the same architecture, to be consistent with the off-policy algorithms.

Note A2C and PPO models saved with SB3 < 1.7.0 will show a warning about missing keys in the state dict when loaded with SB3 >= 1.7.0. To suppress the warning, simply save the model again. You can find more info in issue #1233

Breaking Changes:

• Removed deprecated create_eval_env, eval_env, eval_log_path, n_eval_episodes and eval_freq parameters, please use an EvalCallback instead
• Removed deprecated sde_net_arch parameter
• Removed ret attributes in VecNormalize, please use returns instead
• VecNormalize now updates the observation space when normalizing images

New Features:

• Introduced mypy type checking
• Added option to have non-shared features extractor between actor and critic in on-policy algorithms (@​AlexPasqua)
• Added with_bias argument to create_mlp
• Added support for multidimensional spaces.MultiBinary observations
• Features extractors now properly support unnormalized image-like observations (3D tensor) when passing normalize_images=False
• Added normalized_image parameter to NatureCNN and CombinedExtractor
• Added support for Python 3.10

SB3-Contrib

• Fixed a bug in RecurrentPPO where the lstm states where incorrectly reshaped for n_lstm_layers > 1 (thanks @​kolbytn)
• Fixed RuntimeError: rnn: hx is not contiguous while predicting terminal values for RecurrentPPO when n_lstm_layers > 1

... (truncated)

Commits

• 6b8905a Release v1.7.0 (#1268)
• 5aa6e7d Fix ProgressBarCallback under-reporting (#1260)
• 30a1984 Deprecation of shared layers in MlpExtractor (#1252)
• 4fa17dc Standardize the use of from gym import spaces (#1240)
• 2bb8ef5 Add RLeXplore to the project page (#1246)
• e78ba6f Hotfix to load policies saved with SB3 <= v1.6 (#1234)
• 3c028f3 Fix load_from_tensor (#1231)
• 5549b34 Fix stable_baselines3/common/vec_env/vec_check_nan.py type hints (#1226)
• 9aff113 Add support for Python 3.10 (#1227)
• 7202ece Update tensorboard callback doc (#1221)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Superseded by #94.