Remove unnecessary SDE resampling in PPO update

docs/misc/changelog.rst

@@ -17,6 +17,7 @@ Bug Fixes:
 - Fixed memory leak when loading learner from storage, ``set_parameters()`` does not try to load the object data anymore
   and only loads the PyTorch parameters (@peteole)
 - Cast type in compute gae method to avoid error when using torch compile (@amjames)
+- Remove unnecessary SDE noise resampling in PPO update (@brn-dev)
 
 `SB3-Contrib`_
 ^^^^^^^^^^^^^^

stable_baselines3/ppo/ppo.py

@@ -210,10 +210,6 @@ def train(self) -> None:
                     # Convert discrete action from float to long
                     actions = rollout_data.actions.long().flatten()
 
-                # Re-sample the noise matrix because the log_std has changed
-                if self.use_sde:
-                    self.policy.reset_noise(self.batch_size)
-
                 values, log_prob, entropy = self.policy.evaluate_actions(rollout_data.observations, actions)
                 values = values.flatten()
                 # Normalize advantage