Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can i change a Distribution? #2032

Open
4 tasks done
CAI23sbP opened this issue Nov 4, 2024 · 1 comment
Open
4 tasks done

How can i change a Distribution? #2032

CAI23sbP opened this issue Nov 4, 2024 · 1 comment
Labels
question Further information is requested

Comments

@CAI23sbP
Copy link

CAI23sbP commented Nov 4, 2024

❓ Question

How are you @araffin ?
I have two questions

  1. If I want to change distribution , how can I do it?

Here is my situation
I made an agent that was based on PPO(diagonal dist) by imitation learning library( behavioral cloning)
And then, Finetuning the pretrained model use a 'gSDE' (StatedependentDist)
It is right to change a sde_sample_freq from 1 to n?

  1. How can i create a normalized observation(for demonstration data)? Is it okay to use a VecNormEnv?
    Might i get any hit about the above issues?

Thank you!

Checklist

@CAI23sbP CAI23sbP added the question Further information is requested label Nov 4, 2024
@CAI23sbP CAI23sbP closed this as completed Nov 4, 2024
@CAI23sbP CAI23sbP reopened this Nov 4, 2024
@CAI23sbP CAI23sbP changed the title How can i change Distribution? How can i change a Distribution? Nov 4, 2024
@araffin
Copy link
Member

araffin commented Nov 5, 2024

It is right to change a sde_sample_freq from 1 to n?

should be fine

Is it okay to use a VecNormEnv?

that's one solution. But if you have a fixed dataset, you can precompute the normalization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants