[Feature Request] MinariExperienceReplay now can handle text fields like "mission"

[marcosgalleterobbva]

Motivation

MinariExperienceReplay at this moment is not able to manage text fields like "missions". This feature is extremely important for BabyAI datasets, that might have diverse missions or even changing missions inside an episode.

Solution

I have an already functioning fork that adds a new argument to MinariExperienceReplay called string_to_tensor_map. This argument is typed as a dictionary mapping string to Tensor, where each key of the dictionary would be any of the keys of the observation TensorDict.

The original NonTensorData values would be mapped with the function to the desired vector representation of each mission (or text data).

Alternatives

Can't think of any other solution that does not hardcode a method for obtaining tensors from NonTensorData.

Additional context

This is my working fork, with tests and documentation.

Checklist

• [ x] I have checked that there is no similar issue in the repo (required)