How to use middleware?

I am trying to pass session middleware for a simple oidc flow.
However even though the documentation states that you can use middleware to store the session, I don't seem to know a way to use the middleware.