shared cache meeting 20200721

Present at the meeting:

• Andrey Mokhov (@snowleopard)
• Jérémie Dimino (@jeremiedimino)
• Quentin Hocquet (@mefyl)
• Arseniy Alekseyev (@aalekseyev)

Work

Quentin

• Working on the work duplication issue where the same file is re-downloaded multiple times if it's requested multiple times in parallel.
• Need further testing to make progress.

Andrey

• We can connect the daemon to the storage node, jenga can connect to the daemon, uploads things to cache successfully.
• Downloading for some reason fails, investigating together with Quentin why that could be happening.

Discussions

• Need good story for Kerberos.

On the server server-side we decided we'll try to use nginx, but the client will need to talk Kerberos directly.

One way is to open-source Jane Street Kerberos stuff and use it in dune-cache

Another is to have an abstract authentication layer in dune-cache which we fill in in Jane Street by replacing a module or applying a functor.

Maybe it's possible to use an alternative Krb library, but that seems undesirable because of security concerns.