Rucio

[zonca]

CMB-S4 is also interested in investigating Rucio, so it would be efficient if @zonca can do work to benefits both projects on this front.

[zonca]

really easy to install the demo version of rucio with https://rucio.cern.ch/documentation/operator/setting_up_demo using docker-compose on cdmsdev.

asked about using OSN and about handling existing data on the CERN support chat: https://mattermost.web.cern.ch/rucio/channels/support

[zonca]

my question:

Hi, I am new to Rucio, I am trying to setup a Demo deployment of Rucio which uses object storage provided by OpenStorageNetwork as an RSE.
Do you think that the instructions from S3 https://rucio.cern.ch/documentation/operator/s3_rse_config should work also for OpenStorageNetwork?
Is there a way to ingest data which are already in object storage to Rucio, without the need to re-upload them? I couldn't find documentation on how to do that

answer from Mario Lassnig:

yes, that should work if it's an S3v4 compatible object store. The important bit is if you have other storage systems that want to integrate with your object store they all need to have frontends with host certificates from the same CA, otherwise you'd potentially be running unencrypted and unverified transfers.
To ingest, yes, that's also possible though I don't think there's a CLI to do it easily, so you'd have to write a python five liner using the Rucio Python API.

[pibion]

Hello, just wanted to check on the status of the Rucio server. I have a student who's available to try registering data (located on OSN). He's currently getting all the account access he needs to make sure he's got access to appropriate metadata.

[pibion]

@zonca my student and I spent some time trying to configure the Rucio client on our machines, so he can start looking at how to register data. Do you have connection information for the Rucio instance you set up? According to the Rucio mattermost chat we need to make a file that looks like

[client]
rucio_host = https://hostname:443
auth_host = https://hostname:443
client_x509_proxy = /my/userproxy.pem

[zonca]

I can stand up a simple Rucio instance on cdmsdev but haven't had time to figure out how to link storage or register data.
It will take time, I am new to Rucio and I am giving priority on the work on kaitai-awkward.