Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Want to impose rucio file check after upload #110

Open
FaroutYLq opened this issue Nov 4, 2023 · 1 comment
Open

Want to impose rucio file check after upload #110

FaroutYLq opened this issue Nov 4, 2023 · 1 comment
Assignees
Labels
bug Something isn't working enhancement New feature or request PRIORITY

Comments

@FaroutYLq
Copy link
Collaborator

FaroutYLq commented Nov 4, 2023

So to avoid empty rules and incomplete upload. A typical rucio corruption is incompleteness in direct upload. Below is an extreme example where nothing was really uploaded for that dataset.

(rucio-venv-1.23) [_jlstephen@rucio-xenon ~]$ rucio ls xnt_048374:peaklets-euocvpkv3y
+--------------------------------+--------------+
| SCOPE:NAME                     | [DID TYPE]   |
|--------------------------------+--------------|
| xnt_048374:peaklets-euocvpkv3y | DATASET      |
+--------------------------------+--------------+
(rucio-venv-1.23) [_jlstephen@rucio-xenon ~]$ rucio list-files xnt_048374:peaklets-euocvpkv3y
+--------------+--------+-----------+------------+----------+
| SCOPE:NAME   | GUID   | ADLER32   | FILESIZE   | EVENTS   |
|--------------+--------+-----------+------------+----------|
+--------------+--------+-----------+------------+----------+
Total files : 0
Total size : 0.000 B
@FaroutYLq FaroutYLq added the enhancement New feature or request label Nov 4, 2023
@FaroutYLq FaroutYLq self-assigned this Nov 4, 2023
@FaroutYLq FaroutYLq added bug Something isn't working PRIORITY labels May 30, 2024
@FaroutYLq
Copy link
Collaborator Author

Right now we just keep running in --debug mode, which avoids rucio upload and we just gfal-copy to destination. It is slow and manual but working.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request PRIORITY
Projects
None yet
Development

No branches or pull requests

3 participants