Skip to content

CMS@Home jobs not being cleaned up  #10751

@KatyEllis

Description

@KatyEllis

Impact of the bug
Cleanup from the CMS@Home jobs is not being done properly since turning off Phedex.

Describe the bug
In an email from Ivan Reid on the 12th August 2021, he describes the issue. Cleanup jobs are trying to delete files from EOS instead of the DataBridge. Similarly the merge log files have the same problem. The DataBridge storage does get garbage collected after 30 days, but this space could fill up before 30 days is reached.

How to reproduce it
Steps to reproduce the behavior:

Expected behavior
Change the (hardcoded?) target of the cleanup jobs?

Additional context and error message
From Ivan's email:
(removing triangular brackets due to syntax requirements)

Our current understanding is that in
/cvmfs/cms.cern.ch/SITECONF/T3_CH_CMSAtHome/JobConfig/site-local-config.xml
we have in stage-out:
se-name value="srm-eoscms.cern.ch"/
phedex-node value="T2_CH_CERN"/
while in event-data we have
catalog url="trivialcatalog_file:/cvmfs/cms.cern.ch/SITECONF/local/PhEDEx/storage.xml?protocol=http"/
in which
lfn-to-pfn protocol="http" path-match="/+store/(.*)"
result="http://data-bridge.cern.ch/myfed/cms-output/store/$1"/>

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    ToDo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions