Published January 1, 2024 | Version v1
Conference paper Open

Scale tests of the new DUNE data pipeline

Creators

  • 1. Fermilab Natl Accelerator Lab, Batavia, IL 60510 USA

Description

In preparation for the second runs of the ProtoDUNE detectors at CERN (NP02 and NP04)[1], DUNE has established a new data pipeline for bringing the data from the EHN-1 experimental hall at CERN to primary tape storage at Fermilab and CERN, and then spreading it out to a distributed disk data store at many locations around the world. This system includes a new Ingest Daemon and a new Declaration Daemon. The Rucio[2] replica catalog, and FTS3 transport are used to transport all files. All file metadata is declared to the new MetaCat[3] metadata service. All of these new components have been successfully tested at a scale equal to the expected output of the detector data acquisition system (similar to 2-4 GB/s), and the expected network bandwidth out of the experimental hall. We present the procedure that was used to test and the results of the test.

Files

bib-566d6b4c-c366-4116-8ac3-28311098eb1e.txt

Files (150 Bytes)

Name Size Download all
md5:68a2211d742ce52742d6e28e3dbbc786
150 Bytes Preview Download