Description

Raw data inspection

Scripts to catalogue, check and transfer the raw data files of the experiment.

File	Description
raw_main_inspector.py	Checks the MD5 checksums of the raw files against the database and records the failed files of each integrity check
catalog_raw_data.py, file_catalogue.json, file_catalogue.sql	Matches the raw file metadata with the File Catalogue database for the storages DDC/DAQ, NCX or CICC/MICC; configuration and schema
transfer_raw_data.py	Matches the raw data files between the storages DDC/DAQ -> NCX -> CICC/MICC
filter_raw_data.py, filter_raw_data.json	Searches for abnormally small and large raw files and run sizes
move_bad_runs.py	Moves the files of bad runs to a separate directory

Directory dependency graph for raw_inspection: