Offline Filtering Rota

Overview

The offline results are reranked using online results, and some data that were dropped in online analysis for some reason need to be refiltered for completeness. Also, the R&P group has produced injection sets to analyze offline. For both dropped data and injection sets, we will filter these injections using the same whitened & decomposed templates that were used online, hereafter referred to simply as SVDs. The non-injection and injection triggers output by this filtering will be included in the final combined reranks. The injection filtering workflow is now done using a Makefile. The Makefile can be used with some modifications for running an offline filtering dag.

Instructions for O4c Rick Injection Filtering

1. Log into gstlalcbc from the 02 headnode on ICDS. Run

cd /ligo/home/ligo.org/gstlalcbc/observing/4/c/offline/injections
make make_segments_and_vetoes N=<N>

This step sets up the directory structure, creates the Makefile and downloads the segments and the vetoes. This is a temporary location and can be deleted once R&P filtering and dropped data filtering is complete.

2. Log into albert.einstein@ldas-pcdev12.ligo.caltech.edu (DO NOT USE THE SHARED ACCOUNT)

make all N=<N> -f /home/gstlalcbc.offline/observing/4/c/injections/Makefile

This step will take a long time as it is copying the SVDs. Run it using screen.

3. Log into gstlalcbc.offline from the 02 headnode on ICDS. We will run the dags from this headnode. You can run this step while the SVDs are being copied. (Step 2)

cd /ligo/home/ligo.org/gstlalcbc.offline/observing/4/c/injections
make submit_psd_dag N=<N>

This step generates the PSDs.

4. Proceed to this step only after steps 2 & 3 are complete. Log into gstlalcbc.offline from 02 headnode on ICDS.

cd /ligo/home/ligo.org/gstlalcbc.offline/observing/4/c/injections
make submit_inj_filter_dag N=<N>

Monitor the dags.

Instructions for O4c Bob Injection Filtering

You can only set up Bob after setting up Rick’s injection-filter dags (Step 4 for Rick). This step can be done when Rick’s injection filter dag is still running.

Log into gstlalcbc.offline from 02 headnode on ICDS.

cd /ligo/home/ligo.org/gstlalcbc.offline/observing/4/c/injections
make submit_inj_filter_dag N=<N> -f Makefile_bob

Edward Analysis Times for o4a

The Edward SVDs were replaced on Tuesdays. Week divisions are at 16:00 UTC. Note about week 6: the SVD policy hadn’t been finalized yet and the SVD was swapped out on July 1. We’ll be conservative and use the older SVD for the whole week.

Jacob Analysis Times for o4a

The Jacob SVDs were replaced on Thursdays until December 20, then the SVDs were replaced on Wednesdays. Week divisions are at 16:00 UTC.