Data access — get_ms, remove, make_ms_list¶
get_ms — print MS paths¶
Prints a space-separated list of MS paths for the given obs_ids, data level, and spectral windows. The output is designed for shell command substitution.
Examples¶
# Get all L2 MSs for a set of nights, SW03
mss=$(nenudata get_ms L2 "202312*_NT04" --sws SW03)
calpipe cal/ddecal.toml $mss
# Narrow to two specific spectral windows
mss=$(nenudata get_ms L2 "20231208_NT04" --sws SW03,SW04)
# Append a sub-path inside each MS (e.g. to point at a diagnostic sub-dir)
nenudata get_ms L2 "20231208_NT04" --post_path logs
With --post_path logs, each path becomes /net/node/obs/L2/SW03.MS/logs.
Options¶
Option |
Default |
Description |
|---|---|---|
|
|
Comma-separated spectral windows, or |
|
`` |
Appended to each MS path as a sub-directory |
|
|
Data-handler config file |
remove — delete MS files¶
nenudata remove L2 "202312*_NT04"
Prompts for confirmation before deleting all MSs matching the given obs_ids
and spectral windows at the specified data level. Use --sws to restrict to
specific spectral windows.
nenudata remove L2 "20231208_NT04" --sws SW03
make_ms_list — write MS path files for calpipe/DP3¶
Creates plain text files containing MS paths, one file per (obs_id, sw)
combination. These files can be passed to calpipe or DP3 via @filename
syntax.
One list file per (obs_id, sw)¶
nenudata make_ms_list L2 "202312*_NT04" --target ms_lists/
Creates files like ms_lists/20231208_NT04_L2_SW03 containing all MS paths
on one line (space-separated by default).
One MS per line (column format)¶
nenudata make_ms_list L2 "202312*_NT04" --column
Each MS path is written on its own line. Useful for tools that read line-delimited input.
One file per individual MS¶
nenudata make_ms_list L2 "202312*_NT04" --per_ms --target ms_lists/
Creates a sub-directory ms_lists/20231208_NT04_L2_SW03.d/ containing one
file per MS file.
Filter by elevation¶
nenudata make_ms_list L2 "202312*_NT04" --min_alt 25
Only includes MSs where the mean elevation of the target field is at least 25 degrees.
Reference¶
nenudata get_ms¶
Return a list of all MS corresponding to given OBS_IDS and SWS
Usage
nenudata get_ms [OPTIONS] LEVEL OBS_IDS
Options
- -c, --config <config>¶
Data handler configuration file
- -s, --sws <sws>¶
Spectral windows
- -p, --post_path <post_path>¶
Add post_path to the path of the MS
Arguments
- LEVEL¶
Required argument
- OBS_IDS¶
Required argument
nenudata remove¶
Remove all MS corresponding to given OBS_IDS and SWS
Usage
nenudata remove [OPTIONS] LEVEL OBS_IDS
Options
- -c, --config <config>¶
Data handler configuration file
- -s, --sws <sws>¶
Spectral windows
Arguments
- LEVEL¶
Required argument
- OBS_IDS¶
Required argument
nenudata make_ms_list¶
Make MS list for all OBS_IDS at level LEVEL
Usage
nenudata make_ms_list [OPTIONS] LEVEL OBS_IDS
Options
- -c, --config <config>¶
Data handler configuration file
- --target <target>¶
Target directory
- -C, --column¶
Write one MS per line (column format)
- --min_alt <min_alt>¶
Minimum mean elevation in degrees. Only MS with mean altitude ≥ this value.
- --per_ms¶
Create one ms_list file per MS instead of one per (obs_id, sw)
Arguments
- LEVEL¶
Required argument
- OBS_IDS¶
Required argument