Anomalies (processing errors)

There are a number of anomalies that are defined to track where there are issues in the processing of the data. Each of the anomalies is identified with a letter or combination of letters (see table below). Some of these anomalies will raise an error (e.g. metadata file missing), and cause the processing of the data to be stopped (as indicated by column in the table). Other anomalies (e.g. no_clear_sky_sequence) indicate an issue, but don’t halt the processing of the data (e.g. measurements where the clear sky check failed (i.e. overcast conditions) might still be useful to some users). In such cases, a quality flag is added to the data so that users can easily identify the affected sequences without having to look in the anomaly database. The different quality flags are described on the Flags description page.

The following table lists the different anomalies, their description and whether they stop the processing.

Table 1: Anomalies description

anomaly	name	network	level	Description	halts processing	flag bit
m	metadata_miss	L & W	L0A	metadata file is missing or one of the raw files listed in the Metadata file is missing	True
s	meteo_miss	L & W	L0A	File with meteorological information is missing	False
a	bad_pointing	L & W	L0A	Difference between requested and effective pan/tilt angle is $>=$ 3°	False	4
nld	not_enough_dark_scans	L & W	L0B	Not enough valid dark scans for this series ($#$ valid dark scans $<$ n_valid_dark from the config file)	False	10
nlu	not_enough_rad_scans	L & W	L0B	Not enough valid radiance scans for this series ($#$ valid radiance scans $<$ n_valid_rad from the config file)	False	11
ned	not_enough_irr_scans	L & W	L0B	Not enough valid irradiance scans for this series ($#$ valid irradiance scans $<$ n_valid_irr from the config file)	False	12
ms	series_missing	L & W	L1B	Check if there are any missing series (either not present or flagged by `not_enough_dark_scans’; `not_enough_irr_scans’; `not_enough_rad_scans’ or `vza_irradiance’)	False	13
u	negative_unc	L & W	L1B	There are negative uncertainties	True
o	half_of_unc_too_big	L & W	L1B	More than 50% of data has random error above 100% (likely corrupted or dark data)	False	17
nu	check_valid_irradiance	L & W	L1C	Halt processing if `variable_irradiance’ flag was triggered at previous level	True
in	check_valid_sequence	L & W	L1C	Halt processing if there are no valid series (flagged by `not_enough_dark_scans’; `not_enough_irr_scans’; `not_enough_rad_scans’ or `vza_irradiance’).	True
cl	no_clear_sky_sequence	L & W	L1C	If all irradiance series are flagged with the `no_clear_sky_irradiance’ flag	False	19
d	discontinuity_VNIR_SWIR	L	L1B	Checks if the VNIR and SWIR are different by more than 25%	False	20
nd	variable_radiance	W	L1C	More than 10% difference between start and end $L_d$ at 550~nm	True
l	ld_missing	W	L1C	Ld missing for sky reflectance correction	True
x	unexpected_error	L & W		unexpected error during processing; catches all errors	True