HYPERNETS Product files

File Name conventions

The naming convention is intended to allow the unique identification of all product files and summarise the contents. It is composed of a defined sequence of data fields, separated by an underscore. For the HYPERNETS measurement data, the file name is composed as in the following way:

SYSTEM_NETWORK_SITEID_LEVEL_TYPE_ACQUISITIONDATETIME_PROCESSINGDATETIME_version.nc

For the HYPSTAR calibration data, the file name is similar except that it includes the system_id and the date and time of the calibration.

SYSTEM_NETWORK_SYSTEMID_TYPE_CALIBRATIONDATETIME_version.nc

For the RGB images taken during the measurements, the file name is similar except that it also includes the series ID, viewing and azimuth angle.

SYSTEM_NETWORK_SITEID_TYPE_ACQUISITIONDATETIME_PROCESSINGDATETIME_SERIESID_ZENITH_AZIMUTH_version.nc

The files are stored in the NetCDF data format and so have the extension “.nc” (except for the RGB images taken during the measurements by the instrument). The definition of the data fields and their allowed contents is described as follows:

Table 1: File name conventions

Example: For version 1 of water network L1B product, acquired at Blankaart South at 11:30 on 4/2/2020 and processed at 11:30 on 5/2/2020, the filename should be:

HYPERNETS_W_BSBE_L1B_RAD_20200204T1130_20200205T1130 _v1.0.nc

Table 2 defines the abbreviated name convention applicable to the individual Hypernets sites. Site name convention is a 4 letter abbreviation [LLCC] with LL standing for the location abbreviation and CC for the country abbreviation.

Table 2: Examples of site name conventions for water sites

Site ID

Site Name

BSBE

Blankaart South, Belgium

TCBE

Thornton-C, Belgium

ZBBE

Zeebrugge MOW-1, Belgium

MAFR

MAGEST station, Gironde estuary, France

LPAR

LA PLATA, La Plata River, Argentina

BEFR

Lac de BERRE, France

VEIT

Aqua Alta Oceanographic Tower, Venice, Italy

Data level

The end-to-end prototype processor takes the data from acquisition (raw data) to application of calibration and quality controls, computation of correction factors (e.g. Fresnel correction for water processing), temporal interpolation to coincident timestamps, processing to surface reflectance and averaging per series. To account for all these steps different data levels have been defined (see Table 3). See Definitions and protocols for a detailed explanantion of the terminology used.

Table 3: HYPERNETS processing levels

Network

Level_Type

Description

Dimensions

Both

Ancillary

Generic term covering non-measurement data used in processing chain

Both

Spe files

Raw binary files (.spe format)

wavelength & scan

Both

jpg files

RGB images taken by the HYPSTAR®

image

Both

L0A_RAD

Raw data for radiance scans stored in NetCDF files

wavelength & scan

Both

L0A_IRR

Raw data for irradiance scans stored in NetCDF files

wavelength & scan

Both

L0A_BLA

Raw data for dark scans stored in NetCDF files

wavelength & scan

Both

L0B_RAD

Raw data for radiance averaged per series and corresponding dark scans averaged per series

wavelength & series

Both

L0B_IRR

Raw data for irradiance averaged per series and corresponding dark scans averaged per series

wavelength & series

Both

L1A_RAD

Calibrated data for radiance scans corrected for dark samples and any other instrument corrections (e.g. non-linearity)

wavelength & scan

Both

L1A_IRR

Calibrated data for irradiance scans corrected for dark samples and any other instrument corrections (e.g. non-linearity)

wavelength & scan

Both

L1B_RAD

Calibrated data for radiance averaged over scans within one series stored in NetCDF files

wavelength & series

Both

L1B_IRR

Calibrated data for irradiance averaged over scans within one series stored in NetCDF files

wavelength & series

Land

L1C_ALL

LANDHYPERNET network file with (upwelling) radiance and irradiance which has been temporally and spectrally interpolated to match the radiance series

wavelength & series

Water

L1C_ALL

WATERHYPERNET network file with downwelling radiance and irradiance which has been temporally and spectrally interpolated to match the upwelling radiance scans and wavelength - upwelling radiance scans and estimated water-leaving radiance and reflectance with and without the NIR similarity correction

wavelength & upwelling radiance scan

Land

L2A_REF

LANDHYPERNET network file with surface reflectances per series

wavelength & series

Water

L2A_REF

WATERHYPERNET network file with water-leaving radiance and surface reflectance with and without the NIR similarity correction Ruddick et al. (2006)

wavelength & series

Both

L2B_REF

Only includes L2A_REF measurements which have passed site specific quality checks

wavelength & series

Both

L1D_RAD

Only includes L1B_RAD measurements which have passed site specific quality checks

wavelength & series

Both

L1D_IRR

Only includes L1B_IRR measurements which have passed site specific quality checks

wavelength & series

Product format

The main output files produced by the HYPERNETS_PROCESSOR are in NetCDF CF-convention version 1.8 format. There are also plots, typically produced in png format, and SQL databases (see SQL Databases).