TAP Tables and Views - CSA Guide
TAP TABLES AND VIEWS
The TAP system allows read access to the CSA database concerning CSA products. The available data is arranged into custom tables called 'views' which collect together useful attributes for searching for the data/metadata that you need. The tables below list the views with their column names, descriptions/examples and equivalents in the header metadata and in the old CAIO system.
The CAIO keywords are still included due to the extraordinary length of the Cluster operations, and how old scripts may be that may require updating.
Here are instructions for using TOPCAT to find this information.
Remember (from metadata page) that to find all the possible values for a column, the ADQL syntax is:
SELECT DISTINCT <column> FROM <view>
For example, to find a list of possible values, for e.g., 'category' column name:
SELECT DISTINCT entity FROM v_parameter
and the results are:
Photon, Instrument, Transformation, Particles, Ion_CNO, Compound, Magnetic_Field, Proton, Electric_Field, Other1, Helium+, Alpha, Electron, Observatory, Oxygen+, Ion
In alphabetical order, the views are:
|
VIEW NAME |
DESCRIPTION |
|
|
Dataset information, including dataset IDs, dates, formats, type (e.g. data or graphical). |
||
|
Information about availability of data: time ranges where there were data points, interleaved with time ranges where there were none. |
||
|
Dataset reference documents (usually caveat files) associated with dataset IDs. |
||
|
Experiment information such as descriptions, datasets available and contact details. |
||
|
File information such as version numbers and dates ingested. |
||
|
Instrument information including instrument types and measurement types. |
||
|
Descriptions and dates for the Cluster and Double Star Missions. |
||
|
Descriptions and dates for each spacecraft; also describes contextual datasets, i.e., mixed instrument or cross-calibrated. |
||
|
Provides metadata about the parameters in each dataset, including labels, units, data type, etc. |
||
|
Pre-generated plot inventory information, such as generation date and size of file. |
||
|
Lists of quick look products and image size. |
CSA.V_DATASET
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
acknowledgement |
Acknowledgement text for use in publications |
ACKNOWLEDGEMENT |
DATASET.ACK |
|
allow_overlap |
Whether consecutive files in the dataset may cover overlapping time periods (0 = no, 1 = yes) |
|
DATASET.ALLOW_OVERLAP |
|
category |
E.g., 'CLUSTER', 'Diagnostics', 'MIRACLE', 'Moments', ... |
|
DATASET.CATEGORY |
|
compress |
Whether the dataset is compressed: (0 = no, 1 = yes) |
|
|
|
crosscal |
Whether the dataset is a cross-calibration product: (0 = no, 1 = yes) |
|
|
|
data_type |
Full data type description, e.g., |
DATA_TYPE |
|
|
data_type_id |
Abbreviated data type code, e.g., |
DATA_TYPE |
|
|
dataset_caveats |
Caveat dataset_id or 'See User Guide for caveats', ... |
|
|
|
dataset_id |
Unique identifier for the dataset ID, e.g., C1_CP_FGM_SPIN |
DATASET_ID |
DATASET.DATASET_ID |
|
dataset_reference |
Reference dataset IDs delivered if applicable |
|
|
|
date_last_file_ingested |
Date that the last file was ingested into the CSA, in ISO time format |
|
DATASET.DATE_LAST_FILE_INGESTED |
|
date_last_update |
Date that the last file was updated in the CSA, in ISO time format |
|
DATASET.DATE_LAST_UPDATE |
|
description |
Description of the dataset |
DATASET_DESCRIPTION |
DATASET.DESCRIPTION |
|
display_order |
Position of this dataset in web interface listing |
|
DATASET.DISPLAY_ORDER |
|
end_date |
End date of currently ingested data for this dataset, in ISO time format |
|
DATASET.END_DATE |
|
experiments |
Experiments involved in this dataset (multiple for cross-calibration products) |
|
|
|
file_extension |
Format extension of the files E.g., .cef, .cdf, .png, ... |
|
DATASET.FILE_EXTENSION |
|
gui_name |
Name as it appears in the web interface (GUI) |
|
DATASET.GUI_NAME |
|
ingestion_date |
Earliest time that this dataset was ingested into the CSA, in ISO time format |
|
DATASET.INGESTION_DATE |
|
instruments |
Instrument name plus spacecraft number, e.g., PEACE2, STAFF-SA4 |
|
|
|
"interval" |
Interval covered by the product, mainly for graphical products, e.g., "24 Hour" |
|
DATASET.INTERVAL |
|
inventory |
Whether the dataset is represented in the inventory plots: (0 = no, 1 = yes) |
|
DATASET.INVENTORY |
|
is_cef |
Whether the dataset is a CEF product: (0 = no, 1 = yes) |
|
DATASET.IS_CEF |
|
is_istp |
Indicates if the dataset is ISTP-compliant and downloadable as an ISTP CDF (0 = no, 1 = yes). |
|
DATASET.IS_ISTP |
|
key_product |
Indicates if this dataset is shown when GUI Results' "Short List" box is ticked |
|
DATASET.KEY_PRODUCT |
|
"level" |
Processing level, e.g., Calibrated, Raw, Derived, ... |
PROCESSING_LEVEL |
|
|
main_group |
Grouping for GUI, e.g., Graphical, Science, ... |
|
DATASET.MAIN_GROUP |
|
max_start_file_date |
Start time of the chronologically last file in the dataset, in ISO time format |
|
DATASET.MAX_START_FILE_DATE |
|
max_time_resolution |
Maximum time resolution, in seconds |
|
DATASET.MAX_TIME_RESOLUTION |
|
measurement_types |
E.g., Magnetic_Field, Energetic_Particles |
|
|
|
min_time_resolution |
Minimum time resolution, in seconds |
|
DATASET.MIN_TIME_RESOLUTION |
|
multi_inst |
Indicates if this dataset is multi-instrument: (0 = no, 1 = yes) |
|
DATASET.MULTI_INST |
|
multi_sc |
Indicates if this dataset is multi-spacecraft: (0 = no, 1 = yes) |
|
DATASET.MULTI_SC |
|
observatory_name |
Name of spacecraft, e.g., Cluster-4, DoubleStar-1, ... |
|
OBSERVATORY.NAME |
|
on_demand |
Indicates if this dataset is on demand: (0 = no, 1 = yes) |
|
DATASET.ON_DEMAND |
|
person_reference |
PI Team personnel/contact information |
CONTACT_COORDINATES |
|
|
pregen_product |
Indicates if this dataset is a pre-generated product: (0 = no, 1 = yes) |
|
DATASET.PREGEN_PRODUCT |
|
quicklook_product |
Indicates if this dataset is a quick-look product: (0 = no, 1 = yes) |
|
DATASET.QUICK_LOOK_PRODUCT |
|
released |
Indicates if this dataset is a released product: (0 = no, 1 = yes) |
|
DATASET.RELEASED |
|
start_date |
Start date of dataset, in ISO time format |
|
DATASET.START_DATE |
|
time_resolution |
Time resolution in seconds |
|
DATASET.TIME_RESOLUTION |
|
title |
Technical title of dataset, may or may not be same as gui_name |
DATASET_TITLE |
DATASET.TITLE |
|
unit_name |
E.g., Bitmap, Particle Energy Flux, Raw, ... |
|
DATASET.UNIT_NAME |
CSA.V_DATASET_INVENTORY
No equivalents in header metadata
|
COLUMN NAME |
EXAMPLE |
CAIO ATTRIBUTE |
|
dataset_id |
Unique identifier for the dataset ID, e.g., 'C1_CP_FGM_SPIN' |
DATASET_INVENTORY.DATASET_ID |
|
end_time |
End time of interval, ISO time format |
DATASET_INVENTORY.END_TIME |
|
inventory_version |
Interval data version number |
DATASET_INVENTORY.VERSION |
|
num_instances |
Number of data points in the interval, integer |
DATASET_INVENTORY.NUM_INSTANCES |
|
start_time |
Start time of interval, ISO time format |
DATASET_INVENTORY.START_TIME |
CSA.V_DATASET_REFERENCED
No equivalents in header metadata
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
CAIO ATTRIBUTE |
|
dataset_id |
Unique identifier for the dataset ID, e.g., 'C1_CP_FGM_SPIN' |
|
|
dataset_referenced_id |
Reference document dataset ID |
|
|
mandatory |
Mandatory delivery if applicable: (0 = no, 1 = yes) |
REFERENCED_DATASET.MANDATORY |
CSA.V_EXPERIMENT
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
caveats |
Caveat dataset ID or descriptive caveats |
EXPERIMENT_CAVEATS |
|
|
datasets |
List of datasets from this experiment |
|
|
|
description |
Description of experiment |
EXPERIMENT_DESCRIPTION |
EXPERIMENT.DESCRIPTION |
|
display_order |
Display order in the web interface |
|
EXPERIMENT.DISPLAY_ORDER |
|
end_date |
Final date of data for this experiment in ISO time format |
|
EXPERIMENT.END_DATE |
|
investigators |
Experiment investigator contact details |
INVESTIGATOR_COORDINATES |
|
|
key_persons |
Key personnel contact details |
EXPERIMENT_KEY_PERSONNEL |
|
|
long_name |
Full experiment name, e.g., PEACE electron spectrometer |
|
EXPERIMENT.LONG_NAME |
|
mission |
Cluster or Double Star |
|
|
|
name |
Experiment acronym, e.g., PEACE |
EXPERIMENT |
EXPERIMENT.NAME |
|
"references" |
Reference publications |
EXPERIMENT_REFERENCES |
|
|
start_date |
Start date of data for this experiment in ISO time format |
|
EXPERIMENT.START_DATE |
CSA.V_FILE
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
backup |
Indicates if this file is backed up, (0 = no, 1 = yes) |
|
|
|
caa_ingestion_date |
Date that the file was ingested into the CAA, ISO time format |
|
FILE.CAA_INGESTION_DATE |
|
compressed |
Indicates if this file is compressed (0 = no, 1 = yes) |
|
FILE.COMPRESSED |
|
csa_ingestion_date |
Date that the file was ingested into the CSA, ISO time format |
|
FILE.CSA_INGESTION_DATE |
|
dataset_id |
Unique identifier for the dataset ID, e.g., 'C1_CP_FGM_SPIN' |
|
FILE.DATASET_ID |
|
dataset_version |
File dataset version |
|
FILE.DATASET_VERSION |
|
date_last_update |
Date that this file was last updated, ISO time |
|
FILE.DATE_LAST_UPDATE |
|
distribution_path |
Folder within package |
|
FILE.DISTRIBUTION_PATH |
|
extension |
Extension of the file, e.g., cef.gz |
|
FILE.EXTENSION |
|
file_end_date |
End time of the file, ISO time |
FILE_TIME_SPAN |
FILE.END_DATE |
|
file_name |
Full file name |
|
FILE.FILE_NAME |
|
file_size |
KB |
|
FILE.FILE_SIZE |
|
file_start_date |
Start time of the file, ISO time |
FILE_TIME_SPAN |
FILE.START_DATE |
|
file_type |
Format of the file, e.g., cef |
FILE_TYPE |
FILE.FILE_TYPE |
|
logical_file_id |
Filename without extension |
LOGICAL_FILE_ID |
FILE.LOGICAL_FILE_ID |
|
time_coverage_in_sc |
File coverage time in seconds |
|
|
|
version_number |
File version number, integer |
VERSION_NUMBER |
FILE.VERSION_NUMBER |
CSA.V_INSTRUMENT
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
datasets |
Instrument's dataset IDs (unique identifier for each dataset ID, e.g., 'C1_CP_FGM_SPIN') |
|
|
|
description |
Instrument's description |
INSTRUMENT_DESCRIPTION |
INSTRUMENT.DESCRIPTION |
|
experiment_name |
Experiment name (acronym) |
|
|
|
instrument_types |
Instrument type, e.g., Antenna, Waveform_Receiver |
INSTRUMENT_TYPE |
INSTRUMENT_TYPE.TYPE |
|
measurement_types |
Measurement types, e.g., Radio_and_Plasma_Waves, Magnetic_Field |
MEASUREMENT_TYPE |
MEASUREMENT_TYPE.TYPE |
|
name |
Experiment name (acronym) + spacecraft number, e.g., PEACE2, HID-D2 |
INSTRUMENT_NAME |
INSTRUMENT.NAME |
|
observatories |
Spacecraft + number, e.g., DoubleStar-2, Cluster-4 (csa.v_observatory.name) |
OBSERVATORY |
OBSERVATORY.NAME |
CSA.V_MISSION
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
agency |
ESA or CNSA_and_ESA |
MISSION_AGENCY |
MISSION.AGENCY |
|
description |
Mission description |
MISSION_DESCRIPTION |
MISSION.DESCRIPTION |
|
end_date |
Mission end date, ISO time format |
MISSION_TIME_SPAN{21:] |
MISSION.END_DATE |
|
name |
Cluster or DoubleStar |
MISSION |
MISSION.NAME |
|
start_date |
Mission start date, ISO time format |
MISSION_TIME_SPAN[:20] |
MISSION.START_DATE |
CSA.V_OBSERVATORY
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
abbreviation |
C1-4, D1-2, CC for contextual and CM for all Cluster spacecraft |
|
OBSERVATORY.ABBREVIATION |
|
description |
Description of s/c including COSPAR ID, dates, orbits, etc. |
|
OBSERVATORY.DESCRIPTION |
|
instruments |
Instrument names, acronym + s/c number (csa.v_instrument.name) |
|
|
|
mission_name |
Mission name: Cluster or DoubleStar |
MISSION |
|
|
name |
Mission and spacecraft number: e.g., Cluster-1 or DoubleStar-2 |
OBSERVATORY |
OBSERVATORY.NAME |
|
time_span |
Observatory operating time span, ISO time interval |
OBSERVATORY_TIME_SPAN |
OBSERVATORY.TIME_SPAN |
CSA.V_PARAMETER
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
HEADER METADATA |
CAIO ATTRIBUTE |
|
array_dimension |
Numbered dimensions of the array, e.g. for 1D = 0:20, 2D = 0:21, 1:3 |
SIZES |
|
|
cat_description |
Description of parameter |
CATDESC |
PARAMETER.CAT_DESC |
|
caveat |
Parameter caveat e.g., "This assumes that the source is dipolar…" |
PARAMETER_CAVEATS |
PARAMETER.CAVEAT |
|
coordinate_system |
E.g., GSE>Geocentric Solar Ecliptic |
COORDINATE_SYSTEM |
PARAMETER.COORDINATE_SYSTEM |
|
dataset_id |
Unique identifier for the dataset ID, e.g., 'C1_CP_FGM_SPIN' |
|
|
|
data_type |
Data or Support_Data |
PARAMETER_TYPE |
PARAMETER.TYPE |
|
delta_minus |
A floating point number or parameter_id |
DELTA_MINUS |
PARAMETER.DELTA_MINUS |
|
delta_plus |
A floating point number or parameter_id |
DELTA_PLUS |
PARAMETER.DELTA_PLUS |
|
display_type |
Time_Series or Spectrogram |
DISPLAYTYPE |
PARAMETER.DISPLAY_TYPE |
|
entity |
The subject, e.g., Electron, Magnetic_Field, etc. |
ENTITY |
PARAMETER.ENTITY |
|
error_minus |
Parameter ID of error |
ERROR_MINUS |
PARAMETER.ERROR_MINUS |
|
error_plus |
Parameter ID of error |
ERROR_PLUS |
PARAMETER.ERROR_PLUS |
|
field_name |
Parameter name, e.g, Electron Gyrofrequency, Ion Count Rates, etc |
FIELD_NAME |
PARAMETER.FIELD_NAME |
|
fillval |
Value used as a fill value for gaps in data |
FILLVAL |
PARAMETER.FILL_VAL |
|
fluctuations |
E.g., Waveform, Wavelet_Cross_Spectrum |
FLUCTUATIONS |
PARAMETER.FLUCTUATIONS |
|
frame |
scalar>na, FAC>xyz, … |
FRAME |
PARAMETER.FRAME |
|
frame_origin |
Observatory |
|
PARAMETER.FRAME_ORIGIN |
|
frame_velocity |
Inertial or Observatory |
FRAME_VELOCITY |
PARAMETER.FRAME_VELOCITY |
|
label_axis |
Axis label, e.g., UT, Mag Field, etc |
LABLAXIS |
PARAMETER.LABEL_AXIS |
|
parameter_data |
Lists of e.g., energy levels or frequencies |
DATA |
|
|
parameter_dependency |
Numbered list of dependencies on other parameters |
DEPEND_0 |
|
|
parameter_id |
Parameter name + dataset_id, e.g., time_tags__C1_CP_EDI_AEDC |
|
PARAMETER.PARAMETER_ID |
|
parameter_label |
Numbered list of labels for parameter, e.g., 1:Bz, 1:By, 1:Bx for magnetic field |
|
|
|
parameter_representation |
1:x, 1:y, 1:z or 2:xx, 2:yy, 2:zz |
REPRESENTATION_1 |
|
|
property |
Property being measured, e.g., Vector, Magnitude, Raw_Particle_Counts, etc |
PROPERTY |
PARAMETER.PROPERTY |
|
quality |
Integer from 0-3, or parameter ID, e.g., status__C1_CP_EDI_SPIN |
QUALITY |
PARAMETER.QUALITY |
|
scale_max |
A floating point number |
|
PARAMETER.SCALE_MAX |
|
scale_min |
A floating point number |
|
PARAMETER.SCALE_MIN |
|
scale_type |
Linear or Log |
|
PARAMETER.SCALE_TYPE |
|
si_conversion |
Conversion from data units to SI units, e.g. for nT: 1.0E-9>T |
SI_CONVERSION |
PARAMETER.SI_CONVERSION |
|
significant_digits |
Number of significant digits |
SIGNIFICANT_DIGITS |
PARAMETER.SIGNIFICANT_DIGITS |
|
target_system |
FAC or GSE>Geocentric Solar Ecliptic |
|
PARAMETER.TARGET_SYSTEM |
|
tensor_order |
If the parameter is a tensor, the order of that tensor |
TENSOR_ORDER |
PARAMETER.TENSOR_ORDER |
|
units |
Units of the parameter |
UNITS |
PARAMETER.UNITS |
|
value_type |
Data type, i.e., FLOAT, INT or CHAR |
VALUE_TYPE |
PARAMETER.VALUE_TYPE |
CSA.V_PREGEN_INVENTORY
No equivalents in header or CAIO.
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
|
compressed |
0, 1 |
|
experiment_name |
Experiment acronym, e.g., PEACE, CIS-CODIF |
|
file_name |
PNG filename |
|
file_size |
File size in bytes |
|
ingestion_date |
Date of ingestion (generation) |
|
"interval" |
DAILY, MONTHLY or YEARLY |
|
observatory_name |
Spacecraft, e.g., Cluster-1, (csa.v_observatory.name) |
|
start_date |
Start date within plot |
|
to_regenerate |
0, 1 |
CSA.V_QUICK_LOOK_DATASET
No equivalents in header or CAIO.
|
COLUMN NAME |
DESCRIPTION/EXAMPLE |
|
dataset_id |
Dataset ID of quick look product |
|
height |
Height in pixels |
|
max_height |
Maximum height in pixels |
|
max_width |
Maximum width in pixels |
|
ql_display_order |
Order to display in GUI |
|
width |
Width in pixels |