Image of the Week

News from the Gaia Archive

 

Figure 1: A screenshot taken from the Gaia Archive showing the new feature "external TAP search". Image credit: ESA/ESDC

The release of the second batch of Gaia data on 25 April 2018 came along with substantial improvements to the Gaia Archive, aimed at facing the great challenge of handling the nearly 20,000 GB of data hosted in it (including not only Gaia DR2 data, but also the previous data releases and ancillary data as well as the data stored in user spaces). These improvements also prepared for Gaia's future and even more challenging data releases.

Over one year of Gaia DR2 data, archive users have performed around 62 million queries and produced more than 1000 refereed papers. In the image below you can see an overview of the amount of different IP addresses downloading Gaia data per month with a clear jump near the release date of Gaia DR2 on 25 April. Data downloaded before this date was data from the first Gaia Data Release.

Figure 2: Number of active IP addresses per month since September 2016 (when Gaia DR1 was released) through April 2018 (when Gaia DR2 was released) up to April 2019 (one year after Gaia DR2). Image credit: ESA/ESDC

Figure 3: Amount of Gigabytes downloaded per month since September 2016 (when Gaia DR1 was released) up to April 2019, which is one year after the release of Gaia DR2. Gaia DR2 was released in April 2018, which is clearly visible in the graph showing a high peak in downloaded data in the period right after the release of Gaia DR2. Image credit: ESA/ESDC

 

The Gaia Archive team is already working to get everything ready for the next data releases, Gaia EDR3 (third quarter of 2020) and Gaia DR3 (second half of 2021). The processing of the data that will lead to Gaia EDR3 and Gaia DR3 is currently ongoing in the Gaia Data Processing and Analysis Consortium. In the meantime, users of the archive continue exploring Gaia DR2 data and can get support via the Gaia Helpdesk.

However, even in between Gaia data releases, archive developments are ongoing. New versions of the Gaia Archive are put out regularly and a new version was released in May 2019. This new version provides you with an upgraded performance and new features.

One of these new features is interesting for scientists wishing to combine data from the literature or from other data providers with the catalogues hosted in the Gaia Archive. They now have a faster and more efficient way to do so: it is now possible to connect to an external data server from inside the Gaia archive, query the tables hosted in it and work with them within the user’s personal space. The only condition is that the server is compliant with the Table Access Protocol (TAP) standard, a Virtual Observatory (VO) protocol for accessing general table data, including astronomical catalogs as well as general database tables. Access is provided for both database and table metadata as well as for actual table data.
Tables from external TAP queries are stored in a different workspace in the archive, where the user can manipulate them with ADQL queries as they would do with any table directly hosted in the archive. The tables resulting from these jobs can also be uploaded, if wanted, as new user tables in the user’s Gaia workspace. To learn more, watch the below video tutorial or refer to the Gaia Archive help. Users needing support to get started with this functionality can contact the Gaia Archive team via the Gaia Helpdesk.

This video shows how to connect to an external TAP server from inside the user's space in the Gaia Archive. Credits: ESA/ESDC

 

Another new feature of the Gaia Archive is the inclusion of the RUWE data. A recipe was already provided through the Gaia DR2 known issues page, and some of the Gaia partner data centres already served the RUWE data along with the Gaia data. A decision was made in the Gaia Data Processing and Analysis Consortium to make an official release of the RUWE data along with the Gaia DR2 data, to ensure consistency of the RUWE data provided through ESA/Gaia/DPAC. The difference between the RUWE data as provided now through the Gaia Archive (and soon through the Gaia Partner Data Centres) and the RUWE data as was provided initially through for example the ARI partner data centre is reasonably small.

 

The above story is based on some of the news items that appeared in the ESDC newsletter on the Gaia Archive. If you are interested in following up on Gaia Archive developments and on all archive developments in general, this newsletter might be of interest to you. Of course there is also the Gaia Newsletter, dedicated to keep you updated on all Gaia related topics. More info on the Gaia newsletter can be found here.

Credits: ESA/Gaia/DPAC, ESA/ESDC, B. López Martí, J.C. Segovia

[Published: 18/06/2019]

 

Image of the Week Archive

2019
08/08: 30th anniversary of Hipparcos
17/07: Whitehead Eclipse Avoidance Manoeuvre
28/06: Following up on Gaia Solar System Objects
19/06: News from the Gaia Archive
29/05: Spectroscopic variability of emission lines stars with Gaia
24/05: Evidence of new magnetic transitions in late-type stars
03/05: Atmospheric dynamics of AGB stars revealed by Gaia
25/04: Geographic contributions to DPAC
22/04: omega Centauri's lost stars
18/04: 53rd ESLAB symposium "the Gaia universe"
18/02: A river of stars
2018
21/12: Sonification of Gaia data
18/12: Gaia captures a rare FU Ori outburst
12/12: Changes in the DPAC Executive
26/11:New Very Low Mass dwarfs in Gaia data
19/11: Hypervelocity White Dwarfs in Gaia data
15/11: Hunting evolved carbon stars with Gaia RP spectra
13/11: Gaia catches the movement of the tiny galaxies surrounding the Milky Way
06/11: Secrets of the "wild duck" cluster revealed
12/10: 25 years since the initial GAIA proposal
09/10: 3rd Gaia DPAC Consortium Meeting
30/09: A new panoramic sky map of the Milky Way's Stellar Streams
25/09: Plausible home stars for interstellar object 'Oumuamua
11/09: Impressions from the IAU General Assembly
30/06: Asteroids in Gaia Data
14/06: Mapping and visualising Gaia DR2

25/04: In-depth stories on Gaia DR2

14/04: Gaia tops one trillion observations
16/03: Gaia DR2 Passbands
27/02: Triton observation campaign
11/02: Gaia Women In Science
29/01: Following-up on Gaia
2017
19/12: 4th launch anniversary
24/11: Gaia-GOSA service
27/10: German Gaia stamp in the making
19/10: Hertzsprung-russell diagram using Gaia DR1
05/10: Updated prediction to the Triton occultation campaign
04/10: 1:1 Gaia model arrives at ESAC
31/08: Close stellar encounters from the first Gaia data release
16/08: Preliminary view of the Gaia sky in colour
07/07: Chariklo stellar occultation follow-up
24/04: Gaia reveals the composition of asteroids
20/04: Extra-galactic observations with Gaia
10/04: How faint are the faintest Gaia stars?
24/03: Pulsating stars to study Galactic structures
09/02: Known exoplanetary transits in Gaia data
31/01: Successful second DPAC Consortium Meeting
2016
23/12: Interactive and statistical visualisation of Gaia DR1 with vaex
16/12: Standard uncertainties for the photometric data (in GDR1)
25/11: Signature of the rotation of the galactic bar uncovered
15/11: Successful first DR1 Workshop
27/10: Microlensing Follow-Up
21/10: Asteroid Occultation
16/09: First DR1 results
14/09: Pluto Stellar Occultation
15/06: Happy Birthday, DPAC!
10/06: 1000th run of the Initial Data Treatment system
04/05: Complementing Gaia observations of the densest sky regions
22/04: A window to Gaia - the focal plane
05/04: Hipparcos interactive data access tool
24/03: Gaia spots a sunspot
29/02: Gaia sees exploding stars next door
11/02: A new heart for the Gaia Object Generator
04/02: Searching for solar siblings with Gaia
28/01: Globular cluster colour-magnitude diagrams
21/01: Gaia resolving power estimated with Pluto and Charon
12/01: 100th First-Look Weekly Report
06/01: Gaia intersects a Perseid meteoroid
2015
18/12: Tales of two clusters retold by Gaia
11/11: Lunar transit temperature plots
06/11: Gaia's sensors scan a lunar transit
03/11: Celebrity comet spotted among Gaia's stars
09/10: The SB2 stars as seen by Gaia's RVS
02/10: The colour of Gaia's eyes
24/09: Estimating distances from parallaxes
18/09: Gaia orbit reconstruction
31/07: Asteroids all around
17/07: Gaia satellite and amateur astronomers spot one in a billion star
03/07: Counting stars with Gaia
01/07: Avionics Model test bench arrives at ESOC
28/05: Short period/faint magnitude Cepheids in the Large Magellanic Cloud
19/05: Visualising Gaia Photometric Science Alerts
09/04: Gaia honours Einstein by observing his cross
02/04: 1 April - First Look Scientists play practical joke
05/03: RR Lyrae stars in the Large Magellanic Cloud as seen by Gaia
26/02: First Gaia BP/RP deblended spectra
19/02: 13 months of GBOT Gaia observations
12/02: Added Value Interface Portal for Gaia
04/02: Gaia's potential for the discovery of circumbinary planets
26/01: DIBs in three hot stars as seen by Gaia's RVS
15/01: The Tycho-Gaia Astrometric Solution
06/01: Close encounters of the stellar kind
2014
12/12: Gaia detects microlensing event
05/12: Cat's Eye Nebula as seen by Gaia
01/12: BFOSC observation of Gaia at L2
24/11: Gaia spectra of six stars
13/11: Omega Centauri as seen by Gaia
02/10: RVS Data Processing
12/09: Gaia discovers first supernova
04/08: Gaia flag arrives at ESAC
29/07: Gaia handover
15/07: Eclipsing binaries
03/07: Asteroids at the "photo finish"
19/06: Calibration image III - Messier 51
05/06: First Gaia BP/RP and RVS spectra
02/06: Sky coverage of Gaia during commissioning
03/04: Gaia source detection
21/02: Sky-background false detections in the sky mapper
14/02: Gaia calibration images II
06/02: Gaia calibration image I
28/01: Gaia telescope light path
17/01: First star shines for Gaia
14/01: Radiation Campaign #4
06/01: Asteroid detection by Gaia
2013
17/12: Gaia in the gantry
12/12: The sky in G magnitude
05/12: Pre-launch release of spectrophotometric standard stars
28/11: From one to one billion pixels
21/11: The Hipparcos all-sky map
15/10: Gaia Sunshield Deployment Test
08/10: Initial Gaia Source List
17/09: CU1 Operations Workshop
11/09: Apsis
26/08: Gaia arrival in French Guiana
20/08: Gaia cartoons
11/07: Model Soyuz Fregat video
01/07: Acoustic Testing
21/06: SOVT
03/06: CU4 meeting #15
04/04: DPCC (CNES) 
26/03: Gaia artist impression 
11/02: Gaia payload testing  
04/01: Space flyby with Gaia-like data
2012
10/12: DPAC OR#2. Testing with Planck
05/11: Galaxy detection with Gaia
09/10: Plot of part of the GUMS-10 catalogue
23/07: "Gaia" meets at Gaia
29/06: The Sky as seen by Gaia
31/05: Panorama of BAM clean room
29/03: GREAT school results
12/03: Scanning-law movie
21/02: Astrometric microlensing and Gaia
03/02: BAM with PMTS
12/01: FPA with all the CCDs and WFSs
2011
14/12: Deployable sunshield
10/11: Earth Trojan search
21/10: First Soyuz liftoff from the French Guiana
20/09: Fast 2D image reconstruction algorithm
05/09: RVS OMA
10/08: 3D distribution of the Gaia catalogue
13/07: Dynamical Attitude Model
22/06: Gaia's view of open clusters
27/05: Accuracy of the stellar transverse velocity
13/05: Vibration test of BAM mirrors
18/04: L. Lindegren, Dr. Honoris Causa of the Observatory of Paris
19/01: Detectability of stars close to Jupiter
05/01: Delivery of the WFS flight models
2010
21/12: The 100th member of CU3
17/11: Nano-JASMINE and AGIS
27/10: Eclipsing binary light curves fitted with DPAC code
13/10: Gaia broad band photometry
28/09: Measuring stellar parameters and interstellar extinction
14/09: M1 mirror
27/08: Quest for the Sun's siblings
 
Please note: Entries from the period 2003-2010 are available in this PDF document.