​​​​​​​​​​​​​​

Delivering the Promise of Gaia

Gaia Data Processing and Analysis Consortium (DPAC)

 

Schematic overview of the way the data processing within DPAC is structured around the scientific units (Coordination Units or CUs), in charge of developing the algorithms for the data processing, and the data processing centres (DPCs), in charge of providing the hardware and the IT infrastructure to run the scientific algorithms.
 

The DPAC Consortium

A large pan-European team of expert scientists and software developers known as DPAC (Data Processing and Analysis Consortium) is responsible for the processing of Gaia's data with the final objective of producing the Gaia Catalogue. Drawing its membership from over 20 countries, the consortium brings together skills and expertise from accross the continent, reflecting the international nature and cooperative spirit of ESA itself.

DPAC has been in place since 2006 and has the task to develop the data processing algorithms, the corresponding software, and the IT infrastructure for Gaia. It also executes the algorithms during the mission in order to turn the raw telemetry from Gaia into the final scientific data products that will be released to the scientific community.

 

 

 

Gaia DPAC - 2017 - all countries in dark blue participate in Gaia DPAC Gaia DPAC - 2020 - all countries in dark red participate in Gaia DPAC

 

The responsibilities of the Gaia Data Processing and Analysis Consortium are:

  • preparation of the data analysis algorithms to reduce the astrometric, photometric, and spectroscopic data within a coherent and integrated processing framework, including special objects such as multiple stars and minor planets;
  • generation and supply of simulated data to support the design, development and testing of the entire data processing system;
  • design, development, procurement and operation of all aspects of the hardware and software processing environment necessary to process the mission data throughout the simulation, mission operations and final catalogue production phases;
  • design, development and operation of the Gaia database and archive, which will contain the intermediate and final mission products of interest to the scientific community at large.

For a general introduction and overview of DPAC the original proposals for DPAC and its CU9 are very useful.

A list of participating institutes can be found here.

 

Structure

The Consortium is structured around specialized sub-units know as Coordination Units (CUs). Each CU is responsible for developing the scientific algorithms and software corresponding to a particular sub-system of the overall Gaia data processing system. The software developed by the CUs is run by one of the data processing centres (DPCs). These centres host the computing hardware and provide software engineering expertise to support the CU software development work. Each DPC supports at least one CU.

 

Each CU is led by a CU-leader and the DPCs are led by a DPC-manager. The consortium as a whole is led by the DPAC Executive which consists of the CU leaders, a representative from the CNES DPC, and the DPACE chair and deputy chair. The Gaia Project Scientist and the Gaia Mission Operations Manager have the status of observer on the DPACE. The day to day management of the DPAC operations is delegated to the DPAC Project Office which is led by the DPAC Project Coordinator. The Project Coordinator has a standing invitation to the DPACE meetings.

The DPAC is funded through national funding agencies of the participating ESA member states. These funding agencies have signed a multilateral agreement (MLA) with ESA which commits all parties to fund the DPAC effort up to the completion of the final Gaia catalogue, expected around 2022. The DPACE regularly reports to the MLA Steering Committee which consists of representatives of ESA and the partner funding agencies.

 

DPACE

DPACE is the interface for DPAC to the scientific community (through the Gaia Science Team) and to ESA and industry partners in the Gaia project. Many of the day to day interface tasks are performed by the DPAC Project Office. The current composition of the DPACE can be found here.

 

Contributions to the Gaia DPAC consortium for Gaia Data Release 3 in 2022. Countries in darker red contribute directly to Gaia DPAC. Countries in lighter red are member states of the European Space Agency, but not directly involved in Gaia DPAC.

Coordination Units

The Coordination Units are:

  • CU1 System architecture - A. Hutton (Manager), F. Riclet (Deputy-manager)
  • CU2 Data simulations - C. Babusiaux (Manager), E. Masana (Deputy-manager)
  • CU3 Core processing - M. Biermann (Manager), M. Lattanzi (Deputy-manager), C. Fabricius (Deputy-manager)
  • CU4 Object processing - F. Arenou (Manager NSS), P. Tanga (Manager SSO), C. Ducourant (Manager EO), Laurent Galluccio (Deputy-Manager EO)
  • CU5 Photometric processing - D.W. Evans (Manager), Francesca De Angeli (Deputy-manager and Technical manager)
  • CU6 Spectroscopic reduction - P. Sartoretti (Manager), G. Seabroke (Deputy-manager), D. Katz (Deputy-manager), P. Panuzzo (Deputy-manager)
  • CU7 Variability processing - L. Eyer (Manager), D.W. Evans (Deputy-manager), N. Mowlavi (Deputy-manager), M. Audard (Deputy-manager)
  • CU8 Astrophysical parameters - O. Creevey (Manager) with M. Fouesneau, Y. Fremat, F. Pailler, R. Sordo, R. Andrae in the management team.
  • CU9 Catalogue access - X. Luri (Manager), J. Bakker (Deputy-manager), C. Fabricius (Deputy-manager)

 

Data Processing Centres

The Data Processing Centres are:

  • DPC-E: ESAC - Rocio Guerra (Manager), Neil Cheek (Deputy-Manager)
  • DPC-C: CNES, Toulouse - Angelique Barbier (Manager), Clara Nicolas (Manager), François Riclet (Deputy-Manager)
  • DPC-I: IoA, Cambridge - Francesca De Angeli (Manager), Marco Riello (Deputy-Manager)
  • DPC-G: Observatoire de Genève / ISDC - Krzysztof Nienartowicz (Manager)
  • DPC-T: INAF-OATo, Torino - Rosario Messineo (Manager)
  • DPC-B: BSC and CESCA, Barcelona - Javier Castañeda (Manager), Jordi Portell (Deputy-Manager)