Science Pipelines for the Square Kilometre Array
Jamie Farnes, Ben Mort, Fred Dulwich, Stef Salvini, Wes Armour
(Submitted on 20 Nov 2018)
The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of 5 zettabytes of data per year. A critical task for the SKA will be its ability to process data for science, which will need to be conducted by science pipelines. Together with polarization data from the LOFAR Multifrequency Snapshot Sky Survey (MSSS), we have been developing a realistic SKA-like science pipeline that can handle the large data volumes generated by LOFAR at 150 MHz. The pipeline uses task-based parallelism to image, detect sources, and perform Faraday Tomography across the entire LOFAR sky. The project thereby provides a unique opportunity to contribute to the technological development of the SKA telescope, while simultaneously enabling cutting-edge scientific results. In this paper, we provide an update on current efforts to develop a science pipeline that can enable tight constraints on the magnetised large-scale structure of the Universe.
Comments: Published in Galaxies, as part of a Special Issue on The Power of Faraday Tomography
Subjects: Instrumentation and Methods for Astrophysics (astro-ph.IM); Cosmology and Nongalactic Astrophysics (astro-ph.CO)
Journal reference: Galaxies 2018, 6(4), 120
DOI: 10.3390/galaxies6040120
Cite as: arXiv:1811.08272 [astro-ph.IM] (or arXiv:1811.08272v1 [astro-ph.IM] for this version)
Submission history
From: Jamie Stephen Farnes
[v1] Tue, 20 Nov 2018 14:39:10 UTC (5,270 KB)
