Orchestration of Distributed LOFAR Workflows

Leiden Repository

Orchestration of Distributed LOFAR Workflows

Type: Doctoral Thesis
Title: Orchestration of Distributed LOFAR Workflows
Author: Mechev, A.P.
Issue Date: 2019-12-09
Keywords: Radio Astronomy
Distributed Computing
Workflow Orchestration
Performance Analysis
Abstract: The LOFAR radio telescope produces petabytes of data every year. Radio Astronomers use complex multi-step pipelines to process this data and produce scientific images. In this thesis, we describe methods for astronomers to efficiently process massive amounts of data on high-throughput clusters. We gain insights into efficient acceleration of complex scientific pipelines, as well as understanding of the scalability of the underlying software. These insights ensure the scientific output of LOFAR keeps up with the pace of the data the telescope produces. Moreover, our results can be applied to arbitrary scientific studies, greatly increasing the potential of the LOFAR telescope. Finally, our discoveries can be applied to current and future telescopes. These lessons will help astronomers efficiently producing science in the big data era.
Promotor: Supervisor: Röttgering H.J.A., Plaat A. Co-Supervisor: Oonk J.B.R.
Faculty: Science
University: Leiden
Handle: http://hdl.handle.net/1887/81487
 

Files in this item

Description Size View
application/pdf Full Text 12.38Mb Under embargo until 2021-12-09
application/pdf Cover 520.6Kb View/Open
application/pdf Title Page_Contents 234.5Kb View/Open
application/pdf Chapter 01 5.495Mb View/Open
application/pdf Chapter 02 950.9Kb Under embargo until 2021-06-09
application/pdf Chapter 03 1.569Mb Under embargo until 2021-12-09
application/pdf Chapter 04 1.243Mb Under embargo until 2021-12-09
application/pdf Chapter 05 464.4Kb Under embargo until 2021-12-09
application/pdf Chapter 06 2.083Mb Under embargo until 2021-12-09
application/pdf Chapter 07 929.7Kb Under embargo until 2021-06-09
application/pdf Chapter 08 199.0Kb View/Open
application/pdf Publications_Bibliography 317.3Kb View/Open
application/pdf Summary 115.7Kb View/Open
application/pdf Summary_in Dutch 116.8Kb View/Open

This item appears in the following Collection(s)