matvis: a matrix-based visibility simulator for fast forward modelling of many-element 21 cm arrays

dc.contributor.authorKittiwisit, Piyanaten
dc.contributor.authorMurray, Steven G.en
dc.contributor.authorGarsden, Hughen
dc.contributor.authorBull, Philipen
dc.contributor.authorWilensky, Michael J.en
dc.contributor.authorCain, Christopheren
dc.contributor.authorParsons, Aaron R.en
dc.contributor.authorSipple, Jacksonen
dc.contributor.authorAdams, Tyroneen
dc.contributor.authorAguirre, James E.en
dc.contributor.authorBaartman, Rushelleen
dc.contributor.authorBeardsley, Adam P.en
dc.contributor.authorBerkhout, Lindsay M.en
dc.contributor.authorBernardi, Giannien
dc.contributor.authorBillings, Tashalee S.en
dc.contributor.authorBowman, Judd D.en
dc.contributor.authorBradley, Richard F.en
dc.contributor.authorBurba, Jacoben
dc.contributor.authorCarey, Stevenen
dc.contributor.authorCarilli, Chris L.en
dc.contributor.authorChen, Kai Fengen
dc.contributor.authorChoudhuri, Samiren
dc.contributor.authorCox, Tyleren
dc.contributor.authorDeBoer, David R.en
dc.contributor.authorAcedo, Eloy de Leraen
dc.contributor.authorDexter, Matten
dc.contributor.authorDillon, Joshua S.en
dc.contributor.authorEksteen, Nicoen
dc.contributor.authorEly, Johnen
dc.contributor.authorEwall-Wice, Aaronen
dc.contributor.authorFagnoni, Nicolasen
dc.contributor.authorFurlanetto, Steven R.en
dc.contributor.authorGale-Sides, Kingsleyen
dc.contributor.authorGehlot, Bharat Kumaren
dc.contributor.authorGlendenning, Brianen
dc.contributor.authorGorce, Adelieen
dc.contributor.authorGorthi, Deepthien
dc.contributor.authorGreig, Bradleyen
dc.contributor.authorGrobbelaar, Jasperen
dc.contributor.authorHalday, Ziyaaden
dc.contributor.authorHazelton, Bryna J.en
dc.contributor.authorHewitt, Jacqueline N.en
dc.contributor.authorHickish, Jacken
dc.contributor.authorJacobs, Daniel C.en
dc.contributor.authorJosaitis, Alecen
dc.contributor.authorKern, Nicholas S.en
dc.contributor.authorKerrigan, Joshuaen
dc.contributor.authorKim, Honggeunen
dc.contributor.authorKolopanis, Matthewen
dc.contributor.authorLanman, Adamen
dc.contributor.authorPlante, Paul Laen
dc.contributor.authorLiu, Adrianen
dc.contributor.authorMa, Yin Zheen
dc.contributor.authorMacMahon, David H.E.en
dc.contributor.authorMalan, Lourenceen
dc.contributor.authorMalgas, Cresshimen
dc.contributor.authorMalgas, Keithen
dc.contributor.authorMarero, Bradleyen
dc.contributor.authorMartinot, Zachary E.en
dc.contributor.authorMcBride, Lisaen
dc.contributor.authorMesinger, Andreien
dc.contributor.authorMolewa, Mathakaneen
dc.contributor.authorMorales, Miguel F.en
dc.contributor.authorMosiane, Tshegofalangen
dc.contributor.authorNunhokee, Chuneeta Devien
dc.contributor.authorNuwegeld, Hansen
dc.contributor.authorPascua, Roberten
dc.contributor.authorQin, Yuxiangen
dc.contributor.authorRath, Eleanoren
dc.contributor.authorRazavi-Ghods, Nimaen
dc.contributor.authorRobnett, Jamesen
dc.contributor.authorSantos, Mario G.en
dc.contributor.authorSims, Peteren
dc.contributor.authorSingh, Saurabhen
dc.contributor.authorStorer, Daraen
dc.contributor.authorSwarts, Hiltonen
dc.contributor.authorTan, Jianrongen
dc.contributor.authorThyagarajan, Nithyanandanen
dc.contributor.authorvan Wyngaarden, Pieteren
dc.contributor.authorXu, Zhileien
dc.contributor.authorZheng, Haoxuanen
dc.date.accessioned2025-06-30T18:37:52Z
dc.date.available2025-06-30T18:37:52Z
dc.date.issued2025en
dc.description.abstractDetection of the faint 21 cm line emission from the Cosmic Dawn and Epoch of Reionization will require not only exquisite control over instrumental calibration and systematics to achieve the necessary dynamic range of observations but also validation of analysis techniques to demonstrate their statistical properties and signal loss characteristics. A key ingredient in achieving this is the ability to perform high-fidelity simulations of the kinds of data that are produced by the large, many-element, radio interferometric arrays that have been purpose-built for these studies. The large scale of these arrays presents a computational challenge, as one must simulate a detailed sky and instrumental model across many hundreds of frequency channels, thousands of time samples, and tens of thousands of baselines for arrays with hundreds of antennas. In this paper, we present a fast matrix-based method for simulating radio interferometric measurements (visibilities) at the necessary scale. We achieve this through judicious use of primary beam interpolation, fast approximations for coordinate transforms, and a vectorized outer product to expand per-antenna quantities to per-baseline visibilities, coupled with standard parallelization techniques. We validate the results of this method, implemented in the publicly available matvis code, against a high-precision reference simulator, and explore its computational scaling on a variety of problems.en
dc.description.sponsorshipThis material is based upon work supported by the National Science Foundation under grants #1636646 and #1836019 and institutional support from the HERA collaboration partners. This research is funded in part by the Gordon and Betty Moore Foundation through Grant GBMF5212 to the Massachusetts Institute of Technology. HERA is hosted by the South African Radio Astronomy Observatory, which is a facility of the National Research Foundation, an agency of the Department of Science and Innovation. PK acknowledges the financial assistance of the South African Radio Astronomy Observatory (SARAO; www.sarao.ac.za). This result is part of a project that has received funding from the European Research Council (ERC) under the European Union\u2019s Horizon 2020 research and innovation programme (Grant agreement No. 948764; PB). PB and HG acknowledge support from UK Science and Technology Facilities Council (STFC) Grants ST/T000341/1 and ST/X002624/1. SGM has received funding from the European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement No. 101067043. CC is supported by the Beus Center for Cosmic Foundations. This work used Bridges-2 at the Pittsburgh Supercomputing Centre (PSC) through allocation PHY210042 from the Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) program, which is supported by National Science Foundation (NSF) grants #2138259, #2138286, #2138307, #2137603, and #2138296. We acknowledge the use of the ilifu cloud computing facility \u2013 www.ilifu.ac.za, a partnership between the University of Cape Town, the University of the Western Cape, Stellenbosch University, Sol Plaatje University, the Cape Peninsula University of Technology, and the South African Radio Astronomy Observatory. The ilifu facility is supported by contributions from the Inter-University Institute for Data Intensive Astronomy (IDIA \u2013 a partnership between the University of Cape Town, the University of Pretoria and the University of the Western Cape), the Computational Biology division at UCT and the Data Intensive Research Initiative of South Africa (DIRISA). PK acknowledges the financial assistance of the South African Radio Astronomy Observatory (SARAO; www.sarao.ac.za ). This result is part of a project that has received funding from the European Research Council (ERC) under the European Union\u2019s Horizon 2020 research and innovation programme (Grant agreement No. 948764; PB). PB and HG acknowledge support from UK Science and Technology Facilities Council (STFC) Grants ST/T000341/1 and ST/X002624/1. SGM has received funding from the European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie grant agreement No. 101067043. CC is supported by the Beus Center for Cosmic Foundations. This work used Bridges-2 at the Pittsburgh Supercomputing Centre (PSC) through allocation PHY210042 from the Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) program, which is supported by National Science Foundation (NSF) grants #2138259, #2138286, #2138307, #2137603, and #2138296. We acknowledge the use of the ilifu cloud computing facility \u2013 www.ilifu.ac.za , a partnership between the University of Cape Town, the University of the Western Cape, Stellenbosch University, Sol Plaatje University, the Cape Peninsula University of Technology, and the South African Radio Astronomy Observatory. The ilifu facility is supported by contributions from the Inter-University Institute for Data Intensive Astronomy (IDIA \u2013 a partnership between the University of Cape Town, the University of Pretoria and the University of the Western Cape), the Computational Biology division at UCT and the Data Intensive Research Initiative of South Africa (DIRISA). This material is based upon work supported by the National Science Foundation under grants #1636646 and #1836019 and institutional support from the HERA collaboration partners. This research is funded in part by the Gordon and Betty Moore Foundation through Grant GBMF5212 to the Massachusetts Institute of Technology. HERA is hosted by the South African Radio Astronomy Observatory, which is a facility of the National Research Foundation, an agency of the Department of Science and Innovation.en
dc.description.statusPeer-revieweden
dc.format.extent21en
dc.identifier.issn2752-8200en
dc.identifier.scopus85217577649en
dc.identifier.urihttp://www.scopus.com/inward/record.url?scp=85217577649&partnerID=8YFLogxKen
dc.identifier.urihttps://hdl.handle.net/1885/733765981
dc.language.isoenen
dc.provenanceThis is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.en
dc.rights © 2025 The Author(s). en
dc.sourceRAS Techniques and Instrumentsen
dc.subjectalgorithmen
dc.subjectcosmology: diffuse radiation, dark ages, reionization, first starsen
dc.subjectsoftware: development, public release, simulationsen
dc.subjecttechniques: interferometricen
dc.titlematvis: a matrix-based visibility simulator for fast forward modelling of many-element 21 cm arraysen
dc.typeJournal articleen
dspace.entity.typePublicationen
local.contributor.affiliationKittiwisit, Piyanat; University of the Western Capeen
local.contributor.affiliationMurray, Steven G.; Scuola Normale Superiore di Pisaen
local.contributor.affiliationGarsden, Hugh; Queen Mary University of Londonen
local.contributor.affiliationBull, Philip; University of the Western Capeen
local.contributor.affiliationWilensky, Michael J.; University of Manchesteren
local.contributor.affiliationCain, Christopher; Arizona State Universityen
local.contributor.affiliationParsons, Aaron R.; University of California at Berkeleyen
local.contributor.affiliationSipple, Jackson; University of California at Berkeleyen
local.contributor.affiliationAdams, Tyrone; South African Radio Astronomy Observatoryen
local.contributor.affiliationAguirre, James E.; University of Pennsylvaniaen
local.contributor.affiliationBaartman, Rushelle; South African Radio Astronomy Observatoryen
local.contributor.affiliationBeardsley, Adam P.; Arizona State Universityen
local.contributor.affiliationBerkhout, Lindsay M.; Arizona State Universityen
local.contributor.affiliationBernardi, Gianni; South African Radio Astronomy Observatoryen
local.contributor.affiliationBillings, Tashalee S.; University of Pennsylvaniaen
local.contributor.affiliationBowman, Judd D.; Arizona State Universityen
local.contributor.affiliationBradley, Richard F.; National Science Foundationen
local.contributor.affiliationBurba, Jacob; University of Manchesteren
local.contributor.affiliationCarey, Steven; University of Cambridgeen
local.contributor.affiliationCarilli, Chris L.; National Science Foundationen
local.contributor.affiliationChen, Kai Feng; Massachusetts Institute of Technologyen
local.contributor.affiliationChoudhuri, Samir; Queen Mary University of Londonen
local.contributor.affiliationCox, Tyler; University of California at Berkeleyen
local.contributor.affiliationDeBoer, David R.; University of California at Berkeleyen
local.contributor.affiliationAcedo, Eloy de Lera; University of Cambridgeen
local.contributor.affiliationDexter, Matt; University of California at Berkeleyen
local.contributor.affiliationDillon, Joshua S.; University of California at Berkeleyen
local.contributor.affiliationEksteen, Nico; South African Radio Astronomy Observatoryen
local.contributor.affiliationEly, John; University of Cambridgeen
local.contributor.affiliationEwall-Wice, Aaron; University of California at Berkeleyen
local.contributor.affiliationFagnoni, Nicolas; University of Cambridgeen
local.contributor.affiliationFurlanetto, Steven R.; University of California at Los Angelesen
local.contributor.affiliationGale-Sides, Kingsley; University of Cambridgeen
local.contributor.affiliationGehlot, Bharat Kumar; Arizona State Universityen
local.contributor.affiliationGlendenning, Brian; National Science Foundationen
local.contributor.affiliationGorce, Adelie; Université Paris-Suden
local.contributor.affiliationGorthi, Deepthi; University of California at Berkeleyen
local.contributor.affiliationGreig, Bradley; University of Melbourneen
local.contributor.affiliationGrobbelaar, Jasper; South African Radio Astronomy Observatoryen
local.contributor.affiliationHalday, Ziyaad; South African Radio Astronomy Observatoryen
local.contributor.affiliationHazelton, Bryna J.; University of Washingtonen
local.contributor.affiliationHewitt, Jacqueline N.; Massachusetts Institute of Technologyen
local.contributor.affiliationHickish, Jack; University of California at Berkeleyen
local.contributor.affiliationJacobs, Daniel C.; Arizona State Universityen
local.contributor.affiliationJosaitis, Alec; University of Cambridgeen
local.contributor.affiliationKern, Nicholas S.; Massachusetts Institute of Technologyen
local.contributor.affiliationKerrigan, Joshua; Brown Universityen
local.contributor.affiliationKim, Honggeun; Massachusetts Institute of Technologyen
local.contributor.affiliationKolopanis, Matthew; Arizona State Universityen
local.contributor.affiliationLanman, Adam; Brown Universityen
local.contributor.affiliationPlante, Paul La; University of California at Berkeleyen
local.contributor.affiliationLiu, Adrian; University of California at Berkeleyen
local.contributor.affiliationMa, Yin Zhe; Stellenbosch Universityen
local.contributor.affiliationMacMahon, David H.E.; University of California at Berkeleyen
local.contributor.affiliationMalan, Lourence; South African Radio Astronomy Observatoryen
local.contributor.affiliationMalgas, Cresshim; South African Radio Astronomy Observatoryen
local.contributor.affiliationMalgas, Keith; South African Radio Astronomy Observatoryen
local.contributor.affiliationMarero, Bradley; South African Radio Astronomy Observatoryen
local.contributor.affiliationMartinot, Zachary E.; University of Pennsylvaniaen
local.contributor.affiliationMcBride, Lisa; Université Paris-Suden
local.contributor.affiliationMesinger, Andrei; Scuola Normale Superiore di Pisaen
local.contributor.affiliationMolewa, Mathakane; South African Radio Astronomy Observatoryen
local.contributor.affiliationMorales, Miguel F.; University of Washingtonen
local.contributor.affiliationMosiane, Tshegofalang; South African Radio Astronomy Observatoryen
local.contributor.affiliationNunhokee, Chuneeta Devi; International Centre for Radio Astronomy Researchen
local.contributor.affiliationNuwegeld, Hans; South African Radio Astronomy Observatoryen
local.contributor.affiliationPascua, Robert; University of California at Berkeleyen
local.contributor.affiliationQin, Yuxiang; Research School of Physics, ANU College of Science and Medicine, The Australian National Universityen
local.contributor.affiliationRath, Eleanor; Massachusetts Institute of Technologyen
local.contributor.affiliationRazavi-Ghods, Nima; University of Cambridgeen
local.contributor.affiliationRobnett, James; National Science Foundationen
local.contributor.affiliationSantos, Mario G.; University of the Western Capeen
local.contributor.affiliationSims, Peter; Arizona State Universityen
local.contributor.affiliationSingh, Saurabh; McGill Universityen
local.contributor.affiliationStorer, Dara; University of Washingtonen
local.contributor.affiliationSwarts, Hilton; South African Radio Astronomy Observatoryen
local.contributor.affiliationTan, Jianrong; University of Pennsylvaniaen
local.contributor.affiliationThyagarajan, Nithyanandan; National Science Foundationen
local.contributor.affiliationvan Wyngaarden, Pieter; South African Radio Astronomy Observatoryen
local.contributor.affiliationXu, Zhilei; Massachusetts Institute of Technologyen
local.contributor.affiliationZheng, Haoxuan; Massachusetts Institute of Technologyen
local.identifier.citationvolume4en
local.identifier.doi10.1093/rasti/rzaf001en
local.identifier.pure68e1a427-c2a8-4756-ae33-bc2932231ef6en
local.identifier.urlhttps://www.scopus.com/pages/publications/85217577649en
local.type.statusPublisheden

Downloads

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
rzaf001.pdf
Size:
11.73 MB
Format:
Adobe Portable Document Format