Data-intensive Research - Challenges & Issues. Modern Data Management Overview

Abstract

The advent of digital data has revolutionised analytical options for researchers in science and the humanities as well as data analysts in government and large corporations. Such data, however, does not come without a price.

Many organisations are facing the need to provide data management and storage for large amounts of data to support analysis, preservation, publication and other services. These issues affect researchers, managers and technical specialists.

This lecture will address the new options for EResearch as well as the challenges and issues involved in managing digital data.

Reagan Moore is an internationally known and highly regarded figure in the field of data management. He is Associate Director for Data Intensive Computing at the San Diego Supercomputer Center. In this role, he coordinates research efforts in the development of massive data analysis systems, scientific data publication systems, and persistent archives. One of his ongoing research interests is the support for information based data-intensive computing.

Australia is attempting to pursue some of the same issues through the Australian Partnership for Sustainable Repositories (APSR), a project funded by the Systemic Infrastructure Initiative as part of the Commonwealth Government's Backing Australia’s Ability Program. One of the partners of APSR is the Australian Partnership for Advanced Computing (APAC), which provides advanced computing and grid infrastructure for EResearch in Australia.