7 - Large Databases and Knowledge Re-use

Summary

Abstract

This article argues that problems of scale and complexity of data in large scientific and engineering databases will drive the development of a new generation of databases. Examples are the human genome project with huge volumes of data accessed by widely distributed users, geographic information systems using satellite data, and advanced CAD and engineering design databases. Databases will share not just facts, but also procedures, methods and constraints. This together with the complexity of the data will favour the object-oriented database model. Knowledge base technology is also moving in this direction, leading to a distributed architecture of knowledge servers interchanging information on objects and constraints. An important theme is the re-use not just of data and methods but of higher-level knowledge. For success, a multi-disciplinary effort will be needed along the lines of the Knowledge Sharing Effort in USA, which is discussed.

Introduction

The research area of databases is a very interesting testing ground for computing science ideas. It is an area where theory meets reality in the form of large quantities of data with very computer-intensive demands on it. Until recently the major problems were in banking and commercial transactions. These sound easy in principle but they are made difficult by problems of scale, distributed access, and the ever present need to move a working system with long-term data onto new hardware, new operating systems, and new modes of interaction. Despite this, principles for database system architecture were established which have stood the test of time – data independence, serialised transactions, two-phase commit, query optimisation and conceptual schema languages. Thanks to these advances the database industry is very large and very successful.