17.2. Benchmark Specification

Various domain-specific benchmarks have been developed because no single metric can measure the performance of computer systems for all applications. The Benchmark Handbook by Jim Gray (Gray 1993) has laid down the following four key criteria for a domain-specific benchmark:

  • Relevance: The benchmark must capture the characteristics of the system to be measured.

  • Portability: The benchmark should be able to be implemented in different systems.

  • Scalability: The benchmark should be able to test various databases in different computer systems.

  • Simplicity: The benchmark must be understandable; otherwise it will not be credible.

Basically, a benchmark is used to test the peak performance of a system. Different aspects ...

Get XML Data Management: Native XML and XML-Enabled Database Systems now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.