You are previewing Prometheus Assessed?.
O'Reilly logo
Prometheus Assessed?

Book Description

This book examines the problems, pitfalls and opportunities of different models of assessing research quality, drawing on studies from around the world. Aimed at academics, education officials and public servants, key features include an overview of the argument of whether research should be assessed and how research quality should be determined. Prometheus Assessed? offers a survey of research assessment models in the US, UK, Japan and New Zealand and includes an examination of citation analysis and comparison between the different models.

  • Should research be assessed and what is research quality?
  • Survey of research assessment models in US, UK, Japan and New Zealand
  • Examination of citation analysis

Table of Contents

  1. Cover image
  2. Title page
  3. Table of Contents
  4. Copyright
  5. List of figures and tables
  6. List of abbreviations
  7. Acknowledgements
  8. About the authors
  9. Chapter 1: Prometheus assessed?
    1. Abstract:
    2. Bibliometric measures
    3. Panel review models
    4. Decentralised models
    5. But models overlap
    6. The philosophy of science and research assessment
    7. What use, if any, is the philosophy of science to research assessment?
    8. Prometheus assessed – towards a study of the processes and assessment of research
  10. Chapter 2: Publication, citation and bibliometric assessment of research
    1. Abstract:
    2. Publication and its centrality to research assessment
    3. Judging research by publication outlet
    4. Measuring publication
    5. Ranking journals – impact factor and professional association listings
    6. Citation analysis
    7. Limitations to citations
    8. Conclusion
  11. Chapter 3: Peer review, refereeing and their discontents: a failed model or simply the least worst option?
    1. Abstract:
    2. The development of the refereeing process
    3. The process of review
    4. Valuing peer review
    5. Questions and problems regarding peer review and refereeing
    6. Conclusion: is refereeing a failed model? Or just the least worst option?
  12. Chapter 4: From the Research Assessment Exercise to the Research Excellence Framework: changing assessment models in the United Kingdom?
    1. Abstract:
    2. Research and science in the United Kingdom
    3. The United Kingdom university system
    4. The Research Assessment Exercise
    5. Evolution of the RAE
    6. Process and cost of the RAE
    7. Evaluating the RAE
    8. The Research Excellence Framework
    9. Conclusion
  13. Chapter 5: Perils of peer review in a small country? The Performance Based Research Fund in New Zealand
    1. Abstract:
    2. Higher education policy framework
    3. The Performance Based Research Fund – design and operation
    4. Quality assessment process
    5. PBRF panel process
    6. An evaluation of the PBRF by surveying panel members
    7. Assessing research outputs
    8. Assessing peer esteem
    9. Contribution to research environment
    10. Respondents’ views of what makes an ‘A’ researcher
    11. The process of assessment
    12. Respondents’ view of the PBRF scheme
    13. Assessing the assessors
    14. Results
    15. Evaluating the PBRF
    16. Conclusion: limitations of the PBRF and suggested improvements
  14. Chapter 6: Research evaluation in Japan: the case of the National University Corporations
    1. Abstract:
    2. Research in Japan
    3. The Japanese university system
    4. Research assessment and national universities
    5. Evaluating the performance of the national universities
    6. Implementation and results
    7. Analysis and hypotheses
    8. Discussion
    9. Conclusion
  15. Chapter 7: Conclusion: Prometheus assessed and lessons for research assessment
    1. Abstract:
    2. Research and university evaluation in the United States
    3. Assessing research – investigating the issues
    4. Peer and panel review
    5. Problems of group decision-making
    6. Disciplinary power, panel review and citation analysis
    7. Bureaucratic control and research assessment
    8. The dichotomy between bibliometric and panel assessment is a false one
    9. Impact, relevance and new directions in research assessment
    10. Conclusion
  16. References
  17. Index