An Introduction to the Analysis of Algorithms, Second Edition

An Introduction to the Analysis of Algorithms, Second Edition

by Robert Sedgewick, Philippe Flajolet
Released January 2013
Publisher(s): Addison-Wesley Professional
ISBN: 9780133373455

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

Despite growing interest, basic information on methods and models for mathematically analyzing algorithms has rarely been directly accessible to practitioners, researchers, or students. An Introduction to the Analysis of Algorithms, Second Edition, organizes and presents that knowledge, fully introducing primary techniques and results in the field.

Robert Sedgewick and the late Philippe Flajolet have drawn from both classical mathematics and computer science, integrating discrete mathematics, elementary real analysis, combinatorics, algorithms, and data structures. They emphasize the mathematics needed to support scientific studies that can serve as the basis for predicting algorithm performance and for comparing different algorithms on the basis of performance.

Techniques covered in the first half of the book include recurrences, generating functions, asymptotics, and analytic combinatorics. Structures studied in the second half of the book include permutations, trees, strings, tries, and mappings. Numerous examples are included throughout to illustrate applications to the analysis of algorithms that are playing a critical role in the evolution of our modern computational infrastructure.

Improvements and additions in this new edition include

  • Upgraded figures and code

  • An all-new chapter introducing analytic combinatorics

  • Simplified derivations via analytic combinatorics throughout

The book’s thorough, self-contained coverage will help readers appreciate the field’s challenges, prepare them for advanced results—covered in their monograph Analytic Combinatorics and in Donald Knuth’s The Art of Computer Programming books—and provide the background they need to keep abreast of new research.

“[Sedgewick and Flajolet] are not only worldwide leaders of the field, they also are masters of exposition. I am sure that every serious computer scientist will find this book rewarding in many ways.”

—From the Foreword by Donald E. Knuth

Table of contents

  1. Title Page
  2. Copyright Page
  3. Foreword
  4. Preface
    1. Preparation
    2. Related books
    3. How to use this book
    4. Booksite
    5. Acknowledgments
  5. Note on the Second Edition
  6. Table of Contents
  7. Notation
  8. Chapter One. Analysis of Algorithms
    1. 1.1. Why Analyze an Algorithm?
    2. 1.2. Theory of Algorithms
    3. 1.3. Analysis of Algorithms
    4. 1.4. Average-Case Analysis
    5. 1.5. Example: Analysis of Quicksort
    6. 1.6. Asymptotic Approximations
    7. 1.7. Distributions
    8. 1.8. Randomized Algorithms
    9. References
  9. Chapter Two. Recurrence Relations
    1. 2.1. Basic Properties
    2. 2.2. First-Order Recurrences
    3. 2.3. Nonlinear First-Order Recurrences
    4. 2.4. Higher-Order Recurrences
    5. 2.5. Methods for Solving Recurrences
    6. 2.6. Binary Divide-and-Conquer Recurrences and Binary Numbers
    7. 2.7. General Divide-and-Conquer Recurrences
    8. References
  10. Chapter Three. Generating Functions
    1. 3.1. Ordinary Generating Functions
    2. 3.2. Exponential Generating Functions
    3. 3.3. Generating Function Solution of Recurrences
    4. 3.4. Expanding Generating Functions
    5. 3.5. Transformations with Generating Functions
    6. 3.6. Functional Equations on Generating Functions
    7. 3.7. Solving the Quicksort Median-of-Three Recurrence with OGFs
    8. 3.8. Counting with Generating Functions
    9. 3.9. Probability Generating Functions
    10. 3.10. Bivariate Generating Functions
    11. 3.11. Special Functions
    12. References
  11. Chapter Four. Asymptotic Approximations
    1. 4.1. Notation for Asymptotic Approximations
    2. 4.2. Asymptotic Expansions
    3. 4.3. Manipulating Asymptotic Expansions
    4. 4.4. Asymptotic Approximations of Finite Sums
    5. 4.5. Euler-Maclaurin Summation
    6. 4.6. Bivariate Asymptotics
    7. 4.7. Laplace Method
    8. 4.8. “Normal” Examples from the Analysis of Algorithms
    9. 4.9. “Poisson” Examples from the Analysis of Algorithms
    10. References
  12. Chapter Five. Analytic Combinatorics
    1. 5.1. Formal Basis
    2. 5.2. Symbolic Method for Unlabelled Classes
    3. 5.3. Symbolic Method for Labelled Classes
    4. 5.4. Symbolic Method for Parameters
    5. 5.5. Generating Function Coefficient Asymptotics
    6. References
  13. Chapter Six. Trees
    1. 6.1. Binary Trees
    2. 6.2. Forests and Trees
    3. 6.3. Combinatorial Equivalences to Trees and Binary Trees
    4. 6.4. Properties of Trees
    5. 6.5. Examples of Tree Algorithms
    6. 6.6. Binary Search Trees
    7. 6.7. Average Path Length in Random Catalan Trees
    8. 6.8. Path Length in Binary Search Trees
    9. 6.9. Additive Parameters of Random Trees
    10. 6.10. Height
    11. 6.11. Summary of Average-Case Results on Properties of Trees
    12. 6.12. Lagrange Inversion
    13. 6.13. Rooted Unordered Trees
    14. 6.14. Labelled Trees
    15. 6.15. Other Types of Trees
    16. References
  14. Chapter Seven. Permutations
    1. 7.1. Basic Properties of Permutations
    2. 7.2. Algorithms on Permutations
    3. 7.3. Representations of Permutations
    4. 7.4. Enumeration Problems
    5. 7.5. Analyzing Properties of Permutations with CGFs
    6. 7.6. Inversions and Insertion Sorts
    7. 7.7. Left-to-Right Minima and Selection Sort
    8. 7.8. Cycles and In Situ Permutation
    9. 7.9. Extremal Parameters
    10. References
  15. Chapter Eight. Strings and Tries
    1. 8.1. String Searching
    2. 8.2. Combinatorial properties of bitstrings
    3. 8.3. Regular Expressions
    4. 8.4. Finite-State Automata and the Knuth-Morris-Pratt Algorithm
    5. 8.5. Context-Free Grammars
    6. 8.6. Tries
    7. 8.7. Trie Algorithms
    8. 8.8. Combinatorial Properties of Tries
    9. 8.9. Larger Alphabets
    10. References
  16. Chapter Nine. Words and Mappings
    1. 9.1. Hashing with Separate Chaining
    2. 9.2. The Balls-and-Urns Model and Properties of Words
    3. 9.3. Birthday Paradox and Coupon Collector Problem
    4. 9.4. Occupancy Restrictions and Extremal Parameters
    5. 9.5. Occupancy Distributions
    6. 9.6. Open Addressing Hashing
    7. 9.7. Mappings
    8. 9.8. Integer Factorization and Mappings
    9. References
  17. List of Theorems
  18. List of Tables
  19. List of Figures
  20. Index
  21. Ad Page

Product information

  • Title: An Introduction to the Analysis of Algorithms, Second Edition
  • Author(s): Robert Sedgewick, Philippe Flajolet
  • Release date: January 2013
  • Publisher(s): Addison-Wesley Professional
  • ISBN: 9780133373455