You are previewing Mapping and Visualization with SuperCollider.
O'Reilly logo
Mapping and Visualization with SuperCollider

Book Description

Create interactive and responsive audio-visual applications with SuperCollider

  • Master 2D computer-generated graphics and animation

  • Perform complex encodings and audio/data analysis

  • Implement intelligent generative audio-visual systems

In Detail

SuperCollider is an environment and programming language used by musicians, scientists, and artists who work with audio-files SuperCollider has built-in graphical features which are used in conjunction with the sound synthesis server to create audio-visual mapping and sound visualization. If you wish to create data visualizations by acquiring data from audio and visual sources, then this book is for you.

Digital sound artists need to analyze, manipulate, map, and visualize data when working on a scientific or an artistic project. As an artist, this book, by means of its numerous code examples will provide you with the necessary knowledge of SuperCollider's practical applications, so that you can extract meaningful information from audio-files and master its visualization techniques. This book will help you to prototype and implement sophisticated visualizers, sonifiers, and complex mappings of your data.

This book takes a closer look at SuperCollider features such as plotting and metering functionality to dispel the mysterious aura surrounding the more advanced mappings and animation strategies. This book also takes you through a number of examples that help you to create intelligent mapping and visualization systems. Throughout the course of the book, you will synthesize and optimize waveforms and spectra for scoping as well as extract information from an audio signal. The later sections of the book focus on advanced topics such as emulating physical forces, designing kinematic structures, and using neural networks to enable you to develop a visualization that has a natural motion with structures that respect anatomy and which come with an intelligent encoding mechanism. This book will teach you everything you need to work with intelligent audio-visual systems to extract and visualize audio-visual data.

Table of Contents

  1. Mapping and Visualization with SuperCollider
    1. Table of Contents
    2. Mapping and Visualization with SuperCollider
    3. Credits
    4. About the Author
    5. About the Reviewers
    6. www.PacktPub.com
      1. Support files, eBooks, discount offers and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
    7. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Downloading the example code
        2. Errata
        3. Piracy
        4. Questions
    8. 1. Scoping, Plotting, and Metering
      1. Plotting audio, numerical datasets, and functions
        1. Using plot and plot graph
        2. Using plotter
        3. Using SoundFileView
      2. Scoping signals
        1. Scoping waveforms
        2. Scoping spectra
      3. Metering levels
        1. Monitoring signals
        2. Monitoring numerical data
      4. Nonstandard and complex visualizers
        1. Nonstandard visualizers
        2. A complex scope
      5. Summary
    9. 2. Waveform Synthesis
      1. Waveform synthesis fundamentals
      2. Time domain representation
        1. Waveform species
        2. DC, amplitude, frequency, and phase
      3. Custom waveform generators
        1. Wavetable lookup synthesis
        2. Using envelopes as wavetables
        3. Custom aperiodic waveform generators
      4. Waveform transformations
      5. Waveshaping
        1. Unary operations
        2. Binary operations
        3. Bitwise operations
      6. Summary
    10. 3. Synthesizing Spectra
      1. Introducing the frequency domain
        1. Spectra
        2. Fast Fourier Transform in SuperCollider
      2. Creating and manipulating spectra
        1. Aggregating and enriching spectra
        2. Sculpting and freezing spectra
        3. Shifting, stretching, and scrambling spectra
        4. Using the pvcalc method
      3. Visualizing spectra
        1. Limitations of spectral scoping
        2. Optimizing spectra for scoping
      4. Summary
    11. 4. Vector Graphics
      1. Learning the vector graphics fundamentals
        1. Drawing primitive shapes and loading images
        2. Complex shapes and graphics state
        3. Introducing colors, transparency, and gradients
      2. Abstractions and models
        1. Objects and prototypes
        2. Factories
        3. Geometrical transformations, matrices, and trailing effects
      3. Complex structures
        1. Particle systems
        2. Fractals
      4. Summary
    12. 5. Animation
      1. Fundamentals of motion
        1. Motion species
        2. Using UserView
        3. Animating complex shapes and sprites
      2. Fundamental animation techniques
        1. Trailing effects
        2. Interaction and event-driven programming
        3. Particle systems
      3. Advanced concepts
        1. Animating fractals
        2. Adding dynamics to simulate physical forces
        3. Kinematics
      4. Summary
    13. 6. Data Acquisition and Mapping
      1. Data acquisition
        1. Dealing with local files
        2. Accessing data remotely
        3. Using OSC
        4. Using MIDI
        5. Using Serial Port
      2. Machine listening
        1. Tracking amplitude and loudness
        2. Tracking frequency
        3. Timbre analysis and feature detection
        4. Onset detection and rhythmical analysis
      3. Basic mappings
        1. Preparing and preprocessing data on the client side
        2. Preparing and preprocessing data on theserver side
        3. Basic encodings and interpolation schemes
        4. Sharing and distributing data
      4. Summary
    14. 7. Advanced Visualizers
      1. Audio visualizers
        1. Trailing waveforms
        2. Spectrogram
      2. Music visualizers
        1. Rotating windmills
        2. Kinematic patterns
      3. Visualizing and sonifying data
        1. Particles and grains
        2. Fractalizer
      4. Summary
    15. 8. Intelligent Encodings and Automata
      1. Analyzing data
        1. Statistical analyses and metadata
        2. Probabilities and histograms
        3. Dealing with textual datasets
      2. Advanced mappings
        1. Complex and intelligent encodings
        2. Neural networks
      3. Automata
        1. Cellular automata
        2. Game of Life
      4. Summary
    16. 9. Design Patterns and Methodologies
      1. Blackboard
        1. Methodology
        2. Model-View-Controller
        3. Handling multiple files and environments
        4. Threads, semaphores, and guards
      2. The View
        1. Clients and interfaces
        2. Implementation
        3. Strategies and policies
      3. The Model
        1. Aggregates and wrappers
        2. Software agents
        3. Introducing software actors and finalizing the model
      4. The Controller
        1. Game of Life
        2. Finalizing the Controller
      5. Summary
    17. Index