You are previewing Professional Microsoft® Search: FAST Search, SharePoint® Search, and Search Server.
O'Reilly logo
Professional Microsoft® Search: FAST Search, SharePoint® Search, and Search Server

Book Description

Use Microsoft's latest search-based technology-FAST search-to plan, customize, and deploy your search solution

FAST is Microsoft's latest intelligent search-based technology that boasts robustness and an ability to integrate business intelligence with Search. This in-depth guide provides you with advanced coverage on FAST search and shows you how to use it to plan, customize, and deploy your search solution, with an emphasis on SharePoint 2010 and Internet-based search solutions.

With a particular appeal for anyone responsible for implementing and managing enterprise search, this book presents the key features and functions that are available with FAST search. Real-world examples show you how the technology works and the author team of experts demonstrates how FAST can be used to solve key challenges in the Enterprise.

  • FAST search is Microsoft's latest search-based technology that enables large companies to filter through enormous amounts of data to find very specific pieces of information

  • Reviews the key features and functions of FAST and provides examples of how FAST can be used to solve common challenges you may face

  • Covers Enterprise Search and the Microsoft search product line, SharePoint-focused Enterprise search, and FAST search for Internet business

  • Demonstrates how to implement and manage an enterprise system with FAST search

  • Addresses the future of Enterprise search and the role FAST search will play

Don't waste any time! This book will help you act fast so you can get started implementing FAST search today.

Table of Contents

  1. Copyright
  2. ABOUT THE AUTHORS
  3. ABOUT THE TECHNICAL EDITORS
  4. CREDITS
  5. ACKNOWLEDGMENTS
  6. INTRODUCTION
    1. MICROSOFT SEARCH HAS CHANGED
    2. WHO THIS BOOK IS FOR
    3. WHAT THIS BOOK COVERS
    4. HOW THIS BOOK IS STRUCTURED
    5. WHAT YOU NEED TO USE THIS BOOK
    6. CONVENTIONS
    7. SOURCE CODE
    8. ERRATA
    9. P2P.WROX.COM
  7. I. Introduction
    1. 1. What Is Enterprise Search?
      1. 1.1. WHY ENTERPRISE SEARCH?
      2. 1.2. HOW ENTERPRISE SEARCH DIFFERS FROM WEB SEARCH
        1. 1.2.1. The Enterprise Is Not Just a Small Internet
        2. 1.2.2. Technical Differences in Search Requirements and Technologies
        3. 1.2.3. Every Intranet Search Project Is Unique
      3. 1.3. ENTERPRISE SEARCH TECHNOLOGY OVERVIEW
        1. 1.3.1. Search Components Outline
        2. 1.3.2. Vendor Vocabulary
        3. 1.3.3. Scalability
        4. 1.3.4. Federated Search
      4. 1.4. MICROSOFT'S 2010 SEARCH TECHNOLOGY ROAD MAP
        1. 1.4.1. Microsoft's Explanation
      5. 1.5. CATEGORIZING YOUR ORGANIZATION'S USE OF SEARCH — EXAMPLES
        1. 1.5.1. The Gray Area: Where Search Might Be Misranked
          1. 1.5.1.1. A Local Sales Office
          2. 1.5.1.2. A Contract Manufacturer
          3. 1.5.1.3. A Midsized to Large Energy Producer
      6. 1.6. THE ROI OF SEARCH
        1. 1.6.1. The Business Intelligence Benefits of Search
      7. 1.7. THE SEARCH CENTER OF EXCELLENCE
        1. 1.7.1. Before SCOE
        2. 1.7.2. The Birth of SCOE
        3. 1.7.3. Centralized SCOE
        4. 1.7.4. Distributed SCOE
        5. 1.7.5. Examples of SCOE Tasks
        6. 1.7.6. SCOE Staffing and Skills
        7. 1.7.7. Questions That Everybody Asks
          1. 1.7.7.1.
            1. 1.7.7.1.1. Business Considerations
            2. 1.7.7.1.2. Technical Considerations
          2. 1.7.7.2. Why Not Just Use an Open-Source Engine Like Lucene?
          3. 1.7.7.3. I Have Search Inside SharePoint; Do I Need Anything Else?
          4. 1.7.7.4. Why Is Search so Hard?
          5. 1.7.7.5. We've Upgraded Search, and Users Are Unhappy.
          6. 1.7.7.6. Do I Need a Taxonomy?
          7. 1.7.7.7. Do I Need Facets or Entity Extraction?
          8. 1.7.7.8. What Is Clustering?
          9. 1.7.7.9. Can't I Just Have Users Tag Everything?
          10. 1.7.7.10. Can We Do It in Phases?
          11. 1.7.7.11. How Much Is This Going to Cost?
          12. 1.7.7.12. What Type of Staffing Do I Need for Search?
          13. 1.7.7.13. Isn't Enterprise Search Dead?
          14. 1.7.7.14. How Important Is the Gartner Magic Quadrant?
      8. 1.8. SUMMARY
    2. 2. Developing a Strategy — The Business Process of Search
      1. 2.1. DEVELOPING THE SEARCH PROJECT PLAN
        1. 2.1.1. eCommerce Search
        2. 2.1.2. Intranet and Extranet Search
        3. 2.1.3. File Share Search
        4. 2.1.4. Public Site Search
      2. 2.2. ORGANIZING FOR SUCCESS: THE SEARCH CENTER OF EXCELLENCE
        1. 2.2.1. Centers of Excellence
        2. 2.2.2. Building a Virtual SCOE
      3. 2.3. THE PROCESS OF ACQUIRING A SEARCH PLATFORM
        1. 2.3.1. Building a Business Case
          1. 2.3.1.1. Hard ROI
            1. 2.3.1.1.1. eCommerce
            2. 2.3.1.1.2. eDiscovery
          2. 2.3.1.2. The Soft ROI
        2. 2.3.2. Defining Your Requirements
          1. 2.3.2.1. An Overall Approach
          2. 2.3.2.2. High-Level Questions
            1. 2.3.2.2.1. Business Requirements
            2. 2.3.2.2.2. Technical Requirements
            3. 2.3.2.2.3. Hybrid Requirements
          3. 2.3.2.3. Stakeholders
            1. 2.3.2.3.1. Business Case Owner
            2. 2.3.2.3.2. Content Owner
            3. 2.3.2.3.3. IT/Development
            4. 2.3.2.3.4. Senior Management
          4. 2.3.2.4. The Role of Analysts
          5. 2.3.2.5. Priorities
          6. 2.3.2.6. Pre-Enterprise Search
          7. 2.3.2.7. Plan for a Staged Implementation
          8. 2.3.2.8. Creating the RFI or RFP
        3. 2.3.3. Collecting Your Content
          1. 2.3.3.1. Identify Your Content and Repositories
          2. 2.3.3.2. Understanding Your Users and Their Needs
        4. 2.3.4. The Acquisition Process
        5. 2.3.5. Meeting with Suppliers
        6. 2.3.6. The Proof of Concept
        7. 2.3.7. Negotiating the Purchase
        8. 2.3.8. Gathering Information: Training and References
      4. 2.4. PLANNING YOUR DEPLOYMENT
        1. 2.4.1. Optimizing the Roll-Out
        2. 2.4.2. Tuning Relevance
      5. 2.5. AFTER THE ROLL-OUT
        1. 2.5.1. Search Sucks!
        2. 2.5.2. Theory and Practice
      6. 2.6. SUMMARY
    3. 3. Overview of Microsoft Enterprise Search Products
      1. 3.1. UNDERSTANDING THE 2010 ENTERPRISE SEARCH PRODUCT LINE
        1. 3.1.1. SharePoint Foundation 2010
        2. 3.1.2. Search Server 2010 Express
        3. 3.1.3. Search Server 2010
        4. 3.1.4. SharePoint Server 2010
        5. 3.1.5. FAST Search Server 2010 for SharePoint
        6. 3.1.6. FAST Search Server for Internet Sites
        7. 3.1.7. Summary of Enterprise Search Options
      2. 3.2. SHAREPOINT SERVER SEARCH VERSUS FAST SEARCH FOR SHAREPOINT
        1. 3.2.1. Summary of Feature Differences Between SP and FS4SP
        2. 3.2.2. Capabilities Found Only in SharePoint Server 2010 Search
      3. 3.3. TYPICAL SEARCH SCENARIOS
        1. 3.3.1. Intranet Search
        2. 3.3.2. People Search
        3. 3.3.3. Site Search
        4. 3.3.4. Research Portals
        5. 3.3.5. Customer Management
        6. 3.3.6. Parts Search
        7. 3.3.7. Intelligence and Investigation
        8. 3.3.8. Intellectual Property Protection
        9. 3.3.9. Compliance
        10. 3.3.10. E-Commerce
      4. 3.4. WINDOWS DESKTOP SEARCH
        1. 3.4.1. The Role of the Desktop in Enterprise Search
        2. 3.4.2. Windows Desktop Search 4: XP and Vista
        3. 3.4.3. Windows 7 Desktop Search
      5. 3.5. SEARCH IN EXCHANGE AND SQL
        1. 3.5.1. SQL Server 2008
        2. 3.5.2. Exchange 2010
      6. 3.6. BING
        1. 3.6.1. The Bing Exploration Approach
        2. 3.6.2. Sections of Bing
        3. 3.6.3. Voice Search: Bing and Tellme
      7. 3.7. FEDERATION ACROSS PRODUCTS
        1. 3.7.1. Federation and OpenSearch
        2. 3.7.2. Windows 7 and Federation
        3. 3.7.3. Choosing a Product for Your Application
      8. 3.8. SUMMARY
  8. II. Implementing Search
    1. 4. Search within SharePoint 2010
      1. 4.1. SEARCHING WITH SHAREPOINT 2010
        1. 4.1.1. SharePoint 2010 Overview
          1. 4.1.1.1. Search Server 2010
          2. 4.1.1.2. SharePoint Search 2010
          3. 4.1.1.3. Fast Search for SharePoint 2010
      2. 4.2. SHAREPOINT 2010 SEARCH ARCHITECTURE OVERVIEW
        1. 4.2.1. Key Components
          1. 4.2.1.1. Administration
          2. 4.2.1.2. Crawler
          3. 4.2.1.3. Query and Index
      3. 4.3. DEPLOYMENT PLANNING
        1. 4.3.1. Capacity Planning
        2. 4.3.2. Distribution Considerations (Location, Location, Location ...)
        3. 4.3.3. Information Architecture
          1. 4.3.3.1. Crawled Properties and Managed Properties
          2. 4.3.3.2. Content types
      4. 4.4. INSTALLATION AND CONFIGURATION
        1. 4.4.1. Single Node
        2. 4.4.2. Multiple Nodes
        3. 4.4.3. Scaling a Search Application in a Farm
        4. 4.4.4. Configuration
          1. 4.4.4.1. People Search
          2. 4.4.4.2. Reporting
            1. 4.4.4.2.1. Search Administration Reports
      5. 4.5. IMPLEMENTING SECURITY
      6. 4.6. CAPACITY AND LIMITATIONS
        1. 4.6.1. Search Server 2010
        2. 4.6.2. SharePoint Search 2010
      7. 4.7. TOPOLOGIES
      8. 4.8. FEDERATION
      9. 4.9. SEARCH USER EXPERIENCE
        1. 4.9.1. People Search
      10. 4.10. OPERATIONS
        1. 4.10.1. Relevance Tuning
      11. 4.11. SUMMARY
    2. 5. FAST Search within SharePoint 2010
      1. 5.1. SEARCH WITH FAST SEARCH FOR SHAREPOINT 2010
        1. 5.1.1. FAST Search for SharePoint 2010 Product Overview
        2. 5.1.2. Key Search Engine Components
          1. 5.1.2.1. Administration
          2. 5.1.2.2. Content Gathering
          3. 5.1.2.3. Content-Processing Pipeline
          4. 5.1.2.4. Index
        3. 5.1.3. FAST Search Authorization
          1. 5.1.3.1. Query Component
          2. 5.1.3.2. Web Analyzer
        4. 5.1.4. Installation and Configuration
          1. 5.1.4.1. Prerequisites
            1. 5.1.4.1.1. Hardware Requirements
            2. 5.1.4.1.2. Operating System Requirements
            3. 5.1.4.1.3. Permissions
            4. 5.1.4.1.4. Prerequisite Installer
          2. 5.1.4.2. Installation
          3. 5.1.4.3. Configuration
            1. 5.1.4.3.1. Setup FAST Search Query Service
            2. 5.1.4.3.2. Set up Content Search Service Application (SSA)
            3. 5.1.4.3.3. Configure SSL-enabled communication
            4. 5.1.4.3.4. Configure FAST Search Authorization (FSA)
            5. 5.1.4.3.5. Configure Claims-Based Authentication
          4. 5.1.4.4. Multinode
        5. 5.1.5. Capacity and Limitations
        6. 5.1.6. Topologies and Federation
          1. 5.1.6.1. Search Cluster Columns and Rows
          2. 5.1.6.2. Topology Design Considerations
          3. 5.1.6.3. Federation
        7. 5.1.7. Content Processing
          1. 5.1.7.1. Tokenization, Normalization, and Lemmatization
          2. 5.1.7.2. Entity Extraction
        8. 5.1.8. Query Component
          1. 5.1.8.1. FAST Query Language
        9. 5.1.9. Relevance Tuning
          1. 5.1.9.1. Managed Properties
          2. 5.1.9.2. Rank Profile
          3. 5.1.9.3. Search Center
        10. 5.1.10. Search Administration
          1. 5.1.10.1. Monitoring
          2. 5.1.10.2. PowerShell
        11. 5.1.11. Search Center
          1. 5.1.11.1. End User Search Experience
            1. 5.1.11.1.1. People Search
            2. 5.1.11.1.2. UI Design Considerations
            3. 5.1.11.1.3. Web Parts
            4. 5.1.11.1.4. User Context
      2. 5.2. SUMMARY
    3. 6. Customizing Search with SharePoint 2010
      1. 6.1. SEARCH ARCHITECTURE AND TOPOLOGIES
        1. 6.1.1. SharePoint Search Key Components
        2. 6.1.2. FAST Architecture and Topology
        3. 6.1.3. How Architecture Meets Applications
      2. 6.2. DEVELOPING WITH ENTERPRISE SEARCH
        1. 6.2.1. Range of Customization
        2. 6.2.2. Top Customization Scenarios
        3. 6.2.3. Search-Driven Applications
          1. 6.2.3.1. Search-Driven Application Example
      3. 6.3. CUSTOMIZING THE SEARCH USER EXPERIENCE
        1. 6.3.1. Web Parts with FAST
        2. 6.3.2. Inter-Web-Part Communication
        3. 6.3.3. Example: Tag Cloud Web Part
      4. 6.4. SEARCH CONNECTORS AND SEARCHING LOB SYSTEMS
        1. 6.4.1. New Connector Framework Features
          1. 6.4.1.1. Crawling Associated Content
        2. 6.4.2. Creating Indexing Connectors
          1. 6.4.2.1. Model Files
          2. 6.4.2.2. Tooling in SPD and VS2010
          3. 6.4.2.3. Writing Custom Connectors
          4. 6.4.2.4. A Few More Tips
          5. 6.4.2.5. Deploying Connectors
        3. 6.4.3. FAST-Specific Indexing Connectors
        4. 6.4.4. Customizing Connectivity
      5. 6.5. WORKING WITH FEDERATION
        1. 6.5.1. Custom Federation to FAST ESP
        2. 6.5.2. Additional Considerations in Federation
      6. 6.6. WORKING WITH THE QUERY OM
        1. 6.6.1. Query-Side APIs and OMs
          1. 6.6.1.1. The Federation Object Model
          2. 6.6.1.2. The Query Web Service
          3. 6.6.1.3. The Query RSS Feed
          4. 6.6.1.4. The Query Object Model
        2. 6.6.2. Query Syntax
        3. 6.6.3. FAST Query Language
        4. 6.6.4. Using RANK and XRANK
        5. 6.6.5. Using SortFormula
      7. 6.7. CONTENT ENHANCEMENT
        1. 6.7.1. Advanced Content Processing with FAST
          1. 6.7.1.1. Content Pipeline Configuration
          2. 6.7.1.2. Content Pipeline Extensibility
        2. 6.7.2. Multilingual Search
      8. 6.8. EXTENDING SEARCH USING THE ADMINISTRATIVE OM
        1. 6.8.1. Authentication and Security
        2. 6.8.2. Search Reports
      9. 6.9. SUMMARY
  9. III. Implementing Search with ESP
    1. 7. Introduction to FAST ESP
      1. 7.1. ESP PRODUCT OVERVIEW
        1. 7.1.1. System Architecture and Administration
          1. 7.1.1.1. ESP Architecture and Key Components
          2. 7.1.1.2. The ESP Administrative Interface
            1. 7.1.1.2.1. Viewing the Administrative Screens
            2. 7.1.1.2.2. Accessing The Search Front End
        2. 7.1.2. Installation and Setup
          1. 7.1.2.1. Hardware
            1. 7.1.2.1.1. Local Disk Drives
            2. 7.1.2.1.2. RAID: The Type Matters
            3. 7.1.2.1.3. Network Storage
            4. 7.1.2.1.4. Solid State Storage
          2. 7.1.2.2. Operating System and Software
            1. 7.1.2.2.1. The Final Infrastructure: Java
            2. 7.1.2.2.2. Virtual Systems
            3. 7.1.2.2.3. VMWare Performance
            4. 7.1.2.2.4. Hyper-V Performance
            5. 7.1.2.2.5. HyperV and Linux
          3. 7.1.2.3. Preparing to Install ESP
            1. 7.1.2.3.1. The Surprisingly Important Installation and Prerequisites Guides
            2. 7.1.2.3.2. Downloading the Package
            3. 7.1.2.3.3. License File
            4. 7.1.2.3.4. Incremental or Roll-Up Packages
            5. 7.1.2.3.5. Differences Installing FSIS
            6. 7.1.2.3.6. Some Differences Between Windows and Linux
          4. 7.1.2.4. Doing the Install
          5. 7.1.2.5. Surprises During Installation
            1. 7.1.2.5.1. All Platforms
            2. 7.1.2.5.2. Windows Surprises
          6. 7.1.2.6. Install Checklist
        3. 7.1.3. Quick Start: Build and Search
          1. 7.1.3.1. Creating a Collection
          2. 7.1.3.2. Searching the Collection
        4. 7.1.4. Managing ESP
          1. 7.1.4.1. FAST Home
            1. 7.1.4.1.1. User Administration
            2. 7.1.4.1.2. Manage Search Profiles
            3. 7.1.4.1.3. Creating a Search Profile
            4. 7.1.4.1.4. Revisiting FAST Home
          2. 7.1.4.2. Search Business Center
            1. 7.1.4.2.1. Reporting
            2. 7.1.4.2.2. Boost and Blocks
            3. 7.1.4.2.3. Synonyms
            4. 7.1.4.2.4. Search Profile Settings
            5. 7.1.4.2.5. Publishing
          3. 7.1.4.3. ESP Admin GUI
            1. 7.1.4.3.1. Collection Overview
            2. 7.1.4.3.2. Document Processing
            3. 7.1.4.3.3. Search View
            4. 7.1.4.3.4. System Management
            5. 7.1.4.3.5. System Overview
            6. 7.1.4.3.6. Logs
            7. 7.1.4.3.7. Data Sources
            8. 7.1.4.3.8. Matching Engines
            9. 7.1.4.3.9. Web Analyzer Overview
            10. 7.1.4.3.10. Clarity Overview
            11. 7.1.4.3.11. Command-Line ESP Admin Tools
          4. 7.1.4.4. Other ESP Goodies
            1. 7.1.4.4.1. Integrating the FileTraverser into the ESP Admin GUI
            2. 7.1.4.4.2. About the Index Profile File
            3. 7.1.4.4.3. Setting the Administrative Password
            4. 7.1.4.4.4. Enabling Graphics Reporting in SBC
          5. 7.1.4.5. Documentation by Role
            1. 7.1.4.5.1. System Preparation and Setup/Technical Administration
            2. 7.1.4.5.2. Business Administration/Boosts and Blocks
            3. 7.1.4.5.3. Submitting Content into to ESP
            4. 7.1.4.5.4. Customizing the Indexing Process
            5. 7.1.4.5.5. Developers
          6. 7.1.4.6. Technical Assistance
      2. 7.2. CTS AND IMS
        1. 7.2.1. Introducing CTS and IMS
          1. 7.2.1.1. Content Transformation Services
          2. 7.2.1.2. Interaction Management Services
          3. 7.2.1.3. Summary of the CTS and IMS
      3. 7.3. SUMMARY
    2. 8. Customization and Deployment of FAST ESP 5.X
      1. 8.1. THE BIG PICTURE: WHY IT'S BUILT THIS WAY
        1. 8.1.1. The Core Nodes
        2. 8.1.2. Getting Data into and out of the Core
          1. 8.1.2.1. Inbound Documents
          2. 8.1.2.2. Searches and Outbound Search Results
          3. 8.1.2.3. QR Server Versus RTS Search
        3. 8.1.3. Scaling in General
        4. 8.1.4. Scaling Core RTS Search Nodes for Content
        5. 8.1.5. Scaling Non-Core Nodes for Content
        6. 8.1.6. Scaling Cores for Search Traffic
        7. 8.1.7. Scaling in Both Directions
      2. 8.2. OVERVIEW: HOW A MULTINODE INSTALLATION WORKS
      3. 8.3. MULTINODE INSTALLATION PREP WORK
        1. 8.3.1. High-Level Checklist
        2. 8.3.2. TCP/IP Configuration Should Not Be Changed After Installation
        3. 8.3.3. Check Your Firewall against ESP Ports
        4. 8.3.4. Symmetric DNS
      4. 8.4. UNIX-SPECIFIC CONSIDERATIONS
        1. 8.4.1. Input Mode for Various Admin Tasks
        2. 8.4.2. You Probably Need X-Windows
        3. 8.4.3. Minimum X-Windows Resolution
        4. 8.4.4. Unix Multinode Non-GUI Installs
          1. 8.4.4.1. The Two Normal Scenarios
          2. 8.4.4.2. Other GUI Choices for Unix Installations
          3. 8.4.4.3. Can You Tunnel?
          4. 8.4.4.4. Network Settings
          5. 8.4.4.5. Other Choices for Bootstrapping InstallProfile.xml
          6. 8.4.4.6. Using a Temporary Virtual Linux Box
            1. 8.4.4.6.1. Using Microsoft Hyper-V and Linux Client Machines
          7. 8.4.4.7. Using a Temporary Windows Microsoft Machine!
          8. 8.4.4.8. Custom Install Profiles
            1. 8.4.4.8.1. Differences between Microsoft Windows and Unix Node Definition
            2. 8.4.4.8.2. Hand-Created Install Profile
            3. 8.4.4.8.3. Create a Custom OEM Profile
            4. 8.4.4.8.4. Custom Automation
        5. 8.4.5. Specific Unix SSH Requirements
          1. 8.4.5.1. Summary of SSH Setup Procedure
          2. 8.4.5.2. Replace Passwords with SSH Credentials and Keys
          3. 8.4.5.3. Removing SSH Host Authorization Prompts
          4. 8.4.5.4. Distributing the SSH Credentials
      5. 8.5. REVIEWING A THREE-NODE LINUX INSTALLATION
        1. 8.5.1. Allocation of Processes
        2. 8.5.2. Installation Profile
        3. 8.5.3. Starting the Installation
        4. 8.5.4. Defining Nodes
        5. 8.5.5. System Tests
        6. 8.5.6. Assigning Processes
        7. 8.5.7. Copying Node Files
        8. 8.5.8. Installing
      6. 8.6. BACKING UP QUIESCENT STATES
      7. 8.7. A FEW ESP TERMS YOU MIGHT COME ACROSS
        1. 8.7.1. About Python and FAST Cobra
        2. 8.7.2. References to FDS
        3. 8.7.3. The Mythical ESPDeploy Application
      8. 8.8. CUSTOMIZING THE DOCUMENT PROCESSING PIPELINE
        1. 8.8.1. About ESP's Internal Data Representations
        2. 8.8.2. Managing Pipelines Processing Stages
        3. 8.8.3. Simple Pipeline Modification Example
        4. 8.8.4. Configuring the Pipeline
          1. 8.8.4.1. Step 1: Create the Batch File
          2. 8.8.4.2. Step 2: Create a Document Pipeline Stage
          3. 8.8.4.3. Step 3: Create a Document Pipeline Using the New Stage
          4. 8.8.4.4. Step 4: Create a Collection and Submit a Single Document
          5. 8.8.4.5. Step 5: Verify That Your Stage Works
          6. 8.8.4.6. Some Caveats
          7. 8.8.4.7. ESP Template Pipelines and Stages
      9. 8.9. SUMMARY
    3. 9. Advanced Topics
      1. 9.1. SCALABILITY
        1. 9.1.1. ESP Rows and Columns
        2. 9.1.2. Scaling the Amount of Data
          1. 9.1.2.1. Latency and Updates
          2. 9.1.2.2. Metadata and Pipelines
          3. 9.1.2.3. Licensing and Content
        3. 9.1.3. Scaling the Number of Searches
          1. 9.1.3.1. Average and Peak QPS
          2. 9.1.3.2. Failover Rows
          3. 9.1.3.3. Don't Bet Entirely on Caching
      2. 9.2. INTEGRATING WITH A TAXONOMY
        1. 9.2.1. Background and Definitions
          1. 9.2.1.1. Types of Taxonomies
          2. 9.2.1.2. Taxonomies Versus Ontologies
          3. 9.2.1.3. Other Terms Associated with Taxonomies
          4. 9.2.1.4. Faceted Navigation and Taxonomies
        2. 9.2.2. Taxonomies as a Symptom?
        3. 9.2.3. Taxonomy Workflow
        4. 9.2.4. Taxonomy Rule Sets
          1. 9.2.4.1. FAST Partner Teragram
          2. 9.2.4.2. Rolling Your Own
            1. 9.2.4.2.1. Outline of the Procedure
            2. 9.2.4.2.2. Sample Stage Python Code
            3. 9.2.4.2.3. Sample Stage Configuration File
            4. 9.2.4.2.4. Sample Mapping File
      3. 9.3. A BRIEF OVERVIEW OF OTHER ADVANCED ESP FEATURES
        1. 9.3.1. Structural Analysis Toolkit
          1. 9.3.1.1. How Entities and Fields Relate to Navigators, Refiners, and Facets
          2. 9.3.1.2. Various Methods for Entity Extraction
          3. 9.3.1.3. STAN Workflow
        2. 9.3.2. Relevancy Tweaking
          1. 9.3.2.1. Default Relevancy
          2. 9.3.2.2. Relevancy Tuning Options in ESP
        3. 9.3.3. FAST's Hybrid Security Model
        4. 9.3.4. Unsupervised Clustering and Noun Phrase Extraction
        5. 9.3.5. Federated Search
      4. 9.4. SUMMARY
  10. IV. Enterprise Search 2.0
    1. 10. Enterprise Search Is Social Search
      1. 10.1. SOCIAL COMPUTING
      2. 10.2. SOCIAL SEARCH
        1. 10.2.1. Types of Social Activities That Affect Search
      3. 10.3. SOCIAL SEARCH IN SHAREPOINT 2010
        1. 10.3.1. Outlook 2010
        2. 10.3.2. Implementing Social Search in SharePoint 2010
        3. 10.3.3. User Profile Service Application
          1. 10.3.3.1. User Profile Synchronization
          2. 10.3.3.2. My Site
          3. 10.3.3.3. User Profiles
        4. 10.3.4. People Search
          1. 10.3.4.1. Refiners
          2. 10.3.4.2. Self-Search
        5. 10.3.5. Social Search Experience
          1. 10.3.5.1. Suggestive Search
          2. 10.3.5.2. Contextual Search
          3. 10.3.5.3. Click-Through Relevancy
          4. 10.3.5.4. Social Tags
          5. 10.3.5.5. Implicit User Profile Data
      4. 10.4. EXTENDING SOCIAL SEARCH
        1. 10.4.1. Enhancing Search Through Content-Processing
        2. 10.4.2. Leveraging Social Distance Information
        3. 10.4.3. Content Rating and Reviews
      5. 10.5. SUMMARY
    2. 11. Search and Business Intelligence
      1. 11.1. SEARCH AND BI ARE CONVERGING
        1. 11.1.1. Search and BI Combine in Different Ways
          1. 11.1.1.1. Text Analytics
            1. 11.1.1.1.1. Voice of the Customer Applications
            2. 11.1.1.1.2. Microsoft LookingGlass
            3. 11.1.1.1.3. Summary of Text Analytics
          2. 11.1.1.2. Search Analytics
            1. 11.1.1.2.1. BI on Search and Web Logs
            2. 11.1.1.2.2. BI on Search Result Sets
          3. 11.1.1.3. Unified Information Access
            1. 11.1.1.3.1. Finding and Reusing BI Artifacts
            2. 11.1.1.3.2. Search as an Alternative Datamart
            3. 11.1.1.3.3. Faceted Navigation as Analytics
            4. 11.1.1.3.4. Ad Hoc Queries for Structured Data
            5. 11.1.1.3.5. Integrated Information Access Platforms
        2. 11.1.2. Business Intelligence Needs Search
          1. 11.1.2.1. The State of Traditional BI
          2. 11.1.2.2. Challenges with Traditional BI
        3. 11.1.3. Benefits of BI Search Combinations
          1. 11.1.3.1. BI for the Masses
          2. 11.1.3.2. Search as the UI Paradigm for BI
      2. 11.2. ADOPTION OF SEARCH/BI INTEGRATION
        1. 11.2.1. Survey on Adoption
        2. 11.2.2. Areas of Adoption
        3. 11.2.3. Applications at the Intersection of Search and BI
          1. 11.2.3.1. Customer-Centric Applications
          2. 11.2.3.2. Information Consolidation
          3. 11.2.3.3. Operational Intelligence
      3. 11.3. MICROSOFT BI OVERVIEW
        1. 11.3.1. BI in Microsoft SharePoint 2010
        2. 11.3.2. PowerPivot for Excel 2010
        3. 11.3.3. SQL Server
        4. 11.3.4. SSRS
        5. 11.3.5. SSRS with SharePoint
        6. 11.3.6. Microsoft StreamInsight and Complex Event Processing
        7. 11.3.7. FAST for Search on Structured Data
      4. 11.4. THE MICROSOFT BI INDEXING CONNECTOR
        1. 11.4.1. Tour of the Reports Center
        2. 11.4.2. Features of the BI Indexing Connector
        3. 11.4.3. Architecture of the BI Indexing Connector
        4. 11.4.4. Setup and Administration of the BI Indexing Connector
      5. 11.5. THE FUTURE OF SEARCH AND BI
      6. 11.6. SUMMARY
    3. 12. The Future of Search
      1. 12.1. THE SORRY STATE OF SEARCH
        1. 12.1.1. The Flawed HAL9000 Usage Model
        2. 12.1.2. Enterprise Search 2.0
          1. 12.1.2.1. Business-Driven Search
          2. 12.1.2.2. Conversational Search
          3. 12.1.2.3. Socially Aware
          4. 12.1.2.4. Integrated with Other Content Sources
        3. 12.1.3. Emerging Trends in Enterprise Search
          1. 12.1.3.1. Business-Based Goals
            1. 12.1.3.1.1. Search Becomes More Vertical
            2. 12.1.3.1.2. Search-Based Applications
          2. 12.1.3.2. User Experience
            1. 12.1.3.2.1. User Roles
            2. 12.1.3.2.2. Contextual Search
            3. 12.1.3.2.3. Psychic search
            4. 12.1.3.2.4. One-Click Search
            5. 12.1.3.2.5. Visualization
            6. 12.1.3.2.6. Non-Web Clients
            7. 12.1.3.2.7. Creative Output Formats
          3. 12.1.3.3. Search Technology
            1. 12.1.3.3.1. Entity, Sentiment, and Fact Extraction
            2. 12.1.3.3.2. Automatic Indexing
            3. 12.1.3.3.3. Open Pipelines/Open Search
            4. 12.1.3.3.4. Enterprise Capabilities
            5. 12.1.3.3.5. Near Duplicate Detection
          4. 12.1.3.4. Operations
            1. 12.1.3.4.1. Cloud Computing
            2. 12.1.3.4.2. Cores, Processors, and Virtualization
            3. 12.1.3.4.3. Shifting Control
            4. 12.1.3.4.4. Search as a Service
            5. 12.1.3.4.5. Smart Indexing
            6. 12.1.3.4.6. Hardware Searching
        4. 12.1.4. Enterprise Search 3.0 — and Beyond
          1. 12.1.4.1.
            1. 12.1.4.1.1. Agents and Smart Agents
            2. 12.1.4.1.2. Behavioral Tagging
            3. 12.1.4.1.3. Language Support
      2. 12.2. WHAT YOU CAN DO TODAY
      3. 12.3. SUMMARY
    4. A. Resources
      1. A.1. BOOKS
      2. A.2. MICROSOFT ENTERPRISE SEARCH SITES
      3. A.3. USER FORUMS
      4. A.4. NEWSLETTERS
      5. A.5. BLOGS
      6. A.6. VENDOR BLOGS
      7. A.7. OTHER BLOGS
      8. A.8. TRADE SHOWS