You are previewing Enterprise Integration: The Essential Guide to Integration Solutions.
O'Reilly logo
Enterprise Integration: The Essential Guide to Integration Solutions

Book Description

“The book’s use of real-world case study vignettes really does go to the heart of the subject matter. This stuff is real, it has real applicability to real problems, and, as with most things in life, it shows how it all comes down to real money in the final analysis. This book shows you what your peers are doing to drive costs out of integration projects and to build new applications without re-inventing the entire wheel—just a few new spokes and off you go. This is a good book. Read it.”

     —Peter Rhys Jenkins, Complex Systems Architect, Candle Corporation

“When you get two long-term, acknowledged experts on integration and interoperability together to lay out the current state of the IT universe you expect an immediate return on investment—and this book delivers. It’s common knowledge that 90% of total software lifecycle cost is in maintenance and integration, and that needs to drive IT decision-making. With comprehensive coverage of the integration technology landscape, and clear case studies presented at every turn, this book belongs on every IT manager’s, every system architect’s, and every software developer’s bookshelf.”

     —Richard Mark Soley, chairman and CEO, Object Management Group

“Today’s myriad of integration technologies and alternatives can be daunting. This book presents a framework and process for the evaluation, design, and selection of the appropriate integration technologies to meet your strategic business needs. You will find the templates a particularly useful mechanism to jump-start documentation and drive your decision-making process.”

     —Ron Zahavi, CIO, Global Business Transformation, Unisys Global Transformation Team; author of Enterprise Application Integration with CORBA

“It is refreshing to read a book that presents a good business approach to the integration challenge facing most business leaders today, while at the same time educating them about the major components of the required technologies and management practices changes required. The narrative, examples, and templates establish a common reference point between the business and the technology organizations. A must-read for senior business leaders challenged with the complexities of business integration, as well as Senior IT Leaders challenged with shrinking budgets and lower tolerances for failures.”

     —Chuck Papageorgiou, managing partner, Ideasphere

“Integration has, and will continue to be, one of the success indicators of any enterprise project. Failing to understand the nuances of integration is a critical mistake managers cannot afford to make.”

     —Marcia Robinson, author of Services Blueprint: Roadmap for Execution

“A much-needed book; it ties together the business and technology aspects of information system implementation, emphasizing best practices for really getting things done. I believe that both the technical and business communities will benefit from the in-depth material provided in this book.”

     —Dr. Barry Horowitz, professor of systems and information engineering, University of Virginia (former CEO, Mitre Corporation)

Integration of applications, information, and business process has become today’s #1 IT investment priority. Most enterprise integration books simply explain the technology. This one shows exactly how to apply it. It’s a step-by-step roadmap for your entire project—from the earliest exploratory stages through analysis, design, architecture, and implementation.

Renowned enterprise integration experts Beth Gold-Bernstein and William Ruh present best practices and case studies that bring their methodology to life. They address every stage from the decision-maker’s and implementer’s point of view—showing how to align business requirements to specific solutions, systematically reduce risk, and maximize ROI throughout the entire lifecycle. Coverage includes:

  • Supporting strategies, tactics, and business planning: enterprise integration from the business perspective

  • Defining realistic project success indicators and metrics

  • Establishing integration architectures: supporting near-term needs while building reusable infrastructure services for the long-term

  • Adopting metadata architecture and standards

  • Implementing four essential implementation patterns: application, information, composite, and process integration

  • Understanding service integration and implementing service-oriented architectures

  • Providing organizational structure and governance to support effective integration

  • The authors provide detailed plans and specification templates for application integration projects—both in the book and on the CD-ROM. These projects include identifying business drivers and requirements; establishing strategy; and integrating services, information, process, and applications.

    Enterprise Integration was written for every member of the integration team: business and IT leaders, strategists, architects, project managers, and technical staff. Regardless of your role, you’ll discover where you fit, what to do, and how to drive maximum business value from your next integration project.



    Table of Contents

    1. Copyright
      1. Dedication
    2. Gold-Bernstein/Ruh Endorsement Quotes
    3. Addison-Wesley Information Technology Series
    4. Foreword
    5. Preface
      1. About This Book
      2. The Integration Dilemma
      3. Bringing Simplicity from Complexity
      4. Enterprise Integration Applied
      5. The End of a Journey
    6. I. Business Drivers for Enterprise Integration
      1. One. The Business Imperative for Enterprise Integration
        1. 1.1. Executive Overview
        2. 1.2. How Business Is Changing
          1. 1.2.1. Customer Interaction
          2. 1.2.2. Manufacturing
          3. 1.2.3. Business in Real Time
          4. 1.2.4. Business Operations
          5. 1.2.5. Business Organization
          6. 1.2.6. Management
        3. 1.3. Business Agility Is Becoming a Competitive Requirement
        4. 1.4. Business Agility Requires Enterprise Integration
        5. 1.5. The ROI of Enterprise Integration
          1. 1.5.1. Reducing Costs
          2. 1.5.2. Increasing Revenue
          3. 1.5.3. Customer Satisfaction
          4. 1.5.4. Business Process Improvement
        6. 1.6. The Challenges of Integration
        7. 1.7. How This Book Will Help
      2. Two. Business Drivers and Requirements
        1. 2.1. Executive Overview
        2. 2.2. Business Drivers for Enterprise Integration
          1. 2.2.1. Increasing Business Efficiency and Competitiveness
          2. 2.2.2. Improving Customer Satisfaction
          3. 2.2.3. Mergers and Acquisitions
          4. 2.2.4. Regulatory Compliance
        3. 2.3. Defining Requirements
        4. 2.4. Business Drivers and Requirements Specification
          1. 2.4.1. Introduction
          2. 2.4.2. Scope
          3. 2.4.3. Key Participants
          4. 2.4.4. Statement of Purpose
          5. 2.4.5. Cost Estimates
          6. 2.4.6. ROI
          7. 2.4.7. Metrics
          8. 2.4.8. Risks
          9. 2.4.9. Conclusions and Commentary
        5. 2.5. Best Practices
        6. 2.6. Next Steps
      3. Three. Enterprise Integration Strategy
        1. 3.1. Executive Overview
        2. 3.2. Why Has Enterprise-Wide Integration Failed in the Past?
        3. 3.3. How to Succeed with an Integration Strategy
        4. 3.4. Key Architectural Best Practices: SOA and Process-Driven Integration
          1. 3.4.1. Service-Oriented Architecture
          2. 3.4.2. Process-Driven Integration
        5. 3.5. How Long Should a Strategy Take?
        6. 3.6. Business Integration Strategy Specification
          1. 3.6.1. Introduction
          2. 3.6.2. Scope
          3. 3.6.3. Key Participants
          4. 3.6.4. Integration Strategies
          5. 3.6.5. Mapping to Business Strategies and Initiatives
          6. 3.6.6. Strategic Sourcing
          7. 3.6.7. Standards
          8. 3.6.8. Metrics
          9. 3.6.9. Risks
          10. 3.6.10. Conclusions and Recommended Next Steps
        7. 3.7. Next Steps
    7. II. Enterprise Integration Architecture
      1. Four. Enterprise Integration Architecture Overview
        1. 4.1. Executive Overview
        2. 4.2. The Business Case for a Strategic Enterprise Approach
        3. 4.3. Components of an Enterprise Integration Architecture
          1. 4.3.1. Technical Integration Architecture
          2. 4.3.2. Service Integration Architecture
          3. 4.3.3. Information Integration Architecture
          4. 4.3.4. Business Process Integration Architecture
        4. 4.4. Organizational Structure and Architecture Governance
          1. 4.4.1. Organizational Structure
          2. 4.4.2. Architecture Governance
          3. 4.4.3. Enterprise Priority-Setting
        5. 4.5. Conclusion
        6. 4.6. Next Steps
      2. Five. Current Integration Environment Assessment
        1. 5.1. Executive Overview
        2. 5.2. Understanding Integration Technology
        3. 5.3. Current Environment Assessment Specification
          1. 5.3.1. Introduction
          2. 5.3.2. Purpose
          3. 5.3.3. Key Participants
          4. 5.3.4. Scope
          5. 5.3.5. Integration Technologies
          6. 5.3.6. Application and Data Source Interfaces
          7. 5.3.7. Integration Matrix
          8. 5.3.8. Integration Diagram
          9. 5.3.9. Security
          10. 5.3.10. Conclusions and Commentary
        4. 5.4. Best Practices and Recommendations
        5. 5.5. Next Steps
      3. Six. Technical Integration Architecture
        1. 6.1. Executive Overview
        2. 6.2. Technical Integration Architecture Specification
          1. 6.2.1. Introduction
          2. 6.2.2. Scope
          3. 6.2.3. Key Participants
          4. 6.2.4. Integration Architecture Requirements
            1. 6.2.4.1. Types of Integration
            2. 6.2.4.2. Integration Services and Technologies
          5. 6.2.5. Integration Architecture Description
            1. 6.2.5.1. Conceptual View
            2. 6.2.5.2. Development View
          6. 6.2.6. Standards Profile
          7. 6.2.7. Service-Level Requirements
            1. 6.2.7.1. Availability
            2. 6.2.7.2. Integrity and Delivery Service
            3. 6.2.7.3. Scalability
            4. 6.2.7.4. Maintainability and Manageability
            5. 6.2.7.5. Usability
            6. 6.2.7.6. Performance
            7. 6.2.7.7. Transaction Services
            8. 6.2.7.8. Persistence Services
            9. 6.2.7.9. Directory Services
            10. 6.2.7.10. Service Level Summary Table
          8. 6.2.8. Security
            1. 6.2.8.1. Authentication
            2. 6.2.8.2. Authorization
            3. 6.2.8.3. Perimeter Security
            4. 6.2.8.4. Auditing
            5. 6.2.8.5. Confidentiality
            6. 6.2.8.6. Nonrepudiation
          9. 6.2.9. Capacity Planning View
          10. 6.2.10. Design Constraints and Guidance
          11. 6.2.11. Conclusions and Commentary
        3. 6.3. Best Practices in Technical Integration Architecture
        4. 6.4. Next Steps
      4. Seven. Service Integration Architecture
        1. 7.1. Executive Overview
        2. 7.2. Benefits of SOA
        3. 7.3. Defining Services—Bottom-Up or Top-Down?
        4. 7.4. Event-Driven Service Design
        5. 7.5. Service Integration Architecture Specification
          1. 7.5.1. Introduction
          2. 7.5.2. Scope
          3. 7.5.3. Key Participants
          4. 7.5.4. Business Events
          5. 7.5.5. Services
            1. Service Category Table
            2. Service Definition Table
            3. Service Interface Table
          6. 7.5.6. Use Case Diagram and Specification
          7. 7.5.7. Conclusions and Commentary
        6. 7.6. Best Practices in Service Integration Architecture
        7. 7.7. Next Steps
      5. Eight. Information Integration Architecture
        1. 8.1. Executive Overview
        2. 8.2. Understanding Metadata
        3. 8.3. Metadata Architecture
        4. 8.4. Metadata Standards
          1. 8.4.1. World Wide Web Consortium (W3C)
          2. 8.4.2. The Organization for the Advancement of Structured Information Standards (OASIS)
          3. 8.4.3. Object Management Group (OMG)
          4. 8.4.4. Open Applications Group (OAG)
        5. 8.5. Information Integration Patterns
        6. 8.6. Enterprise Information Integration Technology
        7. 8.7. Information Integration Architecture Specification
          1. 8.7.1. Introduction
          2. 8.7.2. Scope
          3. 8.7.3. Key Participants
          4. 8.7.4. Mapping Requirements to Information Integration Design Patterns
          5. 8.7.5. Data Flow Diagram
          6. 8.7.6. Metadata Model
          7. 8.7.7. Relationship Model
          8. 8.7.8. Information Design Reviews
          9. 8.7.9. Conclusions and Commentary
        8. 8.8. Best Practices in Information Design
        9. 8.9. Next Steps
      6. Nine. Process Integration Architecture
        1. 9.1. Executive Overview
        2. 9.2. Why Process Is Important to Business
        3. 9.3. Understanding Process Integration Technology
          1. 9.3.1. Business Process Management (BPM)
          2. 9.3.2. Business Process Integration (BPI)
          3. 9.3.3. Business Process Automation (BPA)
          4. 9.3.4. Workflow Automation
          5. 9.3.5. Business Activity Monitoring (BAM)
          6. 9.3.6. Web Service Orchestration (WSO)
        4. 9.4. Process Standards
          1. 9.4.1. Business Process Execution Language for Web Services (BPEL4WS)
          2. 9.4.2. Unified Modeling Language (UML)
          3. 9.4.3. Business Process Management Initiative (BPMI) and the Workflow Management Coalition (WfMC)
          4. 9.4.4. Integration Definition for Function Modeling (IDEF0)
        5. 9.5. Process Integration Architecture Specification
          1. 9.5.1. Introduction
          2. 9.5.2. Scope
          3. 9.5.3. Key Participants
          4. 9.5.4. Business Process Descriptions
          5. 9.5.5. Process Flow Models
          6. 9.5.6. Process Design Reviews
          7. 9.5.7. Conclusions and Commentary
        6. 9.6. Best Practices in Process Integration
        7. 9.7. Next Steps
    8. III. Enterprise Integration Solutions
      1. Ten. Application Integration
        1. 10.1. Executive Overview
        2. 10.2. Application Integration Scenarios
        3. 10.3. Choosing Application Integration Technology
          1. 10.3.1. Messaging and Connectivity
          2. 10.3.2. Data Transformation
          3. 10.3.3. Message Brokers and Enterprise Service Buses
          4. 10.3.4. Application Interfaces
          5. 10.3.5. Legacy Integration
          6. 10.3.6. Portals
          7. 10.3.7. Mobile Integration
          8. 10.3.8. B2B Integration
          9. 10.3.9. Application Integration Platforms
        4. 10.4. Application Integration Implementation Specification
          1. 10.4.1. Introduction
          2. 10.4.2. Scope
          3. 10.4.3. Key Participants
          4. 10.4.4. Application Integration Implementation Patterns and Services
            1. 10.4.4.1. Message Broker
            2. 10.4.4.2. Enterprise Service Bus (ESB)
            3. 10.4.4.3. Legacy Integration
            4. 10.4.4.4. B2B Integration
            5. 10.4.4.5. Portals
            6. 10.4.4.6. Mobile Integration
            7. 10.4.4.7. Other Services
          5. 10.4.5. Conclusions and Commentary
        5. 10.5. Best Practices in Application Integration
        6. 10.6. Next Steps
      2. Eleven. Information Integration
        1. 11.1. Executive Overview
        2. 11.2. Information Integration Scenarios
        3. 11.3. Choosing Information Integration Technology
          1. 11.3.1. ETL
          2. 11.3.2. EII
          3. 11.3.3. ECM
        4. 11.4. Information Integration Implementation Specification
          1. 11.4.1. Introduction
          2. 11.4.2. Scope
          3. 11.4.3. Key Participants
          4. 11.4.4. Information Integration Patterns and Services
            1. 11.4.4.1. Data Integration
            2. 11.4.4.2. Unstructured Content Integration
            3. 11.4.4.3. Metadata Repository Integration
          5. 11.4.5. Conclusions and Commentary
        5. 11.5. Best Practices in Information Integration
        6. 11.6. Next Steps
      3. Twelve. Composite Application Integration
        1. 12.1. Executive Overview
        2. 12.2. Composite Application Integration Scenarios
        3. 12.3. Choosing Composite Application Integration Technology
          1. 12.3.1. Application Platform Suites
          2. 12.3.2. Web Services
          3. 12.3.3. Orchestration
        4. 12.4. Composite Integration Implementation Specification
          1. 12.4.1. Introduction
          2. 12.4.2. Scope
          3. 12.4.3. Key Participants
          4. 12.4.4. Composite Integration Patterns and Services
          5. 12.4.5. Conclusions and Commentary
        5. 12.5. Best Practices in Composite Application Integration
        6. 12.6. Next Steps
      4. Thirteen. Process-Driven Integration
        1. 13.1. Executive Overview
        2. 13.2. Process Integration Scenarios
        3. 13.3. Choosing Technology for Process Integration
          1. 13.3.1. Business Process Modeling
          2. 13.3.2. Process and Rules Engines
          3. 13.3.3. Supporting Manual Processes
          4. 13.3.4. Enabling Business Process Improvement
          5. 13.3.5. Business Activity Monitoring (BAM)
          6. 13.3.6. Supporting Collaborative Processes
          7. 13.3.7. Supporting Multiple Types of Processes
        4. 13.4. Process Integration Implementation Specification
          1. 13.4.1. Introduction
          2. 13.4.2. Scope
          3. 13.4.3. Key Participants
          4. 13.4.4. Process Integration Patterns and Services
            1. 13.4.4.1. Process Automation
            2. 13.4.4.2. Business Activity Monitoring (BAM)
            3. 13.4.4.3. Collaborative Process Integration
          5. 13.4.5. Conclusions and Commentary
        5. 13.5. Best Practices in Process Integration
        6. 13.6. Next Steps
      5. Fourteen. Conclusion: Best Practices for Enterprise Integration
        1. 14.1. Executive Overview
        2. 14.2. Reference Architecture for the Fully Integrated Enterprise
        3. 14.3. Succeeding with Strategic Integration
        4. 14.4. Applying This Book
        5. 14.5. Final Thoughts
      6. A. Business Drivers and Requirements Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Statement of Purpose
          5. 5. Cost Estimates
          6. 6. ROI
          7. 7. Metrics
          8. 8. Risks
          9. 9. Conclusions and Recommended Next Steps
        2. Appendix A: References
      7. B. Business Integration Strategy Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Integration Strategies
          5. 5. Mapping to Business Strategies and Initiatives
          6. 6. Strategic Sourcing
          7. 7. Standards
          8. 8. Metrics
          9. 9. Risks
          10. 10. Conclusions and Recommended Next Steps
        2. Appendix A: References
      8. C. Current Environment Assessment Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Purpose
          3. 3. Key Participants
          4. 4. Scope
          5. 5. Integration Technologies
          6. 6. Application and Data Sources Interfaces
          7. 7. Integration Matrix
          8. 8. Integration Diagram
          9. 9. Security
          10. 10. Conclusions and Recommended Next Steps
        2. Appendix A: References
      9. D. Technical Integration Architecture Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Integration Architecture Requirements
            1. 4.1. Types of Integration
            2. 4.2. Integration Services and Technologies
          5. 5. Integration Architecture Description
            1. 5.1. Conceptual View
            2. 5.2. Development View
          6. 6. Standards Profile
          7. 7. Service Level Agreements
            1. 7.1. Availability
            2. 7.2. Integrity and Delivery Service
            3. 7.3. Scalability
            4. 7.4. Maintainability and Manageability
            5. 7.5. Usability
            6. 7.6. Performance
            7. 7.7. Transaction Services
            8. 7.8. Persistence Services
            9. 7.9. Directory Services
            10. 7.10. Service Level Summary Table
          8. 8. Security
            1. 8.1. Authentication
            2. 8.2. Authorization
            3. 8.3. Perimeter Security
            4. 8.4. Auditing
            5. 8.5. Confidentiality
            6. 8.6. Nonrepudiation
          9. 9. Capacity Planning View
          10. 10. Design Constraints and Guidance
          11. 11. Conclusions and Recommended Next Steps
        2. Appendix A: References
      10. E. Service Integration Architecture Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Business Events
          5. 5. Services
            1. 5.1. Service Category Table
            2. 5.2. Service Definition Table
            3. 5.3. Service Interface Table
          6. 6. Use Cases
            1. 6.1. Use Case Diagram
            2. 6.2. Use Case Specification
          7. 7. Conclusions and Recommended Next Steps
        2. Appendix A: References
      11. F. Information Integration Architecture Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Mapping Requirements to Information Integration Design Patterns
          5. 5. Data Flow Diagram
          6. 6. Metadata Model
          7. 7. Relationship Model
          8. 8. Information Design Reviews
          9. 9. Conclusions and Recommended Next Steps
        2. Appendix A: References
      12. G. Process Integration Architecture Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Business Process Descriptions
          5. 5. Process Flow Models
          6. 6. Process Design Reviews
          7. 7. Conclusions and Recommended Next Steps
        2. Appendix A: References
      13. H. Application Integration Implementation Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Application Integration Implementation Patterns and Services
            1. 4.1. Message Brokers
            2. 4.2. ESB
            3. 4.3. Legacy Integration
            4. 4.4. B2B Integration
            5. 4.5. Portals
            6. 4.6. Mobile Integration
            7. 4.7. Other Services
          5. 5. Conclusions and Recommended Next Steps
        2. Appendix A: References
      14. I. Information Integration Implementation Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Information Integration Patterns and Services
            1. 4.1. Data Integration
            2. 4.2. Unstructured Content Integration
            3. 4.3. Metadata Repository Integration
          5. 5. Conclusions and Recommended Next Steps
        2. Appendix A: References
      15. J. Composite Application Integration Implementation Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Composite Application Integration Patterns and Services
          5. 5. Conclusions and Recommended Next Steps
        2. Appendix A: References
      16. K. Process Integration Implementation Specification
        1. Template Instructions
          1. 1. Introduction
          2. 2. Scope
          3. 3. Key Participants
          4. 4. Process Integration Patterns and Services
            1. 4.1. Process Automation
            2. 4.2. Process Monitoring
            3. 4.3. Collaborative Process Integration
          5. 5. Conclusions and Recommended Next Steps
        2. Appendix A: References
    9. Bibliography
    10. CD-ROM Warranty