Sqoop 2 architecture

Sqoop 2 architecture overcomes the limitations of Sqoop 1, which we discussed earlier. The features of Sqoop 2 are:

  • Sqoop 2 exposes REST API as a web service, which can be easily integrated with other systems.
  • The connectors and drivers are managed centrally in one place.
  • Sqoop 2 is well configured and integrated with HBase, Hive, and Oozie for interoperability and management.
  • Connectors can be non-JDBC based.
  • As a service-oriented design, Sqoop 2 can have role-based authentication and audit trail logging to increase the security.

The following is an architecture of Sqoop 2:

Sqoop 2 architecture

Get Hadoop Essentials now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.