O'Reilly logo

Instant Apache Sqoop by Ankit Jain

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Incremental import (Simple)

Incremental import means importing the new version of records or the latest inserted records from the RDBMS table into HDFS.

Getting ready

We can control the incremental import by using the arguments listed in the following table:

Parameter/argument

Description

--check-column <column-name>

The value of this column is used to determine the rows to be imported during the import process.

--incremental <incremental-type>

Specifies the type of incremental mode. Possible values are append and lastmodified.

--last-value <value>

Specifies the last value or the maximum value of the check column from the previous import. All the records whose check column value is greater than the value of the –last-value argument ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required