In most of the IIoT use cases, the data needs to be transformed for various reasons, such as the modern data architecture using NoSQL technologies, deduplication, Lambda, and data transformations from a legacy data model to a newer model. Typically, the ingested raw data goes through an ETL pipeline that can archive, extract, transform, and load the data into the new systems. The operations can happen interchangeably and with more cycles, based on the use case. After the data is transformed into the final format, it can be streamed to the next step of the pipeline processing.
ETL
Get Industrial Internet Application Development now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
