The ingested data can be stored in a filesystem and indexed data can be stored in search tools such as Solr or Elasticsearch for looking up the actual data. The search tools also enable the applications to look up the data using metadata. We can leverage Spark to store the analyzed results in the search tools, so that the applications can access the data for fast access and make simple calculations such as the moving average based on the criteria selected by users.
Data search
Get Industrial Internet Application Development now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
