Developing Spark applications in Eclipse with SBT
Simple Build Tool (SBT) is a build tool made especially for Scala-based development. SBT follows Maven-based naming conventions and declarative dependency management.
SBT provides the following enhancements over Maven:
- Dependencies are in the form of key-value pairs in the
build.sbt
file as opposed topom.xml
in Maven - It provides a shell that makes it very handy to perform build operations
- For simple projects without dependencies, you do not even need the
build.sbt
file
In build.sbt
, the first line is the project definition:
lazy val root = (project in file("."))
Each project has an immutable map of key-value pairs. This map is changed by settings in SBT like so:
lazy val root = (project in file(".")) ...
Get Spark Cookbook now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.