You are previewing Hadoop in Action.

Hadoop in Action

Cover of Hadoop in Action by Chuck Lam Published by Manning Publications

Chapter 6. Programming Practices

This chapter covers

  • Best practices unique to developing Hadoop programs
  • Debugging programs in local, pseudo-distributed, and fully distributed modes
  • Sanity checking and regression testing program outputs
  • Logging and monitoring
  • Performance tuning

Now that you’ve gone through various programming techniques in MapReduce, this chapter will step back and cover programming practices.

Programming on Hadoop differs from traditional programming mainly in two ways. First, Hadoop programs are primarily about processing data. Second, Hadoop programs are run over a distributed set of computers. These two differences will change some aspects of your development and debugging processes, which we cover in sections 6.1 ...

The best content for your career. Discover unlimited learning on demand for around $1/day.