CHAPTER 11
Logging in HDInsight
A complex eco system like Hadoop must have a detailed logging mechanism to fall back on in case something goes wrong. In traditional Hadoop, all the services—like NameNode, JobTracker, TaskTracker, and so on—have logging capabilities where each and every operation is logged right from service startup to shut down. Apart from the services or daemons startup, there are additional events that need to be recorded, such as job requests, interprocess communication between the services, job execution history, and others.
HDInsight distribution extends this logging mechanism by implementing its own. As you know, the entire ...
Get Pro Microsoft HDInsight: Hadoop on Windows now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
