Logs Analyzer Application

This directory contains code from the chapters, assembled together to form
a sample logs analyzer application. Other libraries that are not discussed
have been used to make this a more finished application.
These are the features of our MVP (minimal viable product) logs analyzer application:

  • Reads in new log files from a directory and inputs those new files into Spark Streaming.
  • Compute stats on the logs using Spark - stats for the last 30 seconds are calculated as well as for all of time.
  • Write the calculated stats to an html file on the local file system that gets
    refreshed on a set interval.

Log Analyzer MVP Application

You can use this simple application as a skeleton and combine features from
the chapters to produce your own custom logs analysis application. The main
class is LogAnalyzerAppMain.java.