This is a simple Spark Streaming example written in Scala that monitors a "data" directory and processes each file added to the directory. It is a simple word count application, but driven by files added to the data directory.
-
Notifications
You must be signed in to change notification settings - Fork 1
Sample Spark Streaming application. This application creates a directory monitor and processes files as they are added to a "data" directory. It counts all of the unique words in the file and prints the results to the screen.
ligado/sparkstreamingexample
About
Sample Spark Streaming application. This application creates a directory monitor and processes files as they are added to a "data" directory. It counts all of the unique words in the file and prints the results to the screen.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published