Today, the amount of data generated on the web is growing as fast as ever, therefore it's utmost important that the processing is as fast as possible. We describe the implementation of an end-to-end system, which will specialize in near real-time processing big data, and will include one framework for each part: retrieval, processing, storage and visualization. The individual frameworks are selected on the basis of our use case of the system, which is the processing of tweets generated on social network Twitter during a football match. For our use case, we also show the analyses and visualizations possible by our system. We end with displaying some of the system metrics gathered during our system's execution.
|
