REAL-TIME ANALYTICS

INTRODUCTION 

It is important to deal with real-time data when it comes to visual analytics.


As the stream processing engines, there are several ways to use like WSO2 SP, Esper, Kafka streaming and etc. which you can use for real-time event processing.

In here I have used WSO2 Data Analytics Server.

WSO2 Data Analytics Server (DAS) listens to a constant stream of events that represents the transactions and activities of an enterprise from different sources, processes them in real time and communicates the results in a variety of interfaces. This allows organisations to respond quickly to their environments, thus gaining an advantage over their competitors. In addition, WSO2 DAS combines real-time analytics with batch (equipped with incremental processing), interactive and predictive (via machine learning) analysis of data into one integrated platform to support the multiple demands of the Internet of Things (IoT) solutions, as well as mobile and Web apps as illustrated by the image below.

MAIN STEPS

WSO2 DAS workflow consists of the following three main phases.

• Collecting Data.
• Analyzing Data.
• Communicating Results.

Step 01: Start Up the DAS Server

Step 02: Login to the WSO2 Management server.

Step 03: Creating the Input stream.

Go to the Event and click the Stream and then click the "Add Event Stream"

Add all the attributes to the first input stream in order to catch all the data in the data set.

Then create the Persistent Event.

Step 04: Let's implement real-time visuals for the below scenario.

          

Question - Total number of tickets over the last 1 min for each car brand 

Step 4.1: Create the Execution Plan.

This the Query for the above question. Run the query and apply the execution plan.

Using Siddhi SQL we can input data to the input stream.

Step 4.2: Create Event Publisher.

Step 4.3: Connect the server to the My SQL Server.

 Home > Configure > Datasources

Step 4.4: Create relevant tables in the DB in MYSQL.

Step 4.5: Simulate the stream.

Step 4.6: Check the loaded data in the Data Explorer and also in the DB. 

Step 05: Connect the DB to the tableau into visualizing data.

Check this out for the final Dashboards of Real-Time  Analytics !!here