Improving the Analytical Workflow …. with Dataflow!
What is the analytical workflow? This is the process in which analysts mine, filter, pivot, and exploit data to try and find anomalies and ways to improve business processes. The workflow typically starts with a problem in a business process, and a hypothesis on why the problem is occurring. For example, in the airline industry, a problem may be a delay in take-off times; and a hypothesized reason for this is because of a recent change in airline boarding practices. There are several steps that need to occur to try and identify the root cause, and typically it is not a lock-step process; rather, it involves multiple iterations. Some of the steps in this iterative process include: identification, preparation, development, deployment, execution, and adjustment.
Here we’ll go through this use case, and identify how dataflow, and in particular, Composable Analytics, can improve the efficiency by reducing the latency between and within the steps for the analyst.