Real-Time Visualization of Streaming Big Data (VisBig)

Type: National Project

Duration: from 2018 Oct 01 to 2021 Sep 30

Financed by: FCT

Prime Contractor: INESC-ID (Other)

Big Data, and especially Streaming Big Data (SBD) is often analysed by automated processes, not amenable to real-time decisions by human analysis. There, timely decision making must involve the quick and easy understanding of the data. Making that possible is the purview of Visual Analytics, but existing solutions are tailored for mostly static (comparatively) small datasets and will not scale well for SBD. We will fill that gap by researching solutions that separate the wheat from the chaff and highlight real-time relevant changes in the data streams. We will develop novel visualization techniques capable of displaying important features in SBD. These will be supported by machine-learning for the identification of relevant changes in the streams, to be highlighted in the visualizations. Underlying it we will study how best to cope with SBD in terms of collection, filtering and (where necessary) storage, in ways that make the other components feasible.

Partnerships

  • Hitachi Vantara Portugal (Company) -Portugal
  • INESC-ID (Other)
  • IST-ID (University) -Portugal

Principal Investigators

Members