How to maximize the value of Big Data with the open source SpagoBI suite through a comprehensive approach Monica Franceschini - SpagoBI Architect SpagoBI Competency Center - Engineering Group Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con COMPREHENSIVE APPROACH vis u a liz a tio n for BIG DATA in fo rm a tio n b u ild in g Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con DATASET Independent object to collect data from different sources, used by visualization tools. schedulation d a ta s e t visualization Follows SpagoBI behavioural model database in-memory Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con DATA SOURCES SpagoBI data sources are defined as connections towards different databases both from the Hadoop ecosystem and NoSql db visualization d a ta s e t SQL-like queries : HiveQL ● HBQL ● CQL ● Cypher... ● Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con IN-MOTION DATA Continuously running data can be processed by stream processors or CEPs and collected by SpagoBI dataset visualization d a ta s e t Dataset as an Event Handler notified by SpagoBI Adapter of newly available data + Stream processors/CEPs SpagoBI Adapter Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con SEMANTIC DATA Classify and categorize unstructured and heterogeneous data through semantic annotations, using domain ontologies. visualization d a ta s e t Semantic information can be stored in NoSql Graph databases and extracted by SpagoBI dataset Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con INFORMATION BUILDING Cooperation of visualization tools and free enquiry engine to produce information visualization d a ta s e t Ad hoc reporting FILE QbE Self Service DATA SOURCES DATASET Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con AGILE DEVELOPMENT Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con SELF SERVICE QbE engine allows to create new datasets and refine analysis in a graphical way FILE DATA SOURCES DATASET Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con AD HOC REPORTING Worksheet engine provides an instant graphical meaning to datasets DATASET Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con DASHBOARDS Cockpit engine allows aggregating different documents, interacting one with each other, to get information at a glance Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con JUST A USE CASE Open Data + Big Data = Value VALUE for BIG DATA BIG DATA Te le c o m m u n ic a tio n c o m p a n ie s : need to extract value from mobile data traffic information to improve services and advance new solutions OPEN DATA Pu b lic a d m in is tra tio n : need to extract value from information gathered from different sources (consumption, highway traffic, voice traffic) in order to improve the supply of tourist, environmental, social services Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con INFORMATION CYCLE SpagoBI tools cooperating together produce NEW VALUE from information Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con WHAT NEXT? Data mining Text mining Sentiment analysis Predictive analysis ... Ex tra c t va lu e fro m in fo rm a tio n d a ta s e t Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con Find out all information (demo, documentation, tutorials, services and much more) and download all SpagoBI components at: w w w.s p a g o b i.o rg Contact us s p a g o b i@e n g .it @tw ittm o n iq u e – m o n ic a .fra n c e s c h in i@e n g .it Copyright (C) 2013 - Engineering Group, SpagoBI Competency Center www.ow2.org Twitter #ow2con