ITEE Distinguished Lecture Series in Data Science: Towards High-Quality Big Data for Responsible Data Science

Event Details

Date:

Monday, 10 February 2020

Time:

2:00 pm - 3:30 pm

Room:

GHD Auditorium

Location:

Advanced Engineering Building (49)

URL:

Event category(s):

Full Description:: Data are being generated, collected and analyzed today at an unprecedented scale, and data-driven decision making is sweeping through all aspects of society. As the use of big data has grown, so too have concerns that poor quality data, prevalent in large data sets, can have serious adverse consequences on data-driven decision making. Responsible data science thus requires a recognition of the importance of veracity, the fourth “V” of big data. In this talk, we present a vision of high-quality big data and highlight the substantial challenges that the first three “V”s, volume, velocity and variety, bring to dealing with veracity in big data. Due to the volume and velocity of data, one needs to understand and possibly repair poor quality data in a scalable and timely manner. With the variety of data, often from a diversity of sources, data quality rules cannot be specified a priori; one needs to let the “data to speak for itself.” We conclude with some recent results relevant to big data quality that are cause for optimism.