An unbiased approach for sifting through big data

Research Press Release | February 03, 2018

A new method could help researchers develop unbiased indicators for assessing complex systems such as population health.


A video summarizing the new method to identify unbiased indicators from big data and its possible applications. (Servadio J.L. and Convertino M, Science Advances, February 2, 2018)


Researchers have developed a complex system model to evaluate the health of populations in some U.S. cities based only on the most significant variables expressed in available data. Their unbiased network-based probabilistic approach to mine big data could be used to assess other complex systems, such as ranking universities or evaluating ocean sustainability.


Societies today are data-rich, which can both empower and overwhelm. Sifting through this data to determine which variables to use for the assessment of something like the health of a city’s population is challenging. Researchers often choose these variables based on their personal experience. They might decide that adult obesity rates, mortality rates, and life expectancy are important variables for calculating a generalized metric of the residents’ overall health. But are these the best variables to use? Are there other more important ones to consider?


Matteo Convertino of Hokkaido University in Japan and Joseph Servadio of the University of Minnesota in the U.S. have introduced a novel probabilistic method that allows the visualization of the relationships between variables in big data for complex systems. The approach is based on “maximum transfer entropy”, which probabilistically measures the strength of relationships between multiple variables over time.


Using this method, Convertino and Servadio mined through a large amount of health data in the U.S. to build a “maximum entropy network” (MENet): a model composed of nodes representing health-related variables, and lines connecting the variables. The lines are darker the stronger the interdependence between two variables. This allowed the researchers to build an “Optimal Information Network” (OIN) by choosing the variables that had the most practical relevance for assessing the health status of populations in 26 U.S. cities from 2011 to 2014. By combining the data from each selected variable, the researchers were able to compute an “integrated health value” for each city. The higher the number, the less healthy a city’s population.



The maximum entropy network (MENet) of all variables of health data analysed. Nodes and lines represent the health-related variables and the strength of interdependence between two variables respectively. MENet helps build the Optimal Information Network (OIN) which indicates the most useful information to accurately characterize systemic health. (Servadio J.L. and Convertino M, Science Advances, February 2, 2018)


They found that some cities, such as Detroit, had poor overall health during that timeframe. Others, such as San Francisco, had low values, indicating more favorable health outcomes. Some cities showed high variability over the four year period, such as Philadelphia. Cross-sectional comparisons showed tendencies for California cities to score better than other parts of the country. Also, Midwestern cities, including Denver, Minneapolis, and Chicago, appeared to perform poorly compared to other regions, contrary to national city rankings.

Convertino believes that methods like this, fed by large data sets and analysed via automated stochastic computer models, could be used to optimize research and practice; for example for guiding optimal decisions about health. “These tools can be used by any country, at any administrative level, to process data in real-time and help personalize medical efforts,” says Convertino.


But it is not just for health — “The model can be applied to any complex system to determine their Optimal Information Network, in fields from ecology and biology to finance and technology. Untangling their complexities and developing unbiased systemic indicators can help improve decision-making processes,” Convertino added.



Original paper:

Joseph L. Servadio and Matteo Convertino, Optimal information networks: Application for data-driven integrated health in populations. Science Advances, February 2, 2018.

DOI: 10.1126/sciadv.1701088

 

Funding Information:

This study was supported by the NSF SRN project (no. 1444745, “SRN: Integrated Urban Infrastructure Solutions for Environmentally Sustainable, Healthy, and Livable Cities”) , the MNDrive program at the University of Minnesota, and the Global Institution for Collaborative Research and Education Initiative on Big-Data and Cybersecurity at Hokkaido University.

 

Contacts:

Associate Professor Matteo Convertino

Graduate School of Information Science and Technology
Gi-CoRE Station for Big Data & Cybersecurity

Hokkaido University

E-mail: matteo[at]ist.hokudai.ac.jp


Naoki Namba (Media Officer)

Global Relations Office

Institute for International Collaboration

Hokkaido University

Tel: +81-11-706-2185

Email: pr[at]oia.hokudai.ac.jp


BACK TO TOP