Raginsky receives CAREER Award to apply information theory to machine learning problems

Maxim Raginsky, an assistant professor of electrical and computer engineering, has received a CAREER Award from the National Science Foundation to develop an information-theoretic approach to machine learning problems that involve multiple resource-constrained learning agents in a large network.

Traditionally, communications researchers have been concerned about delivering information reliably from point A to point B, such as a Netflix user who wants movie content to stream smoothly to his screen. However, technology users these days not only want information to be delivered, but also analyzed and interpreted. Traditional compression algorithms exploit redundancy in the signal, but are oblivious to the goals of many different types of users that may rely on the network. 

“The overall design objective is to make sure that the network resources are allocated in a smart way, and each user receives only the data they need without significant waste of bandwidth or power,”  said Raginsky, who is also a researcher and a member of the Decision and Control group at the Coordinated Science Laboratory. 

Raginsky uses ecological monitoring as an example. If someone is tracking a rare bird species in a specific habitat and wants to record how many of these birds fly in and out of the area, it would be a waste of resources to continuously stream video if what the person really wants is just the arrivals and departures of the birds. A big part of the problem is learning to detect events of interest and to reliably communicate only the data describing these events.

“So I want to make sure that only the relevant information gets to those who need it, despite the fact that everyone is using the same network and the kinds of information that are relevant to one user are different than the kinds of information that are relevant to somebody else,” Raginsky said.

These problems are messy and complex, and there is no hope to come up with an accurate model for all kinds of data being transmitted and received over networks because of the increasing size and complexity of both the networks and the data, Raginsky said. Machine learning offers a variety of tools for extracting predictively relevant information from observations, but to date most of the research on machine learning has not focused on the network aspect and all the resource constraints that it imposes.

This project will systematically explore what is and is not possible in these types of large networks with multiple learning agents, specifically identifying the effect of bandwidth limitations, losses, delays and lack of central coordination on the performance of statistical learning algorithms, thus helping develop efficient and robust coding/decoding schemes.

The CAREER Award is awarded by the National Science Foundation specifically to “junior faculty members who demonstrate their roles through outstanding research and education,” according to NSF’s website.

Raginsky said that because these awards are for 5-year projects, the proposals take a lot of time and effort.

“You propose to research something you’re really passionate about, and presumably you want to work on this topic even if it did not get funded,” he said. “So, when I heard about my proposal being recommended for funding, of course it was a relief. I will have a good time working on this problem.”
________________________

Contact:  Maxim Raginsky, Department of Electrical and Computer Engineering, 217/244-1782.

Writer: Elise King, CSL Communications

If you have any questions about the College of Engineering, or other story ideas, contact Rick Kubetz, editor, Engineering Communications Office, University of Illinois at Urbana-Champaign, 217/244-7716.