Network of the Future Technology DeepdiveExplore the Tech


Why Consensual AI Improves Problem Solving

Bernardo Huberman
Fellow and Vice President of Core Innovation

Feb 22, 2019

A version of this blog post was published on February 21, 2019, on the S&P Global Market Intelligence site. 

We are surrounded by embedded sensors and devices with more processing power than many of the computers standing on our desks. Machine learning modules inside phones, home control systems, thermostats, and the ubiquitous voice operated gadgets, constitute a whole technological species that now coexist with us through the same Internet environment we populate with our own communication devices. These are the simple components of what it is commonly called the “Internet of Things” (IoT).

The real revolution is taking place in a different, less visible setting, an industrial one, that ranges from manufacturing and refineries to health care. Within these very large systems and organizations, myriads of embedded smart sensors are connected through shared API’s, leading to a new form of networked computing power that will likely dwarf what we conceive of as the present-day Internet.

The Challenges of Embedded Systems

This vast industrial array of connected sensors has many characteristics that make it different from the consumer smart devices with which most people are familiar. First, the pervasiveness and interconnectivity of these sensors, coupled with the unpredictability of their inputs, make their response times autonomous from human intervention. For instance, a fitness tracker running out of power does not necessitate an urgent response. In comparison, the failure or delayed emergency signal from a smart sensor controlling several refinery valves can trigger an undesirable chain reaction from other sensors and actuators leading to consequential systemic failures.

Second, these smart sensors constitute an open and asynchronous distributed system which cannot predict the behavior of the environment in which it is embedded. This system is also decentralized since it would be hard for a central unit to receive and transmit up-to-date information on the state of the whole system.

Third, the distributed nature of this industrial internet of things makes it open to a host of security threats, since a single break into a component of the distributed fabric can compromise the entire system.

While it is easy to create machine learning algorithms that report on the behavior of parts of the system, it is hard for these programs to be able to reason and act swiftly in response to inputs and malfunctions of a large, interconnected embedded system. A notable improvement can be achieved by using Edge Computing, which entails sensing and processing the information from embedded systems in close spatial proximity to them.

Far more complicated is the aggregation of such local information at a coarser level, so that one can obtain global and timely information and take corrective action when needed. The reason why this is difficult is that sensors differ in the precision and sophistication with which they sense and process data, while at times reporting faulty readings.

Consensual AI Solutions

One way to remedy these problems is to design distributed algorithms that can cooperate in the overall task of diagnosing and acting on systems of embedded sensors. Examples include the sensing of local anomalies that are aggregated intelligently in order to decide on a given action, the collective detection of malware in parts of the network, and effective responses to predetermined traffic and content patterns, to name a few.

We know that such distributed systems are extremely effective at solving the global problems posed by interconnected local units because this is the manner in which humans successfully manage large distributed tasks. Organizations are created at a dizzying speed to deal with problems of control and distribution in a number of industries and services, and they function by interweaving local expertise that is able to detect and solve problems that require timely solutions, from network malfunctions to supply chain interruptions.

This distributed form of artificial intelligence is not an illusory goal. A few such systems have already been designed and tested and have shown dramatic improvements in the times needed to solve hard problems such as optimization and graph coloring. These problems are characterized by the fact that as their size increases linearly, the time to finding a solution rises exponentially. A common example is the traveling salesman problem, which can be seen as a metaphor for the laying of networks in a manner that minimizes the number of traversals needed to cover multiple cities and users. As more nodes are added to such a network, the number of possible solutions increases exponentially, leading to the impossibility of finding the node that minimizes the connections in finite times.

The beauty of cooperative systems is that once deployed, they can exhibit combinatorial implosions. These implosions are characterized by a sudden collapse in the number of possible avenues to a solution due to the effectiveness of cooperation. As a result, problems that took an enormous amount of time to solve are now rendered in linear or polynomial time. These implosions occur when both the quality and the number of messages exchanged by these agents or programs increases while working on the solution of complex problems.

In the context of these networked embedded sensors, consensual systems have the ability to aggregate disparate, and at times, incorrect information to quickly and reasonably diagnose problems. These types of cooperative systems will allow for the control of these large embedded systems without having to resort to an exhaustive analysis of all the data that floods the network. Even better, one hopes that as algorithmic forms of common-sense reasoning (e.g. haven’t I seen this problem before?) are developed in the future we will then reach the dream of fully embedded sensors being able to control their systems in a form that one would call intelligent.

Want to learn more about AI in the future? Subscribe to our blog.