Scientists Develop Computer Program Looks Five Minutes Into the Future

Sunday, June 17, 2018 - 17:01

Computer scientists from the University of Bonn have developed software that can look a few minutes into the future.

Scientists could develop software which first learns the typical sequence of actions, such as cooking, from video sequences. Based on this knowledge, it can then accurately predict in new situations what the chef will do at which point in time, Science Daily reports.

Researchers will present their findings at the world's largest Conference on Computer Vision and Pattern Recognition, which will be held June 19-21 in Salt Lake City, USA.

The training data used by the scientists included 40 videos in which performers prepare different salads. Each of the recordings was around 6 minutes long and contained an average of 20 different actions. The videos also contained precise details of what time the action started and how long it took.

The computer "watched" these salad videos totaling around four hours. This way, the algorithm learned which actions typically follow each other during this task and how long they last. This is by no means trivial: After all, every chef has his own approach. Additionally, the sequence may vary depending on the recipe.

"Then we tested how successful the learning process was," explains Prof. Dr. Jürgen Gall. "For this we confronted the software with videos that it had not seen before." At least the new short films fit into the context: They also showed the preparation of a salad. For the test, the computer was told what is shown in the first 20 or 30 percent of one of the new videos. On this basis it then had to predict what would happen during the rest of the film.

That worked amazingly well. Gall: "Accuracy was over 40 percent for short forecast periods, but then dropped the more the algorithm had to look into the future." For activities that were more than three minutes in the future, the computer was still right in 15 percent of cases. However, the prognosis was only considered correct if both the activity and its timing were correctly predicted.

Gall and his colleagues want the study to be understood only as a first step into the new field of activity prediction. Especially since the algorithm performs noticeably worse if it has to recognize on its own what happens in the first part of the video, instead of being told. Because this analysis is never 100 percent correct -- Gall speaks of "noisy" data. "Our process does work with it," he says. "But unfortunately nowhere near as well."

Related News

AUT to Host Iran FIRA RoboWorldCup Open 2019

1397/7/15 10:23

AI Might Be Able to Predict Earthquake Aftershocks

1397/6/10 10:46

Scientists Identify Acute Neurological Illnesses Using AI

1397/5/23 14:23

Researchers Devise a New Machine Learning Model to Isolate the Effects of Age in Predicting Dementia

1397/5/8 11:43

Scientists Develop Machine-Learning Model Perceives Human Emotions

1397/5/3 10:40

Scientists Develop AI System to Predict IQ From Brain Scans

1397/4/9 15:02

Scientists Use AI to Identify, Count, Describe Wild Animals

1397/3/19 10:05

China's Museums to Apply AI to Support the Country's Culture and History

1397/2/23 14:56

Google Lets You Talk To Books With Its New AI Tool

1397/1/28 10:49

Microsoft Offers AI Training Courses to the Public

1397/1/15 11:26

Startup to Apply AI to Improve Workplace Communication

1396/12/16 14:25

AI Helps Detect Earthquakes 17 Times More Earthquakes Than Traditional Methods

1396/11/29 13:20

AI Could Be “Billions of Times Smarter” Than Humans, Futurist Says

1396/11/28 10:14

Mashhad IAU Hosts ICTCK 2018

1396/11/4 13:29

Toyota Reveals 'Roaming Shops' Concept

1396/10/19 16:42

Beijing to Build a Giant $2.1 Billion Research Park

1396/10/16 09:59

AI Can Detect Deception in the Courtroom

1396/10/2 12:46

Smart Seatbelt, Results of Bardsir IAU Students Joint Project

1396/7/2 15:11

MIT Researchers More Accurately Study Sleep

1396/6/12 13:56

Teaching AI to Behave Like Humans

1396/5/23 02:51

Researchers Develop AI ‘Nose’

1396/5/21 12:23

Scientists Develop Curious Robots

1396/3/13 23:09

Virtual Assistant to Coach Customers on Saving and Spending

1395/8/9 12:32

IAU Shines in FIRACup Open Competition 2015

1394/9/2 12:15

Amirkabir University of Technology Holds International Contests

1394/8/26 14:36

Opinions


Popular News

Latest News