Is time moving forward or backward Computers learn to spot the difference

To find out, she and her collaborators broke down 180 YouTube videos into square patches of a few hundred pixels, which they further divided into four-by-four grids. Combining standard techniques for discovering objects in still photographs with motion detection algorithms, the researchers identified 4000 typical patterns of motion, or “flow words,” across a grid’s 16 cells. The gentle downward drifting of snowflakes, for example, would be one flow word. From those patterns, the team created flow word descriptions of each video along with three other versions—a time-reversed version, a mirror-image version, and a mirror-image and time-reversed version. Then, they made a computer program watch 120 of these clips, training it to identify which flow words best revealed whether a video ran forward or backward.When they tested their program on the remaining 60 videos, the trained computers could correctly determine whether a video ran forward or backward 80% of the time, the team reported this week at the IEEE Computer Society Conference on Computer Vision and Pattern Recognition in Columbus, Ohio. A closer analysis found that flow words associated with divergence (water splashing outward as someone dives into a pool) or dissipation (a steam train’s exhaust spreading out in air) were especially good indicators of the direction in which time was moving.In principle, the work could provide clues about how humans, as well as computers, perceive time passing, Pickup says, and reverse-time videos could play a role akin to the optical illusions and reverse-color photographs psychologists have used to study visual perception in the past. Seeing time running backward is “really captivating,” and continuing the research might help her team figure out why, she says.Shai Avidan, an associate professor of engineering at Tel Aviv University in Israel who wasn’t involved with the work, says that the team is the first to ask, “Can we analyze and understand” what attributes distinguish backward from forward video? It’s an intriguing if largely academic question. Still, practical applications may be possible. Avidan compares the flow words approach to earlier work on identifying different kinds of texture in still images. Though studying image textures was considered “superficial” 15 years ago, he says, the tools developed to do so have since proved essential for engineers working on how to reduce noise in low-light digital photographs and other images. By identifying the subtle features that indicate time’s arrow and separating those from noise, flow words could play a similar role for improving otherwise fuzzy low-light video, Avidan ventures.Regardless of any possible applications, “we just thought it was a great problem,” says Pickup’s co-author and computer scientist William Freeman of the Massachusetts Institute of Technology in Cambridge. Pickup agrees: Teaching computers to see the arrow of time combines computer science, physics, and human perception to get at the heart of the question, “How do we understand the visual world?” Click to view the privacy policy. Required fields are indicated by an asterisk (*) Play the video above, and it won’t take you long to notice there’s something off about it. Rather than drifting down toward the forest below, the snow is falling …up? Then it hits you: The video is running backward. Now, a computer watching the movie could arrive at that same realization. For the first time, scientists have taught computers to figure out the direction of time in videos, a result that could help researchers better understand our own perception of time.Computer vision—a field focused on how computers could learn to detect objects, motion, or even human emotions and intentions in photographs and video—has long fascinated computer scientists, with applications ranging from more realistic-looking video games to video surveillance and intelligence. At the same time, computer vision has attracted the interest of psychologists, who hope to use it to study how people turn raw visual data into an understanding of the world around them.The latter question led Lyndsey Pickup, now a human and computer vision researcher at Mirada Medical in Oxford, U.K., to wonder how we tell the difference between time running forward and backward in movies. After all, we only ever observe time running forward in the real world—a concept called time’s arrow. How do we pick up on it when a movie has put time arrow’s in reverse? And might she be able to teach computers to make the same observation? Sign up for our daily newsletter Get more great content like this delivered right to you! Country Email Country * Afghanistan Aland Islands Albania Algeria Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint Eustatius and Saba Bosnia and Herzegovina Botswana Bouvet Island Brazil British Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Cayman Islands Central African Republic Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Congo Congo, the Democratic Republic of the Cook Islands Costa Rica Cote d’Ivoire Croatia Cuba Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Falkland Islands (Malvinas) Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guatemala Guernsey Guinea Guinea-Bissau Guyana Haiti Heard Island and McDonald Islands Holy See (Vatican City State) Honduras Hungary Iceland India Indonesia Iran, Islamic Republic of Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Korea, Democratic People’s Republic of Korea, Republic of Kuwait Kyrgyzstan Lao People’s Democratic Republic Latvia Lebanon Lesotho Liberia Libyan Arab Jamahiriya Liechtenstein Lithuania Luxembourg Macao Macedonia, the former Yugoslav Republic of Madagascar Malawi Malaysia Maldives Mali Malta Martinique Mauritania Mauritius Mayotte Mexico Moldova, Republic of Monaco Mongolia Montenegro Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Nicaragua Niger Nigeria Niue Norfolk Island Norway Oman Pakistan Palestine Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Qatar Reunion Romania Russian Federation Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin (French part) Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Serbia Seychelles Sierra Leone Singapore Sint Maarten (Dutch part) Slovakia Slovenia Solomon Islands Somalia South Africa South Georgia and the South Sandwich Islands South Sudan Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syrian Arab Republic Taiwan Tajikistan Tanzania, United Republic of Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates United Kingdom United States Uruguay Uzbekistan Vanuatu Venezuela, Bolivarian Republic of Vietnam Virgin Islands, British Wallis and Futuna Western Sahara Yemen Zambia Zimbabwe

Leave a Reply

Your email address will not be published. Required fields are marked *