At http://www.popsci.com/technology/article/2012-06/our-web-videos-reveal-more-we-realize-and-perhaps-more-we-want

Our Web Videos Reveal More Than We Realize, and Perhaps More Than We Want

By Jacob Ward Posted 06.29.2012 at 10:04 am

As we upload more and more videos to the Internet—one hour of new video every second to YouTube alone—experts are finding new ways to mine them. A team led by Igor Curcio of Nokia's Research Center, for example, has developed an algorithm that stitches concertgoers' cellphone footage into a single, synchronized multi-angle film. The concept is relatively simple: the audio track serves as a guide to sync up the footage, and the software chooses the best shots. Curcio has no real business model yet—photography is prohibited at most concerts—but giving people the ability to identify and coherently connect common elements in multiple videos is nonetheless a step toward something significant.

For instance, the drones that patrol the U.S.-Mexican border and the security cameras in cities already record more footage than human observers can possibly examine. If an agency could rely on a computer to track individuals, groups and events on its own, agents could use intelligence far more—well, intelligibly.

That new capability will drive the demand for even more raw data. The Intelligence Advanced Research Projects Activity (IARPA) agency, overseen by the U.S. director of national intelligence, has launched two projects that may help analysts use civilian video from YouTube, Vimeo and other sources. Investigators at the Finder program are studying ways to locate where and when a video was taken based solely on the image itself. That's hard enough. But researchers at IARPA's Aladdin are working on an even more challenging task: how to search for "specific events of interest." If they succeed, analysts could feed in a name, a simple text description or a few sample videos of what they seek—say, "five people wearing backpacks next to a pickup truck"—and get back any number of clips that match the query.

Beyond categories lies the greater hurdle of finding not just an event or a group of objects but a single object: a missing child, a misplaced purse, a suicide bomber in a... (more at http://www.popsci.com/technology/article/2012-06/our-web-videos-reveal-more-we-realize-and-perhaps-more-we-want )