Project Video At Your Fingertips, in cooperation with PERSonal Information Services
Concert Video Browser
no longer lost in music
Crazy about music and concerts, but only looking for the highlights? Fabchannel offers the solution. Fabchannel makes concerts - recorded in Melkweg or Paradiso, Amsterdam - available online to a worldwide audience. By using the Concert Video Browser (Fabplayer), the music lover finds exactly what he is looking for in a few mouse clicks. This could be a screaming guitar solo, a specific song, or the moments that the physically attending audience is going through the roof. It’s like being there yourself.
To show how technological advanced the Fabplayer is, Fabchannel, the Telematica Institute, and the TU Delft have developed a Golden Demo that demonstrates all steps in the chain, from production till use. The demo shows the process of recording and annotation of the concert videos to prepare for your interactive experience using the Fabplayer.
Innovation
The Concert Video Browser was developed by Fabchannel, based on concepts and research results of the Telematica Institute. It offers a unique video environment that supports patch-based video browsing. A user can quickly select and watch just the video segments of interest to him. The necessary analysis, annotation, and indexing of the video fragments is done automatically by using analysis-algorithms, developed by TU Delft. Because these algorithms are robust, they are able to find the most important segments (highlights, solos, applause), even during the sometimes unstructured chaos of a pop concert. On top of that, the algorithms are generic enough to analyze any type of concert or instrument.
Technology
The actual annotation takes place in a Media Post Processor. This post production processor is an automated system for processing media files. Its main purpose is to run media files through one or more feature extraction tools in a batch process. So there is no user interaction, the Media Post Processor will do all the work. This happens on the basis of previously researched user preferences and by dividing the video fragments with the help of video segmentation algorithms.
Toepassingen
The techniques developed are broadly applicable. Beside the Concert Video Browser of Fabchannel, MultimediaN developed the website WKgemist.nl for soccer lovers. Here, soccer fans can find high- (and low-)lights of the 2006 World Cup in Germany in no time. The labeling of user preferences is demonstrated by a Personal TV Guide that continuously learns the favorite television shows of a specific person. This way it becomes easier to choose from the large (not so well ordered) broadcasting offerings.
But also sportsmen and, for example, physiotherapists can benefit from (parts of) the technology developed, as shown in the Golden Video On The Move. Another potential application is using smart cameras for ‘people monitoring’. This is not only useful for the surveillance sector, but also in the commercial sector, where monitoring consumer behavior in shopping malls generates interesting marketing information.
Partners
The Emotional Analyzer (N1)
Video Search Engine (N1)
Affective Mirror (N2)
Excercise in Immersion 4 (N2)
StreetTivo (N3 and N5)
The Investigator's Dashboard (N6)
The Surveillance Dashboard (N6)
On The Move (N6 and N9MI)
Concert Video Browser (N7 and N9MI)
Cultural Search Engine (N9C)