Project Ambient Multimedia Databases in cooperation with project Semantic Multimedia Access
StreetTivo
What if you recorded a television program with your personal video recorder and want to watch it again. Maybe because your daughter is asking for a specific installment of her favorite children’s program. But you’ve recorded 200 episodes. That’s quite a search! With StreetTivo, every episode can be searched right after the broadcast, every fragment can be localized with your self-selected keywords. You don’t even need to know the title! StreetTivo is the Golden Demo of the MultimediaN projects Ambient Multimedia Databases and Semantic Multimedia Access.
StreetTivo shows how to index multimedia collections in a peer to peer (P2P) network of personal hard disk video recorders with an internet connection (specifically: Microsoft’s Windows Media Centre). This way a virtual street emerges with virtual neighbours who can help you analyze television images recorded collectively. In turn you can help your virtual neighbours in search for their favourites.
Innovation
Multimedia analysis generally takes up a lot of computer time. Even modern pc’s often have difficulties analyzing recorded television programs for search within twenty-four hours. StreetTivo shows how resources can be divided over several computers (P2P).
Technology
StreetTivo offers an infrastructure that brings techniques - developed by MultimediaN - to the home of the consumer. Using a database system is a piece of cake for developers. But creating robust P2P software is complex. The idea behind P2P database systems is to simplify the creation of P2P software, because the system takes over all sorts of tasks from the creators. StreetTivo is an example of this. The system has been developed within MultimediaN and is available in open source (monetdb.cwi.nl/xquery).
StreetTivo's search function now works on base of speech-recognition of the audio signal. In the future StreetTivo will offer even more, by using, amongst others, the innovative imaging analyzing techniques that are being developed within the MultimediaN-project Learning Features.
Application areas
StreetTivo is targeted at consumers owning a media center. They will obtain more possibilities to search popular broadcasts quickly and effectively. Crossmedia applications will be growing on trees with StreetTivo. In cooperation with publishers of traditional non-audiovisual media (print media), television material could be linked to online text information. So StreetTivo could turn a television watcher into a digital newspaper reader.
Watch The StreetTivo Golden Video
Partners
The Emotional Analyzer (N1)
Video Search Engine (N1)
Affective Mirror (N2)
Excercise in Immersion 4 (N2)
StreetTivo (N3 and N5)
The Investigator's Dashboard (N6)
The Surveillance Dashboard (N6)
On The Move (N6 and N9MI)
Concert Video Browser (N7 and N9MI)
Cultural Search Engine (N9C)