Nachrichtenübertragung

Multimedia Applications

The Communication Systems Group of the TU Berlin, led by Prof. Dr. Thomas Sikora, employed their results of multimedia analysis and processing in a couple of innovative multimedia applications and was involved in many national and international funded projects related to multimedia applications. The following list gives an overview of research areas we are involved in:

  • 2D-to-3D conversion of videos (automatic and interactive)
  • Geo-tagging in social networks
  • Genre detection in TV broadcast
  • Security in public transportation systems
  • Information exploitation of forensic data
  • Security at big events using drones
  • Privacy protection in video data
  • etc.

Research Activities

DeepStereoBrush: Interactive Depth Map Creation

In this paper, we introduce a novel interactive depth map creation approach for image sequences which uses depth scribbles as input at user-defined keyframes. These scribbled depth values are then propagated within these keyframes and across the entire sequence using a 3-dimensional geodesic distance transform (3D-GDT). In order to further improve the depth estimation of the intermediate frames, we make use of a con-volutional neural network (CNN) in an unconventional manner. Our process is based on online learning which allows us to specifically train a disposable network for each sequence individually using the user generated depth at keyframes along with corresponding RGB images as training pairs.

mehr

Privacy Preserving Technologies

The ever increasing number of surveillance camera networks being deployed all over the world has resulted in a high interest in the development of algorithms to automatically analyze the video footage, but has also opened new questions as how to efficiently manage the vast amount of information generated and, more important, how to protect the privacy of the individuals being recorded in their daily life. An technical approach are the Privacy Preserving Technologies (PET) which are algorithm to filter personal privacy related information and/or adapt the protection level of personal privacy in videos.

mehr

Multimodal Geo-tagging in Social Media Websites using Hierarchical Spatial Segmentation

These days the sharing of photographs and videos is very popular in social networks. Many of these social media web- sites such as Flickr, Facebook and Youtube allows the user to manually label their uploaded videos with geo-information using a interface for dragging them into the map. However, the manually labelling for a large set of social media is still borring and error-prone. For this reason we present a hierarchical, multi-modal approach for estimating the GPS information. Our approach makes use of external resources like gazetteers to extract toponyms in the metadata and of visual and textual features to identify similar content.

mehr

Awards

We were awarded the Lumiére Award 2018 for the Best Paper

We are delighted to announce that we were awarded the Lumiere Award for the Best Paper at the International Conference on 3D Immersion/Stereopsia in Brussels in Dec. 2018! On behalf of the Advanced Imaging Society based in Hollywood, CA, Stereopsia organizes the competitions for the “Lumiere Awards” for the territory consisting of Europe, the Middle East, and Africa (EMEA).

mehr

Runner Up Best Full Paper Award @ ICIDS 2018

We are delighted to announce that our paper "Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films" won the Runner Up Best Full Paper Award at the International Conference on Interactive Digital Storytelling, 05.12.2018 - 08.12.2018.

mehr

Scott Helt Memorial Award 2012

We are delighted to announce that Dr. Sebastian Knorr won the Scott Helt Memorial Award 2012 for the best journal paper published in the IEEE Transactions on Broadcasting in 2011. The title of the paper is "3D-TV Content Creation: Automatic 2D-to-3D Video Conversion". Congratulations to Dr. Knorr and the co-authors.

mehr

Related Publications

2019

2018

  • Sebastian Knorr, Cagri Ozcinar, Colm O Fearghail, Aljosa Smolic
    Director’s Cut - A Combined Dataset for Visual Attention Analysis in Cinematic VR Content
    The 15th ACM SIGGRAPH European Conference on Visual Media Production, London, UK, 13.12.2018 - 14.12.2018
    Details BibTeX
  • Kai-Ole Ide
    Hybrid 3D Reconstruction for Geometry-Based Free Viewpoint Video
    2018
    Details BibTeX
  • Colm O Fearghail, Cagri Ozcinar, Sebastian Knorr, Aljosa Smolic
    Director’s Cut - Analysis of Aspects of Interactive Storytelling for VR Films
    International Conference for Interactive Digital Storytelling, Dublin, Ireland, 05.12.2018 - 08.12.2018
    Received the runner up best full paper award
    Details BibTeX
  • Declan Dowling , Colm O Fearghail , Aljosa Smolic, Sebastian Knorr
    Faoladh : A Case Study in Cinematic VR Storytelling and Production
    International Conference for Interactive Digital Storytelling, Dublin, Ireland, 05.12.2018 - 08.12.2018
    Details BibTeX
  • Sebastian Knorr, Matis Hudong, Julian Cabrera, Thomas Sikora, Aljosa Smolic
    [Lumiere Award] DeepStereoBrush: Interactive Depth Map Creation
    International Conference on 3D Immersion, Brussels, Belgium, 05.12.2018 - 06.12.2018
    Received the Lumiere Award for the best scientific paper
    Details BibTeX
  • Colm O Fearghail, Cagri Ozcinar, Sebastian Knorr, Aljosa Smolic
    Director´s Cut - Analysis of VR Film Cuts for Interactive Storytelling
    International Conference on 3D Immersion, Brussels, Belgium, 05.12.2018 - 05.12.2018
    Details BibTeX
  • Siwei Lyu, Ming-Ching Chang, Dawei Du, Wenbo Li, Yi Wei, Marco Del Coco, Pierluigi Carcagnì, Arne Schumann, Bharti Munjal, Dinh-Quoc-Trung Dang, Doo-Hyun Choi, Erik Bochinski, Fabio Galasso, Filiz Bunyak, Guna Seetharaman,Jang-Woon Baek, Jong Taek Lee, Kannappan Palaniappan, Kil-Taek Lim, Kiyoung Moon, Kwang-Ju Kim, Lars Sommer, Meltem Brandlmaier, Min-Sung Kang, Moongu Jeon, Noor M. Al-Shakarji, Oliver Acatay, Pyong-Kun Kim, Sikandar Amin, Thomas Sikora, Tien Dinh, Tobias Senst, Vu-Gia-Hy Che, Young-Chul Lim, Young-min Song, and Yun-Su Chung
    UA-DETRAC 2018: Report of AVSS2018 & IWT4S Challenge on Advanced Traffic Monitoring
    IEEE International Conference on Advanced Video and Signals-based Surveillance, Auckland, New Zealand, 27.11.2018 - 30.11.2018
    ISBN: 978-1-5386-9294-3/18
    Details BibTeX
  • Markus Küchhold, Maik Simon, Volker Eiselein, Thomas Sikora
    Scale-Adaptive Real-Time Crowd Detection and Counting for Drone Images
    25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 07.10.2018 - 10.10.2018
    Details BibTeX
  • Pengfei Zhu, Longyin Wen, Dawei Du, Xiao Bian, Haibin Ling, Qinghua Hu, Hao Cheng, Chengfeng Liu, Xiaoyu Liu, Wenya Ma, Qinqin Nie, Haotian Wu, Lianjie Wang, Arne Schumann, Dan Wang, Diego Ortego, Elena Luna, Emmanouil Michail, Erik Bochinski, Feng Ni, Filiz Bunyak, Gege Zhang, Guna Seetharaman, Guorong Li, Hongyang Yu, Ioannis Kompatsiaris, Jianfei Zhao, Jie Gao, Jose Martinez, Juan Miguel, Kannappan Palaniappan, Konstantinos Avgerinakis, Lars Sommer, Martin Lauer, Mengkun Liu, Noor Al-Shakarji, Oliver Acatay, Panagiotis Giannakeris, Qijie Zhao, Qinghua Ma, Qingming Huang, Stefanos Vrochidis, Thomas Sikora, Tobias Senst, Wei Song, Wei Tian, Wenhua Zhang, Yanyun Zhao, Yidong Bai, Yinan Wu, Yongtao Wang, Yuxuan Li, Zhaoliang Pi, Zhiming Ma
    VisDrone-VDT2018: The Vision Meets Drone Video Detection and Tracking Challenge Results
    ECCV 2018 Workshops, volume Part V, Munich, Germany, 08.09.2018 - 14.09.2018, pp. 496-518
    Details BibTeX
  • Simone Croci, Mairead Grogan, Sebastian Knorr, Aljosa Smolic
    Colour Correction for Stereoscopic Omnidirectional Images
    Irish Machine Vision and Image Processing Conference, Belfast, North Ireland, 29.08.2018 - 31.08.2018
    ISBN: 978-0-9934207-3-3
    Details BibTeX

2017

2015

2014

2013

2012

  • Working Notes Proceedings of the MediaEval 2012 Workshop
    Martha A. Larson, Sebastian Schmiedeke, Pascal Kelm, Adam Rae, Vasileios Mezaris, Tomas Piatrik, Mohammad Soleymani, Florian Metze, Gareth J.F. Jones (ed(s).), CEUR-WS.org, 25.10.2012
    ISSN 1613-0073 URN: urn:nbn:de:0074-927-7
    Details BibTeX
  • Adam Rae, Pascal Kelm
    Working Notes for the Placing Task at MediaEval 2012
    Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 1-2
    ISSN 1613-0073
    Details BibTeX
  • Sebastian Schmiedeke, Christoph Kofler, Isabelle Ferrane
    Overview of the MediaEval 2012 Tagging Task
    Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 75-76
    ISSN 1613-0073
    Details BibTeX
  • Sebastian Schmiedeke, Pascal Kelm, Thomas Sikora
    TUB @ MediaEval 2012 Tagging Task: Feature Selection Methods for Bag-of-(visual)-Words Approaches
    Working Notes Proceedings of the MediaEval 2012 Workshop, volume 927, Santa Croce in Fossabanda Piazza Santa Croce, 5 - 56125 - Pisa - Toscana - Italia, 04.10.2012 - 05.10.2012, pp. 79-80
    ISSN 1613-0073
    Details BibTeX
  • Sebastian Knorr, Kai Ide, Matthias Kunter, and Thomas Sikora
    THE AVOIDANCE OF VISUAL DISCOMFORT AND BASIC RULES FOR PRODUCING “GOOD 3D” PICTURES
    SMPTE Motion Imaging Journal, Society of Motion Picture & Television Engineers, October 2012, pp. 72-79
    Details BibTeX
  • Pascal Kelm
    Where in the World?: The State of Automatic Geotagging of Video (invited lecture)
    DGA workshop, École nationale supérieure des techniques avancées (ENSTA), 32 bd Victor, Paris 15`eme, 25.06.2012
    The DGA workshop on multimedia information processing aims at presenting the technological state of the art together with the organization underlying progress in the domain. It also aims at fostering exchanges between government, industry and academic personnel interested in the domain.
    Details BibTeX

2011

2010

2008

  • Juan José Burred, Martin Haller, Shan Jin, Amjad Samour, Thomas Sikora
    Audio Content Analysis
    in Semantic Multimedia and Ontologies: Theory and Applications, Yiannis Kompatsiaris, Paola Hobson (ed(s).), Springer Verl., London, UK, January 2008, pp. 123-161
    ISBN 978-1-84800-075-9
    Details BibTeX

2007

2005