Dr. Damian Borth Director of Deep Learning Competence Center
Head of Multimedia Analysis & Data Mining

Deep Learning Competence Center
Multimedia Analysis & Data Mining (MADM)
German Research Center for Artificial Intelligence (DFKI)

In 2014-2015, I had the pleasure to do my post-doc with: Dr. Gerlald Friedland (Int. Computer Science Institute) and Prof. Trevor Darrell (UC Berkeley). In 2012, I was also a visting scholar with Prof. Prof. Shih-Fu Chang (Columbia University).

In the past, our work has also been awarded with the ICMR 2012 Best Paper Award, the McKinsey Business Technology Award, and a Google Research Award (Adrian Ulges)



Trippstaedter Str. 122
67663 Kaiserslautern
Germany

phone: +49 (631) 20575-4184
email: damian.borth [at] dfki.de
Research Projects

There has been a CVPR 2014 tutorial about
VSO and SentiBank by Shih-Fu Chang
Professional Activities I also serve at the following boards or in the following roles:

Publications 2016
  1. AudioSentibank: Large-scale Semantic Ontology of Acoustic Concepts for Audio Content Analysis
    Sebastian Sager, Damian Borth, Benjamin Elizalde, Christian Schulze, Bhiksha Raj, Ian Lane, Andreas Dengel
    arXiv preprint arXiv:1607.03766, 2016
    [paper]
  2. Multimedia COMMONS Workshop 2016 (MMCommons’16) - Datasets, Evaluation, and Reproducibility
    Bart Thomee, Damian Borth, Julia Bernd
    ACM Multimedia Workshops, 2016
    [website]
  3. Generating Captions with Emotions using Concept and Syntax Transition Networks
    Philipp Blandfort, Tushar Karayil, Damian Borth, Andreas Dengel
    ACM Multimedia, Grand Challenge, 2016 (accepted)
    [challenge website]
  4. Contextual Enrichment of Remote-Sensed Events with Social Media Streams
    Benjamin Bischke, Damian Borth, Christian Schulze, Andreas Dengel
    ACM Multimedia, Grand Challenge, 2016 (accepted)
    [website]
  5. Which languages do people speak on Flickr? A Language and Geo-Location Study of the YFCC100m Dataset
    Alireza Koochali, Sebastian Kalkowski, Damian Borth, Christan Schulze, Andreas Dengel
    ACM Multimeda Community-Organized Multimodal Mining: Opportunities for Novel Solutions (MMCOMMONS) Workshop, 2016 (accepted)
    [YFCC100m Browser]
  6. Introducing Concept And Syntax Transition Networks for Image Captioning
    Philipp Blandfort, Tushar Karayil, Damian Borth, Andreas Dengel
    ACM Int. Conf. on Multimedia Retrieval (ICMR), 2016
  7. A Tesseract-based OCR Framework for Historical Document lacking Ground-truth Text
    Brennan Nunamaker, Syed Saqib Bukhari, Damian Borth, Andreas Dengel
    IEEE Int. Conf. in Image Processing (ICIP), 2016
  8. An Evolutionary Algorithm to Learn SPARQL Queries: Finding Patterns for Human Associations in DBpedia
    Jörn Hees, Rouven Bauer, Joachim Folz, Damian Borth, Andreas Dengel
    arXiv preprint arXiv:1607.07249, 2016
    [paper]
  9. Edinburgh Associative Thesaurus as RDF and DBpedia Mapping
    Jörn Hees, Rouven Bauer, Joachim Folz, Damian Borth and Andreas Dengel
    European Semantic Web Conference (ESWC), 2016
    [paper] [website]
  10. An Eye Movement Study on Scientific Papers Using Wearable Eye Tracking Technology
    Saleh Mozaffari Chanijani, Mohammad Al-Naser, Saqib Bukhari, Damian Borth, Shanley Allen, Andreas Dengel
    Int. Conf. on Mobile Computing and Ubiquitous Networking (ICMU), 2016 (accepted)
  11. Trending Topic Aggregation by News-based Context Modeling
    Sebastian Fuchs, Damian Borth and Adrian Ulges
    KI, 2016 (accepted)
  12. First Results from the Rapid-Response Spectrophotometric Characterization of Near-Earth Objects using UKIRT
    Michael Mommert, David E. Trilling, Damian Borth, Robert Jedicke, Nathaniel Butler,
    Mauricio Reyes-Ruiz, Barbara Pichardo, Eric Petersen, Tim Axelrod, Nicholas Moskovitz
    The Astronomical Journal, The Astronomical Journal, 151:98 (10pp), 2016 April
    [paper]
  13. YFCC100m: The New Data in Multimedia Research
    Bart Thomee, David Shamma, Gerald Friedland, Benjamin Elizalde, Karl Ni, Dough Poland, Damian Borth, Li-Jia Li
    Communication of the ACM, 2016, (YFCC100m Dataset Paper)
    [paper], [video], [YFCC100m Browser]
2015
  1. Mapping Images to Sentiment Adjective Noun Pairs with Factorized Neural Nets
    Takuya Narihira, Damian Borth, Stella X. Yu, Karl Ni, Trevor Darrell
    arXiv, preprint arXiv:1511.06838, Nov, 2015
    [paper]
  2. Kickstarting the Commons: The YFCC100M and the YLI Corpora
    Julia Bernd, Damian Borth, Carmen Carrano, Jaeyoung Choi, Benjamin Elizalde, Gerald Friedland,
    Luke Gottlieb, Karl Ni, Roger Pearce, Doug Poland, Khalid Ashraf, David A. Shamma, and Bart Thomee
    ACM Multimeda Community-Organized Multimodal Mining: Opportunities for Novel Solutions (MMCOMMONS) Workshop, 2015
  3. Real-time Analysis and Visualization of the YFCC100m Dataset
    Sebastian Kalkowski, Christian Schulze, Andreas Dengel, Damian Borth
    ACM Multimeda Community-Organized Multimodal Mining: Opportunities for Novel Solutions (MMCOMMONS) Workshop, 2015
    [YFCC100m Browser]
  4. What makes a Beautiful Landscape beautiful: Adjective Noun Pairs Attention by Eye-Tracking and Gaze Analysis
    Mohammad Al-Naser, Seyyed Saleh Mozaffari Chanijani, Syed Saqib Bukhari, Damian Borth, Andreas Dengel
    ACM Workshop on Affect and Sentiment in Multimedia (ASM), 2015
  5. Aesthetic Photo Enhancement using Machine Learning and Case-Based Reasoning
    Joachim Folz, Christian Schulze, Damian Borth, Andreas Dengel
    ACM Workshop on Affect and Sentiment in Multimedia (ASM), 2015
  6. The New Data and New Challenges in Multimedia Research
    Bart Thomee, David Shamma, Gerald Friedland, Benjamin Elizalde, Karl Ni, Dough Poland, Damian Borth, Li-Jia Li
    arXiv, preprint arXiv:1503.01817, March, 2015
    [preprint]
  7. The YLI-MED Corpus: Characteristics, Procedures, and Plans
    Julia Bernd, Damian Borth, Benjamin Elizalde, Gerald Friedland, Heather Gallagher,
    Luke Gottlieb, Adam Janin, Sara Karabashlieva, Jocelyn Takahashi, Jennifer Won
    arXiv, preprint arXiv:1503.04250, March, 2015
    [paper]
  8. Large-Scale Deep Learning on the YFCC100M Dataset
    Karl Ni, Roger Pearce, Kofi Boakye, Brian Van Essen, Damian Borth, Barry Chen, Eric Wang
    arXiv, preprint arXiv:1502.03409, February, 2015
    [paper]
2014
  1. DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks
    Tao Chen, Damian Borth, Trevor Darrell, Shih-Fu Chang
    arXiv preprint, arXiv:1410.8586
    [paper]
  2. The Placing Task: A Large-Scale Geo-Estimation Challenge for Social-Media Videos and Images
    Jaeyoung Choi, Bart Thomee, Gerald Friedland, Liangliang Cao, Karl Ni, Damian Borth,
    Benjamin Elizalde, Luke Gottlieb, Carmen Carrano, Roger Pearce, Doug Poland
    ACM MM Workshop on Geotagging (Geo MM) - MediaEval’s Placing Task, 2014
  3. Visual Learning of Semantic Concepts in Social Multimedia
    Damian Borth
    GI Journal on Artificial Intelligence (KI), Volume 28, Issue 4, 2014
    [paper]
  4. Audio-Concept Features and Hidden Markov Models for Multimedia Event Detection
    Benjamin Elizalde, Mirco Ravanelli, Karl Ni, Damian Borth, Gerald Friedland,
    IEEE Workshop on Speech, Language and Audio in Multimedia (SLAM), 2014
  5. Visual Learning of Socio-Video Semantics
    Damian Borth
    Technische Universität Kaiserslautern, 2014, (PhD Thesis)
    [paper]
  6. Automatic Detection of CSA Media by Multi-modal Feature Fusion for Law Enforcement Support
    Christian Schulze, Dominik Henter, Damian Borth, Andreas Dengel
    ACM Int. Conf. on Multimedia Information Retrieval (ICMR), 2014
    [paper]
2013
  1. Large-scale Visual Sentiment Ontology and Detectors Using Adjective Noun Pairs
    Damian Borth, Rongrong Ji, Tao Chen, Thomas Breuel and Shih-Fu Chang
    ACM Int. Conf. on Multimedia (ACM MM), 2013, (Brave New Idea Track)
    [VSO Browsing Interface]
  2. Analysis and Forecasting of Trending Topics in Online Media Streams
    Tim Althoff, Damian Borth, Jörn Hees, Andreas Dengel
    ACM Int. Conf. on Multimedia (ACM MM), 2013
  3. SentiBank: Large-Scale Ontology and Classifiers for Detecting Sentiment and Emotions in Visual Content
    Damian Borth; Tao Chen; Rong-Rong Ji; Shih-Fu Chang
    ACM Int. Conf. on Multimedia (ACM MM), Demo Track, 2013
    [VSO Browsing Interface]
  4. Content Analysis meets Viewers: Linking Concept Detection with Demographics on YouTube
    Adrian Ulges, Damian Borth, Markus Koch
    International Journal of Multimedia Information Retrieval, 2013
    [paper],
2012
  1. Dynamic Vocabularies for Web-based Concept Detection by Trend Discovery
    Damian Borth, Adrian Ulges, Thomas Breuel
    ACM Int. Conf. on Multimedia (ACM MM), 2012
    [paper], [poster]
  2. Tag Suggestion on YouTube by Personalizing Content-based Auto-Annotation
    Dominik Henter, Damian Borth, Adrian Ulges
    Workshop on Crowdsourcing for Multimedia (CrowdMM), 2012
    [paper], [talk],
  3. Pornography Detection in Video Benefits (a lot) from a Multi-modal Approach
    Adrian Ulges, Christian Schulz, Damian Borth, Armin Stahl
    Workshop on Audio and Multimedia Methods for Large-Scale Video Analysis (AMVA), 2012
    [paper], [talk],
  4. Linking Visual Concept Detection with Viewer Demographics
    Adrian Ulges, Markus Koch, Damian Borth
    ACM Int. Conf. on Multimedia Retrieval (ICMR), 2012, (Best Paper Award)
    [paper]
  5. Making Web Videos more Accessible to Advertising: The Winner of McKinsey’s Business Technology Award
    Damian Borth, Markus Löffler
    McKinsey Quarterly, Business Technology, Issue 23, Spring 2012
2011
  1. Automatic Concept-to-Query Mapping for Web-based Concept Detector Training
    Damian Borth, Adrian Ulges, Thomas Breuel
    ACM Int. Conf. on Multimedia (ACM MM), 2011
    [paper], [poster], [web demo]
  2. Video Concept Detection using web-based Training Sources
    Damian Borth
    ACM Int. Conf. on Multimedia (ACM MM), Doctoral Symposium, 2011
    [poster]
  3. Lookapp for Ads – Content-based Advertising by Visual Concept Detection
    Damian Borth, Adrian Ulges
    McKinsey Business Technology Award, Kitzbühel, 2011, (1. Place Awardee)
    [abstract] [web demo]
  4. Participation at TRECVID 2011 Semantic Indexing Task & Content-based Copy Detection
    Wan-Lei Zhao, Damian Borth, Thomas Breuel
    TRECVID Workshop (unreviewed workshop paper), 2011
    [paper]
  5. Lookapp - Interactive Construction of Web-based Concept Detectors
    Damian Borth, Adrian Ulges, Thomas Breuel
    ACM Int. Conf. on Multimedia Retrieval (ICMR), Demo Session, 2011
    [paper], [poster], [web demo]
  6. Smart Video Buddy - Content-based Live Recommendation
    Damian Borth, Christian Kofler, Adrian Ulges
    IEEE Int. Conf on Multimedia & Expo (ICME), Demo Session, 2011
    [paper], [demo site]
2010
  1. DFKI and University of Kaiserslautern Participation at TRECVID 2010 - Semantic Indexing Task
    Damian Borth, Adrian Ulges, Markus Koch, Thomas Breuel
    TRECVID Workshop (unreviewed workshop paper), 2010
    [paper]
  2. Adapting Web-based Video Concept Detectors for Different Target Domains
    Damian Borth, Adrian Ulges, Thomas Breuel
    Book Chapter in Internet Multimedia Search and Mining, 2010
    [pre print]
  3. Relevance Filtering meets Active Learning: Improving Web-based Concept Detectors
    Damian Borth, Adrian Ulges, Thomas Breuel
    ACM Int. Conf on Multimedia Information Retrieval (MIR), 2010
    [paper], [talk]
  4. Visual Concept Learning from Weakly Labeled Web Videos
    Adrian Ulges, Damian Borth, Thomas Breuel
    Book Chapter in Video Search and Mining (VSM), Springer Verlag, 2010
    [pre print]
2009
  1. DFKI-IUPR participation in TRECVID'09 High-level Feature Extraction Task
    Damian Borth, Markus Koch, Adrian Ulges, Thomas Breuel
    TRECVID Workshop (unreviewed workshop paper), 2009
    [paper]
  2. TubeTagger - YouTube-based Concept Detection
    Adrian Ulges, Markus Koch, Damian Borth, Thomas Breuel
    IEEE ICDM Workshop on Internet Multimedia Mining, 2009
    [paper], [talk], [web demo]
  3. TubeFiler - an Automatic Web Video Categorizer
    Damian Borth, Joern Hess, Markus Koch, Adrian Ulges, Christian Schulze, Thomas Breuel, Roberto Paredes
    ACM Int. Conf on Multimedia, Grand Challenge, 2009
    [paper] [poster], [web demo]
  4. Video Copy Detection providing Localized Matches
    Damian Borth, Adrian Ulges, Christian Schulze, Thomas M. Breuel
    GI Informatiktage, 2009
    [paper] [poster]
  5. Keyframe Extraktion für Video-Annotation und Video-Zusammenfassug
    Damian Borth, Adrian Ulges, Christian Schulze, Thomas M. Breuel
    Informatik-Spektrum: Volume 32, Issue1 (2009), Page 50
    [paper]
2008
  1. Navidgator - Similarity Based Browsing for Image & Video Databases
    Damian Borth, Christian Schulze, Adrian Ulges, Thomas M. Breuel
    KI '08, 22-29, 2008
    [paper], [talk]
  2. Keyframe Extraction for Video Tagging & Summarization
    Damian Borth, Adrian Ulges, Christian Schulze, Thomas M. Breuel
    GI Informatiktage, 2008, (Best Paper Award)
    [paper] [poster]
Contact Information

Damian Borth

Trippstaedter Str. 122
67663 Kaiserslautern
Germany

phone: +49 (631) 20575-4184
email: damian.borth [at] dfki.de