Video Data Mining: Semantic Indexing and Event Detection from the Association Perspective
Author
Xingquan Zhu, Xindong Wu, Ahmed K. Elmagarmid, Zhe Feng, and Lide Wu
Tech report number
CERIAS TR 2005-116
Abstract
Advances in the media and entertainment industries, including streaming audio and digital TV, present new challenges for
managing and accessing large audio-visual collections. Current content management systems support retrieval using low-level
features, such as motion, color, and texture. However, low-level features often have little meaning for naive users, who much prefer to
identify content using high-level semantics or concepts. This creates a gap between systems and their users that must be bridged for
these systems to be used effectively. To this end, in this paper, we first present a knowledge-based video indexing and content
management framework for domain specific videos (using basketball video as an example). We will provide a solution to explore video
knowledge by mining associations from video data. The explicit definitions and evaluation measures (e.g., temporal support and
confidence) for video associations are proposed by integrating the distinct feature of video data. Our approach uses video processing
techniques to find visual and audio cues (e.g., court field, camera motion activities, and applause), introduces multilevel sequential
association mining to explore associations among the audio and visual cues, classifies the associations by assigning each of them with
a class label, and uses their appearances in the video to construct video indices. Our experimental results demonstrate the
performance of the proposed approach.
Booktitle
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING,
Key alpha
Video mining, multimedia systems, database management, knowledge-based systems.
Publication Date
2005-05-01
Keywords
Video mining, multimedia systems, database management, knowledge-based systems.