Contextual Wisdom: Social Relations and Correlations for Multimedia Event Annotation
-
Altmetric Citations
Zunjarwad, Amit; Sundaram, Hari; Xie, Lexing
Description
This work deals with the problem of event annotation in social networks. The problem is made difficult due to variability of semantics and due to scarcity of labeled data. Events refer to real-world phenomena that occur at a specific time and place, and media and text tags are treated as facets of the event metadata. We are proposing a novel mechanism for event annotation by leveraging related sources (other annotators) in a social network. Our approach exploits event concept similarity,...[Show more]
dc.contributor.author | Zunjarwad, Amit | |
---|---|---|
dc.contributor.author | Sundaram, Hari | |
dc.contributor.author | Xie, Lexing | |
dc.coverage.spatial | Augsburg Germany | |
dc.date.accessioned | 2015-12-10T22:41:26Z | |
dc.date.created | September 24-29 2007 | |
dc.identifier.isbn | 9781595937018 | |
dc.identifier.uri | http://hdl.handle.net/1885/57907 | |
dc.description.abstract | This work deals with the problem of event annotation in social networks. The problem is made difficult due to variability of semantics and due to scarcity of labeled data. Events refer to real-world phenomena that occur at a specific time and place, and media and text tags are treated as facets of the event metadata. We are proposing a novel mechanism for event annotation by leveraging related sources (other annotators) in a social network. Our approach exploits event concept similarity, concept co-occurrence and annotator trust. We compute concept similarity measures across all facets. These measures are then used to compute event-event and user-user activity correlation. We compute inter-facet concept co-occurrence statistics from the annotations by each user. The annotator trust is determined by first requesting the trusted annotators (seeds) from each user and then propagating the trust amongst the social network using the biased PageRank algorithm. For a specific media instance to be annotated, we start the process from an initial query vector and the optimal recommendations are determined by using a coupling strategy between the global similarity matrix, and the trust weighted global co-occurrence matrix. The coupling links the common shared knowledge (similarity between concepts) that exists within the social network with trusted and personalized observations (concept co-occurrences). Our initial experiments on annotated everyday events are promising and show substantial gains against traditional SVM based techniques. | |
dc.publisher | Association for Computing Machinery Inc (ACM) | |
dc.relation.ispartofseries | ACM Multimedia 2007 | |
dc.source | Proceedings of ACM Multimedia 2007 | |
dc.source.uri | http://mmc36.informatik.uni-augsburg.de/acmmm2007/ | |
dc.subject | Keywords: Content management; Event annotation; Labeled data; PageRank algorithm; Algorithms; Real time systems; Statistics; User interfaces; Multimedia systems Content management; Context; Event annotation; Images; Multimedia; Social networks | |
dc.title | Contextual Wisdom: Social Relations and Correlations for Multimedia Event Annotation | |
dc.type | Conference paper | |
local.description.notes | Imported from ARIES | |
local.description.refereed | Yes | |
dc.date.issued | 2007 | |
local.identifier.absfor | 080199 - Artificial Intelligence and Image Processing not elsewhere classified | |
local.identifier.absfor | 080609 - Information Systems Management | |
local.identifier.absfor | 080109 - Pattern Recognition and Data Mining | |
local.identifier.ariespublication | U3594520xPUB420 | |
local.type.status | Published Version | |
local.contributor.affiliation | Zunjarwad, Amit, Arizona State University | |
local.contributor.affiliation | Sundaram, Hari, Arizona State University | |
local.contributor.affiliation | Xie, Lexing, College of Engineering and Computer Science, ANU | |
local.description.embargo | 2037-12-31 | |
local.identifier.doi | 10.1145/1291233.1291382 | |
local.identifier.absseo | 890301 - Electronic Information Storage and Retrieval Services | |
local.identifier.absseo | 810105 - Intelligence | |
local.identifier.absseo | 950205 - Visual Communication | |
dc.date.updated | 2015-12-09T11:07:47Z | |
local.identifier.scopusID | 2-s2.0-37849006793 | |
Collections | ANU Research Publications |
Download
File | Description | Size | Format | Image |
---|---|---|---|---|
01_Zunjarwad_Contextual_Wisdom:_Social_2007.pdf | 673.45 kB | Adobe PDF | Request a copy |
Items in Open Research are protected by copyright, with all rights reserved, unless otherwise indicated.
Updated: 17 November 2022/ Responsible Officer: University Librarian/ Page Contact: Library Systems & Web Coordinator