Keynote talk: Mining Events from Multimedia Streams

Jonathon Hare, Sina Samangooei

The aggregation of items from social media streams, such as Flickr photos and Twitter tweets, into meaningful groups can help users contextualise and effectively consume the torrents of information on the social web. This task is challenging due to the scale of the streams and the inherently multimodal nature of the information being contextualised.
In this talk we’ll describe some of our recent work on trend and event detection in multimedia data streams. We focus on scalable streaming algorithms that can be applied to multimedia data streams from the web and the social web. The talk will cover two particular aspects of our work: mining Twitter for trending images by detecting near duplicates; and detecting social events in multimedia data with streaming clustering algorithms. We will describe in detail our techniques, and explore open questions and areas of potential future work, in both these tasks.

Jonathon Hare is a Lecturer in the Web and Internet Science group at the University of Southampton. His research interests lie in the area of multimedia information mining, analysis and retrieval, with a particular focus on large-scale multimodal approaches. He has published nearly 60 papers in peer-reviewed conferences and journals.

Sina Samangooei is a Research Fellow in the Web and Internet Science Research group at the University of Southampton. His research interests include streaming data, multimedia retrieval and large-scale machine learning.