Re-Composition of Distributed Social Media Content
Paperback (Published)
(October 2014)
ISBN: 9783955990138
5.83 x 8.07 inches
Price: $73.00
With the rising age of social media, shared multimedia contents on social networks such as Facebook are rapidly growing. Friends take photos and videos of each other when attending a social event, and the increasingly growing use of smart phones with highresolution cameras facilitates sharing many of these contents directly in common social networks like Facebook. The users tag these media contents with friends, comment on them and add captions and descriptions. However, these media contents remain very scattered between different albums, social accounts, platforms and devices. It becomes
very difficult for the user to search and compile the whole contents of an event later on, especially with the current absence of the metadata related to the EXIF header in the largest photo sharing network (Facebook). In this PhD thesis we introduce a holistic approach to allow the users to re-collect and compose multimedia products from their social events in social media with the minimum effort. Our approach covers the following composition steps:
• Event clustering: We introduce a novel approach for clustering the photos and videos of the same social event scattered over different social contacts in social networks.
For this task we employ visual, social and structure-based features to connect the contents of the same event.
• Re-Connecting the distributed contents between social media and personal devices:
More users are using their phone to browse their contents. We introduce a fusion approach that exploits a face recognition approach to link the contents on the
smart phone to their related ones on Facebook.
• Content summarization: Some social events might be overrepresented with multimedia contents, and in this step we automatically create a summary of the photos and video frames of each social event to fit the size of the multimedia composition. To maximize the satisfaction of the user we take the social-context, the interest of the user and the visual quality of each of the content into consideration.
• Product creation: In the last step we compile the selected contents of the social events in an appealing multimedia product such as a photo book by automatically creating an aesthetic layout and enriching the layout with semantic information in a storytelling form.
We evaluate each of the steps of our approach, and we show some of the real-life applications that resulted from our overall approach.
