VlogSense: Conversational behavior and social attention in ...

ACM Transactions on Multimedia Computing, Communications, ... Our study on 2,269 vlogs from YouTube shows that several nonverbal cues are significantly ... research-articleVlogSense:ConversationalbehaviorandsocialattentioninYouTube Shareon Authors:Joan-IsaacBielIdiapResearchInstituteandEcolePolytechniqueFédéraledeLausanne(EPFL),Martigny,SwitzerlandIdiapResearchInstituteandEcolePolytechniqueFédéraledeLausanne(EPFL),Martigny,SwitzerlandViewProfile,DanielGatica-PerezIdiapResearchInstituteandEcolePolytechniqueFédéraledeLausanne(EPFL),Martigny,SwitzerlandIdiapResearchInstituteandEcolePolytechniqueFédéraledeLausanne(EPFL),Martigny,SwitzerlandViewProfileAuthorsInfo&ClaimsACMTransactionsonMultimediaComputing,Communications,andApplicationsVolume7SIssue1October2011ArticleNo.:33pp1–21https://doi.org/10.1145/2037676.2037690Online:04November2011PublicationHistory 19citation2,120DownloadsMetricsTotalCitations19TotalDownloads2,120Last12Months84Last6weeks6 GetCitationAlertsNewCitationAlertadded!Thisalerthasbeensuccessfullyaddedandwillbesentto:Youwillbenotifiedwheneverarecordthatyouhavechosenhasbeencited.Tomanageyouralertpreferences,clickonthebuttonbelow.ManagemyAlertsNewCitationAlert!Pleaselogintoyouraccount SavetoBinderSavetoBinderCreateaNewBinderNameCancelCreateExportCitationPublisherSiteGetAccessACMTransactionsonMultimediaComputing,Communications,andApplicationsVolume7S,Issue1 PreviousArticleNextArticle AbstractWeintroducetheautomaticanalysisofconversationalvlogs(VlogSense,forshort)asanewresearchdomaininsocialmedia.Conversationalvlogsareinherentlymultimodal,depictnaturalbehavior,andaresuitableforlarge-scaleanalysis.Giventheirdiversityintermsofcontent,VlogSenserequirestheintegrationofrobustmethodsformultimodalanalysisandforsocialmediaunderstanding.Wepresentanoriginalstudyontheautomaticcharacterizationofvloggers'audiovisualnonverbalbehavior,groundedinworkfromsocialpsychologyandbehavioralcomputing.Ourstudyon2,269vlogsfromYouTubeshowsthatseveralnonverbalcuesaresignificantlycorrelatedwiththesocialattentionreceivedbyvideos. References Ambady,N.andRosenthal,R.1992.Thinslicesofexpressivebehavioraspredictorsofinterpersonalconsequences:Ametaanalysis.Psych.Bull.111,2,256--274.GoogleScholarCrossRefBiel,J.-I.andGatica-Perez,D.2009.WearingaYouTubehat:Directors,comedians,gurus,anduseraggregatedbehavior.InProceedingsofthe17thACMInternationalConferenceonMultimedia.GoogleScholarDigitalLibraryBiel,J.-I.andGatica-Perez,D.2010.VoicesofVlogging.InProceedingsoftheInternationalAAAIConferenceonWeblogsandSocialMedia.GoogleScholarBradski,G.andKaehler,A.2008.LearningOpenCV:ComputerVisionwiththeOpenCVLibrary.O'Reilly.GoogleScholarBurgess,J.andGreen,J.2009.YouTube:OnlineVideoandParticipatoryCulture.Polity,Cambridge,UK.GoogleScholarCha,M.,Kwak,R.,Rodriguez,R.,Ahn,Y.-Y.,andMoon,S.2007.Itube,youtube,everybodytubes:Analyzingtheworld'slargestusergeneratedcontentvideosystem.InProceedingsoftheACMSIGCOMMInternetMeasurementConference.GoogleScholarDigitalLibraryCheng,X.,Dale,C.,andLiu,J.2008.Statisticsandsocialnetworkofyoutubevideos.InProceedingsofIEEE16thInternationalWorkshoponQualityofService.GoogleScholarCurhan,J.R.andPentland,A.2007.Thinslicesofnegotiation:Predictingoutcomesfromconversationaldynamicswithinthefirst5minutes.J.Appl.Psych.92,3.GoogleScholarCrossRefdeVasconcelosFilho,J.E.,Inkpen,K.M.,andCzerwinski,M.2009.Image,appearanceandvanityintheuseofmediaspacesandvideoconferencesystems.InProceedingsoftheInternationalACMConferenceonSupportingGroupWork.GoogleScholarDigitalLibraryDovidio,J.F.andEllyson,S.L.1982.Decodingvisualdominance:Attributionsofpowerbasedonrelativepercentagesoflookingwhilespeakingandlookingwhilelistening.J.Soc.Person.Relation.45,2,106--113.GoogleScholarEvans,D.C.,Gosling,S.D.,andCarroll,A.2008.Whatelementsofanonlinesocialnetworkingprofilepredicttarget-rateragreementinpersonalityimpressions.InProceedingsoftheInternationalAAAIConferenceonWeblogsandSocialMedia.GoogleScholarGatica-Perez,D.2009.Automaticnonverbalanalysisofsocialinteractioninsmallgroups:Areview.ImageVis.Comput.27,12,1775--1787.GoogleScholarDigitalLibraryGill,J.A.,Nowson,S.,andOberlander,J.2009.Whataretheybloggingabout?Personality,topic,andmotivationinblogs.InProceedingsoftheInternationalAAAIConferenceonWeblogsandSocialMedia.GoogleScholarGoswami,S.,Sarkar,S.,andRustagi,M.2009.Stylometricanalysisofbloggers'ageandgender.InProceedingsoftheInternationalAAAIConferenceonWeblogsandSocialMedia.GoogleScholarGriffith,M.2007.Lookingforyou:Ananalysisofvideoblogs.InProceedingsoftheAnnualMeetingoftheAssociationforEducationinJournalismandMassCommunication.GoogleScholarHalvey,M.andKeane,M.2007.Exploringsocialdynamicsinonlinemediasharing.InProceedingsofthe16thInternationalConferenceonWorldWideWeb.GoogleScholarDigitalLibraryHanjalic,A.2002.Shot-boundarydetection:unraveledandresolved?IEEETrans.Circ.Syst.VideoTechn.12,2,90--105.GoogleScholarDigitalLibraryHarley,D.andFitzpatrick,G.2009.YouTubeandintergenerationalcommunication:thecaseofgeriatric1927.Univ.AccessInform.Soc.8,1,5--20.GoogleScholarDigitalLibraryHuberman,B.A.,Romero,D.M.,andWu,F.2009.Crowdsourcing,attentionandproductivity.J.Inform.Sci.35,6.GoogleScholarDigitalLibraryHung,H.,Jayagopi,D.B.,Ba,S.,Odobez,J.-M.,andGatica-Perez,D.2008.Investigatingautomaticdominanceestimationingroupsfromvisualattentionandspeakingactivity.InProceedingsofthe10thInternationalConferenceonMultimodalInterfaces.GoogleScholarDigitalLibraryJayagopi,D.B.,Ba,S.,Odobez,J.-M.,andGatica-Perez,D.2008.Predictingtwofacetsofsocialverticalityinmeetingsfromfive-minutetimeslicesandnonverbalcues.InProceedingsofthe10thInternationalConferenceonMultimodalInterfaces.GoogleScholarDigitalLibraryJayagopi,D.B.,Hung,H.,Yeo,C.,andGatica-Perez,D.2009.Modelingdominanceingroupconversationsusingnonverbalactivitycues.IEEETrans.AudioSpeechLang.Process.17,3,501--513.GoogleScholarDigitalLibraryKnapp,M.L.andHall,J.2005.NonverbalCommunicationinHumanInteraction.Holt,RinehartandWinston,NewYork.GoogleScholarKramer,A.D.I.andRodden,K.2008.Wordusageandpostingbehaviors:modelingblogswithunobtrusivedatacollectionmethods.InProceedingsofthe26thannualSIGCHIConferenceonHumanFactorsinComputingSystems.GoogleScholarDigitalLibraryKruitbosch,G.andNack,F.2008.BroadcastyourselfonYouTube—really?InProceedingsofthe3rdACMInternationalWorkshoponHuman-CenteredComputing.GoogleScholarDigitalLibraryLandry,B.andGuzdial,M.2008.Artorcircus?Characterizinguser-createdvideoonYouTube.Tech.rep.,GeorgiaInstituteofTechnology.GoogleScholarLange,P.2007.Publiclyprivateandprivatelypublic:socialnetworkingonYouTube.J.Comput.-Mediat.Comm.1,13.GoogleScholarLevelt,W.J.M.1989.Speaking:FromIntentiontoArticulation.MITPress,Cambridge,MA.GoogleScholarLin,W.-H.andHauptmann,A.2008.Identifyingideologicalperspectivesofwebvideosusingfolksonomies.InProceedingsoftheAAAIFallSymposiumonMultimediaInformationExtraction.GoogleScholarMishne,G.2005.Experimentswithmoodclassificationinblogposts.InProceedingsoftheSIGIRWorkshoponStylisticAnalysisOfTextForInformationAccess.GoogleScholarMislove,A.,Marcon,M.,Gummadi,K.,Druschel,P.,andBhattacharjee,B.2007.Measurementandanalysisofonlinesocialnetworks.InProceedingsoftheACMSIGCOMMInternetMeasurementConference.GoogleScholarDigitalLibraryMolyneaux,H.,O'Donnell,S.,Gibson,K.,andSinger,J.2008.ExploringthegenderdivideonYouTube:Ananalysisofthecreationandreceptionofvlogs.Amer.Comm.J.10,2.GoogleScholarNguyen,D.T.andCanny,J.2009.Morethanface-to-face:Empathyeffectsofvideoframing.InProceedingsofthe27thAnnualSIGCHIConferenceonHumanFactorsinComputingSystems.GoogleScholarDigitalLibraryPentland,A.S.2008.HonestSignals:HowTheyShapeOurWorld.MITPress.GoogleScholarDigitalLibraryScherer,K.R.1979.Personalitymarkersinspeech.InSocialMarkersinSpeech,K.R.SchererandH.Giles,Eds.,CambridgeUniversityPress,147--209.GoogleScholarSellen,A.J.1995.Remoteconversations:Theeffectsofmediatingtalkwithtechnology.Hum.Comput.Interact.10,401--444.GoogleScholarDigitalLibraryStrangelove,M.2010.WatchingYouTube:ExtraordinaryVideosbyOrdinaryPeople.UniversityofTorontoPress.GoogleScholarViola,P.andJones,M.2002.Robustreal-timeobjectdetection.Int.J.Comput.Vis.57,2.GoogleScholarDigitalLibraryVonderau,P.2010.TheYouTubeReader.WallflowerPress.GoogleScholarZancanaro,M.,Lepri,B.,andPianesi,F.2006.Automaticdetectionofgroupfunctionalrolesinfacetofaceinteractions.InProceedingsofthe8thInternationalConferenceonMultimodalInterfaces.GoogleScholarDigitalLibraryZhang,X.,Xu,C.,Cheng,J.,Lu,H.,andMa,S.2009.Effectiveannotationandsearchforvideoblogswithintegrationofcontextandcontentanalysis.IEEETrans.Multimedia11,2.GoogleScholarDigitalLibrary IndexTerms VlogSense:ConversationalbehaviorandsocialattentioninYouTubeComputingmethodologiesArtificialintelligencePhilosophical/theoreticalfoundationsofartificialintelligenceCognitivescienceHuman-centeredcomputingHumancomputerinteraction(HCI)InformationsystemsInformationretrievalDocumentrepresentation Comments LoginoptionsCheckifyouhaveaccessthroughyourlogincredentialsoryourinstitutiontogetfullaccessonthisarticle.SigninFullAccessGetthisArticle InformationContributorsPublishedin ACMTransactionsonMultimediaComputing,Communications,andApplications Volume7S,Issue1SpecialsectiononACMmultimedia2010bestpapercandidates,andissueonsocialmediaOctober2011246pagesISSN:1551-6857EISSN:1551-6865DOI:10.1145/2037676Issue’sTableofContents Copyright©2011ACMSponsorsIn-CooperationPublisherAssociationforComputingMachineryNewYork,NY,UnitedStates PublicationHistory Online:4November2011Published:4November2011Accepted:1August2011Revised:1March2011Received:1September2010 PermissionsRequestpermissionsaboutthisarticle.RequestPermissions AuthorTagssocialmediavloggingnonverbalbehaviorYouTubeQualifiersresearch-articleResearchRefereedConferenceFundingSources OtherMetricsViewArticleMetricsBibliometricsCitations19ArticleMetrics19TotalCitationsViewCitations2,120TotalDownloadsDownloads(Last12months)84Downloads(Last6weeks)6OtherMetricsViewAuthorMetricsCitedByViewallPDFFormatVieworDownloadasaPDFfile.PDFeReaderViewonlinewitheReader.eReaderDigitalEditionViewthisarticleindigitaledition.ViewDigitalEditionFiguresOtherSharethisPublicationlinkhttps://dl.acm.org/doi/10.1145/2037676.2037690CopyLinkShareonSocialMedia Shareon 0ReferencesCloseFigureViewerBrowseAllReturnChangezoomlevelCaption ViewIssue’sTableofContents ExportCitationsSelectCitationformatBibTeXEndNoteACMRefDownloadcitationCopycitationPreviewisnotavailable.Byclickingdownload,anewtabwillopentostarttheexportprocess.Theprocessmaytakeafewminutesbutonceitfinishesafilewillbedownloadedonyourbrowsersopleasedonotclosethenewtab.Download AboutCookiesOnThisSiteWeusecookiestoensurethatwegiveyouthebestexperienceonourwebsite. LearnmoreGotit!