A Deep Learning Approach for Real-Time Analysis of Attendees" Engagement in Public Events

Smart city analytics requires the harnessing and analysis of emotions and sentiments conveyed by images and video footage. In recent years, facial sentiment analysis attracted significant attention for different application areas, including marketing, gaming, political analytics, healthcare, and hum...

Full description

Permalink: http://skupnikatalog.nsk.hr/Record/nsk.NSK01001163165/Details
Matična publikacija: Journal of communications software and systems (Online)
17 (2021), 2 ; str. 106-115
Glavni autori: Mathew, Sujith Samuel (Author), AlKhatib, Manar, El Barachi, May
Vrsta građe: e-članak
Jezik: eng
Online pristup: https://doi.org/10.24138/jcomss-2021-0072
Elektronička verzija članka
Elektronička verzija članka
LEADER 02890naa a22003494i 4500
001 NSK01001163165
003 HR-ZaNSK
005 20230213112853.0
006 m d
007 cr||||||||||||
008 230213s2021 ci |o |0|| ||eng
024 7 |2 doi  |a 10.24138/jcomss-2021-0072 
035 |a (HR-ZaNSK)001163165 
040 |a HR-ZaNSK  |b hrv  |c HR-ZaNSK  |e ppiak 
041 0 |a eng 
042 |a croatica 
044 |a ci  |c hr 
080 1 |2 2011 
100 1 |a Mathew, Sujith Samuel  |4 aut  |9 HR-ZaNSK 
245 1 0 |a A Deep Learning Approach for Real-Time Analysis of Attendees" Engagement in Public Events  |h [Elektronička građa]  |c Sujith Samuel Mathew, Manar AlKhatib, May El Barachi. 
300 |b Ilustr. 
504 |a Bibliografija: 
504 |a Summary. 
520 |a Smart city analytics requires the harnessing and analysis of emotions and sentiments conveyed by images and video footage. In recent years, facial sentiment analysis attracted significant attention for different application areas, including marketing, gaming, political analytics, healthcare, and human computer interaction. Aiming at contributing to this area, we propose a deep learning model enabling the accurate emotion analysis of crowded scenes containing complete and partially occluded faces, with different angles, various distances from the camera, and varying resolutions. Our model consists of a sophisticated convolutional neural network (CNN) that is combined with pooling, densifying, flattening, and Softmax layers to achieve accurate sentiment and emotion analysis of facial images. The proposed model was successfully tested using 3,750 images containing 22,563 faces, collected from a large consumer electronics trade show. The model was able to correctly classify the test images which contained faces with different angles, distances, occlusion areas, facial orientation and resolutions. It achieved an average accuracy of 90.6% when distinguishing between seven emotions (Happiness, smiling, laughter, neutral, sadness, anger, and surprise) in complete faces, and 86.16% accuracy in partially occluded faces. Such model can be leveraged for the automatic analysis of attendees" engagement level in events. Furthermore, it can open the door for many useful applications in smart cities, such as measuring employees" satisfaction and citizens" happiness. 
700 1 |a AlKhatib, Manar  |4 aut  |9 HR-ZaNSK 
700 1 |a El Barachi, May  |4 aut  |9 HR-ZaNSK 
773 0 |t Journal of communications software and systems (Online)  |x 1846-6079  |g 17 (2021), 2 ; str. 106-115  |w nsk.(HR-ZaNSK)000644741 
981 |b Be2021 
856 4 0 |u https://doi.org/10.24138/jcomss-2021-0072 
856 4 0 |u https://jcoms.fesb.unist.hr/10.24138/jcomss-2021-0072/  |y Elektronička verzija članka 
856 4 0 |u https://jcoms.fesb.unist.hr/pdfs/v17n2_2021-0072_barachi.pdf  |y Elektronička verzija članka 
856 4 1 |y Digitalna.nsk.hr