<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">msi</journal-id><journal-title-group><journal-title xml:lang="ru">Современная наука и инновации</journal-title><trans-title-group xml:lang="en"><trans-title>Modern Science and Innovations</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2307-910X</issn><publisher><publisher-name>North-Caucasus Federal University</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.37493/2307-910X.2023.1.24</article-id><article-id custom-type="elpub" pub-id-type="custom">msi-1470</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ДИСКУССИОННЫЕ СТАТЬИ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>DISCUSSION PAPERS</subject></subj-group></article-categories><title-group><article-title>АНАЛИЗ РАСПОЗНАВАНИЯ ЭМОЦИЙ НА БАЗЕ МОДЕЛЕЙ ГЛУБОКОЙ КОНВОЛЮЦИОННОЙ НЕЙРОННОЙ СЕТИ</article-title><trans-title-group xml:lang="en"><trans-title>ANALYSIS OF EMOTION RECOGNITION BASED ON DEEP CONVOLUTIONAL NEURAL NETWORK MODELS</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Горяев</surname><given-names>В. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Goryaev</surname><given-names>V. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p> Горяев Владимир Михайлович, кандидат педагогических наук, доцент</p><p>г. Элиста, ул. Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> Vladimir M. Goryaev, Cand. Sci. (Pedag.), Associate Professor</p><p>358000, Republic of Kalmykia, Elista, Pushkin str., 11</p></bio><email xlink:type="simple">goryaeff@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Манкаева</surname><given-names>Г. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Mankaeva</surname><given-names>G. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p> Манкаева Галина Алексеевна, старший преподаватель</p><p>Республика Калмыкия, г. Элиста, ул.Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> Galina A. Mankaeva, Senior Lecturer</p><p>358000, Republic of Kalmykia, Elista, Pushkin str., 11</p></bio><email xlink:type="simple">mankaeva.galina@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Очир-Горяева</surname><given-names>Т. Б.</given-names></name><name name-style="western" xml:lang="en"><surname>Ochir-Goryaeva</surname><given-names>T. B.</given-names></name></name-alternatives><bio xml:lang="ru"><p> Очир-Горяева Тамара Борисовна, кандидат экономических наук, доцент</p><p>Республика Калмыкия, г. Элиста, ул. Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> Tamara B. Ochir-Goryaeva, Cand. Sci. (Econ.), Associate Professor</p><p>358000, Republic of Kalmykia, Elista, Pushkin str., 11</p></bio><email xlink:type="simple">goryaeff@mail.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Мантусов</surname><given-names>А. Б.</given-names></name><name name-style="western" xml:lang="en"><surname>Mantusov</surname><given-names>A. B.</given-names></name></name-alternatives><bio xml:lang="ru"><p> Мантусов Анатолий Бадмаевич, кандидат педагогических наук, доцент</p><p>Республика Калмыкия, г. Элиста, ул. Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> Anatoliy B. Mantusov, Cand. Sci. (Pedag.), Associate Professor</p><p>358000, Republic of Kalmykia, Elista, Pushkin str., 11</p></bio><email xlink:type="simple">Mantusov@kalmsu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Лиджи-Гаряев</surname><given-names>В. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Lidji-Garyaev</surname><given-names>V. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Республика Калмыкия, г. Элиста, ул. Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> 358000, Republic of Kalmykia, Elista, Pushkin str., 11 </p></bio><email xlink:type="simple">Mandzhieva@kalmsu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Корняков</surname><given-names>А. Б.</given-names></name><name name-style="western" xml:lang="en"><surname>Kornyakov</surname><given-names>A. B.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Республика Калмыкия, г. Элиста, ул. Пушкина, д. 11 </p></bio><bio xml:lang="en"><p> 358000, Republic of Kalmykia, Elista, Pushkin str., 11</p></bio><email xlink:type="simple">Borisov@kalmsu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Калмыцкий государственный университет имени Б. Б. Городовикова</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Kalmyk State University named after B.B. Gorodovikov</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>04</day><month>05</month><year>2023</year></pub-date><volume>0</volume><issue>1</issue><fpage>207</fpage><lpage>219</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Горяев В.М., Манкаева Г.А., Очир-Горяева Т.Б., Мантусов А.Б., Лиджи-Гаряев В.В., Корняков А.Б., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Горяев В.М., Манкаева Г.А., Очир-Горяева Т.Б., Мантусов А.Б., Лиджи-Гаряев В.В., Корняков А.Б.</copyright-holder><copyright-holder xml:lang="en">Goryaev V.M., Mankaeva G.A., Ochir-Goryaeva T.B., Mantusov A.B., Lidji-Garyaev V.V., Kornyakov A.B.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://msi.elpub.ru/jour/article/view/1470">https://msi.elpub.ru/jour/article/view/1470</self-uri><abstract><p>Интерес к распознаванию эмоций на лице растет все больше, и внедряются новые алгоритмы и методы. Последние достижения в области контролируемого и неконтролируемого машинного обучения привели к прорывам в области исследований, и с каждым годом появляется все больше и больше точных систем. Однако, несмотря на значительный прогресс, обнаружение эмоций по-прежнему остается очень сложной задачей. Экспериментальные исследования эмоциональных процессов обычно основаны на наблюдении изображений с аффективным содержанием, включая выражения лица. В статье представлена реализация классификатора эмоциональных выражений  путем обучения алгоритма обнаружения лиц на наборе данных AKDEF фронтальных изображений лиц (  = 4900). Обученная конволюционная нейронная сеть, достигает средней точности обучения по пересечению над объединением 72,7%. Цель исследования состояла в том, чтобы представить нормативные данные относительно распознавания шести выражений лица с эмоциональным содержанием, а также нейтрального выражения лица. с использованием задания с принудительным выбором. В данном исследовании согласие в распознавании между изображенными и выбранными участниками выражениями варьировалось от 70% (для гнева) до 76% (для счастья). В целом, результаты показывают высокий уровень распознавания представленных выражений лица, что свидетельствует о том, что AKDEF обеспечивает адекватные стимулы для исследований, изучающих распознавание выражений эмоций на лице. Пол и возраст участников оказал ограниченное влияние на распознавание эмоций, однако пол модели и возраст требует дополнительного рассмотрения.</p></abstract><trans-abstract xml:lang="en"><p>Interest in facial emotion recognition is increasing and new algorithms and methods are being introduced. Recent advances in supervised and unsupervised machine learning have led to breakthroughs in research, and more and more accurate systems are emerging every year. However, despite significant progress, emotion detection remains a very challenging task. Experimental studies of emotional processes are usually based on the observation of images with affective content, including facial expressions. This paper presents the implementation of an emotional expression classifier by training a face detection algorithm on a dataset of AKDEF frontal face images (N = 4,900). The trained convolutional The purpose of the study was to present normative data regarding the recognition of six facial expressions with emotional content as well as neutral facial expressions. using a forced-choice task. In this study, agreement in recognition between the expressions depicted and chosen by the participants ranged from 70% (for anger) to 76% (for happiness). Overall, the results show a high level of recognition of the facial expressions presented, suggesting that the AKDEF provides adequate stimuli for studies examining the recognition of facial expressions of emotion. Participant gender and age had limited impact on emotion recognition, but model gender and age require additional consideration.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>эмоции</kwd><kwd>распознавание эмоций</kwd><kwd>лицевые выражения</kwd><kwd>набор AKDEF</kwd><kwd>глубокая конволюционная нейронная сеть</kwd></kwd-group><kwd-group xml:lang="en"><kwd>emotions</kwd><kwd>emotion recognition</kwd><kwd>facial expressions</kwd><kwd>AKDEF set</kwd><kwd>deep convolutional neural network</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Liu Yisi, Sourina Olga and Nguyen Minh Khoa, ―Real-Time EEG-Based Emotion Recognition and Its Applications‖, Transactions on Computational Science XII: Special Issue on Cyberworlds, 2011. Рp. 256-277.</mixed-citation><mixed-citation xml:lang="en">Liu Yisi, Sourina Olga and Nguyen Minh Khoa, ―Real-Time EEG-Based Emotion Recognition and Its Applications‖, Transactions on Computational Science XII: Special Issue on Cyberworlds, 2011. Рp. 256-277.</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Stickel Christian, Ebner Martin, Steinbach-Nordmann Silke, Searle Gig and Holzinger Andreas, ―Emotion Detection: Application of the Valence Arousal Space for Rapid Biological Usability Testing to Enhance Universal Access‖, Lecture Notes in Computer Science, 2009. Vol. 5614. Рp. 615-624.</mixed-citation><mixed-citation xml:lang="en">Stickel Christian, Ebner Martin, Steinbach-Nordmann Silke, Searle Gig and Holzinger Andreas, ―Emotion Detection: Application of the Valence Arousal Space for Rapid Biological Usability Testing to Enhance Universal Access‖, Lecture Notes in Computer Science, 2009. Vol. 5614. Рp. 615-624.</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Александров А.А., Кирпичников А.П., Ляшева С.А., Шлеймович М.П. Анализ эмоционального состояния человека на изображении // Вестник технологического университета. 2019. Т. 22, № 8. С. 120-123.</mixed-citation><mixed-citation xml:lang="en">Aleksandrov A.A., Kirpichnikov A.P., Lyasheva S.A., Shleimovich M.P. Analiz ehmotsional'nogo sostoyaniya cheloveka na izobrazhenii // Vestnik tekhnologicheskogo universiteta. 2019. Vol. 22, No. 8. P. 120-123.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">D. Galati , R. Miceli and B. Sini, ―Judging and coding facial expression of emotions in congenitally blind children‖, International Journal of Behavioral Development, 2001.Vol. 25, No 3. Рp. 268-278.</mixed-citation><mixed-citation xml:lang="en">D. Galati , R. Miceli and B. Sini, ―Judging and coding facial expression of emotions in congenitally blind children‖, International Journal of Behavioral Development, 2001.Vol. 25, No. 3. Рp. 268-278.</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">H. A. Elfenbein and N. Ambady, ―On the universality and cultural specificity of emotion recognition: A meta-analysis‖, Psychological Bulletin, 2002, Vol. 128, No 2. Рp. 205-235.</mixed-citation><mixed-citation xml:lang="en">H. A. Elfenbein and N. Ambady, ―On the universality and cultural specificity of emotion recognition: A meta-analysis‖, Psychological Bulletin, 2002, Vol. 128, No. 2. Рp. 205-235.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Рюмина Е.В., Карпов А.А. Аналитический обзор методов распознавания эмоций по выражениям лица человека // Научно-технический вестник информационных технологий, механики и оптики. 2020. Т. 20, № 2. С. 163-176.</mixed-citation><mixed-citation xml:lang="en">Ryumina E.V., Karpov A.A. Analiticheskii obzor metodov raspoznavaniya ehmotsii po vyrazheniyam litsa cheloveka // Nauchno-tekhnicheskii vestnik informatsionnykh tekhnologii, mekhaniki i optiki. 2020. T. 20, No. 2. P. 163-176.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Степанова О.А., Ивановский Л.И., Хрящев В.В. Использование глубокого обучения и сверточных нейронных сетей для анализа выражения лица // DSPA: Вопросы применения цифровой обработки сигналов. 2018. Т. 8, № 4. С. 170-173.</mixed-citation><mixed-citation xml:lang="en">Stepanova O.A., Ivanovskii L.I., Khryashchev V.V. Ispol'zovanie glubokogo obucheniya i svertochnykh neironnykh setei dlya analiza vyrazheniya litsa // DSPA: Voprosy primeneniya tsifrovoi obrabotki signalov. 2018. Vol. 8, No. 4. P. 170-173.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Livingstone S.R., Russo F.A. The Ryerson audio-visual database of emotional speech and song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English // PLoS ONE. 2018. Vol. 13, No. 5. Pр. e0196391. DOI:10.1371/journal.pone.0196391</mixed-citation><mixed-citation xml:lang="en">Livingstone S.R., Russo F.A. The Ryerson audio-visual database of emotional speech and song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English // PLoS ONE. 2018. Vol. 13, No. 5. Pр.0196391. DOI: 10.1371/journal.pone.0196391.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Zangeneh Soroush, Morteza &amp; Maghooli, Keivan &amp; Setarehdan, Kamal &amp; Motie Nasrabadi, Ali. (2017). A Review on EEG Signals Based Emotion Recognition. International Clinical Neuroscience Journal. 4. Рр. 118-129.</mixed-citation><mixed-citation xml:lang="en">Zangeneh Soroush, Morteza &amp; Maghooli, Keivan &amp; Setarehdan, Kamal &amp; Motie Nasrabadi, Ali. (2017). A Review on EEG Signals Based Emotion Recognition. International Clinical Neuroscience Journal. 4. Рр. 118-129.</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Vahid Kazemi and Josephine Sullivan, ―One millisecond face alignment with an ensemble of regression trees‖, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. Рp. 1867-1874.</mixed-citation><mixed-citation xml:lang="en">Vahid Kazemi and Josephine Sullivan, ―One millisecond face alignment with an ensemble of regression trees‖, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014. Рp. 1867-1874.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Богданова Д. Р., Акушев А. Т. Распознавание эмоций по речевому сигналу // E-Scio. 2021. №. 6 (57). C. 43-52.</mixed-citation><mixed-citation xml:lang="en">Bogdanova D. R., Akushev A. T. Raspoznavanie ehmotsii po rechevomu signalu // E-Scio. 2021. No. 6 (57). P. 43-52.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">D. Bertero and P. Fung. A first look into a Convolutional Neural Network for speech emotion detection. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017. Рp. 5115-5119, DOI: 10.1109/ICASSP.2017.7953131</mixed-citation><mixed-citation xml:lang="en">D. Bertero and P. Fung. A first look into a Convolutional Neural Network for speech emotion detection. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2017. Рp. 5115-5119, DOI: 10.1109/ICASSP.2017.7953131.</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Peres D. Emotional Thin-Slicing: A Proposal for a Short- and Long-Term Division of Emotional Speech. 2017. Рp. 591-595. 10.21437/Interspeech.2017-1719.</mixed-citation><mixed-citation xml:lang="en">Peres D. Emotional Thin-Slicing: A Proposal for a Short- and Long-Term Division of Emotional Speech. 2017. Рp. 591-595. 10.21437/Interspeech.2017-1719.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Горяев В.М., Бембитов Д.Б. и др. Прогнозирование степных пожаров с использованием данных дистанционного зондирования временных рядов Современные наукоемкие технологии. 2020. № 12-1. С. 15-19.</mixed-citation><mixed-citation xml:lang="en">Goryaev V.M., Bembitov D.B. i dr. Prognozirovanie stepnykh pozharov s ispol'zovaniem dannykh distantsionnogo zondirovaniya vremennykh ryadov Sovremennye naukoemkie tekhnologii. 2020. No. 12-1. P. 15-19.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Baez John C., Dolan James. Higher-dimensional algebra and topological quantum field theory // Journal of Mathematical Physics. 1995. Vol. 36, No. 11. Pр. 6073-6105.</mixed-citation><mixed-citation xml:lang="en">Baez John C., Dolan James. Higher-dimensional algebra and topological quantum field theory // Journal of Mathematical Physics. 995. Vol. 36, No 11. P. 6073-6105.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Аггарвал Ч. Нейронные сети и глубокое обучение: учебный курс: Пер. с англ. СПб.: ООО «Диалектика», 2020. 752 с.</mixed-citation><mixed-citation xml:lang="en">Aggarval CH. Neironnye seti i glubokoe obuchenie: uchebnyi kurs: Per. s angl. SPb.: OOO "Dialektika", 2020. 752 p.</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Wang Kay Ngai et al. Emotion recognition based on convolutional neural networks and heterogeneous bio-signal data sources. Information Fusion. 2022. Vol. 77. Рр.107-117.</mixed-citation><mixed-citation xml:lang="en">Wang Kay Ngai et al. Emotion recognition based on convolutional neural networks and heterogeneous bio-signal data sources. Information Fusion. 2022. Vol. 77. Рр. 107-117.</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Сикорский О.С. Обзор свѐрточных нейронных сетей для задачи классификации изображений // Новые информационные технологии в автоматизированных системах. Москва, 2017. No 20. С. 37-42.</mixed-citation><mixed-citation xml:lang="en">Sikorskii O.S. Obzor svertochnykh neironnykh setei dlya zadachi klassifikatsii izobrazhenii // Novye informatsionnye tekhnologii v avtomatizirovannykh sistemakh. Moskva, 2017. No. 20. P. 37-42.</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Goryaev V.M. et al. Development of a statistical forecast model to improve accuracy based on statistical analysis of weather historical data for the kalmyk region // IOP Conference Series: Earth and Environmental Science. International Symposium on Earth Sciences: History, Contemporary Issues and Prospects. 2019. Pp. 012058.</mixed-citation><mixed-citation xml:lang="en">Goryaev V.M. et al. Development of a statistical forecast model to improve accuracy based on statistical analysis of weather historical data for the kalmyk region // IOP Conference Series: Earth and Environmental Science. International Symposium on Earth Sciences: History, Contemporary Issues and Prospects. 2019. Pp. 012058.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
