Analyzing and Detecting Abnormal Behaviors of Drug Abuse and Addiction Users in School Environments Based on Deep Learning Approaches
Salma Kammoun Jarraya
Computer Science Department , Faculty of Computing and Information Technology , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorCorresponding Author
Marwa Masmoudi
Mir@ cl Laboratory , University of Sfax , Sfax , Tunisia , fss.rnu.tn
Search for more papers by this authorFahad Abdullah Alqurashi
Computer Science Department , Faculty of Computing and Information Technology , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorSultanah M. Alshammari
Center of Research Excellence in Artificial Intelligence and Data Science , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorSalma Kammoun Jarraya
Computer Science Department , Faculty of Computing and Information Technology , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorCorresponding Author
Marwa Masmoudi
Mir@ cl Laboratory , University of Sfax , Sfax , Tunisia , fss.rnu.tn
Search for more papers by this authorFahad Abdullah Alqurashi
Computer Science Department , Faculty of Computing and Information Technology , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorSultanah M. Alshammari
Center of Research Excellence in Artificial Intelligence and Data Science , King Abdulaziz University , Jeddah , Saudi Arabia , kau.edu.sa
Search for more papers by this authorAbstract
Drug abuse and addiction problems are one of the most serious health, social, and psychological problems facing the world. Many international studies indicate that the start of drug abuse occurs mostly in adolescence, which is the period that young people spend in schools, institutes, and universities. Drugs in the student community have become a scourge that raises increasing concern, whether among families or educators, over the fate of school children and educational attainment. Regarding their behaviors, an addicted student often exhibits abnormal behaviors such as permanent lethargy, anxiety, tremors, and aggressive behavior toward others. Moreover, to obtain drugs, the addicted student becomes compelled to resort to various means and ways, and they gradually become criminal addicts. To this endeavor, a detector of abnormal behaviors in schools has become a necessity. In this paper, we built an automatic system able to analyze and detect abnormal behaviors of addicted students and inform the educational staff and parents to know how to manage and treat them. On a technical level, we used deep learning and the recent computer vision techniques in the suggested solution due to their contributions to human behavior and emotion recognition fields. The best-recorded result (97.5%) is obtained with fused handcrafted features based on skeleton joints and deep features extracted with the MobileNet pretrained model and forwarded to a deep proposed network based on two TimeDistributed layers, one BiLSTM layer, and several Dense layers.
Conflicts of Interest
The authors declare no conflicts of interest.
Open Research
Data Availability Statement
Real-Life Violence Situations Dataset is available in the kaggle website for research purposes (https://www.kaggle.com/datasets/mohamedmustafa/real-life-violence-situations-dataset).
References
- 1 https://www.who.int/publications/i/item/9789240096745.
- 2 Hanson G. R., Venturelli P. J., and Platteborze P., Drugs and Society, 2024, Jones & Bartlett Learning.
- 3 https://www.aihw.gov.au/reports/illicit-use-of-drugs/illicit-drug-use.
- 4 Dryfoos J. G., Adolescents at Risk: Prevalence and Prevention, 1991, Oxford University Press.
- 5 United Nations Office on Drugs, & Global Youth Network, Schools: School-Based Education for Drug Abuse Prevention, 2004, United Nations Publications.
- 6 World Health Organization, Prevention of Drug Use in Schools, 2008.
- 7 Cadri A., Beema A. N., Schuster T., Barnett T., Asampong E., and Adams A. M., School-based Interventions Targeting Substance Use Among Young People in Low-and-middle-income Countries: A Scoping Review, Addiction. (2024) 119, no. 12, 2048–2075, https://doi.org/10.1111/add.16623.
- 8 Barocas S., Hardt M., and Narayanan A., Fairness and Machine Learning, 2019, MIT Press.
- 9
Wang P.,
Yuan C.,
Hu W.,
Li B., and
Zhang Y., Graph Based Skeleton Motion Representation and Similarity Measurement for Action Recognition, Lecture Notes in Computer Science. (2016) 14, 370–385, https://doi.org/10.1007/978-3-319-46478-7_23, 2-s2.0-84990062912.
10.1007/978-3-319-46478-7_23 Google Scholar
- 10 Zhuang F., Qi Z., Duan K. et al., A Comprehensive Survey on Transfer Learning, Proceedings of the IEEE. (2021) 109, no. 1, 43–76, https://doi.org/10.1109/jproc.2020.3004555.
- 11
Schuldt C.,
Laptev I., and
Caputo B., Recognizing Human Actions: a Local SVM Approach, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004.(2004) 3, 32–36 Vol.3, https://doi.org/10.1109/icpr.2004.1334462, 2-s2.0-10044233701.
10.1109/ICPR.2004.1334462 Google Scholar
- 12
Saha S.,
Singh G.,
Sapienza M.,
Torr P. H., and
Cuzzolin F., Deep Learning for Detecting Multiple Space-Time Action Tubes in Videos, Procedings of the British Machine Vision Conference 2016. (2016) 58.1–58.13, https://doi.org/10.5244/c.30.58, 2-s2.0-85041898314.
10.5244/C.30.58 Google Scholar
- 13 Singh G., Saha S., Sapienza M., Torr P. H., and Cuzzolin F., Online Real-Time Multiple Spatiotemporal Action Localisation and Prediction, Proceedings of the IEEE International Conference on Computer Vision, April 2017, 3637–3646.
- 14
Qiu Z.,
Sun J.,
Guo M.,
Wang M., and
Zhang D., Survey on Deep Learning for Human Action Recognition, Data Science: 5th International Conference of Pioneering Computer Scientists, Engineers and Educators, ICPCSEE 2019, September 2019, 3–21, https://doi.org/10.1007/978-981-15-0121-0_1, 2-s2.0-85072983106.
10.1007/978-981-15-0121-0_1 Google Scholar
- 15 Al-Dhamari A., Sudirman R., and Mahmood N. H., Transfer Deep Learning along with Binary Support Vector Machine for Abnormal Behavior Detection, IEEE Access. (2020) 8, 61085–61095, https://doi.org/10.1109/access.2020.2982906.
- 16
Mahdi M. S.,
Mohammed A. J., and
Waedallah A. A., «Detection of Unusual Activity in Surveillance Video Scenes Based on Deep Learning Strategies, Journal of Al-Qadisiyah for computer science and mathematics. (2021) 13, no. 4, 1, https://doi.org/10.29304/jqcm.2021.13.4.858.
10.29304/jqcm.2021.13.4.858 Google Scholar
- 17 Pattan O., Pattan P., and Arjunagi S., «A Human Behavior Analysis Model to Track Object Behavior in Surveillance Videos, Measurement: Sensors. (2022) 24, https://doi.org/10.1016/j.measen.2022.100454.
- 18 Zhou H., Student Dangerous Behavior Detection in School, 2022.
- 19
Patwal A.,
Diwakar M.,
Tripathi V., and
Singh P., An Investigation of Videos for Abnormal Behavior Detection, Procedia Computer Science. (2023) 218, 2264–2272, https://doi.org/10.1016/j.procs.2023.01.202.
10.1016/j.procs.2023.01.202 Google Scholar
- 20 https://www.nih.gov/about-nih/what-we-do/nih-almanac/national-institute-drug-abuse-nida.
- 21 https://www.gatewayfoundation.org/about-gateway-foundation/faqs/effects-of-drug-abuse/.
- 22 Kocsis R. N., Diagnostic and Statistical Manual of Mental Disorders: (DSM-5), 2013.
- 23 Goldstein R. Z. and Volkow N. D., Drug Addiction and its Underlying Neurobiological Basis: Neuroimaging Evidence for the Involvement of the Frontal Cortex, American Journal of Psychiatry. (2002) 159, no. 10, 1642–1652, https://doi.org/10.1176/appi.ajp.159.10.1642, 2-s2.0-0036787356.
- 24 Léonard-Mallaval M., ça mord à la crèche-1001 bb n° 104, 2012.
- 25 Hoaken P. N., Assaad J. M., and Pihl R. O., Cognitive Functioning and the Inhibition of Alcohol-Induced Aggression, Journal of Studies on Alcohol. (1998) 59, no. 5, 599–607, https://doi.org/10.15288/jsa.1998.59.599, 2-s2.0-0031928413.
- 26 Avery J. a. K. M., Technology-Assisted Interventions for Substance Use Disorders, S, Nature. (2023) .
- 27 Fillmore M. T. and Rush C. R., Impaired Inhibitory Control of Behavior in Chronic Cocaine Users, Drug and Alcohol Dependence. (2002) 66, no. 3, 265–273, https://doi.org/10.1016/s0376-8716(01)00206-x, 2-s2.0-0036568635.
- 28 Neveux N., Pratiquer la TIP-Thérapie Interpersonnelle-2e édition, 2021, Dunod.
- 29 https://www.samhsa.gov/mental-health/anxiety-disorders#obsessive-compulsive-disorder.
- 30
Mittelstadt B. D.,
Allo P.,
Taddeo M.,
Wachter S., and
Floridi L., The Ethics of Algorithms: Mapping the Debate, Big Data & Society. (2016) 3, no. 2, https://doi.org/10.1177/2053951716679679, 2-s2.0-85074203937.
10.1177/2053951716679679 Google Scholar
- 31 Morley J., Floridi L., Kinsey L., and Elhalal A., From what to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices, Science and Engineering Ethics. (2020) 26, no. 4, 2141–2168, https://doi.org/10.1007/s11948-019-00165-5.
- 32
Van der Aalst W. M., Process Mining, 2016, Springer.
10.1007/978-3-662-49851-4 Google Scholar
- 33 Binns R., Fairness in Machine Learning: Lessons from Political Philosophy, Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency, April 2018, 149–159.
- 34
Xu M. a. G. L. a. W. H.-C.,
Guo L., and
Wu H. C., «Robust Abnormal Human-Posture Recognition Using OpenPose and Multi-View Cross-Information, IEEE Sensors Journal. (2023) 23, no. 11, 12370–12379, https://doi.org/10.1109/jsen.2023.3267300.
10.1109/JSEN.2023.3267300 Google Scholar
- 35 Bazarevsky M., «Blazepose: On-Device Real- Time Body Pose Tracking, 2020.
- 36 Lin L., «Microsoft Coco: Common Objects in Context, Computer Vision--ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V. (2014) 13, 740-–755.
- 37 Bazarevsky F., «On-device, Real-Time Hand Tracking with Mediapipe,» Google AI Blog, 2019.
- 38 Sastry K., «Fusing Spatio-Temporal Joint Features for Adequate Skeleton Based Action Recognition Using Global Alignment Kernel, International Journal of Engineering and Advanced Technology. (2019) 8, 749-–754.
- 39 Redmon A., «You Only Look once: Unified, Real-Time Object Detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, August 2016, 779-–788.
- 40 Wang Y. a. W. H. a. X. Z., Wang H., and Xin Z., Efficient Detection Model of Steel Strip Surface Defects Based on YOLO-V7, IEEE Access. (2022) 10, 133936-–133944, https://doi.org/10.1109/access.2022.3230894.
- 41 Simonyan K. a. Z. A., «Very Deep Convolutional Networks for Large-Scale Image Recognition, 2014.
- 42 Chollet F., «Xception: Deep Learning with Depthwise Separable Convolutions, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, September 2017, 1251–1258.
- 43
He K. a. Z. X. a. R. S. a. S. J.,
Zhang X.,
Ren S., and
Sun J., «Identity Mappings in Deep Residual Networks, Lecture Notes in Computer Science. (2016) 14, 630–645, https://doi.org/10.1007/978-3-319-46493-0_38, 2-s2.0-84990050094.
10.1007/978-3-319-46493-0_38 Google Scholar
- 44 NVIDIA, 2023.
- 45
Szegedy A.,
Ioffe S.,
Vanhoucke V., and
Alemi A., «Inception-v4, Inception-Resnet and the Impact of Residual Connections on Learning, Proceedings of the AAAI Conference on Artificial Intelligence. (2017) 31, no. 1, https://doi.org/10.1609/aaai.v31i1.11231.
10.1609/aaai.v31i1.11231 Google Scholar
- 46
Sandler M.,
Howard A.,
Zhu M.,
Zhmoginov A., and
Chen L. C., «Mobilenetv2: Inverted Residuals and Linear Bottlenecks, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, September 2018, 4510–4520, https://doi.org/10.1109/cvpr.2018.00474, 2-s2.0-85062799511.
10.1109/cvpr.2018.00474 Google Scholar
- 47 Hernandez-Ortega J., Tolosana R., Fierrez J., and Morales A., Deepfakeson-phys: Deepfakes Detection Based on Heart Rate Estimation, arXiv preprint arXiv:2010.00400. (2020) .
- 48 Li T., Zhao Z., Luo Y. et al., Gait Recognition Using Spatio-Temporal Information of 3D Point Cloud via Millimeter Wave Radar, Wireless Communications and Mobile Computing. (2022) 2022, no. 1, 1–16, https://doi.org/10.1155/2022/4555136.
- 49 Keskar N. S. and Socher R., Improving Generalization Performance by Switching from Adam to Sgd, 2017.
- 50 Scikit-Learn, Metrics and Scoring: Quantifying the Quality of Predictions, 2022.
- 51 Zhou B., Khosla A., Lapedriza A., Oliva A., and Torralba A., Learning Deep Features for Discriminative Localization, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, May 2016, 2921–2929.