Enhancing Forensic Audio Transcription with Neural Network-Based Speaker Diarization and Gender Classification

Rahmat Ullah, Ikram Asghar, Hassan Malik, Gareth Evans, Jawad Ahmad, Dorothy Anne Roberts

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Forensic audio transcription is often compromised by low-quality recordings, where indistinct speech can hinder the accuracy of conventional Automatic Speech Recognition (ASR) systems. This study addresses this limitation by developing a machine learning-based approach to improve speaker diarization, a process critical for distinguishing between speakers in sensitive audio data. Previous research highlights the inadequacy of traditional ASR in forensic settings, particularly where audio quality is poor and speaker overlap is common. This paper presents a neural network specifically designed for gender classification, using 20 key acoustic features extracted from real forensic audio data. The model architecture includes input, hidden, and output layers tailored to differentiate male and female voices, with dropout regularization to prevent overfitting and hyperparameter optimization ensuring robust generalization across test data. The neural network achieved an average recall of 86.81%, F1 score of 85.67%, precision of 87.95%, and accuracy of 86.83% across varied audio conditions. This model significantly improves transcription accuracy, reducing errors in legal contexts and supporting judicial processes with more reliable, interpretable evidence from sensitive audio data.
Original languageEnglish
Title of host publication2024 International Conference on Engineering and Emerging Technologies (ICEET)
Place of PublicationDubai, UAE
PublisherIEEE
Pages1-6
Number of pages6
ISBN (Electronic)9798331532895
ISBN (Print)9798331532901
DOIs
Publication statusPublished - 12 Mar 2025

Publication series

NameInternational Conference on Engineering and Emerging Technologies
PublisherIEEE
ISSN (Print)2409-2983
ISSN (Electronic)2831-3682

Fingerprint

Dive into the research topics of 'Enhancing Forensic Audio Transcription with Neural Network-Based Speaker Diarization and Gender Classification'. Together they form a unique fingerprint.

Cite this