speech-evaluation

Versatile Evaluation of Speech and Audio

Comprehensive voice cloning evaluation: seven automatic speech metrics and ready-to-use benchmark datasets. Score any model’s audio with Python or CLI.

A simple pronunciation evaluation engine python library.

Mandarin Tone Classifier

SHALLOW, the first hallucination benchmark for ASR models

An objective evaluation toolkit for multi-speaker dialogue generation using speaker attribution, speaker similarity, and word error rate

Created a Speech Quality Evaluator API 🎤 as part of an educational technology project, assessing accuracy, pronunciation, and vocal expression in real-time. 📈 Designed to provide weighted average scores for speech evaluations, ensuring precise feedback for educational purposes. 🌟

A standalone tool for evaluating Automatic Speech Recognition (ASR) models, particularly optimized for medical/clinical speech recognition, using Word Error Rate (WER) metric

Evaluation of speech AI behaviour, including transcription, speech metrics, filler detection, and grounded coaching design.

Japanese speech analysis toolkit featuring pitch tracking, audio processing, and evidence-aware evaluation. Backend open source; frontend private.

Self-hosted and offline-first platform for subjective speech evaluation (MOS & SUS intelligibility testing).

Reproducible speech evaluation platform for TTS benchmarking, regression detection, and traceable evidence.

Machine learning notebook for SHL Grammar Scoring Challenge using audio feature extraction and regression models to predict grammar scores.

Kyrgyz-language AI Tutor portfolio: annotation, transcription benchmark, decision log, localization audit, TTS scorecard — built on kgvoice

Speech recognition benchmark and ASR leaderboard for vertical domain evaluation.

Multilingual speech evaluation benchmarks for ASR and related speech tasks with reproducible dataset preparation and reporting.