Since 2017, Mozilla's Common Voice project has collected more than 30,000 hours of recordings of people from around the world speaking their languages.
The project's goal is to provide a free, publicly available dataset that anyone can use for training voice recognition AI software and other projects, while ensuring that all the material is provided with the informed consent of the people being recorded. Common Voice now includes recorded material and corresponding transcripts in roughly 180 languages, all available under the public domain-like Creative Commons CC0 license, with volunteers from communities worldwide working to add their own languages to the mix.
"We don't add languages to the platform without communities," says EM Lewis-Jong, product director at Mozilla. "It sounds like a small thing, but I think in the current AI age, it actually is weirdly radical to be consent-centered."
And while Mozilla doesn't disclose, or in some cases even necessarily know, exactly who's using the data, Lewis-Jong says it's been used by Big Tech companies, small independent operations, and plenty of projects in between. The dataset has been downloaded from Mozilla millions of times, and it's also available through the AI development platform Hugging Face, which hosts speech recognition models trained on the Common Voice data.