Skip to content
This repository has been archived by the owner on Jul 22, 2024. It is now read-only.

Latest commit

 

History

History
72 lines (37 loc) · 3.4 KB

WIKI.md

File metadata and controls

72 lines (37 loc) · 3.4 KB
Raw

Short Title

Build custom Speech to Text model with speaker diarization capabilities

Long Title

Build custom Speech to Text model and transcribe audios to detect multiple speakers from the audio

Author

URLs

Github repo

Video Link

Summary

In this code pattern, given a corpus file and audio recordings of a meeting or classroom, we train custom language and acoustic speech to text model to transcribe audios to get speaker diarized output.

Technologies

  • Python: An open-source interpreted high-level programming language for general-purpose programming.

  • Object Storage: Store large amounts of data in a highly scalable manner.

Description

One of the features of Watson Speech to Text is the capability to detect different speakers from the audio also known as speaker diarization. In this code pattern, we will showcase the speaker diarization capabilities of Watson Speech to Text by training a custom language model with a corpus text file which will train the model with ‘Out of Vocabulary’ words and a custom acoustic model with the audio files (extracted in the previous code pattern of the series) which will train the model with ‘Accent’ detection, in a python flask runtime.

Refer this link for complete details of the series: https://developer.ibm.com/articles/text-mining-and-analysis-from-webex-recordings

Flow

architecture

  1. User uploads corpus file to the application

  2. The extracted audio from the previous code pattern of the series is retrived from Cloud Object Storage

  3. The corpus file as well as the extracted audio are uploaded to Watson Speech To Text to train the custom model

  4. The Downloaded audio file from the previous code pattern of the series is transcribed with the custom Speech To Text model and the text file is stored in Cloud Object Storage

Instructions

Find the detailed steps in the README file.

  1. Clone the repo

  2. Create Watson Speech To Text Service

  3. Add the Credentials to the Application

  4. Deploy the Application

  5. Run the Application

Components and services

  • Speech to Text: The Speech to Text service converts the human voice into the written word. It can be used anywhere there is a need to bridge the gap between the spoken word and their written form, including voice control of embedded systems, transcription of meetings and conference calls, and dictation of email and notes.

  • Object Storage: IBM Cloud Object Storage is a highly scalable cloud storage service, designed for high durability, resiliency and security. Store, manage and access your data via our self-service portal and RESTful APIs. Connect applications directly to Cloud Object Storage use other IBM Cloud Services with your data.