Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speech to Text Module #31

Open
wants to merge 41 commits into
base: main
Choose a base branch
from
Open

Speech to Text Module #31

wants to merge 41 commits into from

Conversation

sharabhuiyan
Copy link
Contributor

We created a module that evaluates the pronunciation of a phrase given an audio recording.

  • Utilized the IBM Watson API to help us transcribe audio clips.
  • Created a frontend interface that allows students to read and record specific sentences.
  • In the backend, we calculate a pronunciation score for each sentence by using the Levenshtein edit-distance between the audio transcript and the original sentence.

Screen Shot 2021-05-24 at 5 12 52 PM

Screen Shot 2021-05-24 at 5 12 24 PM

@ryaanahmed @MBJean

phuang00 and others added 30 commits April 23, 2021 15:10
@phuang00
added files
3d9eda1
@jlin00
init frontend
f2dda25
@phuang00
added speech to text
196f09c
@phuang00
fixed imports
24c55b2
@sharabhuiyan
Create speech_to_text.py
65d4040
@sharabhuiyan
Merge branch 'speech-to-text' of https://github.com/dhmit/lang_learn …
66e59a7 
…into speech-to-text
@sharabhuiyan
Update speech_to_text.py
b2ddf0f
@jlin00
added proptypes
a865616
@phuang00
updated views
5b2569b
@sharabhuiyan
Update speech_to_text.py
bd45d09
@sharabhuiyan
Merge branch 'speech-to-text' of https://github.com/dhmit/lang_learn …
6d9885c 
…into speech-to-text
@phuang00
added api to pass sentences to frontend
e50467d
@phuang00
added react-mic
f1ebac7
@jlin00
added react-mic
80a3d2c
@phuang00
removed print statement
cf54a8a
@phuang00
Update requirements.txt
cdd7d74
@jlin00
added playback functionality
b846024
@jlin00
Merge branch 'speech-to-text' of https://github.com/dhmit/lang_learn …
871e136 
…into speech-to-text
@phuang00
removed some changes
570a058
@phuang00
Merge branch 'speech-to-text' of https://github.com/dhmit/lang_learn …
1355ceb 
…into speech-to-text
@phuang00
add IBM api, will put in apikey later
bfc36fb
@phuang00
added api to views
e894af5
@phuang00
updated config for API key without putting it on github
dd03b7e
@phuang00
added sentences and made page look more like figma
7499f41
@phuang00
add keywords to IBM api
af35ce2
@sharabhuiyan
tested sphinx audio transcription
61dc25b
@sharabhuiyan
updated add_text
f4c684c
@jlin00
deleted pocket sphinx
d046298
@phuang00
added scoring based on edit distance
4e229cd
@phuang00
Merge branch 'master' into speech-to-text
c9934e2
@sharabhuiyan sharabhuiyan requested review from ryaanahmed and MBJean May 25, 2021 05:55
@MBJean
Copy link
Contributor

MBJean commented May 28, 2021

Thanks for this PR! I'll begin looking through it today and leaving my feedback.

@MBJean
Copy link
Contributor

MBJean commented Jun 1, 2021

Just a quick note, all! We're holding off on leaving feedback on this PR until next week. Since we're past the end of the semester, you're under no obligation to address the feedback we do intend to leave. Please do read through it once we've supplied it and let me know if you have any questions, but Ryaan and I will take care of wrapping this PR up and getting it into production. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ryaanahmed ryaanahmed Awaiting requested review from ryaanahmed

@MBJean MBJean Awaiting requested review from MBJean

At least 1 approving review is required to merge this pull request.

Assignees

@jlin00 jlin00

@phuang00 phuang00

@sharabhuiyan sharabhuiyan

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@sharabhuiyan @MBJean @jlin00 @phuang00