Good news! Our work on using crowdsourcing and machine learning to grade spontaneous English has been accepted at ACL 2015.
- Ours is the first semi-automated approach to grade spontaneous speech.
- We propose a new general technique which sits between completely automated grading techniques and peer grading: We use crowd for doing the tough human intelligence task, derive features from it and use ML to build high quality models.
- We think, this is the first time anyone used crowdsourcing to get accurate features that are then fed into ML to build great models. Correct us if we are wrong!
Figure 1: Design of our Automated Spontaneous Speech grading system.
The technique helps scale spoken English testing, which means super scale spoken English training!
Great job Vinay and Nishant.
PS: Also check out our KDD paper on programming assessment if you already haven’t.