Scores used in Openears

Home Forums OpenEars Scores used in Openears

Viewing 6 posts - 1 through 6 (of 6 total)

  • Author
    Posts
  • #10898
    kelvin
    Participant

    Hi,
    I’m using Openears API 1.1. I would like to enquire about the following questions.

    1) recognitionScore in pocketsphinxDidReceiveHypothesis function is it equal to confidence score? Is it the lower the more accurate in pronounciation? Any idea how do we get the formulae?

    2) I understand that in an n-bestlist it always take the 1st hypothesis score(which is the higher ones). Any idea, how do we obtain the results as in formuales used?

    #10899
    Halle Winkler
    Politepix

    recognitionScore is equivalent to confidence score, but in pocketsphinx that is extraordinarily dependent on size of language model and environment and speaker, meaning that you have to be very conservative about using it for any program logic. I recommend testing a lot under many circumstances before deciding how to use scoring or whether to use it.

    For n-best, are all the scores not being returned?

    #10900
    kelvin
    Participant

    Thanks for the prompt reply. Any idea how the recognitionScore are being generated as in the formulae in it?

    No problem returning n-best.

    #10901
    Halle Winkler
    Politepix

    I would just recommend looking into the source in the framework project to get the exact formula/e.

    #10902
    Halle Winkler
    Politepix

    Sorry I don’t have a lot of info on hand about the way that the scoring works — I made a decision to pass the score along via the API because it was available as data and it seemed like overreaching to decide not to pass it back through the callback, but based on my discussions with the CMU Sphinx folks it doesn’t provide a lot of viable info for language models of the size that are appropriate for iPhone apps so I haven’t done a lot of investigation of its intricacies myself. My general advice is that you should base any logic that makes use of the score on data that emerges from well-organized and diverse tests rather than an interpretation of the scoring method.

    #10903
    kelvin
    Participant

    Ok. Thanks for all the advice that you have provided.

Viewing 6 posts - 1 through 6 (of 6 total)
  • You must be logged in to reply to this topic.