Scores used in Openears – Politepix /forums/topic/scores-used-in-openears/feed/ Tue, 23 Apr 2024 14:39:35 +0000 https://bbpress.org/?v=2.6.9 en-US /forums/topic/scores-used-in-openears/#post-10898 <![CDATA[Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10898 Fri, 31 Aug 2012 10:15:22 +0000 kelvin Hi,
I’m using Openears API 1.1. I would like to enquire about the following questions.

1) recognitionScore in pocketsphinxDidReceiveHypothesis function is it equal to confidence score? Is it the lower the more accurate in pronounciation? Any idea how do we get the formulae?

2) I understand that in an n-bestlist it always take the 1st hypothesis score(which is the higher ones). Any idea, how do we obtain the results as in formuales used?

]]> /forums/topic/scores-used-in-openears/#post-10899 <![CDATA[Reply To: Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10899 Fri, 31 Aug 2012 10:39:18 +0000 Halle Winkler recognitionScore is equivalent to confidence score, but in pocketsphinx that is extraordinarily dependent on size of language model and environment and speaker, meaning that you have to be very conservative about using it for any program logic. I recommend testing a lot under many circumstances before deciding how to use scoring or whether to use it.

For n-best, are all the scores not being returned?

]]> /forums/topic/scores-used-in-openears/#post-10900 <![CDATA[Reply To: Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10900 Fri, 31 Aug 2012 10:59:48 +0000 kelvin Thanks for the prompt reply. Any idea how the recognitionScore are being generated as in the formulae in it?

No problem returning n-best.

]]> /forums/topic/scores-used-in-openears/#post-10901 <![CDATA[Reply To: Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10901 Fri, 31 Aug 2012 11:39:04 +0000 Halle Winkler I would just recommend looking into the source in the framework project to get the exact formula/e.

]]> /forums/topic/scores-used-in-openears/#post-10902 <![CDATA[Reply To: Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10902 Fri, 31 Aug 2012 11:47:59 +0000 Halle Winkler Sorry I don’t have a lot of info on hand about the way that the scoring works — I made a decision to pass the score along via the API because it was available as data and it seemed like overreaching to decide not to pass it back through the callback, but based on my discussions with the CMU Sphinx folks it doesn’t provide a lot of viable info for language models of the size that are appropriate for iPhone apps so I haven’t done a lot of investigation of its intricacies myself. My general advice is that you should base any logic that makes use of the score on data that emerges from well-organized and diverse tests rather than an interpretation of the scoring method.

]]> /forums/topic/scores-used-in-openears/#post-10903 <![CDATA[Reply To: Scores used in Openears]]> /forums/topic/scores-used-in-openears/#post-10903 Fri, 31 Aug 2012 11:59:47 +0000 kelvin Ok. Thanks for all the advice that you have provided.

]]>