Using AVFoundation and OpenEars – Politepix /forums/topic/using-avfoundation-and-openears/feed/ Tue, 23 Apr 2024 14:39:29 +0000 https://bbpress.org/?v=2.6.9 en-US /forums/topic/using-avfoundation-and-openears/#post-10924 <![CDATA[Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10924 Mon, 03 Sep 2012 17:16:27 +0000 NebulaFox I am using AVFoundation to record audio and video into a mp4 file and displaying the preview using AVCapturePreviewLayer.

If I start PocketsphinxController listening before I tell AVCaptureSession to start running, the OpenEarsLogging shows it is not detecting any sound.

=STARTLOG
The audio session has never been initialized so we will do that now.
Checking and resetting all audio session settings.
audioCategory is incorrect, we will change it.
audioCategory is now on the correct setting of kAudioSessionCategory_PlayAndRecord.
bluetoothInput is incorrect, we will change it.
bluetooth input is now on the correct setting of 1.
categoryDefaultToSpeaker is incorrect, we will change it.
CategoryDefaultToSpeaker is now on the correct setting of 1.
preferredBufferSize is incorrect, we will change it.
PreferredBufferSize is now on the correct setting of 0.128000.
preferredSampleRateCheck is incorrect, we will change it.
preferred hardware sample rate is now on the correct setting of 16000.000000.
AudioSessionManager startAudioSession has reached the end of the initialization.
Exiting startAudioSession.
…
Recognition loop has started
…
Starting openAudioDevice on the device.
Audio unit wrapper successfully created.
Set audio route to SpeakerAndMicrophone
Checking and resetting all audio session settings.
audioCategory is correct, we will leave it as it is.
bluetoothInput is correct, we will leave it as it is.
categoryDefaultToSpeaker is correct, we will leave it as it is.
preferredBufferSize is correct, we will leave it as it is.
preferredSampleRateCheck is correct, we will leave it as it is.
Setting the variables for the device and starting it.
Looping through ringbuffer sections and pre-allocating them.
…
Started audio output unit.
Calibration has started
…
The Audio Session was interrupted.
Calibration has completed
Project has these words in its dictionary:
RECORD
RECORD(2)
RECORD(3)
SNAP
STOP

Listening.
…
Audio route has changed for the following reason:
There has been a change of category
The previous audio route was SpeakerAndMicrophone
This is not a case in which OpenEars performs a route change voluntarily. At the close of this function, the audio route is SpeakerAndMicrophone
Audio route has changed for the following reason:
There has been a change of category
The previous audio route was Speaker
This is not a case in which OpenEars performs a route change voluntarily. At the close of this function, the audio route is SpeakerAndMicrophone
=ENDLOG

If I start PocketsphinxController listening after I tell AVCaptureSession to start running then OpenEarsLogging shows it is detecting audio but the AVCaptureLayer displaying the feed from AVCaptureSession is frozen.

How can I get it so that I can get PocketsphinxController listening and still have AVCaptureSession showing input via AVCaptureSession.

]]> /forums/topic/using-avfoundation-and-openears/#post-10926 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10926 Mon, 03 Sep 2012 17:31:15 +0000 Halle Winkler Are you capturing audio at the same time as you are trying to do speech recognition?

]]> /forums/topic/using-avfoundation-and-openears/#post-10936 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10936 Mon, 03 Sep 2012 18:39:05 +0000 NebulaFox I connect the audio input to the AVCaptureSession initially and this is the point I get to while I have been testing. I do hope that it is possible to somehow use speech recognition while capturing audio.

]]> /forums/topic/using-avfoundation-and-openears/#post-10937 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10937 Mon, 03 Sep 2012 18:44:11 +0000 Halle Winkler There’s only one audio stream, it can’t be streamed into two objects simultaneously.

]]> /forums/topic/using-avfoundation-and-openears/#post-10938 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10938 Mon, 03 Sep 2012 18:48:12 +0000 NebulaFox Is there away to copy the one audio stream and that can be sent to multiple objects?

]]> /forums/topic/using-avfoundation-and-openears/#post-10939 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10939 Mon, 03 Sep 2012 18:50:08 +0000 Halle Winkler I don’t think that is going to be trivial. I’m sure it is in some way possible but I doubt it can be done while enjoying any of the convenience functions of AVCaptureSession or AudioSessionManager/ContinuousAudioUnit. It’s unfortunately outside of the scope of the support I can give here.

]]> /forums/topic/using-avfoundation-and-openears/#post-10940 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10940 Mon, 03 Sep 2012 18:57:18 +0000 NebulaFox That is true. Although, through AVCaptureSession I have a CMSampleBuffer that should contain an audio sample. It is a shame that can not some how be used.

]]> /forums/topic/using-avfoundation-and-openears/#post-10941 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10941 Mon, 03 Sep 2012 19:04:53 +0000 Halle Winkler You could try keeping your sample buffers and writing them out to a WAV file and submitting the WAV file to the runRecognitionOnWavFileAtPath: method. You won’t get voice audio detection/continuous recognition but you can submit the speech at the end of the capture.

]]> /forums/topic/using-avfoundation-and-openears/#post-10942 <![CDATA[Reply To: Using AVFoundation and OpenEars]]> /forums/topic/using-avfoundation-and-openears/#post-10942 Mon, 03 Sep 2012 19:07:17 +0000 NebulaFox Oww… I will try that

]]>