`Hey guys I’ve a query about intergrating Agora with Openai’s realtime api. My query is: get the textual content returned by openai realtime api from the shopper?
I’m following this web page: https://docs.agora.io/en/open-ai-integration/get-started/quickstart?platform=python. I’ve set my very own backend on AWS EC2, and the Voice a part of OpenAI realtime api works good. Now I additionally wish to permit the Consumer (Android and Ios) might entry the textual content return by OpenAI.
I’ve observed that’s the official backend implementation: https://github.com/AgoraIO/openai-realtime-python/blob/principal/realtime_agent/agent.py, -> _process_model_messages -> ResponseAudioTranscriptDelta, already offers the textual content return:
case ResponseAudioTranscriptDelta():
# logger.information(f"Obtained textual content message {message=}")
asyncio.create_task(self.channel.chat.send_message(
ChatMessage(
message=to_json(message), msg_id=message.item_id
)
))
case ResponseAudioTranscriptDone():
logger.information(f"Textual content message carried out: {message=}")
asyncio.create_task(self.channel.chat.send_message(
ChatMessage(
message=to_json(message), msg_id=message.item_id
)
))
So my remaining questions is basiclly tips on how to get the info despatched by “self.channel.chat.send_message” on IOS/Android/Internet
Thanks for you assist!
I’ve tried to make use of
1.signaling sdk
https://www.agora.io/en/merchandise/signaling/
2.chat sdk
https://www.agora.io/en/merchandise/chat/
However since I am new to agora, I’ve not received issues carried out to date.
`
