Solution design

To achieve our solution, we are going to do the following:

  1. On the view-thread page, we are going to provide a button next to Reply named Reply with Audio to keep things simple

  2. The user is going to record an audio to our server using this interface
  3. The audio will be saved on our servers temporarily
  4. The uploaded audio will then be sent to Cloud Speech API to detect text
  5. Once we get back the response, we upload this to Cloudinary, a file hosting service
  6. Once the upload to Cloudinary is successful, we will get back the public URL
  7. Using all the data we have gathered so far, we are going to create a new message and then respond with it
  8. The Angular app will process the response and update the thread
Uploading audio to Cloudinary ...

Get Google Cloud AI Services Quick Start Guide now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.