Subtitle is missing on Google smart displays

dialogflow
#1

Somehow Google seems not to display media subtitles on smart displays. Does anyone have experience with this issue?

SITUATION
Media subtitles get displayed in the Google Assistant when the description property get a string. E. g. “a funky Jazz tune” in the example of the Google Media Responses.

PROBLEM
The very same subtitle is not visible on smart displays, e. g. Google Nest Hub or in the figure 7 in the Google example.

QUESTION
Is this a bug? Does Jovo have a workaround?

Here my Jovo code:

jovo.$googleAction.$mediaResponse.play("some url", "some title", {
    description: "some subtitle -> not displayed",
    largeImage: {
        url: imageUrl,
        alt: "",
    },
});
#2

Hi @fschwander,

Could you share your response JSON?

Thanks,
Jan

#3

Hi Jan, gladly and thanks for the quick response!

{
  "fulfillmentText": "Gern! Hier kommt die Sendung: Maloney vom <say-as interpret-as=\"date\" format=\"dd.mm\" detail=\"1\">28.2.</say-as><break time=\"0.5s\"/>: Der Schlüssel zum Erfolg",
  "end_interaction": true,
  "outputContexts": [
    {
      "name": "projects/newagent-904be/agent/sessions/1526414104011/contexts/actions_capability_screen_output"
    },
    {
      "name": "projects/newagent-904be/agent/sessions/1526414104011/contexts/actions_capability_audio_output"
    },
    {
      "name": "projects/newagent-904be/agent/sessions/1526414104011/contexts/google_assistant_input_type_keyboard"
    },
    {
      "name": "projects/newagent-904be/agent/sessions/1526414104011/contexts/actions_capability_web_browser"
    },
    {
      "name": "projects/newagent-904be/agent/sessions/1526414104011/contexts/actions_capability_media_response_audio"
    }
  ],
  "payload": {
    "google": {
      "expectUserResponse": false,
      "richResponse": {
        "items": [
          {
            "simpleResponse": {
              "ssml": "<speak>Gern! Hier kommt die Sendung: Maloney vom <say-as interpret-as=\"date\" format=\"dd.mm\" detail=\"1\">28.2.</say-as><break time=\"0.5s\"/>: Der Schlüssel zum Erfolg</speak>"
            }
          },
          {
            "mediaResponse": {
              "mediaType": "AUDIO",
              "mediaObjects": [
                {
                  "name": "Maloney",
                  "contentUrl": "https://srfaudio-a.akamaihd.net/delivery/world/1be795c8-ce18-41ea-9afe-0e70494ae855.mp3",
                  "description": "Der Schlüssel zum Erfolg",
                  "largeImage": {
                    "url": "https://ws.srf.ch/asset/image/audio/6a157454-8930-42d4-ab8d-0944b7549d0d/PODCAST/1570697982.jpg",
                    "alt": ""
                  }
                }
              ]
            }
          }
        ],
        "suggestions": [
          {
            "title": "pause"
          },
          {
            "title": "start over"
          }
        ]
      },
      "userStorage": "{\"userId\":\"jovo-debugger-user\"}"
    }
  }
}
#4

Hi @fschwander,

Hmm, the structure is the same as in the Google Assistant docs, so it should be working. Maybe a Google issue?

#5

Hey @jan,
I guess so too, thanks for looking at my problem!
Danke dir und Gruss, Fabian