Conversation's response in two and more bubbles

dialogflow

#1

Hello, community! I’m trying to split text into several bubbles (speech messages) continiously followings each other , but generally I always get one bubble. I’ve tried ssml, speechEditor and other variants described in doc. Does anybody solved this issue?


#2

Good point.
I’m waiting for a Pull Request and will publish the feature tomorrow.

It will look like this

this.$googleAction!.appendSimpleResponse({
    displayText: 'Hello',
    textToSpeech: 'Test'
});

#3

@AlexSwe it’s quite similar to https://www.jovo.tech/docs/google-assistant/visual-output#display-text , but does it resolves the issue with multiple bubbles? I’ve found here https://stackoverflow.com/questions/49417694/how-can-i-create-a-multi-part-response-with-dialogflow that someone tried to investigate this case earlier, bit seems no luck!


#4

Published the feature a couple of minutes ago.

Yes, this will add a second bubble. (it’s not possible to add more)

Full sample:

this.tell('HelloWorld');
this.$googleActionappendSimpleResponse({
    displayText: 'Hello',
    textToSpeech: 'Test'
});


#5

Have tested and should say it works fine! By the way, could we send in a cast of second speech buble e.g. Basic Card?


#6

Try this:

const basicCard = new BasicCard()
            .setTitle('Title')
            .setImage({
                url: 'http://via.placeholder.com/450x350?text=Basic+Card',
                accessibilityText: 'accessibilityText'})
            .setFormattedText('Formatted Text')
            .setImageDisplay('WHITE');
this.$googleAction.appendResponse({
        basicCard
});
this.tell('HelloWorld');

#7

Thank you! I got it. When I use SSML with markup my agent pronounce all tags . Can I avoid it?


#8

Can you share some code? Usually SSML-tags aren’t pronounced


#9

I use SpeechBuilder

function get_help_info(e_g_jovo_obj) {

    return e_g_jovo_obj.speechBuilder()
        .addSentence('You are playing XXX quiz.')
        .addBreak('100ms')
        .addSentence('Do you need to hear the question once more?');
}

So, the output contains tags <speak>, <s>.
Using

let info = get_help_info();
this.$googleAction.appendSimpleResponse({
                displayText: ...,
                textToSpeech: ...
            });

like that needs some processing of info object , 'cause appendSimpleResponse won’t work with it and when I use info.speech property then SSML tags are shown in the output and assistant pronounce tags also.


#10

So, you want to remove the SSML tags from the string?
You could use a SpeechBuilder helper method.

const { App, SpeechBuilder } = require('jovo-framework');

In your case:

SpeechBuilder.removeSSML(info.speech)

#11

Not actually. Yes, I can strip tags, but it will cause effect on both display text and text to speech. What I really want is to use appendSimpleResponse for second bubble , show html-stripped text on device screen , but still hear voice with delays(breaks) and other SSML features.


#12

I may misunderstand something, but the sample below should solve the problem?! :smiley:

let textWithoutSSML = SpeechBuilder.removeSSML(info.speech);

this.$googleAction.appendSimpleResponse({
                displayText: textWithoutSSML ,
                textToSpeech: info.speech
});

#13

I think I’ve been testing this one :slight_smile: I’ll check one more time. Thank you!