useChat with generateText (maxRoundTrips)?

[benjaminalgreen]

Is it possible to useChat with generateText instead of streamText? Is there a best practice for appending generated text to the message stream and sending it back to the frontend?

Main reason for this is that I'm using the new maxroundtrips with generateText, but still want to have a chat UI. Alternatively, is there a good way to feed tool results into the message stream for streamText?

[lgrammel]

Here is a guide for using maxToolRoundtrips with useChat: https://sdk.vercel.ai/docs/ai-sdk-ui/chatbot-with-tool-calling

[benjaminalgreen]

Thanks @lgrammel, I'm on Sveltekit so I don't believe that approach works for me. Is there a workaround with tools on the backend?

[lgrammel]

ideally the functionality would be added to SvelteKit. Unfortunately I don't have the bandwidth to cover all frameworks so community contributions are appreciated

[benjaminalgreen]

No problem! I'm not a great programmer so can't help you there. Can generateText be used with useChat? Otherwise I'll revert to the workaround I saw of manually appending toolResults to messages.

[aretrace]

Hi @lgrammel,

I'm also interested in using useChat with generateText, it doesn't seem they fit together in a meaningful fashion (unlike streamText that fits like a glove).

Quick preliminary escape hatch I've come up with:

<div>
  {messages.map((m) => (
    <div key={m.id}>
      {m.role === "user" && "You: " + m.content}
      {m.role === "assistant" && "AI: " + JSON.parse(m.content).messages[0].content[0].text}
    </div>
  ))}
</div>

What do you think? What would you recommend todo?

P.S.
Is generateText simply not designed to be used with useChat? If so, why not? 😢
And, may there be any future where Vercel could reconcile these two APIs? 🥺