Improving LLM chatbot UX by utilizing a stateful Markdown stream processor(shopify.engineering)

4 pointsby atesgoral3 ปีที่แล้ว2 comments

Improving LLM chatbot UX by utilizing a stateful Markdown stream processor

https://shopify.engineering/sidekicks-improved-streaming

1 comments

russellbeattie3 ปีที่แล้ว

Or you can specify that LLMs respond in valid HTML and save yourself the processing step.

atesgoral3 ปีที่แล้ว

Ignoring the additional token count cost of HTML, how do you envision rendering HTML that is spit out by an LLM directly (without any processing) to the user?