Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatML: ChatGPT API expects a structured format, called Chat Markup Language

github.com

Post reply on HN
Print view View original

1–10 of 83 posts

Re: ChatML: ChatGPT API expects a structured format, called Chat Markup Language

#4

Post by gdb »

(I work at OpenAI.)

This document is a preview of the underlying format consumed by ChatGPT models. As an API user, today you use our higher-level API (https://platform.openai.com/docs/guides/chat). We'll be opening up direct access to this format in the future, and want to give people visibility into what's going on under the hood in the meanwhile!

Re: ChatML: ChatGPT API expects a structured format, called Chat Markup Language

#6

Post by explaininjs »

Is it just me or is this the least intuitive format imaginable? The type def is something like:

    type Message = string
    type Speaker = 'system' | 'user' | 'assistant' | 'system name=example_user' | 'system name=example_assistant'
    type CML = ('\n' | '${Speaker}\n${Message}' | {token: ''|''})[]
I'd expect something more like...

    type Message = string
    type Speaker = 'system' | 'user' | 'assistant' | 'example_user' | 'example_assistant'
    type CML = {message: Message, speaker: Speaker}[]

Re: ChatML: ChatGPT API expects a structured format, called Chat Markup Language

#8

Post by gdb »

explaininjs wrote: post #6

Is it just me or is this the least intuitive format imaginable? The type def is something like: type Message = string type Speaker = 'system' | 'user' | 'assistant' | 'system name=example_user' | 'system name=example_assistant' type CML = ('\n' | '${Speaker}\n${Message}' | {token: ' '|' '})[] I'd expect something more like... type Message = string type Speaker = 'system' | 'user' | 'assistant' | 'example_user' | 'exa…

Will all make more sense with upcoming releases, we have a lot of extensions in the works :).
Post reply on HN