Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

RubyLLM: A Ruby framework for all major AI providers

rubyllm.com

Post reply on HN
Print view View original

1–10 of 91 posts

Re: RubyLLM: A Ruby framework for all major AI providers

#3

Post by swe_dima »

I found Ruby LLM to be surprisingly good - in terms of usability it's close to Vercel's AI framework.

It tries to strike a balance between working out of the box and being flexible... which has its challenges, still nice overall.

One big real-life pain I experienced is that caches don't always work, e.g. for xAI, since it only supports completions API and thought signatures are returned wrong.

Re: RubyLLM: A Ruby framework for all major AI providers

#4

Post by earcar »

mosselman wrote: post #2

It is quite nice, but not as nice as you'd want. You still have to set platform specifics when running completions when you want to tune things like temperature, effort, max tokens, etc.

RubyLLM author here.

I'm not sure where you got that.

`chat.with_temperature(0.2)`

https://rubyllm.com/chat/#controlling-response-behavior

`chat.with_thinking(effort: :high, budget: 8000)`

https://rubyllm.com/thinking/#controlling-extended-thinking

Max tokens is the only one of your list that require provider specific params:

https://rubyllm.com/chat/#provider-specific-parameters

I'm one guy doing it for free. Happy to see your contribution!

Re: RubyLLM: A Ruby framework for all major AI providers

#6

Post by earcar »

swe_dima wrote: post #3

I found Ruby LLM to be surprisingly good - in terms of usability it's close to Vercel's AI framework. It tries to strike a balance between working out of the box and being flexible... which has its challenges, still nice overall. One big real-life pain I experienced is that caches don't always work, e.g. for xAI, since it only supports completions API and thought signatures are returned wrong.

Thank you!

Responses API is now implemented and it's coming in RubyLLM 2.0

https://github.com/crmne/ruby_llm/blob/main/lib/ruby_llm/pro...

Re: RubyLLM: A Ruby framework for all major AI providers

#7

Post by techscruggs »

earcar wrote: post #4
mosselman wrote: post #2

It is quite nice, but not as nice as you'd want. You still have to set platform specifics when running completions when you want to tune things like temperature, effort, max tokens, etc.

RubyLLM author here. I'm not sure where you got that. `chat.with_temperature(0.2)` https://rubyllm.com/chat/#controlling-response-behavior `chat.with_thinking(effort: :high, budget: 8000)` https://rubyllm.com/thinking/#controlling-extended-thinking Max tokens is the only one of your list that require provider specific params: https://rubyllm.com/chat/#provider-specific-parameters I'm one guy doing it for free. Happy…

And thank you! It is absolutely awesome and a true joy to work with.

Re: RubyLLM: A Ruby framework for all major AI providers

#10

Post by techscruggs »

earcar wrote: post #6
swe_dima wrote: post #3

I found Ruby LLM to be surprisingly good - in terms of usability it's close to Vercel's AI framework. It tries to strike a balance between working out of the box and being flexible... which has its challenges, still nice overall. One big real-life pain I experienced is that caches don't always work, e.g. for xAI, since it only supports completions API and thought signatures are returned wrong.

Thank you! Responses API is now implemented and it's coming in RubyLLM 2.0 https://github.com/crmne/ruby_llm/blob/main/lib/ruby_llm/pro...

Do you have any details published around 2.0? Would love to learn more.
Post reply on HN