Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

deepgrove.ai

Post reply on HN
Print view View original

1–10 of 59 posts

Re: Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

#6

Post by Havoc »

Looks promising though much like the bonsai tenary one it hallucinates knowledge quite aggressively. The online chat having search tools covers this up somewhat, but it's still there.

...from very unscientific casual vibes it does seem pretty good though considering the speed

Would also be curious what their search tool backend looks like - that too is very fast for very rapid multiple searches

Re: Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone

#9

Post by zooloo99 »

Havoc wrote: post #6

Looks promising though much like the bonsai tenary one it hallucinates knowledge quite aggressively. The online chat having search tools covers this up somewhat, but it's still there. ...from very unscientific casual vibes it does seem pretty good though considering the speed Would also be curious what their search tool backend looks like - that too is very fast for very rapid multiple searches

Makes me wonder how much we can 'get away with' in terms of raw model capability, when you have tool access for anything specialised or specific.

I probably could make up a bit of an incorrect carrot cake recipe if asked on the spot, but with a Google search I can give you something far more robust.

Maybe we don't need a 'country of geniuses' in our pocket, but more a helpful assistant that can reasonably reason!

Post reply on HN