231–234 of 234 posts
Earlier quoted context omitted.
At that point, it sounds like your after an API endpoint for any model. Lots of solutions out there, depends more on your hosting
No, I want the opposite: I want a generic chatbot app that connects to any endpoint.
I would imagine someone has built an app that can talk to LLM apis
Earlier quoted context omitted.
No, I want the opposite: I want a generic chatbot app that connects to any endpoint.
Ah, that's not what ollama is, it runs models for you, it doesn't talk to them over an API I would imagine someone has built an app that can talk to LLM apis
Earlier quoted context omitted.
You don't need 128 lanes. 8x PCIe3 is more than enough, so for 4 cards that's 32. Most CPUs have about 40lanes. If you are not doing much that would be more than sufficient. Buy a PCIe riser. Go to amazon and search for it, a 16x to 16x PCIe riser. They go for about $25-$30 often about 20-30cm. If you want really long one, you can get one from China a 60cm for about the same price, you just have to wait for 3 weeks.…
Most CPUs have about 20 lanes (plus a link to the chipset). On the one hand, they will be gen 4 or 5, so they're the equivalent of 40-80 gen 3 lanes. On the other hand, you can only split them up if you have a motherboard that supports bifurcation. If you buy the wrong model, you're stuck dedicating the equivalent of 64 gen 3 lanes to a single card. Edit: Actually, looking into it further, current Intel desktop proce…
Earlier quoted context omitted.
Newton only gave credits to "Gods". He said he stands on shoulders of Gods or something like that. But he never mentioned which Gods in particular, did he?
Giants, not Gods, and it's debated whether it was actually an insult or not: https://en.wikipedia.org/wiki/Isaac_Newton#Personality