Viewing profile — digitallyfree

I use managed switches for this, L2 units are fine if you let opnsense do all the inter-VLAN routing. All network devices go into the switches which are connected to the servers. A…

If you want to take it even further a fully virtualized Opnsense with Proxmox is amazing. Your router can float between cluster nodes and each VLAN becomes a virtual interface in t…

Since you're releasing this under GPLv3 this is indeed open source. Having multiple license options does not affect this.

It's not a community per se but there's a lot of research and discussion going on directly in the llama.cpp repo ( https://github.com/ggerganov/llama.cpp ) if you're interested in …

It certainly looks like it if you check their discussion board.

Likely it's hosted on the same infrastructure. The general recommendation is to host the status page on different provider so it's more likely to stay up.

It's not even source code, it's the fact that this just looks super sketchy in general. The website http://faction504.com/ listed just links directly to the Play Store page. There'…

The issue with AMD and AI is, as always, the software stack. Even if the hardware is great ROCM simply doesn't have industry traction and accessiblity.

If you ask me to make an account before I can see your content (even if it looks interesting) that's a turn off and I'll go somewhere else. Maybe have a button at the top that says…

I don't like the centralization of Cloudflare, but it's the only way I can host public web pages out of my homelab with a DSL connection. I would rather have a CDN than put my cont…

If we look at this from a technical perspective, what is the cost of running such a service? Something like Facebook obviously costs a lot more to run, as it stores photos and vide…

Yeah as a long-time user I was really hoping for that myself, or at least have some sort of compromise. Certainly not that trainwreck of an AMA.

Wouldn't that be Hetzner?

It's not easy to move a group to a new platform, and there's very little people using Lemmy currently. The thing about Reddit despite its flaws is that it allows access to many lar…

OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA. https://github.com/openlm-research/open_llama

The fact that this is commodity hardware makes ggml extremely impressive and puts the tech in the hands of everyone. I recently reported my experience running 7B llama.cpp on a 15 …

Likely you can use a Bluetooth keyboard and mouse with it.

It also doesn't have ECC as well which was a staple of the previous Mac Pro line.

I personally like the Adminforge instance https://teddit.adminforge.de . It's much quicker than the original teddit.net.

Theoretically the ARC should work with llama.cpp using OpenCL, but I haven't seen benchmarks or even a confirmation that it works.

I think the tinybox is meant to be a training/inference server meant for tinygrad and filled with those AMD cards. Very likely it will run Linux.

I learned from the start on lead-free RoHS solder (doing SMT work) and had zero issues with it. Honestly I've never tried leaded solder as I just use lead-free all the time, though…

This is the reason why I still stick with OpenVPN on TCP 443 for my selfhosted VPN. Yes performance suffers a bit but it works absolutely everywhere including behind campus/corp fi…