Viewing profile — zcbenz

It is a bug in MLX that has been fixed a few days ago: https://github.com/ml-explore/mlx/pull/3083

In the absence of hardware unified memory, CUDA will automatically copy data between CPU/GPU when there are page faults.

Most features are already supported on x86 CPUs, you can pip install mlx on Linux , and you can even use it on Windows (no official binary release yet but it is building and tests …

For learning internals of ML frameworks I recommend reading the source code of MLX: https://github.com/ml-explore/mlx . It is a modern and clean codebase without legacies, and I co…

You can use any serialization that supports numbers, in the repo I used BSER (a binary format of JSON), you can even use raw JSON but it would be very inefficient for float numbers…

I wrote this library to explore the possibility of adding native UI APIs to the Electron framework, and I think the concept works quite well. The development (or experiment) stoppe…

No it is not normal, I only tested x64/arm64 macs, I will try on linux.

That is sad, the name sisi comes from the sisi empress: https://en.m.wikipedia.org/wiki/Empress_Elisabeth_of_Austria

I wrote this tool to get familiar with CLIP model, I know many people have written similar tools with CLIP before, but I'm new to machine learning and writing a classic tool helps …

A few months ago I ported ~15k lines of python code (10k are tests) to typescript, using GPT4. It cost me ~$70. The python project is https://github.com/ml-explore/mlx and the conv…

I started studying machine learning this year, and I found python in my way to understand how things actually work, so I decided to port a machine learning framework to JavaScript …

I wrote a Node.js module that implemented similar feature years ago. https://github.com/atom-archive/node-runas (An updated fork can be found at https://www.npmjs.com/package/runas…

Shameless to insert my app here, also open source and provides quick access from menu bar. https://chie.app/posts/minimalist-approach-to-using-chatgpt/

I would argue it is not a large part a webview. The webview related code is 900 lines vs the whole project 10k lines.

I actually asked ChatGPT what chie might mean in other languages, for multiple times, but it did not tell me this :(

I'm submitting this before going to bed, so by the time it hits front page (if it does at all) I'll likely be asleep, so I won't be able to answer questions in time.

Suppose one is writing a desktop app doing searches of embeddings, is there a lightweight vector database that runs on all major desktop platforms? I'm aware of redis and sqlite-vs…

Adding fields to context will break ABI compatibility. To work around the problem, some libraries add padding fields, and some require passing the size of struct to determine ABI v…

Will you provide APIs for this service? I'm writing an extensive desktop app for all ChatGPT alike services, and this service is definitely a thing I want to include.