Viewing profile — ajhai

https://x.com/ajhai/status/1899528923303809217 something I have been working on for a few months now.

It is inference latency most of the time. These VLA models take in an image + state + text and spit out a set of joint angle deltas. Depending on the model being used, we may get j…

Building a wheeled robot with arms to help automate household chores - https://x.com/ajhai/status/1891933005729747096 I have been working with LLMs and VLMs to automate browser bas…

We built tools like web browser, code interpreter etc., needed for LLM agents as part of our LLMStack project. We have now moved them into a single collection as langrocks. We're u…

I've tested Q4 on M1 and it works though the quality may not likely be the same as you'd expect as others have pointed out on the issue.

You can already run these models locally with Ollama (ollama run llama3.1:latest) along with at places like huggingface, groq etc. If you want a playground to test this model local…

You can actually do this with LLMStack ( https://github.com/trypromptly/LLMStack ) quite easily in a no-code way. Put together a guide to use LLMStack with Ollama last week - https…

Just added support for Llama-3 models to our AI app platform Promptly. We decided to try Groq cloud for powering these models and the results have so far been pretty good comparing…

If anyone is looking to try it out quick without local installation, we added Llama-8B model to Promptly playground. Please check it out at https://trypromptly.com/playground .

Sorry missed this. It was hidden behind login before. It should now be reachable.

If you are looking to play with the model without installing it locally, we've added it our playground at https://trypromptly.com/playground .

Put together a guide on how to do this with your own avatar and posted at https://news.ycombinator.com/item?id=39053304

We can get a lot done with vector db + RAG before having to finetune or custom models. There are a lot of techniques to improve RAG performance. Captured a few of them a while back…

We have recently added support to query data from SingleStore to our agent framework, LLMStack ( https://github.com/trypromptly/LLMStack ). Out of the box performance performance w…

Gemini Pro compares to GPT 3.5.. their biggest model that competes with GPT-4 is called Gemini Ultra and they say that's coming early next year.

https://github.com/trypromptly/LLMStack - started working on this as a wrapper over OpenAI's endpoints for another product and it gradually became this. Another project I worked on…

This will hopefully improve the startup times for FFmpeg when streaming from virtual display buffers. We use FFmpeg in LLMStack (low-code framework to build and run LLM agents) to …