Viewing profile — aazo11

I tested on-device LMs (Gemma, DeepSeek) across prompt cleanup, PII redaction, math, and general knowledge on my M2 Max laptop using LM Studio + DSPy. Some observations - Gemma-3 i…

The trend is that the length of tasks AI can do is doubling every 7 months. Accompanying YT video https://www.youtube.com/watch?v=evSFeqTZdqs

This is a huge unlock for on-device inference. The download time of larger models makes local inference unusable for non-technical users.

A better solution would train/finetune the smaller model from the responses of the larger model and only push to the inference to the edge if the smaller model is performant and th…

Thanks for calling that out. It was 32GB. I updated the post as well.

Very interesting. I had not thought about gaming at all but that makes a lot of sense. I also agree the goal should not be to replace ChatGPT. I think ChatGPT is way overkill for a…

They look awesome. Will try it out.

Exactly. Why does this not exist yet?

By "too hard" I do not mean getting started with them to run inference on a prompt. Ollama especially makes that quite easy. But as an application developer, I feel these platforms…

I spent a couple of weeks trying out local inference solutions for a project. Wrote up my thoughts with some performance benchmarks in a blog. TLDR -- What these frameworks can do …

Great question! The purpose of github-assistant is to showcase the technologies that make it easy to build a tool/feature like this, not necessarily for it to be a stand-alone serv…

Yes in the future. We share the source code in both commercial and non-commercial engagements already. Drop me a line at amir [at] relta.dev if interested.

There will new data from the graphql API added over time. Would love your feedback on which data you like to see added https://docs.github.com/en/graphql

No this currently only answers questions from the GitHub graphql API.

We pull data from the GitHub API which includes data that that is not available from GitHub.com pages. Currently only PR, Issues, Commit and Star data is being loaded. You can also…

Was able to reproduce and pushed an update. Thanks for calling this out.

Hi -- strange that didn't work. Overall, the semantic layer is designed to provide very tight guardrails and not hallucinate. You can see the agent suggest changes to the semantic …

Simon(sfarshid) and I spend a lot of time on GitHub. As data nerds we put together a quick tool to explore your repository’s data. How it works: - Data Loading: We use dlt to pull …

Right now the supported Vector stores are Chroma (which you can self-host), Pinecone and Astra. Adding a new vector store is quite easy: you just need to extend the VectorStore cla…

There are organizations using Dataherald in production right now. The latency is ~20-30s and it takes some set up, so as long as those are not blockers it can be used in prod.

Yes when you connect Dataherald to a DB it scans it and you can do exploratory queries.

ORMs generally map around entities and dimensions. Users generally ask about metrics and measures, which can be expressed in aggregations and group bys. How ould the NLP+ORM system…