Ollama-Swift
nshipster.com
Ollama-Swift
1–10 of 17 posts
Re: Ollama-Swift
#2Beautiful article.
Off-topic:
The Nominate app is exactly what’s missing from today’s UIs. Most of today’s user interfaces can benefit from “sparkles of AI helpfulness” instead of requiring a separate “AI App.” For example, macOS file renaming should provide AI-powered predictive suggestions when renaming a file that doesn’t have a useful name. Another example: when creating a GitHub issue, the UI should use AI to predict which labels are most likely relevant and bring them to the top for selection.
It seems many “AI products” attempt to replace entire workflows instead of enhancing the existing ones. GitHub puts a lot of effort into building Copilot features like Copilot Code Reviews, but it doesn’t appear interested in using AI to make existing code reviews more powerful and useful.
Re: Ollama-Swift
#3Beautiful article. Off-topic: The Nominate app is exactly what’s missing from today’s UIs. Most of today’s user interfaces can benefit from “sparkles of AI helpfulness” instead of requiring a separate “AI App.” For example, macOS file renaming should provide AI-powered predictive suggestions when renaming a file that doesn’t have a useful name. Another example: when creating a GitHub issue, the UI should use AI to pr…
This.
AI is a feature, not a product.
Re: Ollama-Swift
#4NSHipster played such a pivotal role in me becoming the engineer I am today. It’s heartwarming and hugely nostalgic to see a mattt post
Re: Ollama-Swift
#5Beautiful article. Off-topic: The Nominate app is exactly what’s missing from today’s UIs. Most of today’s user interfaces can benefit from “sparkles of AI helpfulness” instead of requiring a separate “AI App.” For example, macOS file renaming should provide AI-powered predictive suggestions when renaming a file that doesn’t have a useful name. Another example: when creating a GitHub issue, the UI should use AI to pr…
That’s OK - until the big end of town work this out, you can use LLMs to code this yourself and have an advantage.
For instance - have your LLM create a tool for your framework of choice that pulls commits that are new in your local branch vs. the remote, to gather them up for a code review.
Then by adding that tool and supplying the right prompt, your LLM can give you a code review before you push it. No SaaS in sight, and no git-push in your submit/code-review cycle, let alone a human reviewer.
If you want to get more heavyweight you could deploy a lambda somewhere that responds to a webhook in github and posts that same review as a comment on each PR.
Sky’s the limit & you can build this stuff as easy as anyone.
Re: Ollama-Swift
#6> port 11431 (leetspeak for llama ).
No. It's 11434...
Re: Ollama-Swift
#7Beautiful article. Off-topic: The Nominate app is exactly what’s missing from today’s UIs. Most of today’s user interfaces can benefit from “sparkles of AI helpfulness” instead of requiring a separate “AI App.” For example, macOS file renaming should provide AI-powered predictive suggestions when renaming a file that doesn’t have a useful name. Another example: when creating a GitHub issue, the UI should use AI to pr…
That’s OK - until the big end of town work this out, you can use LLMs to code this yourself and have an advantage. For instance - have your LLM create a tool for your framework of choice that pulls commits that are new in your local branch vs. the remote, to gather them up for a code review. Then by adding that tool and supplying the right prompt, your LLM can give you a code review before you push it. No SaaS in sig…
Trust me! I'm having a ton of fun building things with LLMs. I'm just pointing out the fact that most products are making the LLM input/output the center point of the user experience but in reality it's more useful to enhance existing UIs with LLMs.
Re: Ollama-Swift
#8Curious about RAGs. The article made it look like just a few additional parameters (context) you pass to the LLM. Somehow I was under the impression RAGs required training.
All I want is an LLM front-end to a local Wikipedia drop.
Re: Ollama-Swift
#9Curious about RAGs. The article made it look like just a few additional parameters (context) you pass to the LLM. Somehow I was under the impression RAGs required training. All I want is an LLM front-end to a local Wikipedia drop.
No training needed, but you need to generate embeddings for all the content, store it in a vector DB, and wire it up.
Re: Ollama-Swift
#10 The simplest way to use a language model is to generate text from a prompt (followed by python code)