21–30 of 148 posts
I just tried this model with Koboldcpp on my LLM box. I got gibberish back. My prompt - "please show me how to write a web scraper in Python" The response? I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Pytho…
I just tried this model with Koboldcpp on my LLM box. I got gibberish back. My prompt - "please show me how to write a web scraper in Python" The response? I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Pytho…
I just tried this model with Koboldcpp on my LLM box. I got gibberish back. My prompt - "please show me how to write a web scraper in Python" The response? I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Pytho…
I just tried this model with Koboldcpp on my LLM box. I got gibberish back. My prompt - "please show me how to write a web scraper in Python" The response? I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Pytho…
So you'd need to prompt it through comments or by starting with a function name, basically the same as one would prompt GitHub copilot.
e.g.
# the following code implements a webscraper in python
class WebScraper:
Given the complete failure of the first stable lm, I'm interested to try this one out. Haven't really seen a small language model, except mixtral 7b that's really useful for much. I also hope stability comes out with a competitor to the new midjourney and dalle models! That's what put them on the map in the first place
I use the 6bit GGUF quantized version on a laptop RTX 3070
I just tried this model with Koboldcpp on my LLM box. I got gibberish back. My prompt - "please show me how to write a web scraper in Python" The response? I've written my first ever python script about 5 months ago and I really don't remember anything except for the fact that I used Selenium in order to scrape websites (in this case, Google). So you can probably just copy/paste all of these lines from your own Pytho…
edit: the webpage does call it "Stable Code Completion"
That is fantastic. I'm building a small macOS SwiftUI client with llama cpp built in, no server-client model, and it's already so useful with models like openhermes chat 7B, and fast. If this opens it to smaller laptops, wow! We truly live in crazy time. The rate of improvement in this field is off the walls.
Not sure if this is where your head is, but I think there's a lot of value in integrating LLMs directly into complex software. Jira, Salesforce, maybe K8s - should all have an integrated LLMs that can walk you through how to perform a nuanced task in the software.
How is this compared to the current GitHub Copilot?
If you just want to get stuff done, use the best tools like a Milwaukee Drill - and right now, thats copilot/gpt-4. If you don't want to be tied to a company and like opensource, feel free to connect a toy motor to an AA battery to drill your holes... Or to use Llama/Stable Code 3B.
It's quite amazing - I often find that I read quite positive comments towards LLM tools for coding. Yet, an "Ask HN" I posted a while ago (and which admittedly didn't gain much traction) seemed to mirror mostly negative/pessimistic responses. https://news.ycombinator.com/item?id=38803836 Was it just that my submission didn't find enough / more balanced commenters?
Earlier quoted context omitted.
Not sure if this is where your head is, but I think there's a lot of value in integrating LLMs directly into complex software. Jira, Salesforce, maybe K8s - should all have an integrated LLMs that can walk you through how to perform a nuanced task in the software.
Why would the LLM walk you through and not just do the nuanced task on its own?