Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

github.com

Post reply on HN
Print view View original

41–50 of 74 posts

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#41

Post by bb88 »

JackHopkins wrote: post #31
bb88 wrote: post #26

Earlier quoted context omitted.

I feel like you're hijacking a term at least 15 to maybe 20 years old though. It's kind of a brilliant marketing idea, but you're just confounding the vocabulary. It's not to say this isn't a fucking great idea (because it is!). But you know, just don't piss in the community well. Further, PostgreSQL means one and only one thing. But Monkey Patch means 2 now, apparently! For reference: Here's the google ngram viewer…

The specific package name on GitHub and PyPi is ‘monkeypatch.py’ for the avoidance of doubt!

That's a distinction without a difference...

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#42

Post by JackHopkins »

eychu94 wrote: post #40

Awesome stuff! What other potential integrations are on the roadmap?

The big one is a Typescript implementation. Other than that, the plan is to support other models (e.g Llama) that can be fine-tuned.

Finally, other persistence layers like S3 and Redis, to support running on execution targets (like AWS Lambda and CloudFlare workers) that don’t have persistent storage.

I think it could be really interesting to support Vercel more tightly too. We currently support Vercel with Python, but I think Typescript + Redis would really enable serverless AI functions - which is where I think this project should go!

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#43

Post by vqbd »

JackHopkins wrote: post #31
bb88 wrote: post #26

Earlier quoted context omitted.

I feel like you're hijacking a term at least 15 to maybe 20 years old though. It's kind of a brilliant marketing idea, but you're just confounding the vocabulary. It's not to say this isn't a fucking great idea (because it is!). But you know, just don't piss in the community well. Further, PostgreSQL means one and only one thing. But Monkey Patch means 2 now, apparently! For reference: Here's the google ngram viewer…

The specific package name on GitHub and PyPi is ‘monkeypatch.py’ for the avoidance of doubt!

The problem isn't accidentally downloading the wrong package. How am I supposed to talk about this package? I regularly use monkeypatching (the existing meaning) to prototype out concepts. "I monkey patch dot pied this function"? Cause that doesn't seem to be the name used everywhere.

Why not name it something like Gorillapatch? Gorillas are stronger than monkeys as a slogan or whatever.

The core issue is how am I supposed to talk about regular monkeypatching and your library in the same sentence.

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#44

Post by ipsum2 »

JackHopkins wrote: post #39
ipsum2 wrote: post #37

This is like calling a python package "ListComprehension", that loops through a list and calls OpenAI's API on each item. Confusing and unproductive.

The python package (and repo) is called ‘monkeypatch.py’ for the avoidance of confusion.

Calling my library "listcomprehension.py" doesn't really avoid confusion. In fact, `pip install monkey-patch.py` looks downright odd.

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#45

Post by [deleted] »

JackHopkins wrote: post #29
Scipio_Afri wrote: post #27

Can I use open source LLMs with this? Would be great if everything was available self hosted with open source models.

Native support for OS LLMs is on the roadmap - the main challenge is to figure out how to manage the knowledge distillation for local models. It’s a top priority (along with typescript support), so check back in a few weeks? Right now any ‘plug-in’ model needs to conform to the OpenAI API. (P.S Carthago delenda est)

[deleted]

Re: Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python

#47

Post by JackHopkins »

vqbd wrote: post #43
JackHopkins wrote: post #31

Earlier quoted context omitted.

The specific package name on GitHub and PyPi is ‘monkeypatch.py’ for the avoidance of doubt!

The problem isn't accidentally downloading the wrong package. How am I supposed to talk about this package? I regularly use monkeypatching (the existing meaning) to prototype out concepts. "I monkey patch dot pied this function"? Cause that doesn't seem to be the name used everywhere. Why not name it something like Gorillapatch? Gorillas are stronger than monkeys as a slogan or whatever. The core issue is how am I su…

This is a solid point, at the end of the day creating confusion with the name wasn't the goal in any way as there already are 100s of (often overlapping) terms floating around in this scene. I appreciate the critique and we'll have a think over this. If you have any other naming ideas, would love to hear them!
Post reply on HN