Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MiniGPT-4

minigpt-4.github.io

Post reply on HN
Print view View original

91–100 of 337 posts

Re: MiniGPT-4

#91

Post by astrange »

valine wrote: post #59
niemandhier wrote: post #33

Earlier quoted context omitted.

That's because the decided they do not need lidar.

Near term it’s a frustrating decision, but if these gpt4 vision LLMs are anything to go by it will prove to be the right decision in the long term.

Remember that "cameras" aren't as good as human perception because human eyes interact with the environment instead of being passive sensors. (That is, if you can't see something you can move your head.)

Plus we have ears, are under a roof so can't get rained on, are self cleaning, temperature regulating, have much better dynamic range, wear driving glasses…

Re: MiniGPT-4

#92

Post by eurekin »

152334H wrote: post #6

On a technical level, they're doing something really simple -- take BLIP2's ViT-L+Q-former, connect it to Vicuna-13B with a linear layer, and train just the tiny layer on some datasets of image-text pairs. But the results are pretty amazing. It completely knocks Openflamingo && even the original blip2 models out of the park. And best of all, it arrived before OpenAI's GPT-4 Image Modality did. Real win for Open Sourc…

> I created a PR on the repo to load it with int8, so hopefully by tomorrow it'll be runnable by 3090/4090 users.

How about 2x3090? Can it be run on multiple gpus?

Re: MiniGPT-4

#93

Post by astrange »

pmoriarty wrote: post #47
wsgeorge wrote: post #37

Earlier quoted context omitted.

A 14-line poem with a consistent rhyme scheme and meter. Perhaps my request should have been more specific.

From my experimentation, LLMs tend to kind of suck at rhyme and meter, and all but the simplest types of poetry, so even if you'd specified it probably wouldn't have been able to deliver. This is definitely something they could be trained to be much better at, but I guess it's hasn't been a priority.

GPT4 is surprisingly good at it, considering BPE tokenization means it shouldn't be able to do rhyme at all.

Re: MiniGPT-4

#96

Post by vorticalbox »

Gravityloss wrote: post #74
MattPalmer1086 wrote: post #63

Earlier quoted context omitted.

You can just ask GPT how to do it. Much like a lot of web dev!

at some point someone makes a service where you can let AI take over your computer directly. Easier that way! Curling straight to shell taken to next level.

Found my next hobby project

Re: MiniGPT-4

#97

Post by muyuu »

kramerger wrote: post #15
152334H wrote: post #6

On a technical level, they're doing something really simple -- take BLIP2's ViT-L+Q-former, connect it to Vicuna-13B with a linear layer, and train just the tiny layer on some datasets of image-text pairs. But the results are pretty amazing. It completely knocks Openflamingo && even the original blip2 models out of the park. And best of all, it arrived before OpenAI's GPT-4 Image Modality did. Real win for Open Sourc…

Can any of this realistically run on CPU at some point? (Not training obviously)

quantized Vicuna runs ok-ish in my 16GB i7 laptop (onboard graphics) and the output is usable

see this comparison: https://old.reddit.com/r/LocalLLaMA/comments/12ezcly/compari...

these models quantised to 4bit should run in CPU set ups with 16GB of RAM + 16GB of swap (Linux) and perhaps other setups run similarly

Re: MiniGPT-4

#98

Post by turmeric_root »

mewpmewp2 wrote: post #53
redox99 wrote: post #46

Earlier quoted context omitted.

It's pretty simple actually. Get a 3090 or 4090. Forget about AMD.

Should I get a gaming PC with 4090 if I want to get into personal side projects in ML and also games? Do I need dualboot? Or is Windows good?

Windows reserves a certain percentage for VRAM for some reason. So I'd recommend Linux. Or find a way to disable the desktop/UI in Windows.

Re: MiniGPT-4

#99

Post by dom96 »

alex_duf wrote: post #84
dom96 wrote: post #62

Can this decode CAPTCHAs? Are we finally in a place where CAPTCHAs are useless?

would it be a good things for captchas to be useless? Because in my career I've been a few times on the receiving end of spam attacks and various nastiness and it's nice to be able to integrate such a thing - as unpleasant as it is for the user - and solve the problem at hand. if this disappears then spammers and the various botnets will have the upper hand again.

It wouldn't be good, did I imply it would? I'm interested to know if we are now in a place where they do become useless

Re: MiniGPT-4

#100

Post by sureglymop »

redox99 wrote: post #46
causi wrote: post #26

Earlier quoted context omitted.

Someone needs to write a buyer's guide for GPUs and LLMs. For example, what's the best course of action if don't need to train anything but do want to eventually run whatever model becomes the first local-capable equivalent to ChatGPT? Do you go with Nvidia for the CUDA cores or with AMD for more VRAM? Do you do neither and wait another generation?

It's pretty simple actually. Get a 3090 or 4090. Forget about AMD.

I have access to an Nvidia A100. But as a layman, what specs does the rest of the system need to use it for some real work? I would assume there needs to be at least as much ram as vram and maybe a few terabytes of disk space. Does anyone have experience with this?
Post reply on HN