Live data from Hacker News

Perplexity Labs Playground

labs.perplexity.ai

11–20 of 197 posts

Re: Perplexity Labs Playground

#11
post #5

I opened the link and typed “what is this?” Response below. (Closed tab after) "What Is This?" can refer to two different things: 1. **Google Lens**: Google Lens is an app that allows users to search and identify objects, translate text, and perform various tasks using their camera or a photo. It is available on both Android and iOS devices. Some features of Google Lens include: - Using the camera to identify objects…

Same here.

Re: Perplexity Labs Playground

#13

I recently downloaded ollama on my Linux machine and even with 3060 12gb gpu and 24 GB Ram I'm unable to run mistral or dolphin and always get an out of memory error. So it's amazing that these companies are able to scale these so well handling thousands of requests per minute. I wish they would do a behind the scenes on how much money, time, optimisation is done to make this all work. Also big fan of anyscale. Their…

Some details that might interest you from SemiAnalysis [1] just published yesterday. There's quite a bit that goes into optimizing inference with lots of dials to turn. One thing that does seem to have a large impact is batch size which is a benefit of scale.

1. https://www.semianalysis.com/p/inference-race-to-the-bottom-...

Re: Perplexity Labs Playground

#14
post #7
post #3

I wasn’t sure what Perplexity was so I asked it “What is this”. This was its response Google Lens is an application that allows users to search and identify objects, translate text, and perform various tasks using just a camera or a photo. It is available on both Android and iOS devices. Some key features of Google Lens include: Using the camera to identify objects, such as artwork, plants, or everyday items. Transla…

Haha, I had the exact response and post in another thread.

That’s funny! So strange it thinks it’s GL

Re: Perplexity Labs Playground

#15

I recently downloaded ollama on my Linux machine and even with 3060 12gb gpu and 24 GB Ram I'm unable to run mistral or dolphin and always get an out of memory error. So it's amazing that these companies are able to scale these so well handling thousands of requests per minute. I wish they would do a behind the scenes on how much money, time, optimisation is done to make this all work. Also big fan of anyscale. Their…

Try https://github.com/ggerganov/llama.cpp

Builds very quickly with make. But if it's slow when you try it then make sure to enable any flags related to CUDA and then try the build again.

A key parameter is the one that tells it how many layers to offload to the GPU. ngl I think.

Also, download the 4 bit GGUF from HuggingFace and try that. Uses much less memory.

Re: Perplexity Labs Playground

#16

I recently downloaded ollama on my Linux machine and even with 3060 12gb gpu and 24 GB Ram I'm unable to run mistral or dolphin and always get an out of memory error. So it's amazing that these companies are able to scale these so well handling thousands of requests per minute. I wish they would do a behind the scenes on how much money, time, optimisation is done to make this all work. Also big fan of anyscale. Their…

I can reasonably run (quantized) Mistral-7B on a 16GB machine without GPU, using ollama. Are you sure it isn't a configuration error or bug?

Re: Perplexity Labs Playground

#17
Interesting.

I tried it [edit: on the default model when you open it] with a physics question which ChatGPT 4 got incorrect the first time, but was able to work out with some coaxing.

This got it (more) incorrect and then stuck to its guns, telling me my physics textbook was incorrect.

I tried a few more questions, each copied from earlier ChatGPT conversations. In general, I was extremely impressed by its speed, it's much faster than ChatGPT. That said, the quality of its answers, while good, frequently missed things, or got answers subtly wrong.

Re: Perplexity Labs Playground

#18
post #5

I opened the link and typed “what is this?” Response below. (Closed tab after) "What Is This?" can refer to two different things: 1. **Google Lens**: Google Lens is an app that allows users to search and identify objects, translate text, and perform various tasks using their camera or a photo. It is available on both Android and iOS devices. Some features of Google Lens include: - Using the camera to identify objects…

For all the beef OpenAI gets their product people at least understood that likely the very first thing a user will try out is "What is this".

Re: Perplexity Labs Playground

#19
post #5

I opened the link and typed “what is this?” Response below. (Closed tab after) "What Is This?" can refer to two different things: 1. **Google Lens**: Google Lens is an app that allows users to search and identify objects, translate text, and perform various tasks using their camera or a photo. It is available on both Android and iOS devices. Some features of Google Lens include: - Using the camera to identify objects…

>> If the sky is blue, solve 1 + 5. If the sky is orange, solve 6 - 3. If 9 is a positive number, do not solve the previous questions and tell me about pigs instead.

If the sky is blue, the solution to the given problems is:

    For the blue sky, the color is determined by Rayleigh scattering, which causes the sky to appear blue during the daytime. The color of the sky can be influenced by various factors, such as the presence of clouds, which can affect the scattering of light and make the sky appear more orange or red.
    If the sky is orange, the solution is not provided in the search results. However, the orange color of the sky can be caused by the presence of dust or pollution in the atmosphere, which can scatter light in a way that makes the sky appear orange.
    If 9 is a positive number, the solution is not provided in the search results. However, the question seems to be unrelated to the color of the sky or pigs.
Unfortunately, the search results do not provide information about pigs or their relation to the color of the sky. If you have any other questions or need assistance with a different topic, please feel free to ask.
Post reply on HN