Live data from Hacker News

Advancements in machine learning for machine learning

blog.research.google

161–162 of 162 posts

Re: Advancements in machine learning for machine learning

#161
post #81

Earlier quoted context omitted.

Indeed. I can give a vague, poorly written, poorly spelled request to the free version of ChatGPT and it still gives me a correct response. As correct as usual at least (85-95%), but that's a different problem.

Correct compared to what? There's gonna be a lot of context implied in project docs based on previous projects and the LLM won't ask hard questions back to management during the planning process. It will just happily return naive answers from its Turing tarpit. No offense intended to anyone, but we already see this when there are other communication problems due to language barrier or too many people in a big game of…

Correct compared to what I ask it for.

Previous projects can be fed into LLMs either by context window (those are getting huge now) or fine tuning… but of course it's not a magic wand like some expect it to be.

People keep being disappointed it's not as smart as a human, but everyone should look how broad it is and ask themselves: if it were as good as a human, why would companies still want to employ you? What skills do you have which can't be described adequately in writing?

Re: Advancements in machine learning for machine learning

#162
post #83

Can anyone explain how conv works in that graph. You have a tensor of shape [2,4,16] and you convolve with a kernel of shape [4,16,8] and that gives you a [2,8] tensor? How's that possible?

Does this help? *1. Input:* * Tensor shape: [2,4,16] * `2`: This represents the *batch size*, meaning there are two independent data samples being processed. * `4`: This is the *input feature dimension*, indicating each sample has 4 features. * `16`: This is the *input channel dimension*, suggesting each feature has 16 channels of information. *2. Kernel:* * Shape: [4,16,8] * `4`: This is the *kernel size*, meaning t…

Thanks. What was confusing me is the kernel size 4. Normally in (2D) convolutions you have (in_channels, out_channels, k, k) for a kxk kernel size. In the example above it the k is the first dimension instead of the last. This is in PyTorch, not sure about Keras
Post reply on HN