Social learning: Collaborative learning with large language models
blog.research.google
Social learning: Collaborative learning with large language models
1–10 of 14 posts
Re: Social learning: Collaborative learning with large language models
#2Really interesting work there, and I particularly liked the gif-based story telling - https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg...
Re: Social learning: Collaborative learning with large language models
#3Really interesting work there, and I particularly liked the gif-based story telling - https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg...
I like that they have them, but I really dislike automatically animated anything when I'm trying to read. I installed an extension that can pause gifs. because Google adds them to so many of their blog posts now.
Re: Social learning: Collaborative learning with large language models
#4I wonder where this would be practical. How big would the teacher model need to be?
Re: Social learning: Collaborative learning with large language models
#5Really interesting work there, and I particularly liked the gif-based story telling - https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg...
It would be more useful as something like a video that plays while actually in view. I was actually reading the first part and when I got to the GIF it was in the middle of the animation.
Re: Social learning: Collaborative learning with large language models
#6Re: Social learning: Collaborative learning with large language models
#7Really interesting work there, and I particularly liked the gif-based story telling - https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg...
I like that they have them, but I really dislike automatically animated anything when I'm trying to read. I installed an extension that can pause gifs. because Google adds them to so many of their blog posts now.
this is solving engagement problem, not readability
try it with a mindlessly boring topic you can barely get through a paragraph of, not something you're actively trying to read
Re: Social learning: Collaborative learning with large language models
#8I wonder where this would be practical. How big would the teacher model need to be?
It reminds me of the general idea of generative adversarial networks where instead of a teacher and learner, you have a one trying to learn real inputs from fake inputs while the other tries to trick the first with fakes, with both training each other and the ultimate goal is to have the latter create realistic fakes.
I'm sure it's been or is being researched, but since I'm new to LLMs, my immediate thought was having code-aware models where one tries to find and fix vulnerabilities in a codebase while another tries to exploit them where the ultimate goal is to secure a codebase.
Re: Social learning: Collaborative learning with large language models
#9When is the Large Google Machine going to learn to be social and offer me a decline all non collaborative cookies button?
Re: Social learning: Collaborative learning with large language models
#10So the main idea is that teachers can use examples with PII/user data from gmail etc, but distill task-specific capabilities to students that don’t contain PII/user data. Seems kinda useful for companies that want to utilize private information safely.
Edit: misunderstood the paper on first skim, they don’t actually want smaller students, they might actually want bigger ones. So this is more a privacy thing