The Full Story of Large Language Models and RLHF
assemblyai.com
The Full Story of Large Language Models and RLHF
1–10 of 22 posts
Re: The Full Story of Large Language Models and RLHF
#2Does anyone know what happens if you do transfer learning in addition to scaling? It feels like people used to use transfer learning in lieu of scaling and I haven't wrapped my head around how they work together.
Re: The Full Story of Large Language Models and RLHF
#3"From Giant Stochastic Parrots to Preference-Tuned Models"
I found this sub-title quite interesting
Re: The Full Story of Large Language Models and RLHF
#4> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease.
If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found?
So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general.
In other words AI could be used like a microscope discovering tiny defects in our software which are not visible to the naked eye. Like a microscope that detects viruses and thus allows us to guard against them. Like a COVID-test.
Re: The Full Story of Large Language Models and RLHF
#5Does anyone know what happens if you do transfer learning in addition to scaling? It feels like people used to use transfer learning in lieu of scaling and I haven't wrapped my head around how they work together.
When you scale you've probably included the data you were going to transfer learn to in the dataset, right?
Re: The Full Story of Large Language Models and RLHF
#6> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease. If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found? So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general. In other words AI could be used like a m…
It might be that finding vulnerabilities is easier than fixing them (think AI-driven fuzz testing).
Re: The Full Story of Large Language Models and RLHF
#7> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease. If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found? So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general. In other words AI could be used like a m…
It might be that finding vulnerabilities is easier than fixing them (think AI-driven fuzz testing).
[deleted]
Re: The Full Story of Large Language Models and RLHF
#8> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease. If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found? So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general. In other words AI could be used like a m…
AI can definitely help remediate the bugs but it is all about incentives.
One would hope browser and OS vendors would use AI to remediate vulnerabilities but vast majority of software vendors won't ever use it.
Also, automated vulnerability finding is very much real and already used today. This isn't something that has just become viable via LLMs, but I guess LLMs can enhance it:
Re: The Full Story of Large Language Models and RLHF
#9> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease. If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found? So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general. In other words AI could be used like a m…
> If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found?
It's not that simple. Mal-AI will probably operate orders of magnitude faster than Bene-AI. Patching affected software/hardware is a bureaucratic or formalized process that can take time.
Time dilates for AI relative to humans because it can accomplish so much work in our time horizons. A month to us might be like years to an AI.
So good AI would always be orders of magnitude behind while cleaning up after bad AI.
This perspective doesn't even account for online devices that are un-patchable that constitute the majority of today's bot armies.
Re: The Full Story of Large Language Models and RLHF
#10> LLMs with coding abilities could be employed to create sophisticated malware with unprecedented ease. If that is possible then shouldn't it also be possible to ask the AI to find and code remediation to the vulnerabilities it found? So AI could be used to find all possible code-vulnerabilities and then how to neutralize those? This would advance software security in general. In other words AI could be used like a m…
AI can definitely help remediate the bugs but it is all about incentives. One would hope browser and OS vendors would use AI to remediate vulnerabilities but vast majority of software vendors won't ever use it. Also, automated vulnerability finding is very much real and already used today. This isn't something that has just become viable via LLMs, but I guess LLMs can enhance it: https://github.com/angr/angr
> vast majority of software vendors won't ever use it.
It will likely become part of SOC2, and all the major cloud and IDE vendors will offer it as a service. Potentially just bundled in at no additional cost.