Live data from Hacker News

GitHub Copilot as open source code laundering?

twitter.com

271–280 of 473 posts

Re: GitHub Copilot as open source code laundering?

#271

Attempts to litigate any license violation are going to get precisely nowhere I bet, but I find the actual license violation argument persuasive. This is an excellent example of how the AI singularity/revolution/whatever is a total distraction and that a much bigger and more serious issue is how AI is becoming so effective at turning the output of cheap/free human mental labour into capital. If AI keeps getting bette…

> If AI keeps getting better and better and status quo socio-economic structure don't change, trillions in capital will be captured by the 0.01%.

This is absolutely one of the things that keeps me up at night.

Much of the structure of the modern world hinges on the balance between forces towards consolidation and forces towards fragmentation. We need organizations (by this I mean corporations, governments, unions, etc.) big enough to do big things (like fix climate change) but small enough to not become totalitarian or decrepit.

The forces of consolidation have been winning basically since the 50s with the rise of the military-industrial complex, death of unions, unlimited corporate funding of elections (!), regulatory capture, etc. A short linear extrapolation of the current corporate/government environment in the US is pretty close to Demolition Man's dystopian, "After the franchise wars, all restaurants are Taco Bell."

Big data is a huge force towards consolidation. It's essentially a new form of real estate that can be farmed to grow useful information crops. But it's a strange form of soil that is only productive if you have enough acres of it and whose yield scales superlinearly with the size of your farm.

Imagine doing a self-funded AI startup with just you and a few friends. The idea is nearly unthinkable. How do you bootstrap a data corporation that needs terabytes of information to produce anything of value?

If we don't figure out a "data socialism" movement where people have ownership over the data derived from their life, we will keep careening towards an eventuality where a few giant corporations own the world.

Re: GitHub Copilot as open source code laundering?

#272
Isn't most of modern coding, just googling for someone who had solved the same problem that you are currently facing and then just copy/paste from Stack Overflow?

To the extent that GPT-3 / co-pilot is just an over-fitted neural net, then it's primary value is as an automated search, copy, and paste.

Re: GitHub Copilot as open source code laundering?

#273

Earlier quoted context omitted.

I expect nothing less. The 0,01 will be super rich. You could call it endgame

They need to defend their capitals from the rest 99.99%. Expect huge combat robots investments and expanding of private armies. And, of course, total surveillance helps to prevent any kind of unionization of those 99.99%.

Today's hyper-militarized police forces are their state-provisioned security to protect the capital of the 1%.

Re: GitHub Copilot as open source code laundering?

#274

Attempts to litigate any license violation are going to get precisely nowhere I bet, but I find the actual license violation argument persuasive. This is an excellent example of how the AI singularity/revolution/whatever is a total distraction and that a much bigger and more serious issue is how AI is becoming so effective at turning the output of cheap/free human mental labour into capital. If AI keeps getting bette…

> "'Hey, that's our code you used to replace us!' we will cry out too late."

Are we in the software community not the ones who have frequently told other industries we have been disrupting to "adapt or die" along with smug remarks about others acting like buggy whip makers? Time to live up to our own words ... if we can.

Re: GitHub Copilot as open source code laundering?

#276
post #40

Earlier quoted context omitted.

That would be interesting: * Someone leaks Windows 10/11 source code * Copilot picks it up in its training data * Someone uses copilot to generate a Windows clone and starts selling it I wonder how Microsoft would react to that. I wonder if they've manually blacklisted leaked source code from Windows (or other Microsoft products) so that it doesn't show up in Copilot's training data. If they have, that means Microsof…

> Someone uses copilot to generate a Windows clone You could test this with one of Microsoft's products that is already on GitHub - like VSCode. I doubt you would get anywhere with just copilot.

You probably won't get an entire operating system out of it, but I could totally see a project like Wine using it to implement missing parts of the Win32 API and improve their existing implementations.

Re: GitHub Copilot as open source code laundering?

#277
post #204
post #40

Earlier quoted context omitted.

That would be interesting: * Someone leaks Windows 10/11 source code * Copilot picks it up in its training data * Someone uses copilot to generate a Windows clone and starts selling it I wonder how Microsoft would react to that. I wonder if they've manually blacklisted leaked source code from Windows (or other Microsoft products) so that it doesn't show up in Copilot's training data. If they have, that means Microsof…

Come on, there is a huge gap between 1) writing a single function (potentially incorrectly) with a known prototype/interface and a description and 2) designing interfaces, datatypes and APIs themselves.

Why would you need to design anything? Just copy official Windows headers and use copilot to implement individual functions.

Maybe if the signature matches perfectly, copilot will even pull in the exact implementation from the Windows source code.

Re: GitHub Copilot as open source code laundering?

#278
post #101

One interesting aspect, that I thing will make it difficult for GitHub to argue and justify its not a a license violation would be the answer to the following question: Was Copilot trained using Microsoft internal source code or will it be in the future ? As GitHub is a Microsoft company and OpenAI although a non-profit just got a massive one billion investment from Microsoft (presumably not for free), will it start…

Not a problem because it's possible to check if the code is verbatim from the training set (bloom filters).

Don't come in here with your common sense

Re: GitHub Copilot as open source code laundering?

#279

Attempts to litigate any license violation are going to get precisely nowhere I bet, but I find the actual license violation argument persuasive. This is an excellent example of how the AI singularity/revolution/whatever is a total distraction and that a much bigger and more serious issue is how AI is becoming so effective at turning the output of cheap/free human mental labour into capital. If AI keeps getting bette…

To go on a bit of a tangent, I’m somewhat pessimistic that western societies will plateau and hit a “technofeudalism” in the next century or two. Combine what you mention with other aspects of capital efficiency. It’s not a unique idea, and is played out in a lot of “classic” sci-fi like Diamond Age.

Now it’s also not necessarily that bad of a state. That’s depending on ensuring a few ground elements are in place like people being able to grow their own food (or supplemental food) or still being free to design and build things on their own. If corporations restrict that then people will be at their mercy for all the essentials of life. My take from history is that I’d prefer to have been a peasant during much of the Middle Ages than a factory worker during the industrial revolution. [1] Then again Chinese people have been willing (seemingly) to leave farms in droves for the last decades to accept the modern version of factory life so perhaps farming peasant life isn’t as idyllic as it’d sound. [2]

1: https://www.lovemoney.com/galleries/84600/how-many-hours-did... 2: https://www.csmonitor.com/2004/0123/p08s01-woap.html

Re: GitHub Copilot as open source code laundering?

#280

Earlier quoted context omitted.

Oh man, that got meta super fast. Its like a mobius strip!

It can always get more meta. For example, the AI tool that Microsoft's lawyers use ("Co-Counsel"), will be filing the DMCA notices and subsequenct lawsuits against Co-Pilot generated code. This will result in a massive caseload for the courts, so naturally they'll turn to their AI tool ("DocketPlus Pro") to adjudicate all the cases. Only thing left is to enter these AI-generated judgements into Etherium smart contrac…

The legal system moves swiftly now that we've abolished all lawyers!
Post reply on HN