Earlier quoted context omitted.
> Not that I give much credence to anything Zitron says, but the amount of inference you can get on a £200 a month OpenAI or Anthropic subscription is easily an order of magnitude more than what you'd get paying the same amount at subscription rate. Neither of those is how much it actually costs the company selling the service. And I have feeling they are running at loss here so the play is "get everything possible u…
There have been plenty of studies which indicate that inference considered by itself is almost certainly quite profitable at all the frontier labs. The problem is amortizing the cost of all the expensive training runs required to train new models into the revenue stream.
GitHub Copilot code review will start consuming GitHub Actions minutes
91–100 of 222 posts
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#92Earlier quoted context omitted.
Just you wait, this is a gentle tug to test how hard they can pull when the time comes.
It's gonna be interesting to see how this plays out. Usually a tech rugpull like this lasts a number of years. And this sort of has, but the agentic stuff has really only caught on like wildfire in the last, I dunno, six months or so. The rugpull would be way more effective if there could be several years of getting developers addicted to this development paradigm, but alas, the VC money burned was too great to subsi…
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#93Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#94Earlier quoted context omitted.
Yeah, I did hertzner runner for a bit. But I think the issue is that my situation (solo dev, mono repo) is just not right for a dedicated instance. With only 1-2 runners, the pipeline is slow (low parallelism) and resource constrained. And at least 50% of the time its idle (I'm not working/sleeping). I guess what I'm really looking for is for some kind of aggressive autoscaling, and aggressive caching. I tried a coup…
Not sure of what current prices look like but an old desktop sitting on the floor of your office might work well for you. You would need decent internet but running a single node kubernetes cluster as a GitHub action runner has worked well for others I know. A buddy of mine runs his whole CICD setup off an old gaming desktop. They use tailscale to connect to their hosted infrastructure and set it up as a GitHub actio…
My wife uses my old gaming desktop for her ux design work as well.
And I was thinking of using the gpu to run some tts models.
Now to just figure out a way to run it all on windows and have it auto start when she logs in.
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#95Earlier quoted context omitted.
Just you wait, this is a gentle tug to test how hard they can pull when the time comes.
making you pay the actual price of a product is a rug pull now?
Maybe the government should nationalize GitHub at this point as it is absolutely critical for US infrastructure and MSFT has shown to be a terrible steward for the public.
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#96Expect to see more of these kinds of announcements as companies need to start showing returns on their AI investments. It's hard to say how subsidized the current AI products are[1] but we're definitely getting a free lunch at VC's expense the moment. [1] Ed Zitron speculates the actual prices with token based billing for heavy users will be something like 10x the subscription price, but this seems high.
Not that I give much credence to anything Zitron says, but the amount of inference you can get on a £200 a month OpenAI or Anthropic subscription is easily an order of magnitude more than what you'd get paying the same amount at subscription rate. Although I would also point out that OpenAI recently tripled the amount of Codex inference you get per month for £200 (and to head off the suggestion, this is distinct from…
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#97Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#98This seems nonsensical. Why would non-actions activity consume actions budget?
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#99Earlier quoted context omitted.
Because it doesn't even come close to frontier models in intelligence/speed/price. I can run my 3090 nonstop and rack up an electricity bill that costs more than a subscription and get worse results that are slower. They are ok for simple/non complex things, but that's not really what I need AI for.
Well, it is currently cheaper because it is massively subsidized. That will change when subsidies stop. I don’t think it is a good argument.
There are more and more independent AI inference providers without VC backing that serve open weight models on a ~cost-plus basis that show that subsidies are not significant for AI inference.
Re: GitHub Copilot code review will start consuming GitHub Actions minutes
#100Good thing GitHub has plenty of built-up goodwill to spend down. If they didn’t this cascade of (probably necessary but nevertheless negative for customers) changes might be the tipping point to push a lot of companies to seek other options.