Live data from Hacker News

100M Token Context Windows

magic.dev

21–24 of 24 posts

Re: 100M Token Context Windows

#21
post #13

Earlier quoted context omitted.

Assume around $3/hr per H100 (pretty generous pricing for GCP), that is $2250/month-gpu, or for their fleet of 8000 comes to $18MM/month or around $216MM/year in just compute costs alone, not looking at SSD, bucket storage, or egress. At their initial investment of 465-320=$145MM that means they can’t have operated that cluster for longer than 6ish months without their funds running dry or the got massive discounts s…

Honestly, the more I look at this the more I'm mystified. Magic was founded in 2022 and they received their first funding round of $20 million a year later. Before that, the co-founder/CEO had founded some climate science education program called ClimateScience which he ran for 2 years: > Then, it hit them. They thought, “What if we create bite-sized information, following the same scientific standards of peer-review…

> edit: I looked into the other co-founder just now and I feel like I'm in the twilight zone

likewise, especially as a profitable bootstrapped founder

it's like these people don't play by the same rules as the rest of us

Re: 100M Token Context Windows

#23
post #6

FYI wouldn't interview here. Got rejected after a 30 minute behavioral screen after spending 8 hours on an unpaid take-home.

Are you saying you cannot be rejected in any following interview if you do a 8 hour unpaid take home?

Is it reasonable for non-technical screens to be sequenced before long, unpaid take homes?

Re: 100M Token Context Windows

#24
post #6

FYI wouldn't interview here. Got rejected after a 30 minute behavioral screen after spending 8 hours on an unpaid take-home.

That sucks, sorry to hear that. You should reject take homes like this in future. At least, don’t invest 8 hours before they’ve even interviewed you. The time investment should be symmetrical for the candidate and the employer.
Post reply on HN