Viewing profile — yaroslavvb

You can use eigenvalue solver to find singular values of any matrix but not vica versa. Implementing eigenvalues needs complex numbers

Eigenvalue are more flexible than singular values -- If you have procedure for computing eigenvalues of C, squared singular values of X are eigenvalues of C=XX'. Left and write sin…

I had similar experience, Claude made report of MRI for achilles tear, it measured the gap, but it was completely hallucinated. Achilles tendon is black on the MRI, it instead meas…

its real, I tried it a couple of weeks ago, asked some questions and got answers - https://x.com/yaroslavvb/status/2062692318415867983

This project gave me motivation to build the deep learning next token prediction integration for JetBrains because I was using PyCharm at the time. (Eventually, it wasn't continued…

I don't hold grudge, GPT-2 wasn't that great of a model, so releasing it would be more of a publicity value. But the blog post already had that purpose.

Thanks for the share! Didn't realize eleutherai launched around same time

This was around the time I trained Transformer-XL (outside of OpenAI) with Ben Mann ( https://yaroslavvb.medium.com/scaling-transformer-xl-to-128-... ) . Originally we wanted to re…

Modern AGI discourse defies the voice of reason

I used to look at all TensorFlow questions when I was on the TensorFlow team ( https://stackoverflow.com/tags/tensorflow/info ). Unclear where people go to interact with their user…

Stricter (but not looser) standards can be imposed on state level. Canada has no binding national drinking water law, they leave it to territories/provinces to decide how to implem…

Balancing protection against water bills - https://www.epa.gov/newsreleases/epa-announces-it-will-keep-...

I've used this feature before to make my chats discoverable through search engines. I had to manually click it each time I shared, it didn't toggle on.

Researchers like to talk about and show off their work outside the company. If you don't let them, they get unhappy and leave.

The difference is that for some assets you can calculate value based on fundamentals. IE, humans need shelter, hence estimate future value of shelter (real estate) based on migrati…

Realistic simulation of neurons is expensive. Back in my grad school days we ran Genesis and could afford at most 10k neurons - each neuron needs a lot of work to model the corresp…

It has a name too -- крякозяблики (kryakoziabliki)

Haha, me too. I guess it's a good learning exercise. I've been using Mathematica for 20 years (my name still shows up on https://stackoverflow.com/tags/wolfram-mathematica/topusers…

SF has programs that supplies methadone to homeless, ie, www.sfstreetmed.org. This doesn't fix underlying behavioral disorders.

1. You don't have to sell the stock -- one could fund an ultra-wealthy lifestyle by renting expensive things, using stock as collateral. As your stock goes up in value, so does the…

SPSA seems to be missing. OpenAI's "evolutionary strategies" paper used a form of SPSA. https://en.wikipedia.org/wiki/Simultaneous_perturbation_stoc...