Viewing profile — madisonmay

LLMs are not inherently non-deterministic during inference. I don't believe non-determinism implies lack of abstraction. Abstraction is simply hiding detail to manage complexity.

pypdfium2 is a great choice and a solid piece of software! You might want to look into https://github.com/VikParuchuri/surya as an alternative to tesseract. Yes, it's associated wi…

This is an excellent use case for LLM fine-tuning, purely because of the ease of generating a massive dataset of input / output pairs from public C code

It's more like saying "I've upgraded to 128GB of RAM, I'll never use my disk again".

See figure-2

Why the decision to license as GPL?

Thanks, I hate it.

Coding aid for unittests. Debugging aid for languages / frameworks I'm not particularly familiar with. Work that requires reformatting. Translating from rough drafts to more polish…

Whether or not to split is more a measure of whether or not these two concepts are likely to split down the road than whether or not share similarity today.

Imperfect systems are still useful, and any sufficiently complex system is imperfect.

Interestingly it sounds like offloading could be made quite efficient in a batch setting if you primarily care about throughput rather than latency. Though I guess for most current…

Often it might be viable to implement prediction w/o necessarily implementing training (especially if there are published weights or a reference implementation). Not viable for pap…

Guessing data security constraints -- I'm likely in a similar boat.

I'm getting a variety of CORS errors in console. Maybe this helps: ``` Access to XMLHttpRequest at ' https://api.doqs.dev/v1/organization ' from origin ' https://app.doqs.dev ' has…

Awesome idea, but website seems unstable. Wasn't able to login after sign-up :/

For more efficient einsum, see projects like https://optimized-einsum.readthedocs.io/en/stable/path_findi... .

I suppose so, but perhaps trying to prevent the spaghettification has some positive benefits in terms of DRY + code structure.

Wojciech stated this pretty explicitly on his Gradient Dissent podcast a few months back.

Sweet! Looking forward to it.

@nloui any chance you're willing to share your dataset? Would be fun to replicate this with GPT-2 fine-tuning instead of a Markov chain.

It's also possible it's part of a docker build step or similar. Even if they're aren't downloading models at run time they may be loading s3 if their pytorch-transformers lib docke…