Viewing profile — lsorber

For those who want to dive deeper, here’s a 300 LOC implementation of GRPO in pure NumPy: https://github.com/superlinear-ai/microGRPO The implementation learns to play Battleship i…

RAGLite is a Python package for building Retrieval-Augmented Generation (RAG) applications. RAG applications can be magical when they work well, but anyone who has built one knows …

The name ‘late chunking’ is indeed somewhat of a misnomer in the sense that the technique does not partition documents into document chunks. What it actually does is to pool token …

You don’t have to reduce a long context to a single embedding vector. Instead, you can compute the token embeddings of a long context and then pool those into say sentence embeddin…

Did you even need the D, wouldn't a PI controller be sufficient?

If TSMC buys its lithography machines, why should it even get any credit for 5nm at all?

Could you give an example of an unsolved riddle from linguistics?

In my opinion, the best solution to these issues is to: 1. Declare numbers as numbers in the configuration language. E.g. "decimal(1e1000)". 2. Parse declared numbers with a lossle…

Where's the data that says Moore's law no longer holds? I see comments and articles asserting this but everytime with evidence. The data that I do find certainly still suggests Moo…

Sounds great until the client realises they can hire someone else who does charge by the hour, saving them a massive 100k - 10k = 90k compared to your proposition.

Huh, makes a pretty big difference for us. We were using pandas' built-in to_parquet though, which seems to suffer from some overhead.

Are you sure about that? It depends on how Cloudflare defines what a cold start is. It might well include the initial loading of your code, with imports and init.

Have you benchmarked this against pickling those data files? In our experience, parquet's overhead isn't worth it for smaller data files.

Looks neat. Are you considering a flake8 extension like bandit for easy adoption (in CI and in VS Code)?

As a counterexample: we did actually run out of file descriptors on Lambda by not closing file descriptors.

Can you give an example of a case outside of the happy path?

My experience has been the opposite: building Docker images is much easier with conda than it is with pip. With conda you can start from miniconda3, copy an environment.yml, and th…

I sympathize with your views in that a formalisation of meaning in life would seem to take away from it somewhat. However, your response also comes across as putting a stake in the…

Dynaconf [1], though I think this article's approach in combination with pydantic is better. [1] https://dynaconf.readthedocs.io/en/latest/

In what sense has Intel vertically integrated design and fab according to you?

Nocedal has some papers in this direction.

I think you missed the 'easily'.

What is your preferred format for digesting content like this?

> Any project with CI should recreate the environment a lot. That's a very inefficient way to run your CI, with conda and pip alike. Instead, you could build your environment once …