Viewing profile — rassibassi

CFG (context free grammar), which is explained in the book, is used here together with LLMs: https://tree-diffusion.github.io

In this context, RAG isn't what's being discussed. Instead, the reference is to a process similar to monte carlo tree search, such as that used in the AlphaGo algorithm. Presently,…

The diskcache docs state: """ Caching Libraries joblib.Memory provides caching functions and works by explicitly saving the inputs and outputs to files. It is designed to work with…

What's the difference to using joblibs Memory class similar to this implementation: https://github.com/stanfordnlp/dspy/blob/main/dsp/modules/ca...

If I understand you correctly, you basically mean some interpolation of knowledge within Z, that was not known to humans before, but can be synthesized by recombination of informat…

I'm intrigued by the foundational data that powers models like GPT or LLM. Imagine this data, which encapsulates a vast majority of human knowledge, as a random variable Z. Now, le…

The upper bound is still the Shannon limit. The experiment does a lot of multiplexing: spatial multi-core fiber, spectral multi channel multiplexing across wavelength, dual polariz…

Not practical yet, the novelty is the frequency comb which allows +200 channels across wavelength with only a single laser, where before one required 200 lasers. In an experiment l…

They also multiplex across +200 channels across wavelength (wavelength division multiplexing). Not sure what the baud rate of a single channel was in their experiment but probably …

Correction: the auto encoder is pre-trained :)

Yes, and another reason for the small model size and the novelty of the underlying paper [1], is that the diffusion model is not acting on the pixel space but rather on a latent sp…

Don't be so hard on yourself, and don't compare yourself to a computer science prodigy. You can teach yourself to become a decent web developer in 1 year and take it from there, yo…

Nice, saw you also have a section on fonts! Think the following could make you smile, too. Checkout this font that changes with the users facial expression (shameless plug): Descri…

tribute radio show :) https://www.nts.live/shows/the-do-you-breakfast-show/episode...

Nice documentary on schiele https://www.arte.tv/en/videos/073077-000-A/egon-schiele/

Friend of mine created a parameterised font for his master thesis. We hooked it up to a face expression sentiment analyser (pre trained DNN). It works in the browser with your webc…

Had similar intentions half a year ago, it really clicked for me after watching the linear dynamical systems lecture by Boyd. How rank of a matrix, matrix norm and singular values …

Nice video lecture series by scot https://video.ethz.ch/speakers/bernays/2019/7b11b50e-f813-4d...

I agree that the smartphone could potentially be leveraged to do some audio processing in this context, but you have to consider the latency introduced by the forth and back over b…

We are also in Denmark! Feel free to reach out if you're living in Copenhagen :) https://www.hackyourfuture.dk/

Support for 4! Yet, my understanding is that particle filters are superior but computational more demanding. For nonlinear problems, the extended Kalman Filter linearizes the task,…

I received my PhD in December, so I already pursued further education. My masters was in telecommunications, starting my PhD with a background in signal processing/information theo…

Recent graduate in Optical Communications here :) 1) The fiber is pretty thin, but there are several fibers combined in one transoceanic cable, see here https://en.wikipedia.org/wi…