Viewing profile — fantispug

Yes, this seems to be a common capability - Anthropic and Mistral have something very similar as do resellers like AWS Bedrock. I guess it lets them better utilise their hardware i…

Meta's primary business is capturing attention and selling some of that attention to advertisers. They do this by distributing content to users in a way that maximizes attention. C…

I find this style changes the way I think about and write code transformations. It's also in shell pipelines, R's magrittr, and Clojure's thread macros, and can be emulated in some…

I have seen it work better than LSH. Each time you embed a document you search for approximate nearest neighbours before adding it, so it is O(N) like MinHash. Vector indexes like …

It covers a lot of the fundamentals in some detail (attention and transformers, decoding, transfer learning) that are underneath current cutting edge NLP; this is still a very good…

> Maybe my data structure has a hash table of items, as well as a direct link to the largest item. When I say: "write the function to insert a new item in the list, and remember to…

With the prompt // Print the fibonnaci sequence, except the number 5. int main() { I got the result: int a = 0; int b = 1; int c = 0; while (c

This happened in mathematics about a decade ago when Wolfram Alpha came out. Lecturers started complaining that Wolfram Alpha could solve assignment problems with worked steps. In …

These issues are often interactions between packages. I use TRAMP daily without freezing, but only when I disable company mode in shell modes. VSCode certainly requires much less o…

The killer feature of racket is it is very easy to make Domain Specific Languages (including the teaching language) and related tooling. However last time I looked the library ecos…

Kaluza-Klein theory is an attempt to exhibit a transformation that charged particles travel on "straight" lines in a 5-dimensional space. The fifth dimension is supposed to be a ve…

I'm the same; I use evil-mode in emacs and find the friction of switching between them small.

I've thought about a variant of this with Baking Pi [1]. That takes you through assembly to the point of having a Raspberry Pi with a minimal terminal (with just an external USB dr…

This may make sense if you want to do image processing and deep reinforcement learning. But there are lots of other domains. For tabular data (which is probably most relevant in Ph…

If you like books and you want to deeply understand ML techniques I'd suggest jumping straight into "Introduction to Statistical Learning" and only learning calculus/stats/matrix m…

Without experience in ML it's often hard to know what problems are solvable, how to frame the problem, and to tell a good solution in Github from a bad one, etc. If you want to go …

They do mention Penrose notation in the linked arxiv paper[1], as well as Cvitanović's Birdtracks[2] which let you do calculations on representations of groups. They claim they're …

Circa 2009 I worked on an application that would render maths tests for teachers using plain TeX. I'm sure there are a few other wild examples (my CV is in eplain TeX).

My experience is pip and virtualenv (or venv in 3.3+) works pretty well in both interactive and deployment contexts. My main gripe is Pip doesn't resolve conflicts between downstre…

This is missing the most important difference - deployability. R was built as a language to use interactively and does things like raise warnings for things that should be errors, …

I hope that you're wrong because it's solving the wrong problem. A compatibility interval (at an agreed upon arbitrary level) communicates the magnitude of the difference as well a…

The details are even hairier. He wrote TeX82 (modern TeX) in WEB, a literate programming language he invented that could be tangled into the Pascal machine code or weaved into lite…

I wonder whether using computers more (whether numerical or symbolic calculations) could remove some of the burden of understanding mathematical techniques and make this process sm…

Absolutely. There are some known anomalies in particle physics (e.g. neutrino oscillations) but for the most part it is insanely robust. What's really hard is moving from these fir…

Apache libcloud works well for more basic services (e.g. storand and compute) and is extending into container management services.