Live data from Hacker News

Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

arxiv.org

101–110 of 177 posts

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#101

[flagged]

I tried to look at your screenshot and holy hell what happened to imgur? That site used to be great for sharing images. Now it is enshittified to the max. I couldn’t even zoom in to look at the equations without some random animated GIFs popping up over the entire screen. I even use an ad blocker!

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#102

for those who want some maths-heavy stuff for deep learning, check francois fluret's book https://fleuret.org/francois/lbdl.html . the pdf is free but the print is so cute.

Has anyone figured out a way to print the Fleuret book on A4 paper? Every other page ends up upside down when I've tried it, which is problematic with a duplexer.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#103

Earlier quoted context omitted.

Bishop’s Pattern Recognition and Machine Learning is one example that has tremendous depth and much clearer notation. Deep Learning by Goodfellow et al. is another example, albeit with less depth than Bishop. I’m glad you’re enjoying the book. The approach is ideal for a very small subset of the ML population, no doubt that was their intention. I’m just weighing in that it’s entirely possible to cover this material w…

Thanks for highlighting Bishop to me! I've self-taught through various resources esp. Goodfellow et al 2016. It's taken me a number of years to rebuild my math knowledge so that I feel comfortable with Goodfellow's treatment and look forward to learning from the Bishop book. Fwiw, I've found the math notation in the Goodfellow textbook to be among the best I've ever seen in terms of consistency and clarity. Some othe…

I appreciated the notation in Goodfellow book as well, it was easy enough for me to follow without having a strong mathematics background. I'll agree however with others that this text is instead focused for a different audience and purpose.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#104
post #75

As someone who has a deeper knowledge of programming rather than math, I find the mathematical notation here to be harder to understand than the code (even in a programming language I do not know). Does anyone with a stronger mathematical background here find it easier to understand the math as written more easily than the source code?

I have a strong mathematical background, and I found the notation completely insane. Right out of the gate in chapter 1 we get a definition that has subscript indices in the subscript index and a summation with subscripts in the superscript, and then composed in a giant function chain. Later we get to 4-level subscripts deep, invent at least 3 new infix operators, define 30 new symbols from 3 different alphabets and…

I’m not sure what specialization of math you studied, but using superscripts for indices is pretty common where you’re dealing with multi-dimensional objects. I used it in a lot of the courses in my degree.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#106

[flagged]

Make the robot overlords work for you. ChatGPT 4's data analysis plugin takes a pretty impressive stab at explaining it:

https://i.imgur.com/DCAnoCu.png

It will also make an attempt at turning the expressions into Python. It bombed out at first but caught itself and retried without any additional prompting:

https://i.imgur.com/nzywKkb.png

Not being familiar with SymPy, though, and not having time to think it through myself, this might be a bunch of hallucinated gobbledygook. Caveat lector.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#107

[flagged]

if you have no mathematical background at all this isn’t the book for you i think. that is not really advanced mathematics although a little notationally dense.

there are many good materials such as the fantastic fast.ai course that don’t require such mathematical background.

if you are motivated to learn about ML, then studying the topic can gradually be a route in to more mathematical knowledge so that equations like this would not seem intimidating.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#109

Earlier quoted context omitted.

Use ChatGpt. Screenshot the math, crop it down to the equation, paste into the chat window. It can explain everything about it, what each symbol means, and how it applies to the subject. It’s an amazing accelerator for learning math. There’s no more getting stuck. I think it’s underrated because people hear “LLM’s aren’t good at math”. They are not good at certain kinds of problem solving (yet), but GPT4 is a fantast…

Don't suggest this. While I agree it can be helpful, the problem is if you're a novice you won't be able to distinguish hallucinations. Which in my experience are fairly common, especially as you do advance topice. If you got good math rigor then it's extremely helpful, because often things are hard to exactly search, but it's a potential trap for novices. But if you have no better resource, then I can't blame anyone…

It works better than you think, as long as you use GPT 4. See my answer to the other person (https://news.ycombinator.com/item?id=38837646).

A lot of negativity comes from people who goofed around with 3.X for a while, came away unimpressed, muttered something under their breath about stochastic parrots or Markov chains that sounded profound (at least to them), and never bothered to look any further. 4 is different. 4 is starting to get a bit scary.

The real pedagogical value comes when you try to reconcile what it tells you about the equations with the equations themselves. Ask for clarification when something seems wrong, and there is an excellent chance it will catch its own mistakes.

Re: Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory

#110
It's hard to call comprehensive. Transformers - one page. A picture would be nice. No "prompt engineering", no "double deep". In fact words "prompt" and "double" aren't used at all. "Recognition" is used only once outside of bibliography just for reference. Looks like theory will not catch up with practice any time soon. With looming singularity it's bit worrying.
Post reply on HN