Deep Learning in JavaScript

Post by QuadmasterXLII » Fri, Mar 29, 2024, 11:03 AM UTC

throwaway4aday wrote: post #48

modeless wrote: post #26

Someone needs to do a TypeScript compiler plugin to add multidimensional array slicing and operator overloading to the language, so these libraries can actually work the way PyTorch does. I know operator overloading is controversial, but the way it allows automatic differentiation to work transparently through regular arithmetic expressions is very helpful. Without it these libraries will never feel like PyTorch. Jav…

What's wrong with creating a function that does those things? It would be less surprising to people new to the library, would be self-documenting by having a name and an easily inspected declaration with named arguments, and it would be idiomatic JS. You could also have variants that are purely functional and return a new value or ones that mutate in place that you could use depending on your needs.

Post by 4hg4ufxhy » Fri, Mar 29, 2024, 1:26 PM UTC

QuadmasterXLII wrote: post #51

throwaway4aday wrote: post #48

Earlier quoted context omitted.

What's wrong with creating a function that does those things? It would be less surprising to people new to the library, would be self-documenting by having a name and an easily inspected declaration with named arguments, and it would be idiomatic JS. You could also have variants that are purely functional and return a new value or ones that mutate in place that you could use depending on your needs.

In python when I try a new gpu accelerated array library, to write norm_arr = arr / lib.sqrt( lib.sum( arr*2, axis=-1, keepdims=True) , I have to read documentation for sum to see whther they use axis or dim in sum. In javascript, to write the same thing I need to read documentation for a sum function, a broadcasted division function, a multiply function. I can probably assume that the sqrt function behaves and is na…

Post by goatlover » Fri, Mar 29, 2024, 1:42 PM UTC

modeless wrote: post #26

Someone needs to do a TypeScript compiler plugin to add multidimensional array slicing and operator overloading to the language, so these libraries can actually work the way PyTorch does. I know operator overloading is controversial, but the way it allows automatic differentiation to work transparently through regular arithmetic expressions is very helpful. Without it these libraries will never feel like PyTorch. Jav…

Post by eduardoleao052 » Fri, Mar 29, 2024, 1:53 PM UTC

pzo wrote: post #49

dleeftink wrote: post #31

Earlier quoted context omitted.

You might already be familiar, but a GPU.js backend can provide some speedups via good old WebGL -- no need for WebGPU just yet! [0]: https://github.com/gpujs/gpu.js/

FWIW also taichi is quite popular in python and seems has some javascript related implementation (I haven't used it though), taichi.js [0] [0] https://github.com/AmesingFlank/taichi.js

Post by eduardoleao052 » Fri, Mar 29, 2024, 1:58 PM UTC

pcthrowaway wrote: post #52

eduardoleao052 wrote: post #10

Earlier quoted context omitted.

Thanks for the tip! I will look into your project, for sure! I am still a beginner on Typescript, but when I get the hang of it, I think I might refactor my package to Typescript. Again, thanks for the tip!

Typescript is something you learn progressively over years, and from what others have posted it might not be possible to refactor your package in Typescript (some approaches to problems that are possible in JS aren't supported by TS). But type declarations at the very least should be possible