Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
1–10 of 68 posts
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#2I think Elixir might have the most wonderful community out there.
Really cool to see the concerted effort in parallel going into both ML problem space, and into introducing typing.
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#3From a "marketing strategy" point of view, I wonder what the thinking is in investing in this stuff so heavily when Python seems to be kind of the go-to? Will they be able to create a "good enough" environment to do that kind of work with Elixir? Is it just someone or a company scratching their own itch?
This is a genuine question - I don't know much about "AI stuff", but do know something about the economics of programming languages and I'm "intellectually curious" about what is driving this and what the goals are, rather than critical of Elixir. I love working with BEAM and miss it.
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#4From a "marketing strategy" point of view, I wonder what the thinking is in investing in this stuff so heavily when Python seems to be kind of the go-to? Will they be able to create a "good enough" environment to do that kind of work with Elixir? Is it just someone or a company scratching their own itch? This is a genuine question - I don't know much about "AI stuff", but do know something about the economics of prog…
I can't say I know much about AI stuff or BEAM. But my best guess is that elixir native ML should integrate well with OTP's distributed computing capabilities. As an outsider to the elixir ecosystem, I've seen glimpses of elixir ML here and there but no mention of attempting to bridge the python ML ecosystem into elixir.
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#5From a "marketing strategy" point of view, I wonder what the thinking is in investing in this stuff so heavily when Python seems to be kind of the go-to? Will they be able to create a "good enough" environment to do that kind of work with Elixir? Is it just someone or a company scratching their own itch? This is a genuine question - I don't know much about "AI stuff", but do know something about the economics of prog…
I can't say I know much about AI stuff or BEAM. But my best guess is that elixir native ML should integrate well with OTP's distributed computing capabilities. As an outsider to the elixir ecosystem, I've seen glimpses of elixir ML here and there but no mention of attempting to bridge the python ML ecosystem into elixir.
[deleted]
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#6From a "marketing strategy" point of view, I wonder what the thinking is in investing in this stuff so heavily when Python seems to be kind of the go-to? Will they be able to create a "good enough" environment to do that kind of work with Elixir? Is it just someone or a company scratching their own itch? This is a genuine question - I don't know much about "AI stuff", but do know something about the economics of prog…
One factor may be that a few years back the language creator (José Valim, also the author of this article) announced that the language is basically "completed", and that they would shift focus to other things like developer tooling and other projects outside of the language itself.
José is quite prolific, so I think it's natural that he moves on to things like this. It's hard to know what reception will be like until you build it.
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#7People have to realise these are mostly for hobby. It is really hard to get these working with other libraries.
Take explorer, it’s a mess trying to implement dplyr verbs in elixir. Anyone trying to use it is going to hit its limitations sooner or later. I tried migrating to it from polars but it is too frustrating.. gave up after some time.
Why will people use half baked libraries instead of python ? I will stick to Keres/pytorch, polars, etc
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#8People have to realise these are mostly for hobby. It is really hard to get these working with other libraries. Take explorer, it’s a mess trying to implement dplyr verbs in elixir. Anyone trying to use it is going to hit its limitations sooner or later. I tried migrating to it from polars but it is too frustrating.. gave up after some time. Why will people use half baked libraries instead of python ? I will stick to…
At this point is isnt trying to convert a happy python user like you. Rather to give tools to teams whose app is already in Elixir and the devs knows Elixir. Instead of bringing in Python to the mix you can use Elixir
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#9People have to realise these are mostly for hobby. It is really hard to get these working with other libraries. Take explorer, it’s a mess trying to implement dplyr verbs in elixir. Anyone trying to use it is going to hit its limitations sooner or later. I tried migrating to it from polars but it is too frustrating.. gave up after some time. Why will people use half baked libraries instead of python ? I will stick to…
I don't think a lot of people are using these in production yet, but you can't become fully baked without spending some time being half baked.
Sometimes though it's nice to have most of your stuff in one language.
Re: Elixir and Machine Learning in 2024 so far: MLIR, Arrow, structured LLM, etc.
#10People have to realise these are mostly for hobby. It is really hard to get these working with other libraries. Take explorer, it’s a mess trying to implement dplyr verbs in elixir. Anyone trying to use it is going to hit its limitations sooner or later. I tried migrating to it from polars but it is too frustrating.. gave up after some time. Why will people use half baked libraries instead of python ? I will stick to…
I’ve been considering using elixir for a while. With these libraries, it’s now entirely feasible to move my backend over to elixir, getting rid of 95% of my python code in the process. The tasks leftover that still need python can easily each fit in their own It’s not an all or nothing game, and I rue the day that I decided to do everything in python just because I needed a couple LoC to call a python module.