Earlier quoted context omitted.
My issue with SQL is lack of composability and difficulty of debugging intermediate results.
is it a language problem though? it's just lack of tooling.
I want a good parallel language [video]
21–30 of 69 posts
Re: I want a good parallel language [video]
#22Earlier quoted context omitted.
Also, while not exactly the algorithm Raph is looking for, here is a bracket matching function (from Pareas, which he also mentions in the talk) in Futhark: https://github.com/Snektron/pareas/blob/master/src/compiler/... I haven't studied it in depth, but it's pretty readable.
(author here) check_brackets_bt is actually exactly the algorithm that Raph mentions
Re: I want a good parallel language [video]
#23Re: I want a good parallel language [video]
#24The audio is weirdly messed up
Re: I want a good parallel language [video]
#25Earlier quoted context omitted.
Also, while not exactly the algorithm Raph is looking for, here is a bracket matching function (from Pareas, which he also mentions in the talk) in Futhark: https://github.com/Snektron/pareas/blob/master/src/compiler/... I haven't studied it in depth, but it's pretty readable.
(author here) check_brackets_bt is actually exactly the algorithm that Raph mentions
Re: I want a good parallel language [video]
#26Earlier quoted context omitted.
(author here) check_brackets_bt is actually exactly the algorithm that Raph mentions
Right. This is the binary tree version of the algorithm, and is nice and concise, very readable. What would take it to the next level for me is the version in the stack monoid paper, which chunks things up into workgroups. I haven't done benchmarks against the Pareas version (unfortunately it's not that easy), but I would expect the workgroup optimized version to be quite a bit faster.
Re: I want a good parallel language [video]
#27SQL. It is a joke, but an SQL engine can be massively parallel. You just don't know it, it just gives you what you want. And in many ways the operations resembles what you do for example in CUDA. CUDA backend for DuckDB or Trino would be one of my go-to projects if i was laid off.
Re: I want a good parallel language [video]
#28Re: I want a good parallel language [video]
#29Or basically a generic nestable `remote_parallel_map` for python functions over lists of objects.
I haven't had a chance to fully watch the video yet / I understand it focuses on lower levels of abstraction / GPU programming. But I'd love to know how this fit's into what the speaker is looking for / what it's missing (other than obviously it not being a way to program GPU's) (also full disclosure I am a co-founder).
Re: I want a good parallel language [video]
#30SQL. It is a joke, but an SQL engine can be massively parallel. You just don't know it, it just gives you what you want. And in many ways the operations resembles what you do for example in CUDA. CUDA backend for DuckDB or Trino would be one of my go-to projects if i was laid off.
Term rewriting languages probably work better at this than I would expect? It is kind of sad how little experience with that sort of thing that I have built up. And I think I'm above a large percentage of developers out there.