Viewing profile — cgarciae

NNX is a Neural Networks library for JAX that provides a simple yet powerful module system that adheres to standard Python semantics. Its aim is to combine the robustness of Flax w…

I think we have to make a distiction here: - On one hand, having access to these large scale language models that can do few-shot learning is incredibly useful for the industry as …

Side note: I like Pytorch but eager pytorch is not faster the jax.jit or tf.function code

One thing not mentioned in the original "Why Swift for Tensorflow" document and was a mayor source of conflict when the differentiable programming feature was formally proposed by …

I think the ML community really needs a better language than Python but not because of the ML part, that works really good, its because of the Data Engineering part (which is 80-90…

No repo like LIME? Would love to test this.

Hey, thanks for all the feedback. I will change the naming since its something most of you have agreed is a good change. The goal I have for Pypeline is much simpler: let you easil…

Sounds like a group_by and then do a function per group? Pypeline doesn't have grouping but sounds like Spark or Dask should the the job.

Dask might be lightweight internally but resorting to it just to solve a simple task that requires concurrency is not "simple". Streamz looks nice! However: "Streamz relies on the …

jajajajaja

Nice to hear that. When I wrote this: "Pypeline was designed to solve simple medium data tasks that require concurrency and parallelism but where using frameworks like Spark or Das…

3. If you first have to put in all the data first you cant handle streams. Pypeline accepts non-terminating iterables and also gives you back possibly non-terminating iterables.

Thanks! Did take a look at mpipe (its actually referenced in the readme). But mpipe has its flaws: 1. It uses None as the stage terminator, this is VERY error prone, what if you ac…

I use BEAM for my Dataflow jobs. But their local "DirectRunner" is just for testing purposes. As with Spark, BEAM is a huge beast, Pypeline was created with simplicity in mind, its…

Point taken! Thanks a lot for your feedback. Just a few points: * pypeline is already taken :( * My main reason for this was because initially I was thinking that you did an `impor…