Viewing profile — vtuulos

If you are ok with executing your SFN steps on AWS Batch, Metaflow should do the job well. It's pretty inhuman to interact with SFN directly. One feature that's in our roadmap is t…

Stay tuned! We have some cool new features coming soon to support agentic workloads (teaser: https://github.com/Netflix/metaflow/pull/2473 ) If you are curious, join the Metaflow S…

Metaflow tracks all artifacts and allows you to build dashboards with them, so there’s no need to use MLFlow per se. There’s a Metaflow integration in Weights and Biases, CometML e…

Metaflow was started to address the needs of ML/AI projects whereas Airflow and Dagster started in data engineering. Consequently, a major part of Metaflow focuses on facilitating …

I don't know if it's a coincidence but we just released a major new feature in Metaflow a few days ago - composing flows with custom decorators: https://docs.metaflow.org/metaflow/…

if you want to see similar tricks applied in Python (with a JIT compiler for query-time optimization), take a look at this fun deck that I presented a long time ago: https://tuulos…

yes, this. In case you are interested in seeing some numbers backing this claim, see here https://outerbounds.com/blog/metaflow-fast-data Source: I used to work at Netflix, buildin…

I had the same concern. However, the structure of the output was surprisingly stable. We rejected badly formatted responses: https://github.com/outerbounds/hacker-news-sentiment/bl…

here's how the model ranks the discussion on this page after 40 comments: SENTIMENT 6 :D

yep! And of course the new 3.1 model

even simpler, you can just do it in SQL You can find all titles and dates since the beginning of HN in this public BigQuery dataset: https://console.cloud.google.com/marketplace/pr…

That's an interesting hypothesis but the words we use to express agreement and disagreement haven't changed much. We don't try to retrieve articles/topics from the model, which wou…

yes please! The data is conveniently available as JSON blobs here https://github.com/outerbounds/hacker-news-sentiment/tree/ma...

search "divisive" here: https://github.com/outerbounds/hacker-news-sentiment/blob/ma... I actually spent 10 minutes trying to see if there are obvious tests for U-shaped distributi…

Exactly. Now we have a new UI paradigm and a new, incredibly powerful NLP tool in our toolkit. Is this AGI? Of course not. Is this useful and valuable? Obviously.

here's how we solved engineering challenges related to RAG using open-source Metaflow: https://outerbounds.com/blog/retrieval-augmented-generation/

Metaflow integrates with AWS Batch which many folks use for serious HPC. Internode scheduling happens through the multinode scheduling supported by AWS Batch. networking via EFA et…