Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Who needs MLflow when you have SQLite?

ploomber.io

Post reply on HN
Print view View original

81–90 of 113 posts

Re: Who needs MLflow when you have SQLite?

#81

Post by bqmjjx0kac »

alexpotato wrote: post #80

I recently did the following: - had a giant pcap - wrote a perl script to output some of the key value from the dump (e.g. IP and UDP packet lengths) into csv - loaded the csv into sqlite3 database - ran several queries to identify microbursts of bandwidth etc The younger/more junior folks were blown away that you could do this with Btw, above was inspired by this: https://adamdrake.com/command-line-tools-can-be-235x…

If I were looking for bursts, SQL is not the first thing that comes to mind! Could you elaborate on this or sketch out the query?

Re: Who needs MLflow when you have SQLite?

#82

Post by FridgeSeal »

akdor1154 wrote: post #63
dachryn wrote: post #14

Earlier quoted context omitted.

its forced upon many of them that are in finance, banking, insurance, ... Mainly because those tend to run on Microsoft Azure, which has no decent analytics offering, and are pushing Databricks extremely hard. The CTO or whatever just pushes databricks. On paper it checks all the boxes. Mlops, notebooks, experiment management. It just does all of those things very badly, but the exec doesn't care. They only care abou…

What would you go with instead for collaborative notebooks? I ask because normally I tend pretty strongly towards the "NO just let the DSes/analysts work how they want to", which in this case would be running Jupyter locally. However DBr's notebooks seem genuinely useful. Is your issue "but I don't need Spark" or "i wanna code in a python project, not a notebook?", or something else? Imo if DBr cut their wedding to S…

> What would you go with instead for collaborative notebooks?

Production workloads should be code. In source control. Like everybody else.

Notebooks inevitably degrade into confusing, messy blocks of “maybe applicable, maybe not” text, old results and plots embedded in the file because nobody stripped them before committing and comments like “don’t run cells below here”.

They’re acceptable only as a prototyping and exploration tool. Unfortunately, whole “generation” of data scientists and engineers have been trained to basically only use notebooks.

Re: Who needs MLflow when you have SQLite?

#83

Post by alexpotato »

bqmjjx0kac wrote: post #81
alexpotato wrote: post #80

I recently did the following: - had a giant pcap - wrote a perl script to output some of the key value from the dump (e.g. IP and UDP packet lengths) into csv - loaded the csv into sqlite3 database - ran several queries to identify microbursts of bandwidth etc The younger/more junior folks were blown away that you could do this with Btw, above was inspired by this: https://adamdrake.com/command-line-tools-can-be-235x…

If I were looking for bursts, SQL is not the first thing that comes to mind! Could you elaborate on this or sketch out the query?

Basically, doing a group by at millisecond resolution with a sum on the IP packet length to get a rough metric for bandwidth.

Once you have that, you can see the milliseconds with the highest bandwidth. Some extra math can also get you to Gigabits/second in a more network engineer friendly format.

Re: Who needs MLflow when you have SQLite?

#84

Post by tomrod »

nerdponx wrote: post #73
tomrod wrote: post #67

Earlier quoted context omitted.

I'm not emotionally invested in tools so am happy to identify the user experience and operational experience as "trash." "Trash", despite its connotations of lacking value, is really just a chaotic disorganized mess of something made by artifice with dubious reclaim/reuse/recycle value. Being a subjective assessment, it is natural that one person's trash is a treasure to another.

I take issue with your implication that I'm emotionally invested in something when I shouldn't be. You are free to dislike R and not use it, but to claim that it's "trash" is to wrongly disavow its usefulness for the many people that do find it useful, and to cast aspersions on the judgement of all those people.

Hey, I apologize here, my point on emotional investment was that I, personally, am not emotionally invested in it and did not mean to cast aspersions at you for your defense of the language nor at people who have preferences for it. Specifically I meant that I'm comfortable enough in my understanding of the language to classify it and it's standard library as better in the garbage bin relative to alternatives available.

It's fine that people like it. What's good about it isn't unique, and what's unique about it isn't that great. And there are certainly switching costs for some orgs to consider.

Re: Who needs MLflow when you have SQLite?

#85

Post by chaps »

__mharrison__ wrote: post #79
chaps wrote: post #77

Earlier quoted context omitted.

Docstrings are one thing, but functionality discovery, picking up from scratch, troubleshooting, etc are... not fun, nor easy with the documentation. If you know it well already and use it a lot it's easier to forgive its documentation faults since you can waive off the problems as "that's just learning something new". But for a lot of people who use it infrequently its documentation is a frustrating mess. Simple pro…

Fair enough. I'm highly biased and my recent book is the most popular Pandas book currently, so it is evidence that folks prefer opinionated documentation. However, I always though the 10 minutes to Pandas page was decent for getting started. I picked up Polars recently and thought it was more difficult than Pandas because there wasn't any quick intro docs. What projects have great introductory docs for you? Also, I…

Yeah, I think for your audience, pandas makes total sense! When I first started using it, it was through an ambitiously large project with tons of gaps in data, untype-able text for 1% of rows, didn't fit in memory.. etc. So my personal experience is a bit tainted by putting myself through a hell that could have solved sooner by spending more time learning instead of bashing my keyboard with a hammer.

Re: Who needs MLflow when you have SQLite?

#86

Post by jjgreen »

chaxor wrote: post #27
laichzeit0 wrote: post #20

Earlier quoted context omitted.

To be fair, taking R to production is a goddamn nightmare.

R is a trash of a language. It doesn't have any sense of coherency to it at all. They keep trying to fix the underlying problems by ducktaping paradigms on to it over and over (S3, S4, R6, etc). There's never a clear sense of the best way to do anything, but plenty of options to do a thing in a very hacky 'script-kiddy' way. Looking out at the community of different projects it becomes clear that everyone is pretty l…

It's not trash, it's functional, look:

    x

Re: Who needs MLflow when you have SQLite?

#87

Post by diptanu »

I think this is a neat solution for an engineer working on their own and wants to go back and look at the data from various experiments.

I don't see this scaling to many engineers working in a team, who would want to see each others experiment data, or even store artifacts like checkpoints and such. And lastly, in many cases ACLs are required as well when certain models trained with sensitive data shouldn't be shared with engineers outside of a team/group.

Re: Who needs MLflow when you have SQLite?

#88

Post by bqmjjx0kac »

alexpotato wrote: post #83
bqmjjx0kac wrote: post #81

Earlier quoted context omitted.

If I were looking for bursts, SQL is not the first thing that comes to mind! Could you elaborate on this or sketch out the query?

Basically, doing a group by at millisecond resolution with a sum on the IP packet length to get a rough metric for bandwidth. Once you have that, you can see the milliseconds with the highest bandwidth. Some extra math can also get you to Gigabits/second in a more network engineer friendly format.

Aha, group by millisecond! Thanks.

Re: Who needs MLflow when you have SQLite?

#89

Post by melagonster »

tomrod wrote: post #61
citizenpaul wrote: post #53

Earlier quoted context omitted.

Unless your income is depending on carrying out the exact demands of some money guy that's most common phrase while using a computer is "it won't let me" and they want "big data". Then you just suck it up and build one of the totally unnecessary big data systems that have been excreted all over the business world these days. I don't think the problem is that devs are over-engineering. I wonder what its called, makes…

Hierarchy on bueracracies, by Jean Tirole. I know because this was the phenomenon I wanted to study in grad school only to find he scooped me (on this an several items) by several decades. Edit: Tirole, Jean. "Hierarchies and bureaucracies: On the role of collusion in organizations." JL Econ. & Org. 2 (1986): 181.

if this research is so old, did world tried any thing to ameliorate this problem? I guess it doesn't happen yet...

Re: Who needs MLflow when you have SQLite?

#90

Post by shmoejoe »

LeanderK wrote: post #18

I think MLflow is a good idea (very) badly executed. I would like to have a library that combines: - simple logging of (simple) metrics during and after training - simple logging of all arguments the model was created with - simple logging of a textual representation of the model - simple logging of general architecture details (number of parameters, regularisation hyperparameters, learning rate, number of epochs etc…

How about this? https://github.com/capitalone/rubicon-ml
Post reply on HN