Viewing profile — _pastel

The tradeoff is highly contextual; it's not a tradeoff an agent can always make by inspecting the project themselves. Even within the same project, for a given PR, there are some p…

Bike is the one that gets me - when the full Ode to Joy hits I tear up every time.

You could fine-tune the embedding model to reduce cosine distance on a more specific function.

I work with an extremely effective machine learning engineer, and the biggest thing I've learned is how far you can get with vibes, even in a more traditional ML situation. He inve…

Why is max_seq_len set to 2048 [1] when the model card says the context size is 8k [2]? [1] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959... [2] https://github.com/m…

Tooling around embeddings has improved. Creating and fine-tuning custom embeddings for your tabular data should be easier and more powerful these days.

100% agree. One thing that helps is hooking metabase up to its own database and building queries on your queries, e.g.: select * from report_card where dataset_query ilike '%' || {…

Not only is it not constant time, it's not even polynomial - it's psuedo-polynomial. Also it'll fail on negative numbers, right? You'll need something like `10000 * log(time + min(…

Some ways to make recipients feel more comfortable: - You can suggest some other contribution. "Would you mind bringing snacks? / Would you mind handling music on the drive? / Woul…

True in this situation, but note that intermediate activations and gradients do take memory and in other contexts that's the limiting factor. For example purely convolutional image…

Ah, the celery semantics.

Interesting how Gitlab repeatedly emphasizes it's based on "cost of market", not "cost of living".

So in the sparse grams explanation, what are the bigram weights? Is it inverse frequency, so common bigrams get split last? And the goal is to be able to search on a larger gram th…

From https://acoup.blog/2019/07/26/collections-war-elephants-part... . I highly recommend the whole series. > At Bagradas (255 B.C. – a rare Carthaginian victory on land in the Fir…

Did you target cloud infrastructure from the beginning, or fall into it by chance? Do you think that's an easier entry point than general programming?

I had a graduate algorithms class that was graded like this, but the teacher didn't explain and I was clueless. I spent the whole semester super stressed and convinced I was failin…

I see this when giving and receiving form advice in a few physical disciplines. "Just relax your shoulders here and move naturally." Physical mastery often looks relaxed, natural, …

Thanks for all your work! If you don't mind some off-topic feedback on the Dominion website - have you considered making the Tables screen default to "New" only? At busy times, tha…

Word of warning - if you write your own task queue at a startup, you will spend the rest of your tenure justifying this decision to every new data engineer who joins. Also, am I cr…

If you're interested in browsing creative prompts, I highly recommend the reddit community at r/dalle2. Some are impressive: - www.reddit.com/r/dalle2/comments/uzosy1/the_rest_of_m…

Because anytime I search for literature on basic tweaks to the structure of decision trees, I find nothing. Another example: modern GBM implementations all use binary trees. How wo…

It's baffling to me how little research attention there has been to improving tree-based methods, considering their effectiveness. For example, LightGBM and XGBoost allow some regu…

Note that greedy probability maximization or information gain are not quite optimal. Not without some kind of search or tiling heuristics. For example, suppose you've eliminated al…