Viewing profile — rpedela

GCP is pretty pleasant overall. The API, command line, and UI are all pretty good. Vast majority of functionality is supported in all three places too. Like all providers, they hav…

There are several use cases where ML can help even if it isn't perfect or even just better than random. Here is one example in NLP/search. Let's say you have a product search engin…

If you can write a SQL query or a set of SQL queries to do your transformation, then you can use DBT. DBT doesn't do transformation itself rather it helps you manage all the depend…

DBT has two main innovations. First, everything is a SELECT statement and DBT handles all the DDL for you. You can handle DDL yourself if you have a special case too. Second, the r…

I think using a data warehouse as your data lake or lake house is optimal. Even for data that isn't relational. Storage is so cheap now and is decoupled from compute costs for seve…

For my search use case, documents are mostly single topic and less than 10 pages. However I have found embeddings still work surprisingly well for longer documents with a few topic…

Google has a distributed embedding matching service in preview: https://cloud.google.com/vertex-ai/docs/matching-engine/over... I guess it depends on what you mean by "simple". The…

Yes I know for sure. Postgres search is essentially an easier to use regex engine. If you have a recall-only use case and/or a small dataset, then that works great. As soon as you …

I disagree based on the trends, especially in the US where few, if any, new coal plants are being built and most existing ones are scheduled to be converted to natural gas or shut …

Coal is on its way out. We don't have to wait for the perfect energy solution before we can improve agriculture.

If you are going to put creds in git, at least use sops. https://github.com/mozilla/sops

I grew up in Cincinnati. You are correct, however traffic is bad enough now that a subway or light rail would make a big difference. Unfortunately it is unlikely the voters would a…

I personally try to make decisions using probability. I understand where you are coming from but there is one factor missing in your analysis: this situation is literally life and …

We have no data for mRNA vaccines except those trials. We don't know if the historical data on traditional vaccines are applicable here. As such, it is also possible that a single …

Yeah I agree, I would like to see some percentage be lottery based. I think you should still need to write a proposal, but if the proposal isn't selected then it goes in the lotter…

Where do you think those calories come from?

> no dietary need for sugar Can I assume you mean simple sugars that are added for taste? If you literally meant what you said, well you will die without carbohydrates (sugar).

I think a better analogy would be living near an airport like I do. Depending on the day and weather, even my small airport is quite loud and annoying. My neighbor's motorcycle is …

I think Citus can be used effectively for that scenario now. https://www.citusdata.com/