11–20 of 71 posts
Can Datasette be used with a Postgres RDS database with hundred GBs? Feels like it's mostly designed for smaller things? Also if it can, how would I go about it and if it can't, any similar tools I can use? This looks really cool!!
I tried datasette for the first time not long ago. To me it wasn't obvious what it gave me compared to my local Postgres setup. I have a single docker-compose file with Postgres + pgAdmin and a host mount which I use for data exploration and ad-hoc analysis. I get a nice Web UI and can ingest quickly using the awesome Postgres FDWs. Compared to datasette, it allows me to also transform the data by creating derived vi…
Instead, I have used Datasette as a way to distribute data to less technical groups with a minimum of fuss. Without dedicated infrastructure, sharing data bigger than an Excel file can require quite a bit of work, requiring building some kind of custom query/search/visualization mechanism. With Datasette, after I have completed an analysis, I can dump as much data as I want into some (fairly wide) tables, give a three minute tutorial (This is like a web version of Excel, and this is how you filter rows), and leave them to explore. This has allowed me to offer alternatives reports by just creating a new view into the data. As the underlying technology is SQLite, it can handle large datasets without problem.
Earlier quoted context omitted.
I knew an outdoor person that did almost everything with an Opinel knife when being on tour.
Indeed a blade is one of the most useful things that you can’t replicate with naturally occurring items (a log or a rock can be used to hammer things, for example, or vines can be twisted into rope). Opinel knives in particular are quite handy, thanks to the good quality of the blade. They can take a beating and keep their edge, plus they fold and fit in the pocket (up to No. 9 with ease), so they can fulfill the fun…
Only tangentially related: what is the best general-use single hand tool? My feeling is that it would be some kind of small sturdy knife. "When all you have is a knife, a lot of stuff looks passably doable"
I knew an outdoor person that did almost everything with an Opinel knife when being on tour.
- Tape measure. - Utility knife. - Mechanical pencil. - Distant 4th: Screwdriver. - Even more Distant 5th: Linesman's Pliers (but I'm doing a lot of electrical work right now)
In particular, a few years ago I switched to the Milwaukee FASTBACK utility knife. They have a belt/pocket clip, storage for extra blades, and different models have additional features like: scoring, gut hook, wire stripper, bottle opener, and they have a new one with a bit driver built in, and they're cheapish at $10-$20. Early ones had a far-too-easy to press blade removal button, but more recent versions have added a metal tab to protect it.
On the screwdriver front, I went on a bit of a deep dive when Linus Tech Tips released their own $70 driver, which does look awesome, but in the end I decided I'm just not that picky and the one I usually reach for is the cheap "Amazon Basics 12-in-1". Fairly affordable at $13, and works fairly well.
I had started off the attempt to replace my ~20 year old multi-bit ratcheting driver (because the plastic was starting to break down) with a ChannelLock that Wirecutter fawned over, but I ended up hating that one, largely because it used ball bearings for retaining the bits and 80% of the time I don't get the bit fully seated and then the bit falls out. I also tried the Williams WRS-1 at the recommendation of Project Farm, and it indeed does have a much better ratcheting mechanism, more akin to the LTT, but in the end I decided things like a little bit of wobble and slop don't really matter to me when I'm using it. Having 4-6 Amazons that are just laying around, vs. 2 Williams or 1 LTT for the same price is probably more valuable to me.
Only tangentially related: what is the best general-use single hand tool? My feeling is that it would be some kind of small sturdy knife. "When all you have is a knife, a lot of stuff looks passably doable"
Can Datasette be used with a Postgres RDS database with hundred GBs? Feels like it's mostly designed for smaller things? Also if it can, how would I go about it and if it can't, any similar tools I can use? This looks really cool!!
Can Datasette be used with a Postgres RDS database with hundred GBs? Feels like it's mostly designed for smaller things? Also if it can, how would I go about it and if it can't, any similar tools I can use? This looks really cool!!
I tried datasette for the first time not long ago. To me it wasn't obvious what it gave me compared to my local Postgres setup. I have a single docker-compose file with Postgres + pgAdmin and a host mount which I use for data exploration and ad-hoc analysis. I get a nice Web UI and can ingest quickly using the awesome Postgres FDWs. Compared to datasette, it allows me to also transform the data by creating derived vi…
I do not think Datasette has much to offer the savvy analyst. The base experience is more-or-less what you can get from DBeaver. However, the plug-in system does dramatically change this: check out Simon’s example with the train announcement audio clips or any of the mapping examples. Instead, I have used Datasette as a way to distribute data to less technical groups with a minimum of fuss. Without dedicated infrastr…
I tried datasette for the first time not long ago. To me it wasn't obvious what it gave me compared to my local Postgres setup. I have a single docker-compose file with Postgres + pgAdmin and a host mount which I use for data exploration and ad-hoc analysis. I get a nice Web UI and can ingest quickly using the awesome Postgres FDWs. Compared to datasette, it allows me to also transform the data by creating derived vi…
Question: Did you add plugins? Datasette is basically entirely plugins, such that you can create radically different "sites" and tools out of different combinations of plugins. Datasette without any plugins is useful, but where it's functionality shines is entirely in plugins.
What is your use case and which plugins would you recommend? Providing some kind of bare bones report/dashboard with the visualization plugin?
Interesting project. I would've liked to have heard a brief comparison with Excel - what makes Datasette something that one should reach for over that? Is it just the ability to use SQL in-place?
Some things which stand out to me at a glance: - it’s open source - it allows publishing to the web - it provides handy web-based tooling, like turning your data into a JSON api - it provides a user-friendly UI but also lets you dig deeper with plain old SQL (pro to some, con to others) - apparently has an extensible core with a rich plugin ecosystem which allows it to meet a wide range of needs I’m sure there’s more…