Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is there server-side software that we are missing in 2018?

news.ycombinator.com

Post reply on HN
Print view View original

91–100 of 115 posts

Re: Ask HN: Is there server-side software that we are missing in 2018?

#91

Post by marsanyi »

TheHam wrote: post #81
gfodor wrote: post #32

I don't think anyone has solved the issues raised in Out of the Tar Pit in the data storage space. We still spend a ton of effort, perhaps more than ever before, wrangling incidental complexity. In 2018, I should be able to define a simple relational schema in 30 seconds and start using it with effectively zero constraints around data access patterns, transaction volume, and data scale, and with no design decisions n…

AWS just release AppSync. You can define a relational GraphQL Schema and hook up to a number of sources to feed data to it. Then, AppSync will automatically turn your schema into a GraphQL API where clients can make queries, mutations, and subscribe to data changes with no constraints regarding data access patterns. Subscriptions scales without any work from you. All of these operations use the relational schema, whi…

This looks pretty nice.

Re: Ask HN: Is there server-side software that we are missing in 2018?

#94

Post by anon1253 »

chubot wrote: post #14

I want a distributed (not cloud) file system that handles many files and WAN latency (i.e. not HDFS). It might be a cross between Git and BitTorrent. It feels like deb repos, PyPI, NPM, CPAN, CRAN, etc. should be put in there, with the addition of binaries for popular architectures. And probably Docker-like images, although I think if they are not opaque blobs, it would be better for rsync-like differential compressi…

https://www.resilio.com/ (formerly bitorrent-sync)?

Re: Ask HN: Is there server-side software that we are missing in 2018?

#95

Post by agibsonccc »

m_ke wrote: post #19

Machine learning model management and serving service. I haven't seen a decent open source framework that makes it easy to package a trained model with prepocessing and postprocessing steps and deploy it behind an API. Adding performance tracking and model validation on top of that would be great. Then there are things like queuing/batching and autoscaling. Closes thing that comes to mind right now is tensorflow serv…

This is basically all we do (Disclaimer: This is mainly meant for bigger companies, not startups): https://skymind.ai/platform - reach out if you have any questions. Mail in profile.

One thing I'll say is "just k8s" isn't realistic. You need a lot more than that.

It should run within k8s but should also be minimalistic. Not a lot of platforms provide that. A lot of our docs on the internals are still being built out yet, but we provide everything ranging from an offline install of anaconda to managed connectivity gateway to hadoop and spark clusters.

We also have built in model serving and experiment tracking (which in reality is just a relational database with a rest api automatically integrated in to the platform) - if you're interested in learning more please reach out.

Re: Ask HN: Is there server-side software that we are missing in 2018?

#96

Post by agibsonccc »

simonw wrote: post #15

Serving machine learning models in production is still something that appears not to have an obvious correct solution.

Hi fellow YC alumni! See the pitch here: https://news.ycombinator.com/item?id=16399326

We'll be supporting PMML and the like as well. The goal is to hit the simple things rather than perpetuating the latest hype like the AutoML stuff people are going on about currently. If you'd be interested, would be happy to have a conversation to go over what we're trying to do. We hope to just provide a platform neutral tool for building and deploying models similar to sagemaker (but cloud agnostic)

Re: Ask HN: Is there server-side software that we are missing in 2018?

#97

Post by Fins »

mamcx wrote: post #69
gfodor wrote: post #32

I don't think anyone has solved the issues raised in Out of the Tar Pit in the data storage space. We still spend a ton of effort, perhaps more than ever before, wrangling incidental complexity. In 2018, I should be able to define a simple relational schema in 30 seconds and start using it with effectively zero constraints around data access patterns, transaction volume, and data scale, and with no design decisions n…

> I should be able to define a simple relational schema in 30 seconds and start using it with effectively zero constraints around data access patterns, transaction volume, and data scale, and with no design decisions needing to be made around these bits of incidental complexity Oh, this also is something that need a better way! RDBMS are too coupled. I remember to ask if I can ditch the SQL parsing of sqlite and call…

Wasn't that what Btrieve was doing back in the 90s? Or was it PervasiveSQL on top of Btrieve engine you could access directly?..

Re: Ask HN: Is there server-side software that we are missing in 2018?

#98

Post by sjellis »

takinola wrote: post #72

I should be able to copy and paste a server configuration and create an identical copy of my server. Right now, the only solutions I see are generating images (too big and cumbersome) or writing scripts (too complex). I would like to be able to type in a single command and replicate all the packages, services and configuration present in a particular server to a new target system.

I think there's a general problem that the incentives are for building big tools, so small problems like this are handled by everybody writing their own ad-hoc scripts.

Re: Ask HN: Is there server-side software that we are missing in 2018?

#99

Post by imhoguy »

swaggyBoatswain wrote: post #38

I would say anything in the video / 3D / imaging service platforms always have a lot of things left to be desired for. Anything that potentially touches FFMPEG basically I can name a few examples that I still think need improvements - Online gif editors - Video editing / clipping - Background image editing / online photoshop equivalents - Better alternatives than lucidpress / adobeIndesign for catalog page / brochure…

I would add on-the-fly video transcoding. FFMPEG would need some efficient context state serialization to bring resumability/seekability and at the same time to stay low on resources.

Re: Ask HN: Is there server-side software that we are missing in 2018?

#100

Post by imhoguy »

thesmallestcat wrote: post #12
maratd wrote: post #5

> Nowadays it seems like there's nothing missing. There's lots of things missing. There's just nothing missing in established categories. Why would there be? Start your own category, create software for it, then convince everyone that the category is important.

Great advice! I'd venture that managing large files is an unsolved problem. It's a hack in most version control systems, and uploading/downloading files from a host, even S3, is a slow, serial process. Same for checksumming. Network speeds have more than caught up, and large files are a frequent process bottleneck. Something that makes it easy to manage and consume large files could be a big deal. It probably would r…

Or maybe a file should stay where it is and processing logic itself should be deployed there. If file parts are distributed then processing could be suspended and migrated to place where next piece is stored. Something similar is done with Hadoop and HDFS.
Post reply on HN