Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

aws.amazon.com

Post reply on HN
Print view View original

61–70 of 158 posts

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#61

Post by ddorian43 »

hemancuso wrote: post #60
dagss wrote: post #37

An alternative to doing file based SFTP is to just treat SFTP like an API. A company I work for implemented an SFTP service where every operation simply translates to some SQL DB lookup. And a file download kicks off a larger SQL query and generates the report on the fly, streaming the result straight through to the SFTP client. Works great! SFTP can be an API just like HTTP. Under the hood the protocol is reasonably…

What if you open an SFTP handle, and then write 5 bytes halfway through a 20 GB file and close the handle? How do you translate that?

hint: he doesn't.

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#64

Post by floatboth »

qwerty456127 wrote: post #56

> SFTP (Secure File Transfer Protocol) It's SSH File Transfer Protocol. When you say Secure File Transfer Protocol many people think about FTP over SSL if you don't emphasize it's about SSH.

> many people think about FTP over SSL if you don't emphasize it's about SSH

Huh? Sure there's always potential for confusion but every time I heard anything about FTP over SSL (which no one seems to actually use) it's been called "FTPS"

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#65

Post by degenerate »

clubm8 wrote: post #43
benologist wrote: post #39

Earlier quoted context omitted.

You can't even sell merchandise on Amazon without significant risk they will like your numbers enough to muscle you out: https://www.amazon.com/AmazonBasics/b?node=10112675011

I've found anything more complex than an adapter or cable to be of inferior quality with Amazon Basics, and rarely buy those options anymore.

The mini condenser microphones are actually REALLY good and on par with Yeti and other $100+ mics.

https://smile.amazon.com/AmazonBasics-Desktop-Mini-Condenser...

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#66

Post by rob »

qwerty456127 wrote: post #56

> SFTP (Secure File Transfer Protocol) It's SSH File Transfer Protocol. When you say Secure File Transfer Protocol many people think about FTP over SSL if you don't emphasize it's about SSH.

https://en.wikipedia.org/wiki/SSH_File_Transfer_Protocol

In computing, the SSH File Transfer Protocol (also Secure File Transfer Protocol, or SFTP) is a network protocol that provides file access, file transfer, and file management over any reliable data stream.

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#67

Post by bmilleare »

A tonne of our (enterprise-ey) customers had such trouble trying to integrate into our S3 flow that we started launching VPS for each that abstracted it away into simple SFTP upload/download, which they were used to.

Although this is much more expensive than Lightsail, the man hours saved will make it worthwhile.

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#68

Post by rob »

dagss wrote: post #32
atonse wrote: post #27

Ah this would've been so useful 18 months ago. I had to spend MONTHS to convince a vendor (government) to use S3 to upload (keybase-encrypted) files instead of SFTP. And they finally budged. This would've been so much easier.

One can also implement SFTP on top of anyting just like HTTP apis if you make your own backend, e.g. https://github.com/pkg/sftp

It's 2018 though, that's unnecessary. Amazon should of had this standard years ago. Glad it's here!

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#69

Post by markstos »

matchagaucho wrote: post #38

We use a number of AWS LightSail servers for SFTP today, which mostly sit idle. Will definitely adopt this!

The AWS pricing page for this service says it costs about $225/month for a lightly used instance. I implemented the same kind of thing on AWS using a nano-sized instance for about $10/month. The instance is managed with an Ansible Role for automated SFTP server management. I connected it with an off-the-shelf AWS Lamda function which listens for S3 PUT events and copies files to the SFTP server as needed.

My solution took a little more human-time to setup than the AWS service might, but once setup, it saves about $200/month.

Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3

#70

Post by LinuxBender »

hemancuso wrote: post #60
dagss wrote: post #37

An alternative to doing file based SFTP is to just treat SFTP like an API. A company I work for implemented an SFTP service where every operation simply translates to some SQL DB lookup. And a file download kicks off a larger SQL query and generates the report on the fly, streaming the result straight through to the SFTP client. Works great! SFTP can be an API just like HTTP. Under the hood the protocol is reasonably…

What if you open an SFTP handle, and then write 5 bytes halfway through a 20 GB file and close the handle? How do you translate that?

You could. I mean, at least with OpenSSH you can specify a byte range. That is how lftp is able to chop up files into many streams on SFTP. I can't imagine anyone doing this with a database however, at least, not for writes.
Post reply on HN