somewhat late to the commenting party but apparently WinSCP can communicate with S3:
AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
151–158 of 158 posts
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#152So, I spent a couple days a few months ago building exactly this on an ec-2 instance. I have an SFTP service running on an Ubuntu box, it has jailed homes for users, it's ssh-key-only, uses s3fs to persist things to the correct buckets, etc.
My only problem with the managed service (which I'd LOVE to switch to tbh) is I can't for the life of me get it to actually connect and upload a file. I suspect I'm doing something wrong in IAM, but the tutorials suck and it looks like IAM isn't even ready for this service yet. I can get a user authenticated, but it's like it's trying to figure out where "home" is and crapping out, connection closed. Nothing helpful in the verbose output, either. Bummer.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#153So, I spent a couple days a few months ago building exactly this on an ec-2 instance. I have an SFTP service running on an Ubuntu box, it has jailed homes for users, it's ssh-key-only, uses s3fs to persist things to the correct buckets, etc. My only problem with the managed service (which I'd LOVE to switch to tbh) is I can't for the life of me get it to actually connect and upload a file. I suspect I'm doing somethi…
And to emphasize, the process of simply adding a user to this thing SUCKS. In my homebrew instance, it's just a matter of generating the key pair and dropping the public key into a folder on S3. Cron job reads the bucket, creates new users/homes/etc for anything new, all pasted together using bash scripts basically. But at the end of the day it's ridiculously simple. I'd hoped a fully managed solution would actually be simpler (instead of simply more stable because it's managed, after all).
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#154Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#155Earlier quoted context omitted.
The only downside is whitelisting but not on the SFTP server-side. Many enterprises restrict egress SFTP (usually for security reasons) so you need to provide IPs and they can’t frequently change because it can take enterprise network admins quite some time to deal with all of the bureaucracy and change control. That said, I wouldn’t be surprised if modern networking gear can handle CNAMEs but there’s no guarantee th…
It's less whether the gear is modern and more about the layer that it operates at. A network firewall doesn't see the DNS name that an internal system looked up in order to make an outbound connection. It just sees the source/destination IP/port. Processing a rule based on source/destination IP or CIDR and port is very fast, and all happens locally. Trying to make that device handle rules by IP address is pretty tric…
Yeah I assumed something like Palo Alto’s or maybe ASA’s could do more since (I believe) they’re doing actual inspection but I’m only familiar with them in passing.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#156Earlier quoted context omitted.
New services rarely launch with CF support, if you want to programmatically create SFTP servers TODAY you could write a Lambda that uses the SDK and reference that Lambda with a CF Custom Resource.
> New services rarely launch with CF support Yeah I'm slowly learning that. Thanks for the tip, at least it's a step in the right direction.
FWIW I talked with one of the CF devs at re:invent and he said their team's goal is to have day-one CF coverage of new major offerings going forward, so we'll see. Maybe next year.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#157There are a handful of services out there that do this, I know because I've needed it on multiple occasions. It's nice that Amazon is providing it in house now, but it just reminds of me the last time I went to re:invent and walked through the vendor area and thought about how many of these companies are four dev cycles away from Amazon producing a baked in competitor. Hard to make a B To B Amazon tool these days.
My company, Thorn Technologies, has a direct competitor on the AWS Marketplace called SFTP Gateway. We haven't seen any negative impact on sales just yet, probably because our product is much cheaper, and we think better. But only time will tell!
Yeah, this is so typical of AWS to do this, and I know we're not alone.