Anyone know if this can be used directly from CloudFormation?
AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
51–60 of 158 posts
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#52It seems there are no web-hooks / callbacks, so you don't get notified when a new file is uploaded (or someone downloads a file). Another issue is that if your have to support a partner with SFTP data transfer requirements you may have to support one with FTP/FTPS requirements as well. At this point you will have to go to a dedicated FTP server (or outsource it to another company) anyway, and AWS SFTP service will be…
It's S3, so you can use Lambda, it says so in the article.
> You can write AWS Lambda functions to to build an “intelligent” FTP site that processes incoming files as soon as they are uploaded, query the files in situ using Amazon Athena, and easily connect to your existing data ingestion process.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#53This is why AWS is so far ahead: survey the landscape, find the things they don't already cover, and come up with a managed service for it. It's usually not perfect, but it almost always just works.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#54It seems there are no web-hooks / callbacks, so you don't get notified when a new file is uploaded (or someone downloads a file). Another issue is that if your have to support a partner with SFTP data transfer requirements you may have to support one with FTP/FTPS requirements as well. At this point you will have to go to a dedicated FTP server (or outsource it to another company) anyway, and AWS SFTP service will be…
You can set a lambda to be triggered on a file upload, at work we do this for creating reports.
Lambda dumps mongo data to an s3 bucket which triggers another lambda to create a csv.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#55It seems there are no web-hooks / callbacks, so you don't get notified when a new file is uploaded (or someone downloads a file). Another issue is that if your have to support a partner with SFTP data transfer requirements you may have to support one with FTP/FTPS requirements as well. At this point you will have to go to a dedicated FTP server (or outsource it to another company) anyway, and AWS SFTP service will be…
Callbacks/webhooks are handled by Lambda, according to the article.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#56> SFTP (Secure File Transfer Protocol)
It's SSH File Transfer Protocol. When you say Secure File Transfer Protocol many people think about FTP over SSL if you don't emphasize it's about SSH.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#57We currently pay $250/month through some small vendor for hipaa compliant sftp hosting (that we transfer a whopping 50kb on a weekly basis). I always felt like it was a rip off, but azure/aws didn't have their own version. And I'm loathe to manage a VM. PaaS is my sugar bear. My eyes lit up when I saw this. We're an azure shop, but I'm not afraid to use AWS for limited cases. Then I saw - $.30/hr (so, $214/mo). Reall…
HIPAA compliance, even on AWS is extremely expensive. I believe the best vendor to get HIPAA (someone correct me if I'm wrong) is to go with Google Cloud. Last time I checked did not charge any extra for HIPAA BAA signing. Edit: I stand corrected on this, AWS no longer requires dedicated hardware for BAA HIPAA: Sorry I didn't look this up, I had old information. https://aws.amazon.com/blogs/apn/aws-hipaa-program-upda…
My work has made the aggressive stance no HIPAA data on AWS due to the legal and billing issues, not a technical one. Technically it a good solution, and we might use it down the road. We already use AWS/S3 for firmware device updates.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#58An alternative to doing file based SFTP is to just treat SFTP like an API. A company I work for implemented an SFTP service where every operation simply translates to some SQL DB lookup. And a file download kicks off a larger SQL query and generates the report on the fly, streaming the result straight through to the SFTP client. Works great! SFTP can be an API just like HTTP. Under the hood the protocol is reasonably…
I did something similar using the apache ftp client, as long as the resources are identified by a path it's very convenient and extremely easy, just implement a FileSystemFactory with apache mina and off you go.
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#59Earlier quoted context omitted.
That’s quite literally AWS’s playbook. Fill the vendor hall with tech, learn it, see what sticks and then crush it. This is why I’m bullish on cloud agnostic tech. These practices don’t typically fair well in the enterprise space. This is why companies like MSFT are interesting to me. They partner and rarely kill. Amazon is the complete opposite.
You can't even sell merchandise on Amazon without significant risk they will like your numbers enough to muscle you out: https://www.amazon.com/AmazonBasics/b?node=10112675011
Ikea as a Service!
Re: AWS Transfer for SFTP – Fully Managed SFTP Service for Amazon S3
#60An alternative to doing file based SFTP is to just treat SFTP like an API. A company I work for implemented an SFTP service where every operation simply translates to some SQL DB lookup. And a file download kicks off a larger SQL query and generates the report on the fly, streaming the result straight through to the SFTP client. Works great! SFTP can be an API just like HTTP. Under the hood the protocol is reasonably…
What if you open an SFTP handle, and then write 5 bytes halfway through a 20 GB file and close the handle? How do you translate that?