Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

github.com

Post reply on HN
Print view View original

11–18 of 18 posts

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#11

Post by anitil »

jovezhong wrote: post #8
anitil wrote: post #7

It's interesting that AWS chose(?) not to support this. Can you think of any reason why they wouldn't have? Perhaps it's harder to predict use cases in C++?

I don't know exactly why AWS didn't include C++ SDK when they announced all languages are supported. Maybe it's more common today to use Java/Rust/Python to build data products, but C++ is still such a solid case. Anyway, I will try to reach out AWS team to see whether they are open to put this into the AWS SDK for C++

It's great that you're contributing back like that

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#12

Post by jit_hacker »

mdaniel wrote: post #6

Congratulations, and how shameful for AWS not to meet developers where they are

MSK IAM support has long mystified me. I think they only supported Java for the first 9 months or so. Even then they still don't have GO or PHP support. It's not a ton of work, they're reusing request signer code anyways.

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#13

Post by jovezhong »

jit_hacker wrote: post #12
mdaniel wrote: post #6

Congratulations, and how shameful for AWS not to meet developers where they are

MSK IAM support has long mystified me. I think they only supported Java for the first 9 months or so. Even then they still don't have GO or PHP support. It's not a ton of work, they're reusing request signer code anyways.

According to my teammate who actually wrote the C++ code for this, there are lack of documentations of how the AWS_MSK_IAM is supposed to work. He has to check the Java/Python implementation line by line to avoid those guesswork

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#14

Post by mdaniel »

jovezhong wrote: post #13
jit_hacker wrote: post #12

Earlier quoted context omitted.

MSK IAM support has long mystified me. I think they only supported Java for the first 9 months or so. Even then they still don't have GO or PHP support. It's not a ton of work, they're reusing request signer code anyways.

According to my teammate who actually wrote the C++ code for this, there are lack of documentations of how the AWS_MSK_IAM is supposed to work. He has to check the Java/Python implementation line by line to avoid those guesswork

Well, there's precedent for that since the $(aws eks get-token) is just a base64 pre-signed GetCallerIdentity URL but I don't think that's documented anywhere, either, but can be spotted by squinting at aws-iam-authenticator source

My suspicion is that if they didn't want to bother to write a C++ client, they for sure wouldn't have the empathy(?) to document how anyone else could, too. I said empathy but I kind of wonder if by publishing how something works they're committing to it, versus they're currently only one commit away from changing it in their clients, without having to notify anyone

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#15

Post by zliang »

tuananh wrote: post #9

surprised since aws has sdk for c++ https://github.com/aws/aws-sdk-cpp

Having a SDK and supporting IAM auth for MSK are different stories though. I mean, for supporting IAM auth for MAK for Java, AWS has a separate library instead of putting the code in their Java AWS SDK: https://github.com/aws/aws-msk-iam-auth.

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#16

Post by zliang »

jit_hacker wrote: post #12
mdaniel wrote: post #6

Congratulations, and how shameful for AWS not to meet developers where they are

MSK IAM support has long mystified me. I think they only supported Java for the first 9 months or so. Even then they still don't have GO or PHP support. It's not a ton of work, they're reusing request signer code anyways.

Exactly, once figured out how it works, the implementation is quite straightforward.

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#17

Post by coredog64 »

jovezhong wrote: post #13
jit_hacker wrote: post #12

Earlier quoted context omitted.

MSK IAM support has long mystified me. I think they only supported Java for the first 9 months or so. Even then they still don't have GO or PHP support. It's not a ton of work, they're reusing request signer code anyways.

According to my teammate who actually wrote the C++ code for this, there are lack of documentations of how the AWS_MSK_IAM is supposed to work. He has to check the Java/Python implementation line by line to avoid those guesswork

That’s how it works when writing CDK outside of TypeScript. You have to review the TS docs to get anywhere.

Re: Show HN: C++ AWS MSK IAM Auth Implementation – Goodbye Kafka Passwords

#18

Post by tuananh »

zliang wrote: post #15
tuananh wrote: post #9

surprised since aws has sdk for c++ https://github.com/aws/aws-sdk-cpp

Having a SDK and supporting IAM auth for MSK are different stories though. I mean, for supporting IAM auth for MAK for Java, AWS has a separate library instead of putting the code in their Java AWS SDK: https://github.com/aws/aws-msk-iam-auth .

yeah what i meant is that it's weird that they consider cpp is first class supported language but not having iam auth for msk - cpp.
Post reply on HN