Live data from Hacker News

Launch HN: CSPA (YC S18) – SAT for Software Engineers

news.ycombinator.com

21–30 of 31 posts

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#21

Was curious as to how tests like these guard against Goodhart's law (If goodheart's law is applicable here at all)?

Thanks for the tip! Can you elaborate? Do you mean teaching to the test, or something else? There's a whole research field for large scale assessment and evaluation methodologies.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#22

I want to make another comment about how these questions are much more trivial, when compared to the mathematics SAT which has a lot of problem solving. I suggest have users solve more problems using computers, and less problems about computers. I'm only making these comments because I don't want this to fail.

Thanks for the feedback! We try to have a good mix of trivial, novice, intermediate, and advanced questions.

Some of the multiple choice questions are fact-based and just require a Google search -- this is intentional, since proper Googling skills are still needed for the job :)

Problem solving questions are better formatted as open-response essay questions, which we do have.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#23
post #12

I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…

Thanks for the valuable feedback!

Re: GAN, we tried including ML in the Core exam, but have actually since removed ML since it wasn't working. We may introduce this as part of an ML specific subject test.

If you want to get involved designing questions, please consider applying to the TSC for next term: https://cspa.io/tsc/apply.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#24
post #12

I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…

Six hour test on top of whatever time you spend interviewing. Because you know companies will still have you interview.

Our initial goal is to replace the technical phone screen. We are asking companies to guarantee an interview (or skip the phone screen), if they score above a certain threshold.

Long term, we hope to replace as much of the onsite as possible. But we do acknowledge we can never fully replace it.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#25
post #24

Earlier quoted context omitted.

Six hour test on top of whatever time you spend interviewing. Because you know companies will still have you interview.

Our initial goal is to replace the technical phone screen. We are asking companies to guarantee an interview (or skip the phone screen), if they score above a certain threshold. Long term, we hope to replace as much of the onsite as possible. But we do acknowledge we can never fully replace it.

May seem like I'm shitting on your product, but I'm not. I do a good amount of hiring[0] and have had to use services that provide similar outcomes[1]. It's mostly a waste of time and am currently working on removing that part of the process. My main issue with your product is that I don't see how it would provide me with a better outcome than what's out there.

I want to like it enough to try it out and pay you, but dont see value proposition right now.

[0] Corporate Fortune 500 types in many verticals. [1] http://derricocomputers.com/

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#26

It's good but... I don't want this to turn out to be anything like the SAT in that it's a requirement for schools and they won't have it any other way. I've found when it comes to schooling, people are ready to market aggressively because the students don't have a choice (we saw this with TI calculators)... So what's your promise to prevent this from happening? Software Engineering is good right now because anyone, a…

We view this closer to CFA, where it's not required (I don't think we'd ever get to this point anyway), but we want a world where many employers do recognize CSPA.

> Software Engineering is good right now because anyone, absolutely anyone, can dive in.

Yes, I wholeheartedly agree! CSPA actually bolsters this because there are no eligibility requirements to take the test. We believe there are a ton of great engineers WITHOUT a college degree and we want to surface them.

We're making it MORE accessible, not less. There's no real barrier to taking the CSPA, except the time commitment. Just register and take it.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#27
post #22

I want to make another comment about how these questions are much more trivial, when compared to the mathematics SAT which has a lot of problem solving. I suggest have users solve more problems using computers, and less problems about computers. I'm only making these comments because I don't want this to fail.

Thanks for the feedback! We try to have a good mix of trivial, novice, intermediate, and advanced questions. Some of the multiple choice questions are fact-based and just require a Google search -- this is intentional, since proper Googling skills are still needed for the job :) Problem solving questions are better formatted as open-response essay questions, which we do have.

thanks for the replies

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#28
post #23
post #12

I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…

Thanks for the valuable feedback! Re: GAN, we tried including ML in the Core exam, but have actually since removed ML since it wasn't working. We may introduce this as part of an ML specific subject test. If you want to get involved designing questions, please consider applying to the TSC for next term: https://cspa.io/tsc/apply .

Serious question: why would I do that?

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#29
Sorry, but 5-6 hours is a non-starter for me. I've never taken an exam that long in my life (the SAT is about 4 hours IIRC), and I'm so glad to be out of college and done with this type of BS. At least interviews let me talk to a person and learn something about them and their company - sometimes I get a story out of it.

Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers

#30
post #12

I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…

Every version of this I have seen in the past 20 years always ends up worthless after the braindump sites pop up. How do you intend to mitigate this?
Post reply on HN