Was curious as to how tests like these guard against Goodhart's law (If goodheart's law is applicable here at all)?
Launch HN: CSPA (YC S18) – SAT for Software Engineers
21–30 of 31 posts
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#22I want to make another comment about how these questions are much more trivial, when compared to the mathematics SAT which has a lot of problem solving. I suggest have users solve more problems using computers, and less problems about computers. I'm only making these comments because I don't want this to fail.
Some of the multiple choice questions are fact-based and just require a Google search -- this is intentional, since proper Googling skills are still needed for the job :)
Problem solving questions are better formatted as open-response essay questions, which we do have.
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#23I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…
Re: GAN, we tried including ML in the Core exam, but have actually since removed ML since it wasn't working. We may introduce this as part of an ML specific subject test.
If you want to get involved designing questions, please consider applying to the TSC for next term: https://cspa.io/tsc/apply.
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#24I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…
Six hour test on top of whatever time you spend interviewing. Because you know companies will still have you interview.
Long term, we hope to replace as much of the onsite as possible. But we do acknowledge we can never fully replace it.
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#25Earlier quoted context omitted.
Six hour test on top of whatever time you spend interviewing. Because you know companies will still have you interview.
Our initial goal is to replace the technical phone screen. We are asking companies to guarantee an interview (or skip the phone screen), if they score above a certain threshold. Long term, we hope to replace as much of the onsite as possible. But we do acknowledge we can never fully replace it.
I want to like it enough to try it out and pay you, but dont see value proposition right now.
[0] Corporate Fortune 500 types in many verticals. [1] http://derricocomputers.com/
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#26It's good but... I don't want this to turn out to be anything like the SAT in that it's a requirement for schools and they won't have it any other way. I've found when it comes to schooling, people are ready to market aggressively because the students don't have a choice (we saw this with TI calculators)... So what's your promise to prevent this from happening? Software Engineering is good right now because anyone, a…
> Software Engineering is good right now because anyone, absolutely anyone, can dive in.
Yes, I wholeheartedly agree! CSPA actually bolsters this because there are no eligibility requirements to take the test. We believe there are a ton of great engineers WITHOUT a college degree and we want to surface them.
We're making it MORE accessible, not less. There's no real barrier to taking the CSPA, except the time commitment. Just register and take it.
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#27I want to make another comment about how these questions are much more trivial, when compared to the mathematics SAT which has a lot of problem solving. I suggest have users solve more problems using computers, and less problems about computers. I'm only making these comments because I don't want this to fail.
Thanks for the feedback! We try to have a good mix of trivial, novice, intermediate, and advanced questions. Some of the multiple choice questions are fact-based and just require a Google search -- this is intentional, since proper Googling skills are still needed for the job :) Problem solving questions are better formatted as open-response essay questions, which we do have.
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#28I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…
Thanks for the valuable feedback! Re: GAN, we tried including ML in the Core exam, but have actually since removed ML since it wasn't working. We may introduce this as part of an ML specific subject test. If you want to get involved designing questions, please consider applying to the TSC for next term: https://cspa.io/tsc/apply .
Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#29Re: Launch HN: CSPA (YC S18) – SAT for Software Engineers
#30I scanned through the "General" questions in the practice test linked on the thread, paying particular attention to the "Security" questions. Not the best. There are two questions regarding denial-of-service attacks. One of them I found hard to answer (had a plausible answer and a plausible "none of the above"). The second one was clearer but still ambiguous. Weirdly, the ambiguity in both questions stemmed from the…