Live data from Hacker News

Report on the role of standardized test scores in undergraduate admissions [pdf]

home.dartmouth.edu

71–80 of 451 posts

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#71
Anecdote: a friend of mine is an admission officer for one of the US largest public university.

They told me that if your kid has a 4.0 GPA (a perfect GPA), do not take the SAT/ACT ... because, without those standardized test scores - your kid is "perfect".

But unless your kid has a perfect 4.0 GPA, taking the SAT/ACT typically helps your child get into a better school than their GPA might indicate.

YMMV

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#72
post #28

Here's the money quote: >> Importantly, these test scores better position Admissions to identify high-achieving less-advantaged applicants and high-achieving applicants who attend high schools for which Dartmouth has less information to interpret the transcripts. Precisely. SATs aren't about hurting the poor or disadvantaged. It's about giving them a chance.

IMO the thing that tests do not sample is persistance. Missing that degree of freedom misses important mind-sets to achieving goals. One of the most interesting studies, not specifically focused on "success" / GPA, but on "life-satisfaction" comes from a longitudinal study "Project Talent"[1]. The key correlation to "life-satisfaction"/happiness is how many questions a person _attempts_ to answer on an otherwise un-f…

Wouldn't someone with grit will find a way to persevere and thrive regardless of which institution accepts them?

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#73
post #28

Here's the money quote: >> Importantly, these test scores better position Admissions to identify high-achieving less-advantaged applicants and high-achieving applicants who attend high schools for which Dartmouth has less information to interpret the transcripts. Precisely. SATs aren't about hurting the poor or disadvantaged. It's about giving them a chance.

Then they should be publicly run and free to take and send to universities.

"Should". Every time I read the word "should" I cringe. Everything should be free. I should be able to go to restaurants for free and have the chefs prepare the food for me and the waiters serve me and I should do this and not have to pay money. After all food should be a right.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#74

If this was a paper submitted by one of my students, they would fail. Why would these faculty members sign their names to this drivel? If you read carefully, you see how useless SAT and ACT scores really are. Here are just a few insane things. > Figure 1 shows a linear relationship between SAT scores and cumulative first-year GPA for Dartmouth students. SAT scores are grouped into 16 equal-sized bins, and we plot mea…

Um, 22% > 1/5.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#75
post #25
post #22

Earlier quoted context omitted.

The fact that SAT scores are directly proportional to how much time, effort and money you have spent in preparation should tell you that it is very different from a general IQ test.

Do we know that general IQ tests are not also something that a person can improve on with practice?

You can improve with practice to the point where the procedures for most IQ tests forbid using a measure if the subject has taken that test in the past N months.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#76
post #28

Here's the money quote: >> Importantly, these test scores better position Admissions to identify high-achieving less-advantaged applicants and high-achieving applicants who attend high schools for which Dartmouth has less information to interpret the transcripts. Precisely. SATs aren't about hurting the poor or disadvantaged. It's about giving them a chance.

Except that metrics like how many TVs a household has are indicators of performance on SAT scores.

Obviously this is a proxy for socioeconomic status, and people higher on that ladder will have better support structures to do better in school.

This is begging the question as socioeconomic status is the primary indicator of educational attainment in our country today.

They aren't measuring potential, but the persons ability and advantages. Just as buying more TVs won't improve your students performance.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#77
post #28

Here's the money quote: >> Importantly, these test scores better position Admissions to identify high-achieving less-advantaged applicants and high-achieving applicants who attend high schools for which Dartmouth has less information to interpret the transcripts. Precisely. SATs aren't about hurting the poor or disadvantaged. It's about giving them a chance.

IMO the thing that tests do not sample is persistance. Missing that degree of freedom misses important mind-sets to achieving goals. One of the most interesting studies, not specifically focused on "success" / GPA, but on "life-satisfaction" comes from a longitudinal study "Project Talent"[1]. The key correlation to "life-satisfaction"/happiness is how many questions a person _attempts_ to answer on an otherwise un-f…

Disagree. You can retake the tests, hence they do test for persistence.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#78
post #65

Earlier quoted context omitted.

There is a lot of support for students who can’t afford to take the test. What isn’t really included is test prep. China has the gaokao, which everyone can take, but the prep factor is real even if they tried to outlaw it.

But your local library probably has test prep books. I know things have gotten more competitive since back in the day but you can probably get 90% of the way there without expensive test prep courses. (Yes, it takes time and commitment but it's mostly not the case that paying for test prep courses automatically translates into higher scores.)

I prepped on my own and did really good, but I was middle class and had a lot of other advantages. Prepping isn’t just about having access to prep material, but coaching that encourages you to actually practice the material.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#79

Earlier quoted context omitted.

If the universities were sincere about that, they would figure out how to increase enrollment. Why is every parameter of admissions open to change despite tradition, except that one?

Dartmouth in 1950 was an all mens college that enrolled less than 2,500. Women weren't allowed until the 1970s. Dartmouth today has 6,700 students of all races, genders, religions. Enrollment numbers can and do change, but it is much harder and slower to change something that is physically and resource constrained than it is to change policy.

There's long been this mythos around Dartmouth in the vein of Daniel Webster's "It's a small college but there are those of us who love it" when in fact it's a research university even if it at least clings to the idea that it's a rural, athletically-oriented New England liberal arts college.

Re: Report on the role of standardized test scores in undergraduate admissions [pdf]

#80

If this was a paper submitted by one of my students, they would fail. Why would these faculty members sign their names to this drivel? If you read carefully, you see how useless SAT and ACT scores really are. Here are just a few insane things. > Figure 1 shows a linear relationship between SAT scores and cumulative first-year GPA for Dartmouth students. SAT scores are grouped into 16 equal-sized bins, and we plot mea…

> Total nonsense. Figure 1 does not mean that SAT/ACT scores are predictive of academic achievement! Without seeing the variance you cannot make this statement. At all. The fact that there is a linear relationship means nothing statistically.

You are putting words in their mouth from that quote. They didn't use that Figure to claim the test scores are predictive of academic achievement. They specifically say it is evidence of a linear relationship. They argue in the next paragraph that they are and use regression analysis to make their case.

> So we're explaining less than 1/5th of the variance. This makes SAT scores basically worthless, this account for almost none of the real world performance of people, never mind how redundant they are with GPAs.

Compare that to high school GPA, which explains ~9%. The test optional movement implicitly puts more weight on high school grades by putting less weight on test scores.

I'm not saying their analysis is perfect, but your arguments aren't that strong...

At the end of the day, the analysis focuses on a subset of people who are going to Dartmouth. This is a highly filtered subsample of the total population. If you took a random sampling of 18 year olds, gave them the SAT, and then enrolled them at Dartmouth, then I hypothesize you would see a significantly stronger relationship between test scores and college grades than what is observed in their data.

Post reply on HN