Brian Lovin
/
Hacker News
Daily Digest email

Get the top HN stories in your inbox every day.

delichon

Last month 2,400 University of California faculty asked for admissions to resume using the SAT "to ensure foundational fluency." Of course many employers want to ensure that too, especially when college degrees don't anymore.

  The widening abilities gap followed the 2020 elimination of the SAT/ACT, a temporary measure that has now become a permanent vulnerability. This outcome was explicitly predicted by the Academic Senate’s 2020 Standardized Testing Task Force (STTF) report, which warned that removing these tests would eliminate a vital predictor of college success and obscure the impact of severe high-school grade inflation. Unfortunately, the outcomes cautioned against in that report have now materialized in the data across our campuses. All other leading STEM institutions, including the UC’s primary peers, have resumed using SAT/ACT in their admissions to ensure foundational fluency. For the University of California to remain a global leader in STEM, it is essential to restore these objective benchmarks. -- https://ucstudentsuccess.org/
https://www.insidehighered.com/news/faculty/learning-assessm...

apparent

The UC faculty opposed the SAT requirement being discarded in the first place. They were overruled by the UC Regents, and that may happen again. And even if the SAT is brought back, I'm sure it will be given much less weight and subjected to the "in a local context" process in the name of equity.

WalterBright

I took the SAT 50 some years ago. I kinda doubt I would do so well on it today without doing remedial prep work on the math.

hammock

The SAT is actually a lot easier today than it was when most of us took it.

It is an hour or more shorter in length, the long reading passages have been replaced with short paragraphs, calculators are allowed, and vocabulary has been removed.

apparent

Apologies, but which part of my comment was this a reply to?

JuniperMesos

"Equity" is still something of a euphemism - the specific reason that the UC Regents got rid of the SAT requirement is because the non-profit law firm Public Counsel, along with a consortium of other non-profits and activist organizations, sued the UC system ostensibly on behalf of several students; and the UC Regents ended up agreeing to a settlement where they would not use SAT or ACT scores for admissions until after 2025. Public Counsel brags about the details of the lawsuit on their website (https://publiccounsel.org/our-cases/smith-v-regents-of-unive...):

> For decades, the University of California’s use of discriminatory SAT and ACT scores deprived hundreds of thousands of well-qualified students of color, students from low-income families, and students with disabilities of the opportunity to pursue higher education in the nation’s preeminent public university system. Rather than provide meaningful information about a student’s ability to succeed in college, SAT and ACT scores act as stand-ins for students’ wealth and race, and thus advantage more privileged applicants. Even University leaders admit that the tests are “racist” and “correlated to wealth and privilege.”

> Public Counsel and co-counsel brought this lawsuit on behalf of students and community organizations—Chinese for Affirmative Action, College Access Plan, College Seekers, Community Coalition, Dolores Huerta Foundation, and Little Manila Rising—challenging the University of California’s use of the SAT and ACT as discriminatory on the bases of race, wealth, and disability. In August 2020, Plaintiffs obtained a preliminary injunction requiring the University to immediately stop using the tests for undergraduate admissions and scholarship determinations. Plaintiffs then defeated the University’s attempts to prevent the injunction from taking effect. In the admissions cycle following the injunction, UC saw record gains in numbers of Black and Latinx students applying to and gaining admission to its campus.

Public Counsel is pretty clear that the legal theory they were originally operating under is that requiring SAT and ACT scores for university admission is racially discriminatory, and the specific races it's discriminatory against are the groups they characterize as "students of color", which we can take to mean primarily black and Latino students because they specifically mention the detail "In the admissions cycle following the injunction, UC saw record gains in numbers of Black and Latinx students applying to and gaining admission to its campus.".

Interestingly, the lawsuit was originally brought forward in late 2019, before the start of the COVID pandemic. The temporary injunction against using the SAT/ACT was imposed in August 2020, well into the pandemic, on the grounds that the pandemic conditions made it more difficult for applicants with disabilities to take standardized tests, in a way that was plausibly legally discriminatory - but of course this couldn't have been the primary legal justification that Public Counsel used when the brought the lawsuit in 2019, unless they were prescient enough to have predicted the course of the pandemic at that time (in my memory, the number of people in the Anglosphere who were paying attention to COVID-related news in China before the turn of 2020 and thought that it might develop into a concerning pandemic was incredibly small).

The settlement that the UC Regents reached in May 2021 lasted until Spring 2025, so it's only now that it's legally possible for the UC Regents to reconsider the ban on using the SAT/ACT for admissions. Presumably, Public Counsel and the other activist groups - Chinese for Affirmative Action, College Access Plan, College Seekers, Community Coalition, Dolores Huerta Foundation, and Little Manila Rising - haven't changed their opinion that the use of the SAT/ACT is racially discriminatory towards blacks and latinos. But they don't seem to have raised another lawsuit about this, perhaps because the political environment in the US has changed since 2020 in ways that make them less optimistic about their chances of success.

apparent

> lasted until Spring 2025, so it's only now that it's legally possible for the UC Regents to reconsider the ban on using the SAT/ACT for admissions

They could have reinstated the requirement last year, and they could have undertaken their recently-determined plan to engage in study regarding reinstatement anytime before that. They just couldn't remove the requirement until 2025.

Appreciate your detailed description of the lawsuit and settlement. This is what happens when two parties are settling a lawsuit but do not actually have adverse interests. They were aligned on wanting to get rid of it and signed an agreement to do so. That said, the Regents decided to get rid of it permanently, with no plan to bring it back or create any replacement test (as they had previously said they would do).

everybodyknows

Regents are selected by Sacramento. At bottom, it's a political failure.

WalterBright

I always enjoy the advocates who claim that students have mastered their subjects, but "don't test well".

Would you want a pilot on your flight who flunked flying school exams, but somehow "really knew how to fly!"?

FatherOfCurses

It's not a claim, there is psychological data supporting the negative impact stress can have on recall and that for some students a test is not the best way to identify their retained knowledge.

Your single example identifies a situation where we would want someone resilient to stress to pass the testing process.

However if you are evaluating someone's ability to identify characters in Shakespeare who are most closely representative of the Bard himself, a proctored exam may not be the only environment where that could be demonstrated.

Anyone in software knows as well that for a test to be effective it has to be written properly. In the history of academic and standardized testing however there has been little rigor in the construction of tests, and those who pass are ones who give the "right" answers regardless of whether those answers are true proofs of knowledge.

WalterBright

I've been around tests all my life. I don't know anyone who bombed the test but mastered the material. And the ones who aced the tests - turns out that they actually had mastered the material.

As for people who cannot perform under the stress of a test, how are they going to perform otherwise? Anyhow, the solution to test anxiety is to keep taking tests - the anxiety will recede.

For example, the first time I tried public speaking I was paralyzed. But I kept trying it, and the anxiety went away, and now I do a fair amount of public speaking and enjoy it very much.

mangodrunk

That still doesn’t seem like a reasonable reason to not do tests. In the software analogy you have a unit test that passes but the actual software fails when used in the real world.

What is the point of “knowledge” that can’t be demonstrated. How will that person demonstrate their knowledge of Shakespeare?

andrecarini

My understanding is you're equating `failing a test` to `lacking the relevant skills and knowledge to do a certain task competently`.

The reality is sometimes tests in academia are just not very well made and don't really test what they are supposed to be testing, and that's usually due to multiple reasons like misaligned incentives, staffing shortages and maybe lack of resources / funding.

I don't think the comparison to flight school is relevant enough in this context because it's a too different of a world to traditional academia.

WalterBright

I don't buy the notion that tests do not test relevant skills.

In my long career I've noticed a strong correlation between SAT scores and academic performance as well as job performance.

> I don't think the comparison to flight school is relevant enough in this context because it's a too different of a world to traditional academia.

My dad kept his flight school tests for flying all sorts of airplanes. They bear a lot of similarities with the SATs. There's a lot of math in there for things like fuel consumption, wind, maximum landing weight, glide distance, and so on.

For example, one day he was cruising along in his F-86 when the engine failed. he radioed the tower, and they told him to bail out. But he calculated his speed, altitude, distance, wind, sink rate, air templeratur, etc., and figured he could make the field after configuring the airplane for maximum glide. He made a perfect landing, but still got reprimanded for risking his life bringing the airplane back. But he had worked the math and disagreed that it was more risky to bring it in than bail out.

expedition32

Whether or not tests are bad the fact is that nobody has even come close with something objective that can replace it at scale. Teachers have 30 kids in their class- they actually in reality have no idea what their students can or cannot do.

jimbokun

[flagged]

mangodrunk

I agree with you. The real world is stressful or less than ideal for many reasons and we have to apply our knowledge within that context.

In addition to that, this claim is like the dragon in my garage thought experiment. It an unfalsifiable claim that they have “knowledge” but can’t demonstrate it.

hammock

> Would you want a pilot on your flight who flunked flying school exams, but somehow "really knew how to fly!

Sure, just not in the cockpit

Maxatar

Not really comparable... the overwhelming majority of flight tests involve flying an aircraft. There is no meaningful way someone can be excellent at flying an aircraft but can't pass a test which involves flying an aircraft.

The same can't be said for many other tests. If the test involves the practical application of the very skill being tested, then that test has direct relevance to he competency of said skill.

But many other tests are not like that. A teacher can be brilliant in the classroom yet stumble on a standardized certification exam full of pedagogical jargon. A chef can cook a variety of excellent dishes but fail a written culinary theory exam testing the French names of techniques they perform by instinct. And perhaps more relevant to this audience, a coding interview that relies on whiteboarding algorithms from memory can easily fail an excellent engineer who builds great software every day but doesn't recall the optimal solution to some puzzle on the spot.

BobbyJo

The overwhelming majority of math tests involve doing math, so I'm not sure your critique is useful in this context.

jimbokun

Is there a reason you left out the SAT and ACT?

Because both have been shown to have predictive power for success in college.

fn-mote

The problem that colleges and the SWE profession in general face are identifying “bullshitters”. We need a filter and a fact based exam seems like a good place to start.

WalterBright

They are never going to let you into a cockpit until you pass ground school, which involves a lot of math.

> A teacher can be brilliant in the classroom yet stumble on a standardized certification exam full of pedagogical jargon.

A teacher that cannot explain how calculus works cannot teach it to anybody.

> a coding interview that relies on whiteboarding algorithms from memory can easily fail an excellent engineer who builds great software every day but doesn't recall the optimal solution to some puzzle on the spot.

I've seen too many coders using bubble sort because they don't know enough to look for a better algorithm.

In any case, the purpose of leet coding tests is to quickly filter out the utter frauds. I have a programmer friend who wanted a job at a major software corp. He knew he'd have to pass the leetcode in an early stage of the interviewing. He figured it would take 6 weeks or so to study that material. I suggested that, since he was applying for a $250K job, that would be the most productive studying he'd ever done. He agreed, did the 6 weeks of studying, aced the leetcode test, and got the $250K.

So ya, there is a point to those tests, in filtering out the frauds and the ones who aren't willing to do what it takes to get those jobs.

sir0010010

No, but it'd probably be okay if the pilot flunked their SATs.

Morromist

I did very well with my SAT

but to get to the city we had to take it was a 2 hour long drive through twisted roads that made me carsick. I lived in a small town far away from the city. By the time I got there my breakfast I had quickly eaten gave me a stomach ache, I had woken up far earlier than usual and not gotten my 7 hours too. I certainly would have done a lot better if I had lived in the big city.

Another factor: if you wanted to pay the fee you could just take the test over and over again until you got a great score. So kids with poor parents obviously had a huge disadvantage. Also kids who had the time and money could study for it with prep books - I did, while some of my friends were flipping burgers while still in highschool. Its not surprising I got a higher score than them, but it said nothing about my intellegence or understanding compaired to theirs.

apparent

There are fee waivers for poor kids, and free test prep thanks to Khan Academy. These may not have existed decades ago, but they exist now.

chasd00

I would be much more ok with someone who failed the test but knew how to pilot a plane vs someone who aced the test but can’t figure out how to get the engine started.

WalterBright

One who cannot start the engine cannot kill me.

One who cannot calculate how much fuel he needs to cross the lake will kill me.

Remember JFKjr? He killed himself, his fiance and her friend because he did not pay attention to the instruments.

An acquaintance of mine died trying to fly through a thunderstorm. Another one didn't pay attention to the weather and nearly died from wing icing.

Flying is no joke.

brightball

It’s frustrating when easily predicted outcomes are ignored for the sake of feel good policy.

expedition32

The ironic thing is that feel good policy can be more racist and prejudiced than any test.

They experimented replacing tests in my country with giving teachers the final say- it was a fucking disaster. Human beings are quite terrible at objectivity.

eikenberry

Why is a lossy testing filter better than just failing out those who can't make it? Maybe allow for larger freshmen classes and smaller latter classes or adopt community colleges and have all students start there and advance into the UC system sophomore year on. Instead they bring back what is basically an IQ test for admission.

bigthymer

From the students' perspective, it is better to not be allowed in than fail out midway through. One test is cheaper than years in college.

falcor84

I personally strongly disagree. I think it's much better to be given the opportunity to do the actual work, rather than to be required to do the pre-assessment song and dance. And if there are actual prerequisites that a person hasn't previously passed, they should be allowed to be tested on these specifically.

BobbyJo

If you completely ignore costs, and the negative affects of having 50+% of a class be unprepared and taking time from the other students, sure, that would work great. Seems like a bad alternative to standardized tests considering students will then have to pass tests once in college...

stephenbez

High graduation rates are an important metric to administrators. If a professor gave a failing grade to 1/3 of the class they would be in hot water.

stockresearcher

My wife has a civil engineering degree. There were a number of courses where partial credit was not permitted and the final exam was 2 questions. It was common for students to take those courses 3 or 4 times before passing. Giving a failing grade to only 1/3 of the class might get a professor investigated for making the class too easy.

andrecarini

Failing 1/3 of a class if that cohort is genuinely deemed not qualified enough to pass shouldn't be a problem by itself.

But then it raises questions like "are they really unqualified or is the testing methodology inadequate?" and "why was the system unable to provide the necessary growth to such a high slice of the class?". And then the easy way out is to just cherry-pick which students enter the system at all.

collabs

> High graduation rates are an important metric to administrators. If a professor gave a failing grade to 1/3 of the class they would be in hot water.

I remember practically every single instructor/professor on the first day of class during my freshman year of my undergraduate study said something along the lines of "I have no curves. Your grades depend on you and nobody else. If the whole class does well, everyone can get an A. If nobody does well, everybody can fail."

So I guess this was more motivational to get us to study rather than stating facts?

falcor84

I remember a first lecture when I started my CS studies, where the professor said something like "look at the people to your left and to your right, it's likely that at least one of you will drop out by the end of this year; it's ok, this is not for everyone; if you truly believe this is for you, put in the effort and you'll make it"

subtextminer

1/3 isn't that bad in the late 80s/early 90s at the UT Austin CS department. Only ~30% graduated at the time. The orientation was literally "look to your left and looked to your right only one of you will graduate." They weren't joking!

WalterBright

Caltech did not grade on a curve. I recall one class were half the class failed.

lo_zamoyski

That depends. Some schools actually cap the number of students permitted to continue. They fail a certain fixed number or percentage of students below a threshold, even if the raw score is good.

jimbokun

Because it’s a complete waste of time and money for both those students and the instructors.

paytonjjones

Apply the same question to jobs and it's easy to see: why is a lossy [interview] filter better than just [firing] those who can't make it?

This has enormous costs to the institution, the teachers/mentors, and of course to the person failing out.

And that's not even factoring in the social and psychological costs.

eikenberry

Disagree. Hiring and firing is better than a bad interview process. The reason we don't have that is due to regulations and litigiousness (and the laws that facilitate it).

IMO failing to get the opportunity is worse than getting the opportunity and failing at it.

jdkee

Griggs v. Duke, 401 U.S. 424 (1971).

lern_too_spel

SAT score is known to be predictive of college grades. Is it also predictive for whether a mid-to-late career candidate will pass a phone screen? It is used for early career candidate filtering in finance, but I have not heard of anybody caring beyond that because of the availability of signal on the actual tasks they will be performing.

consensus1

It is correlated tightly with IQ, so yes it will likely be a strong predictive signal for passing a phone screen.

cute_boi

Maybe Maths, but english is probably not correlated tightly with IQ as it is more affected by language background and education.

labcomputer

> Is it also predictive for whether a mid-to-late career candidate will pass a phone screen?

I’m sure having access to your own SAT scores (or even remembering what they were) is highly predictive of not being someone who it would be illegal to fire because they are too old… which is probably the point… and why I’d expect most HR departments to shy away from this requirement.

cute_boi

> Is it also predictive for whether a mid-to-late career candidate will pass a phone screen?

The answer is probably no. I got many friend they got good marks in SAT, but they were average.

jimbokun

Would you include the ability to differentiate between anecdotes and peer reviewed studies in your assessment of intelligence?

doctorpangloss

how many elected leaders are in STEM? would high SAT scores and grades exclude many US presidents and congressmen? (yes) winning elections seems kind of important to me. so if you were just like, selecting for leadership - and many of our leaders are brilliant people, just not in the sense of being good at taking tests - would that be good or bad? or... what is your real opinion? what are you actually mad about?

obviously the UC system should give spots to the kids who will use those spots the best. but it is very hard to define what "using spots the best" means.

WalterBright

> not in the sense of being good at taking tests

The trick to doing well on the SATs is to pay attention in class.

zerr

The trick is to prepare specifically for SATs.

One would say the tests (and job interviews) should have been designed with the original intent of testing candidates AS IS, i.e. preparing specifically for such tests should have been considered as cheating... But at some point it turned into prep gymnastics, and measuring how desperate the candidates are.

Maxatar

That's not how it plays out in practice. There is overwhelming evidence that students who otherwise excel academically score fairly mediocre SAT scores on their first attempt and then jump substantially after weeks of targeted practice and/or tutoring, even though they didn't learn anything new in the classroom.

If attention in class were all it took then that improvement couldn't happen. What changed was familiarity with the test, not classroom focus.

lern_too_spel

We certainly don't want them to fail out, which is what is happening. Berkeley reported 10% failure rate in the intro CS course and 35% in the pre-intro course. https://www.dailycal.org/news/campus/academics/failing-grade...

jimbokun

In the US or China?

ogou

I have seen company descriptions in job ads that list college achievements of founders. They are invariably young Asian men. I understand that it's a cultural signifier and don't judge them. But, I also understand that I will never hear back from them because I don't share that background. So, I never apply to any job listing that references college experience of either side, other than wanting a degree in general.

thisislife2

Someone once told me that American work culture used to be based more on intern-ship / apprentice type hiring but now obsess with formal degrees. I wonder how much of this shift in culture is influenced by the Korean, Chinese and Indian immigrants, as a formal education is a prerequisite to compete in these countries' job market? For example, it is quite common in India for employers to ask for our 10th and 12th standard marks / grade (because these are national exams) along with college grades - to apparently gauge "Consistency". Fluctuating performance, a break or dropout years all negatively impact you and can be nerve wracking for many freshers, until they manage to get some work experience. It is somewhat disappointing to see this culture permeate to America too, even though I feel quite conflicted about it - after all, everyone does want to hire the best / most competent / reliable candidate; but the other approach - a vocational kind of training - also has its merits and seems to have served American companies well too. (Zoho in India is experimenting with this kind of hiring in India where they are hiring high-school students, mainly from rural areas, and offering them a work cum study program. They don't get any formal diploma or degree though - https://www.zohoschools.com/ ).

rayiner

> I wonder how much of this shift in culture is influenced by the Korean, Chinese and Indian immigrants

I think there’s an influence, but it’s amplifying a pre-existing trend. Bureaucratic societies favor formal credentials. The U.S. has become much more bureaucratic since the mid-20th century, and credentialism has grown. Reliance on degrees and other formal credentials also enables the universities to achieve political goals through admissions and grading policies. Asian immigrants in the U.S. have readily adapted to that system.

doctorpangloss

how many uncredentialed people's families go to private school with what you pay them?

it's one thing to hire some people for some roles with this sort of, diamond in the rough mentality. obviously that can be a good idea. but in my experience, if you try to take leadership in that way, you are spending most of your time persuading other people that it's a good idea, which they will reject, and consequently, it's of little influence.

then you look at people who become bosses who lack credentials (or whatever), and you find out it's only because they drop out of their competitive colleges to be fabulously successful. the true weirdos out there - whatever held them back from "credentials" doesn't stop them from becoming fabulously wealthy, but rarely do they go and hire anyone else. like they do not create enterprises, teams or even families. do you get it?

onetimeusename

I have suspected the influence is real. For a reference point, the majority of students at top tier US universities are Asian at this point, broadly. Not every top tier university but there's a trend to have about 30-40% Asian American students and then roughly 1/3 international which is heavily weighted toward China and India. This constitutes the largest group usually. So it's quite likely that universities adapt to this and hiring practices begin to reflect an intense interest in exam taking and credentials.

The thing about it is I view it similarly to how in the past "well-roundedness" and "leadership" was part of hiring and admissions. We laugh at that now but my understanding is the SAT score can be improved with long term studying. So intensive SAT studying seems like a new thing that isn't evenly practiced among people in the US. So at worst SAT score usage seems like a way for an elite group to preserve and replicate itself. I have no SAT score so I feel somewhat outside of this debate and have no experience with it.

Pay08

Have university faculty become mostly Asian too?

firstplacelast

I don't think other cultures are driving much of the trend for educational check marks. I remember my dad and uncle talking about the awkwardness of being asked where they did their MBA's by colleagues/clients in the late 90s/early 00's and them trying to figure out how to navigate that as they didn't even have bachelors degrees. And I doubt whoever replaced them when they retired had less than an MBA.

Between increased regulation and greater competition for jobs, the degree requirements keep going up in a lot of/most industries. I also think there is a tendency for those that have reached a level of educational attainment to push back on others without equal numbers of checkmarks. Once a role is populated by MBA, PhD, MS or even BS, individuals don't like to see others doing the same work with less credentials. Maybe it's a 'I had to do this, so you do too' mentality or a sense that it devalues their own credentials.

georgeecollins

I think it is a positive for an employer to ask for an SAT because it tells me right away I don't want to work for them. Once (a long time ago) I tried to upload my resume to apply for a job. The web page started asking me very basic questions, like a basic aptitude test. I was out. Tell me you do not know how to find and evaluate talent!

apparent

I think this is highly age-dependent. I took the SAT well over a decade ago and have significant work experience since then. It would be odd to require me to put down my SAT scores, which I don't even precisely remember.

But if I were < 5 years out of college, and especially if I had gone to school during COVID times (when SATs were not required by many colleges), I would completely understand why an employer might ask.

Basically, colleges used to act as a filter for SAT and other attributes. During the 2020-2025 period, they admitted students under fairly different standards, due in part to testing challenges and social movements.

It makes sense for an employer to want to do a little more diligence to ensure that students who were admitted during this period are similar to students admitted during the prior several decades.

JackFr

It was required at my first job in 1989, for entry level actuaries.

In fairness, part of job performance was passing the actuarial exams, the first two of which were calculus and statistics. I imagine testing well on the SATs for a math or EE degree (what they hired) was a good indicator of passing tests.

aprdm

You basically described Canonical's hiring process !

AnotherGoodName

No only sat scores but specifically they ask for the percentile band of your high school maths and hard sciences scores.

Not even kidding. I’ve been in a staff level+ role at 3 of the 5 faang. Applied to canonical because their products are interesting. I’m ~30 years past high school and i get hit with ‘what are your high school maths scores’. I answered the online form honestly and got a rejection email immediately on send. Phew!

Not at all kidding on that and there’s screenshots of the literally insane questions they ask online.

LewisVerstappen

The filter works both ways so it makes sense. Those employers do not want to hire people like you either.

pmontra

> similar-to-me bias (I like you because you're me!).

My first boss in the 90s eventually told me why he hired me.

"I assume that everybody at their first job with a CS degree have more or less the same level of technical competence [which is not much IMHO] so I ask which are the last books they have read. You told me a few, I usually get none, so I hired you because I hoped that talking with you would be interesting."

At least a similar-to-me bias builds a pleasing work environment because of homogeneity.

TomasBM

Isn't that bias just legitimized by having culture fitness criteria in hiring?

buildsjets

You cannot use the SAT as a metric to compare different cohorts. SAT scoring has been revised many times over the years. When I took it the highest possible score was 1600. From 2004 through 2016 the highest score was 2400. Now it is back to 1600 again. Plus, both the content and the format of the exam has changed many times over the years. At times, there was no essay requirement, at times the essay was required, and at times it was optional. Hence, each year the examination produces a different distribution/histogram of scores even if you normalize the 1600 vs 2400 difference.

jedberg

The scores have changed, but ideally they are asking for the percentiles. Those are scaled to the current year.

hardtke

Even the scaled score is not that informative (and perhaps crosses the line on age discrimination) because for older workers the population of people taking the SAT was much smaller as a percentage of high school grads (and presumably weighted towards higher IQs). It's also why there were so many fewer perfect SAT scores -- smaller population in the bell curve.

sarchertech

Number of perfect scores is also affected by the increase in the number of students who spend 20 hours each a week or more doing SAT prep.

____tom____

I somehow doubt that the people that would ask for SAT scores would actually be the sort to think about how those numbers should most effectively be used.

tzs

Paid test prep is generally considered to be more effective on the current SAT than it was several years ago which also makes it harder to compare across years.

buildsjets

Don’t make stuff up to defend this practice. The original poster only said the employer asked for the score, not the percentile.

DenverR

You can look at historical percentile by year and score though.

giantrobot

Which requires them to explicitly ask your age outside the bounds of qualification for a job (over 18 etc). Which ends up opening them to age discrimination lawsuits.

apparent

It does not require them to ask about your age, just the year in which you took the SAT. As other commenters have pointed out, this can range from 12 to 17.

Also, they could just ask for your SAT score and any relevant info (if you took it during COVID from your car, etc.) and then you could disclose whatever context you wanted.

rayiner

Yeah they’re much easier now.

solid_fuel

Got a source for that, bud?

varun_ch

When I took the digital SAT a couple years ago, we had access to the Desmos Graphing Calculator during the whole math section.

The entire point of the exam was to test whether you can read a math question, input it into the calculator and select the option that matches the result within 60 seconds. If you get a couple questions wrong, you drop hundreds of points. I don’t think it was a valuable test whatsoever (and of course, it biases to students who can afford time/money for thousands of practice questions to improve this “skill” through repetition)

The English reading/writing section was much more interesting, but again, the time limitations make it a skimming test more than anything else.

Many universities allow you to ‘superscore’ multiple attempts, to combine a math and RW score from different SATs. So again, scores bias towards students who can afford to take one test dedicated to math, and another dedicated to English.

hammock

Everything you’re saying makes me so mad

jimbokun

Sure but if you also give the year they can work out the percentile for your cohort.

Although that probably also outs your company at risk for age discrimination.

insane_dreamer

> When I took it the highest possible score was 1600. From 2004 through 2016 the highest score was 2400. Now it is back to 1600 again.

that's because the 2400 score included an 800 point writing component; the math and reading components remained scored at 800 points (and still do now)

Izkata

Even during that time the writing component was optional. I took it twice, once with and once without.

zx8080

But numbers are so easy to compare! Don't take this joy from HRs and recruiters!

/s

jawns

As a manager, there are several qualities that I value highly in an engineer, and they all happen to begin with the letter C: Competent, Consistent, Curious, Caring, and Clear Communicators.

While SAT scores might act as a proxy for competency and possibly curiosity, they're not going to tell you much about whether the person is consistently reliable, whether they care about others and cooperate well, or whether their vocabulary or literary analysis skills have any correlation with their ability to read the room and tailor their communication to their audience.

If I were giving these job posters the benefit of the doubt, I would guess they're including this requirement for the same reason that musicians request particular colors of M&Ms in their riders. They want to weed out people (or bots) who aren't paying attention. Nevertheless, there are better ways to do that than demanding (and presumably filtering by) teenage performance metrics.

analog31

C = Competitiveness.

I met an HR manager who had worked for a local but well known company with a reputation for caring about things like GPA and SAT scores. She told me that remembering your SAT scores after college was a sign of a competitive attitude.

jimbokun

In the same sense that the high school quarterback continues to talk about the Big Game now that he’s an overweight retail employee making minimum wage years later.

WalterBright

I've seen what happens in engineering with those with low SAT math scores. They need others to do the math for them, or they just wing it.

I remember one who was trying to reduce the noise in an electronic amplifier. He spent days trying random things. Another engineer asked what he was doing, did a quick calculation, and put in an RC circuit that solved the problem.

denotational

Off-topic, but can an RC circuit really reduce noise? I can see how it would reduce distortion (which is not the same as noise), but adding passives is surely going to increase thermal noise?

dingdongditchme

You are correct, but an RC circuit is part of the amplifier circuit and you can do a lot to improve the signal to noise ratio (SNR) depending on frequencies/signals are trying to amplify versus the ones you want to filter out.

boring_twenties

The problem here seems to be that the person was unwilling or unable to ask for help when they needed it, not that they don't know math per se.

I don't know how to do that either, but "winging it" is not something that would occur to me. First I'd Google it and try to figure it out. If it turns out to be nontrivial, I would just ask for help.

And I wouldn't feel the least bit bad about it. After all, those same highly educated folks need my help with e.g. git a lot more often than most software needs serious math :)

WalterBright

The problem was the "engineer" did not know how to design an RC circuit, one of the simplest electronic circuits, in Electronics 101.

Would you rather pay an engineer days to fail to solve a basic problem, or pay a real engineer 15 minutes to solve it?

sinuhe69

You forgot that the SAT requirement is not exclusive but an additional data point. While I agree that it could narrow the path for truly good employees, I’d argue that an additional data point like SAT (+ GPA) could tell the employer a lot about consistency of the applicants. Or at least an interesting talking point (“I see you got a very high SAT score but your GPA was lower, what happened?”), if they care.

I think it could serve the purposes of hiring fresh/young graduates. However, it’s still weird if they requested it for people already 5-10 years or more in the industry.

aidenn0

I had a friend with an MS show up for first-day of work for a job that asked for SAT scores on the application. HR said "we never got documentation for your SAT scores, can you provide that?" He was on the phone with his mother, having her go through a filing cabinet when he realized that he didn't want to work for a company that was this serious about SAT scores when hiring someone with a post-graduate degree.

apparent

That does seem wild. Out of curiosity, did he also have to submit GRE scores, which would be closer in time and more representative of his current knowledge/skills?

jleyank

Worker w/PhD was asked by Quebec during residency interview to produce High School grades. Bureaucrats will be bureaucrats independent of language I guess.

aidenn0

I'll ask him. This was about 20 years ago.

amazingamazing

F7F7F7

The job description touts investment from some members of the "PayPal Mafia." For some odd reason that fact that and the SAT requirement combine to make this whole thing feel kind of normal.

energy123

No way! These guys stole my money a while back. But it was too small (less than $100) to pursue through criminal/civil.

dataviz1000

> Low ego: There can be significant economic upside to this role as things progress, but the nature of this role day-to-day may involve things that can be less exciting / more mundane (it's a job, after all!)

What does this mean?

skirmish

Have to make sure all coworker's coffee cups are full.

Dilettante_

"I'm the boss, you do what I tell you when I tell you. I say jump out the window, you ask which one."

OptionOfT

> Please note that we will also rely significantly on both solicited references (where you introduce us) as well as unsolicited or "back-end" references (where we do our own). For the latter, please rest assured that we will never contact a current employer without first getting your permission.

References already give me goosebumps. Having them reach out to people who haven't given you permission to be a reference sounds like a recipe for disaster.

jedberg

Every job does that, whether they tell you or not.

lazyasciiart

No they don't. Source: have hired people without doing that.

phyzome

Sorry, no. That might be a thing you've personally experienced, but it's far from universal.

mc32

If they do sensitive work for the government, it'd make sense that they'd do those back-end references. Also if they are in high end finance where you want to weed out people who have demonstrated moral flexibility was well as total lack of it for certain things.

bayarearefugee

> If they do sensitive work for the government, it'd make sense that they'd do those back-end references.

If they do government work that requires clearances, the clearance process already covers this sort of investigation on its own.

In any case, they are free to do whatever background checks they want within legal limits, but I'd never apply to a company with such ridiculous hiring processes.

parpfish

i hate references.

all a good reference means to a potential employer is "you are on good terms with somebody from a previous job".

and as a job seeker, it's awkward reaching out to people you may not have talked to in a couple years to announce that you're job hunting.

dingdongditchme

in my experience it (announcing to people in your network that you are job hunting) is precisely what you should be doing. Some might even point you to the next opportunity. I understand your concern though and have personally only shared it with close contacts (guess it is an ego thing).

dominotw

airbnb asked me why i didnt go iit in india and interviever soured after that. it was a chinese guy.

thisislife2

Seriously? This made me lol.

undefined

[deleted]

cm2012

I would never ask for them since its so cringe. But SAT scores correlate to IQ at .81, and IQ is one of the few things that strongly correlates to knowledge work performance positively. There is probably a lot of alpha from knowing candidates SAT scores. Its more useful than knowing the college they went to.

ludicrousdispla

Is it really that hard to assess someone's intelligence after talking with them for half an hour?

That would be an interesting experiment, post-interview ask each interviewer to guesstimate the candidate's SAT score.

Balgair

That's r = 0.81 right? so R2 would then be ~.66. Meaning that 66% of the variation in IQ scores can be statistically explained by variation in SAT scores.

It's really high for psych stuff. If you even get r=0.5, you've got a great result there.

But it is important to note, I feel, that SAT maps to only about 2/3 parts of the IQ score, and IQ score is also a quite fuzzy measure here for things like knowledge work job performance.

I do agree though, you get quite a bang for your buck just reporting these numbers.

But, if you explicitly tie money and compensation to the SAT score, man, that is setting up some very perverse incentives around it. If it adopts widely to do so, then you're gonna get some really strange interaction effects there.

KevinMS

Nothing is worse than a smart bad programmer. There's no limit to the technical debt they can pile up.

TMWNN

>I would never ask for them since its so cringe. But SAT scores correlate to IQ at .81

The combination of these two phrases is the equivalent to "I hate Trump, but ..." in another context.

undefined

[deleted]

tg180

[flagged]

doctorpangloss

> and IQ is one of the few things that strongly correlates to knowledge work performance positively

i think you mean that it correlates to pay. nobody knows what you mean by "knowledge work performance." reviews of your peers also correlated with pay. often it is not the smartest person who is the most popular. so... do you see how you said something kind of meaningless?

margalabargala

> nobody knows what you mean by "knowledge work performance"

I actually was pretty easily able to deduce what they meant by "knowledge work performance".

It's understandable to be frustrated by not knowing something, but to claim "I don't understand that and therefore no one does and you're being nonsensical" is a bad look.

Consider responding with curiosity rather than defensiveness.

cm2012

Nope, I meant what I said.

A very good metastudy is "The Validity and Utility of Selection Methods in Personnel Psychology" (by Frank L. Schmidt and John E. Hunter). It summarizes 100 years of research on predicting job and training performance. It makes a very strong case that General Mental Ability (GMA, their word for IQ) is the single most valid predictor of employee success on the job, not just income.

tptacek

That's not what that paper says. Work sample tests are more valid than GMAs; the paper just presumes they're too expensive. Meanwhile, we don't have to axiomatically derive any of this: we know that relying on general cognitive assessments to prospective software developers wouldn't work. That's why almost no firms use them.

If you exclude work sample testing from your analysis, all this paper is really saying is that active examination of candidates beats subjective interviews and resume scans. Well, obviously.

obviouslynotme

They are obviously using the SAT as a safer alternative to the legally dubious practice of IQ testing which can lead to running afoul of the ADA and EEOC. I'm not sure it's much safer, but I am positive it's less safe than doing timed leetcode. At least leetcode problems can be painted as relating to the job.

Additionally, the SAT is a shitty IQ test that is constantly crammed for and cheated on. I remember my SAT test. I was the only person in the room not openly cheating. The teacher proctor didn't care. Higher scores mean better students, more funds, higher home prices, bonuses, and a litany of secondary effects. That's not even including people that pay professional test-takers to do it for them.

The software industry needs to let go of their obsession with finding 10X ROCKSTAR L33T programmers. They never will though. It has gotten worse every few years for decades, and the problems are almost entirely managerial.

tptacek

IQ testing isn't legally dubious. The idea that it is is an Internet myth. There are a couple household-name corporations that administer general cognitive tests for candidates for some roles.

More companies don't do it because it doesn't work well.

slashdave

> Higher scores mean better students, more funds, higher home prices, bonuses, and a litany of secondary effects.

Sounds like an IQ test

LtWorf

Canonical is doing IQ testing (with very crappy tests, see my other comment). Not sure if that is because SAT doesn't exist everywhere.

tjwebbnorfolk

I hate to be the one to tell you this, but every job interview is a derivative IQ test. That includes leetcode.

OptionOfT

This by default includes a whole bunch of people who didn't take any kind of standardized tests (most notably, immigrants).

The (albeit small) country I'm from doesn't do any. Reasoning was that standardized tests create an environment where teaching is merely done to create good test scores, not to actually teach.

gmadsen

The SAT doesn’t test course material. It is literally just applying middle school math and English proficiency.

apparent

It's not just middle school math. It covers geometry and algebra 2, which very few students complete in middle school.

aidenn0

Starting in 2016 College Board said that they were aligning the test with Common Core, so this might not be true any more.

tptacek

It's weird that people think AI breaks the concept of work sample testing. Work sample testing isn't "about" programming, and predates the profession of programming. You can (and some companies do) work-sample test sales account managers, customer support, accountants, whatever.

AI changes the underlying job you're testing for. So, obviously, the tests you might have been using pre-AI won't work anymore; they're testing something that isn't really the job anymore. Update your tests so they're about the real work again, that's all. For coding, that probably means assuming (or requiring) candidates use AI to do your assessment.

What AI really does mess with is conversational/interactive interviewing. We do all our interactive scripted interview on Slack, but I can imagine us having to end that practice and return to face-to-face.

klausa

I've seen you comment along those lines before, and I think you're both right, and terribly wrong.

By all measures, the way you describe any hiring processes you've designed and had input on designing the metric and the work sample, probably is both high in signal, and not very arbitrary in scoring. They sound genuinely and refreshingly good. Maybe one day I'll interact with one :)

But man, that is very much not how work sample tests work in _a lot_ of places out there.

Places with actual, formalized rubrics for what constitutes a "pass" or a "good" score are very rare, it's almost always just based on vibes of whatever person is reading your code. If there _are_ formalized rubrics, then they have "suggested allowed time" that is incongruous with what the requirements for a "pass" actually are.

All of that is downstream, fundamentally, from the design of the tests not being taken very seriously by the people doing that. And because they're not actually thinking about it very deeply (or they're not allowed to because of time constraints or whatever); "sit down and redesign this task from first principles thinking about what AI enables now" is just not something that happens, and you just get people increasing the scopes of the project blindly.

tptacek

I agree that there aren't many places that are serious about work-sample testing and far too many that using them as a hiring hazing ritual, but that doesn't make me "terribly wrong", just more distinctively right. We've hired resume-blind at Fly.io for 6 years using work samples with fixed rubrics.

klausa

Sure, it was a rhetorical flourish that maybe didn't land :)

tb99

Sneaky age filter? You must be young enough to remember your SAT scores.

boredatoms

Sneaky immigration filter? Most wont have an SAT score at all

827a

[flagged]

hamdingers

Between 2005 and 2015 the maximum score was 2400 instead of 1600. Assuming anyone who got <1600 during that period wouldn't admit it, you now have three well defined buckets.

But of course this is a lot of unnecessary steps compared to the usual method: length of work and education history +18 years.

tayo42

The extra 800 points didn't count for a few years, I didn't practice for it and as expected did bad. Don't remeber the score except I did well enough on math

nostrademons

I remember mine (both from when I was 12 and when I was 17) close to 30 years later.

jedberg

Hah, you did the one at 12 also? I too remember both, and it was also 30 years ago. I don't know why, probably because they were really important numbers to teenagers, and they say you remember things that happened to you as a teen more than any other part of your life.

reaperducer

Sneaky age filter? You must be young enough to remember your SAT scores.

I can remember mine just fine.

If you're really looking for smart people, use "Answer this word problem in two or more paragraphs. Write your answer on the sheet of paper provided. In cursive."

consensus1

The signal being that the smart people will refuse to jump through this hoop in your inane process because they have a lot of other opportunities to choose from.

margalabargala

Are people who were forced to learn cursive smarter? They're just older.

Doing this may well expose you to age discrimination lawsuits, since it's just sneaky indirect age filtering.

Another example would be if you required a minimum SAT score of 1601. Sure, someone could have gone off and taken the SAT as an adult or a young child but in reality it is mainly an age filter.

apparent

> Are people who were forced to learn cursive smarter? They're just older.

My kids are learning cursive in elementary school right now, FWIW.

reaperducer

Are people who were forced to learn cursive smarter?

By definition, people who know more things are smarter than people who know fewer things. That's just how it works.

For centuries, people have striven to improve themselves through the acquisition of knowledge and skills. It is a quirk of recent generations that so many members take pride in their lack of knowledge.

I'm repeatedly bewildered by my Millennial colleagues who proudly say "I don't know what that means," or boast "I don't know what that is" with no sense of shame.

khuey

Having to write the "I did not cheat" pledge in cursive was the most difficult part of the SAT for me.

crooked-v

"In cursive" is just filtering for people old enough to have been taught cursive.

spullara

sadly my kids were just recently taught cursive in elementary school for some unknown reason

undefined

[deleted]

seibelj

It’s an approximation for an IQ test

Daily Digest email

Get the top HN stories in your inbox every day.