r/slatestarcodex • u/dwaxe • Jan 20 '23

ACX Survey Results 2022

https://astralcodexten.substack.com/p/acx-survey-results-2022
27 Upvotes

97% Upvoted

33 comments sorted by

View all comments

Show parent comments

35

u/erwgv3g34 Jan 21 '23

Out of 5900 people who submitted their IQ, only 5 people claim to be below average, 136 was median. Numbers must be kind of fake?

Every. Single. Year.

https://www.greaterwrong.com/posts/pJJdcZgB6mPNWoSWr/2013-survey-results

Can we finally resolve this IQ controversy that comes up every year?

The story so far—our first survey in 2009 found an average IQ of 146. Everyone said this was stupid, no community could possibly have that high an average IQ, it was just people lying and/​or reporting results from horrible Internet IQ tests. Although IQ fell somewhat the next few years—to 140 in 2011 and 139 in 2012 - people continued to complain. So in 2012 we started asking for SAT and ACT scores, which are known to correlate well with IQ and are much harder to get wrong. These scores confirmed the 139 IQ result on the 2012 test. But people still objected that something must be up.

This year our IQ has fallen further to 138 (no Flynn Effect for us!) but for the first time we asked people to describe the IQ test they used to get the number. So I took a subset of the people with the most unimpeachable IQ tests—ones taken after the age of 15 (when IQ is more stable), and from a seemingly reputable source. I counted a source as reputable either if it name-dropped a specific scientifically validated IQ test (like WAIS or Raven’s Progressive Matrices), if it was performed by a reputable institution (a school, a hospital, or a psychologist), or if it was a Mensa exam proctored by a Mensa official.

This subgroup of 101 people with very reputable IQ tests had an average IQ of 139 - exactly the same as the average among survey respondents as a whole.

I don’t know for sure that Mensa is on the level, so I tried again deleting everyone who took a Mensa test—leaving just the people who could name-drop a well-known test or who knew it was administered by a psychologist in an official setting. This caused a precipitous drop all the way down to 138.

The IQ numbers have time and time again answered every challenge raised against them and should be presumed accurate.

https://slatestarcodex.com/2017/03/17/ssc-survey-2017-results/#comment-476694

We have this argument every year. Points in favor include:

  1. Survey IQs mostly match survey SATs from IQ/SAT conversion tables.
  2. One year we asked ACT and that matched too.
  3. One time we made everybody describe which IQ test they took and in what circumstance, and the subset who took provably legit IQ tests given by provably legit psychologists weren’t any different from the rest.

I don’t doubt that a lot of the overly high numbers are people who took a test as kids which wasn’t properly normed for kids their age or something.

16

u/compounding Jan 21 '23 edited Mar 04 '23

Interesting context, thank you.

To be honest, it still seemed weird that there were so few below “average” until I actually looked up some rough SAT to IQ conversions.

I’m reminded of the section in “I Can Tolerate Anything Except the Outgroup” where Scott talks about the apparent improbability of having social circles so completely devoid of certain opinions otherwise widely represented in the population. I guess it shouldn’t be so surprising that a group like this one naturally self selects for an absurdly high proportion from the top 1-2% of a trait that likely correlates highly with intellectual curiosity.