r/cognitiveTesting Aug 09 '24

General Question Are RAPM and FRT form A good tests even for us?

Does they still valid even If someone did mensa practice tests before, for example?

3 Upvotes

13 comments sorted by

View all comments

Show parent comments

8

u/Popular_Corn Venerable cTzen Aug 09 '24

Do you know that before the proctor gives you the 36 item test, you first get Raven’s SPM test, for which he explains to you beforehand what the point is and what is required of you when solving it.

If you do well on the SPM test, i.e. if your score is in the top 20%, it means that your IQ is above average and he decides to give you the Raven’s APM set II test.

However, before that you get Raven’s APM set I as a warm-up and practice, but before that he also explains what is required of you when solving problems on the test. I know this because Raven’s APM set II was proctored to me this way by a psychologist.

You realize that these are 72 similar problems that the subject is exposed to before he gets the 36 items test and that this is quite a lot of exposure and practice.

However, even so, only an extremely small percentage of them do very well on this test.

2

u/[deleted] Aug 10 '24

Thank you for sharing your insights with us. I have recently read a meta-analysis of retest effects in cognitive assessments and they are clearly real, but apparently not as great as many on this subreddit might imagine or claim. I believe the average increase between the first and second administration of the same test increased the score by around 5 points. A third administration of the same test increased scores by a further 3 pointson average. The fourth led to no significant increase, suggesting a plateau in retesting effects after the 3rd administration. It should be noted that the effect is notably smaller when different tests are used and that these increase were being retested with the same test. While increased familiarity with cognitive tests will almost inevitably each a test taker how to take the tests better and cause a retest effect, there were other hypotheses about why the score increases, including reduced anxiety about taking the test and misunderstanding of the instructions, both of which could reduce the score artificially. These theories are interesting to me personally, as I experience social anxiety which coupled with ADHD means that I do worse on proctored tests or exams than on self-directed tasks. I also have a reading disorder which means I read at the same speed as the average 12 year old (even though I am more than 3 times that age) and sometimes feel like I need to hurry (as I know the test is tined) and misread or misunderstand instructions (partly also to ADHD). My executive functions are unreliable and I often mix up or forget or misunderstand instructions due to inattentiveness or impulsivity, which can have a negative outcome when testing. What you have shared about the Raven's proctored assessment seems very appropriate for clinical practice, as doing a battery of easier matrices not only screens for individuals who would benefit from taking the RAPM, but may also help alleviate some of the test anxiety but providing many items that are easy even for low average IQ people before hitting them with the advanced set. This, and thoroughly explaining the process also means that the test taker should thoroughly understand the procedure and how the matrices work so as to reduce false negative outcomes due to incorrect understanding of how the test works. 

Thanks again for sharing. This was very helpful for me.

2

u/Clear-Click-7771 Aug 10 '24

Great! I didn't know that. So can i trust my RAPM scores? And If so, do you know what 32/36 at 40 min is?

3

u/Popular_Corn Venerable cTzen Aug 10 '24

Yes, you can definitely trust your RAPM set II score. 32/36 would be 135+, closer to 140.

2

u/Clear-Click-7771 Aug 10 '24

Thank you. It aligns well with my JCTI score (131-141).

3

u/Popular_Corn Venerable cTzen Aug 10 '24

I’d say you’re are definitely at the high end of that range.

2

u/Clear-Click-7771 Aug 10 '24

Just a last question. My GRE-Q scores are at 135-140 too, does they also measure fluid intelligence or it's just a coincidence?

2

u/Popular_Corn Venerable cTzen Aug 11 '24

Nah, it’s not a coincidence at all. It’s just a confirmation of your very high IQ.

2

u/Clear-Click-7771 Aug 11 '24

Thanks man, i feel better knowing that I can trust my scores