We report the results of a meta-study of 118 Cognitive Reflection Test studies comprising of 44,558 participants across 21 countries. There is a negative correlation between being female and the overall, and individual, correct answers to CRT questions. Taking the test at the end of an experiment negatively impacts performance. Monetary incentives do not impact performance. Overall students perform better compared to non-student samples. Exposure to CRT over the years may impact outcomes, however, the effect is driven by online studies. We obtain mixed evidence on whether the sequence of questions matters. Finally, we find that computerized tests marginally improve results.
Brañas-Garza, P., Kujal, P., & Lenkeim, B. (2015). Cognitive reflection test: Whom, how, when. ESI Working Paper 15-25. Retrieved from http://digitalcommons.chapman.edu/esi_working_papers/174
Working Paper 15-25