By playing Guess the Replication, you are granting us the permission to collect data from you. We will do so in a way that does not permit us to identify players. Participation in the study is voluntary. You must be at least 18 years old to participate. You can revoke your consent to participate in this study at any time and without giving reasons without any disadvantages to you.
Data is stored online via Supabase and will be published on Zenodo or OSF under a CC-BY license for at least ten years. Collected data includes the personal code that you generate, nickname, responses, response times, and demographics. You can request deletion of your data by sending an email with your code to the contact person, which will result in it not being included in the leaderboard and the published dataset. Feel free to reach out to us if you have any questions about the content of the project.
Will be displayed on the GutheR-leaderboard. Please don't change the nickname unless you let another person play on your device. This will help researchers use the data to study predictions of replicability.
Please generate your anonymous and personal code. This will greatly help us connect your predictions if you play multiple times:
1. The first two letters of your city of birth (e.g. 'Am' for 'Amsterdam')
2. The last two letters of your father's first name (e.g. 'in' for 'Martin')
3. The last two digits of your birth year (e.g. '93' for '1993')
4. The day of the month you were born (e.g. '02' for the 2nd of June)
About You
Please answer these questions before playing for the first time.
How to Play
In this game, we present you the title and abstract of a study that has been replicated. That means, after the study you are reading about has been published, a group of researchers has tested the same claim again. Your task is to guess the outcome of the replication based on only the information you have.
💡 For every five correct predictions, you get a bonus live and your level increases. Start as a junior reviewer and see how far you can make it.
🖱️/⌨️ You can use the mouse to click on the buttons, or press 1 (Success), 2 (Failure), and the Spacebar to continue.
About the Game
Research is about truth and truth should be findable by everyone. One way to do this is to test again what others have claimed, that is, to replicate. In social science research, replications are often neglected, which is why we created this game: Our aim is for you to learn about replications in a fun and educational way.
The game uses an excerpt from the FORRT Library of Reproduction and Replication Attempts - the world's largest study-based database of replications. Note that about one third of replications in the full database show mixed results, but these are excluded from this game for simplicity. Also, a single study may appear multiple times if it has been replicated by multiple independent groups. Finally, just because a replication failed, it does not automatically mean that the original study cannot be trusted. And just because it succeeded, it does not mean that the original study was definitely right. Things are complicated, welcome to the world of research!
Data Sharing
Gameplay data (guesses, reaction times) will be shared openly for research purposes, attached only to the nickname you provide. We use this game to learn more about how people predict replication outcomes.
Credits
This game was developed by Lukas and Jessica Röseler with the help of Gemini 3.1 pro preview. The authorship order was determined by who got a higher score in the game.
Contact:
Questions, feedback, criticism? Write us an email at lukas.roeseler [at] uni-muenster.de.
Data Quality Check
Please let us know whether you looked up any of the studies before making a prediction or whether you just randomly pressed buttons without paying much attention.
Note that this will not affect your potential position on the leaderboard and you will still get a certificate. However, we will remove this round of yours from the data analysis that is part of a research report.
Quote from the replication authors:
LEVEL UP!
+1 LIFE AWARDED! ❤️
Maximum Rank Achieved!
GUESS THE REPLICATION
CERTIFICATE OF ACHIEVEMENT
predicted out of replication outcomes correctly and achieved the rank: