Lecturer: Nicole Janz, Department of Sociology (Email)
This workshop will introduce students to the process of reproducing published work. Replicating other scholars’ work is an essential tool for becoming familiar with methods, learning to select suitable models, and getting a chance to publish early during their academic career. This replication workshop will therefore provide students with a deeper understanding of statistical modeling and professionalism in their field. With the right amount of value added, a replication study can be submitted to a journal, as has been done by several students in the past.
About the instructor: Nicole Janz is a Research Methods Associate at the Social Sciences Research Methods Centre. She co-founded the Political Science Replication Initiative (PSRI), which aims at providing guidelines for conducting replication studies in political science, she is an ambassador at the Center for Open Science, and publishes the Political Science Replication Blog. Nicole gave lectures about approaches to replication studies at UC Berkeley and the Royal Society. She published the article "Bringing the Gold Standard Into the Class Room: Replication in University Teaching" based on this workshop.
Dates and Format
The course starts Thursday Nov 5 5-7pm and takes place Thursdays throughout January 28. Each session consists of a short lecture and a hands-on practical session in which the TAs will help you with your project. Please read the full syllabus. Location: Location: Sociology Dep't, Seminar room (first floor).
Slides, handouts and materials
We work with a shared dropbox. This year, we will upload most of the class materials on a weekly basis to our OSF project page. You can also browse our archive of replication studies and class materials on Dataverse.
- You can do summary statistics, correlation, Chi-square, t-tests and F-tests, multiple linear regression, data handling in R.
- You can commit to at least 6 hours self-directed work in most of the weeks.
- Your MPhil / PhD supervisor supports your participation in the course.
- You commit to finishing the course and uploading your result to our dataverse.
- You should install Rstudio and R on your laptop and bring it to the sessions.
You can apply to become a participant here (Deadline for applications Oct 25, 2015 -- EXTENDED TO OCT 30).
What previous students said...
- "It was one of the best methodology courses that I took here in Cambridge."
- "I think this course is absolutely incredible. It taught me so much about how to publish legitimate and correct research. I have learned so much more about modelling and R than I ever could have imagined. As cheesy as it sounds, working through the process with the support of Nicole and the TAs gave me the confidence to try to create statistical models for projects that I had only dreamt of doing before. I cannot wait to apply my knowledge from this course to other projects."
- "It's a great way to get some hands-on experience for sure."
- "I think it was excellent! The replicated workshop has a steep learning curve. But the approach was very hands on. Through that, I had to critic and really understand how the paper conducted the analysis rather than just reading to see the end results"
- "This course helped me understand not only specific stats concepts and analysis methods but also the whole procedure of interpreting research results (e.g., sample sizes, conceptual definitions, analyses methods, and limitations of using a specific method)."
Preparation for first session
Please bring a copy of the article(s) including the replication data set you would like to work on so we can discuss if it is suitable. A rough guideline:
- Pick a paper where the data set is available from the Journal’s webpage, the author’s webpage or a data verse. If you cannot locate its data and code, don’t choose it!
- To increase the probability that your paper will eventually be published, pick an article from a top journal.
- The article should have been published in 2010 or later.
- Your paper should use methods you can manage or learn.
- Janz, N. (2015) Bringing the Gold Standard Into the Class Room: Replication in University Teaching, International Studies Perspectives, Article first published online: 9 March 2015. Copy at: http://tinyurl.com/q2qnrvn
- Brandt et al. (2014) The Replication Recipe: What makes for a convincing replication? Journal of Experimental Social Psychology, Vol 50, pp. 217-224. Copy at: http://tinyurl.com/poe474k
- King, Gary. (2006). How to Write a Publishable Paper as a Class Project,copy at: http://gking.harvard.edu/papers (with updates)