PC1 Scientific Methods: Hands-on Research from Conceptualizing to Data Analysis
The sessions will deliver a crash course in scientific methods with a focus on human subject research by encouraging the swift exploration of new research ideas and hands-on learning of research methods and procedures. Research questions will target the suggested topic of “Creativity and Intelligence”. Mirroring the concept of “hackatons” and “game jams”, participants will be invited to prototype pre-studies, and execute initial trial runs together with a rough analysis. This can be done along the example of existing studies and data, or the participants may choose to produce their own exploratory research. In the latter case, first outcomes will be summarized as a presentation or poster. The course discusses frequent limitations and biases of scientific methods and provides a practical exploration on the importance of pre-studies and pilot studies in early instances of novel research. The method course encourages an open-minded approach and welcomes challenges and problems in experiment designs as learning opportunities.
Background information on the concept of rapid research prototyping. A general introduction to the scientific method and human subject research with a focus on quasi-experimental quantitative small-n research (study designs, research methods, procedures, types of analysis, ethics, etc.).
Practical part: brainstorming a research question, designing a research concept.
Part II of the introduction to scientific methods and human subject research. Limitations and challenges are discussed along practical examples.
Practical part: Groups present research concepts. Peer ethics review. Study preparation and implementation. Optional: internal pilot runs.
Methods and precautions for presenting early research results. Progress presentations and feedback. Discussion of questions resulting from ongoing group work.
Practical part: Fixes / improvements to study procedures and materials. Optional: trial runs, analysis and preparation of a brief results presentation.
Group presentations with a discussion of the results and interpretation. Reflection on the process and lessons learned in the larger context of scientific methods and human subject research in different research areas.
Practical part: Optional: last improvements regarding analysis, results, and presentation. Possibly prepare a public presentation for the other attendees of IK’17.
Participants will gain a broad overview of scientific methods and human subject research, and they will gain hands-on experience. To those who are new to experimental research, the course will provide basic information about research methods and a first practical experience. To those who have prior experience, the course will challenge the established approaches and provide a rapid-prototyping experience. A broad selection of rather entertaining micro-research topics can be expected to emerge from this course.Literature
Briscoe, G., & Mulligan, C. (2014). Digital Innovation: The Hackathon Phenomenon. CreativeWorks London Working Paper. Retrieved from http://www.creativeworkslondon.org.uk/wp-content/uploads/2013/11/Digital-Innovation-The-Hackathon-Phenomenon1.pdf
Carifio, J., & Perla, R. (2008). Resolving the 50-year debate around using and misusing Likert scales. Medical Education, 42(12), 1150–1152. http://doi.org/10.1111/j.1365-2923.2008.03172.x
Cooper, H. M., & American Psychological Association. (2012). APA handbook of research methods in psychology. Washington, DC: American Psychological Association.
Elmes, D., Kantowitz, B., & III, H. R. (2011). Research Methods in Psychology. Cengage Learning.
Erceg-Hurn, D. M., & Mirosevich, V. M. (2008). Modern robust statistical methods: An easy way to maximize the accuracy and power of your research. American Psychologist, 63(7), 591–601. http://doi.org/10.1037/0003-066X.63.7.591
Komssi, M., Pichlis, D., Raatikainen, M., Kindstrom, K., & Jarvinen, J. (2015). What are Hackathons for? IEEE Software, 32(5), 60–67. http://doi.org/10.1109/MS.2014.78
Lazar, J., Feng, J. H., & Hochheiser, H. (2010). Research Methods in Human-Computer Interaction (1st ed.). Wiley.
Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: causes, consequences, and remedies. Psychological Methods, 9(2), 147–163. http://doi.org/10.1037/1082-989X.9.2.147
Seltman, H. J. (2010). Experimental design and analysis (Vol. 26). Retrieved from http://www.stat.cmu.edu/~hseltman/309/Book/Book.pdf
Wilcox, R. (2011). Modern Statistics for the Social and Behavioral Sciences: A Practical Introduction. Boca Raton: CRC Press.