Advances in Design-Based Research
Main Article Content
Abstract
Design-based research is a core methodology of the Learning Sciences. Historically rooted as a movement away from the methods of experimental psychology, it is a means to develop “humble” theory that takes into account numerous contextual effects for understanding how and why a design supported learning. DBR involves iterative refinement of both designs for learning and theory; this process is illustrated with retrospective analysis of six DBR cycles. Calls for educational research to parallel medical research has led learning scientists to strive for more specific standards about what constitutes DBR and what makes it desirable, especially regarding robustness and rigor. A recent trend in DBR involves efforts to extend the reach through scalability. These developments potentially endanger the designerly nature of DBR by orienting focus toward generalizability, meaning researchers must be vigilant in their pursuit of understanding how and why learning occurs in complex contexts
Article Details
How to Cite
Svihla, V. (2014). Advances in Design-Based Research. Frontline Learning Research, 2(4), 35–45. https://doi.org/10.14786/flr.v2i4.114
Section
Articles
FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.
References
Barab, S. A., Dodge, T., Thomas, M. K., Jackson, C., & Tuzun, H. (2007). Our Designs and the Social Agendas They Carry. The Journal of the Learning Sciences, 16(2), 263-305. doi: 10.1080/10508400701193713
Barab, S. A., & Squire, K. (2004). Design-Based Research: Putting a Stake in the Ground. Journal of the Learning Sciences, 13(1), 1-14. doi: 10.1207/s15327809jls1301_1
Bielaczyc, K. (2013). Informing design research: Learning from teachers' designs of social infrastructure. Journal of the Learning Sciences, 22(2), 258-311. doi: 10.1080/10508406.2012.691925
Borko, H., & Klingner, J. (2013). Supporting teachers in schools to improve their instructional practice. National Society for the Study of Education Yearbook, 112(2), 274-297.
Brown, A. L. (1992). Design Experiments: Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings. The Journal of the Learning Sciences, 2(2), 141-178. doi: 10.1207/s15327809jls0202_2
Cobb, P., Confrey, J., diSessa, A. A., Lehrer, R., & Schauble, L. (2003). Design Experiments in Educational Research. Educational Researcher, 32(1), 9-13. doi: 10.3102/0013189X032001009
Cobb, P., Jackson, K., Smith, T., Sorum, M., & Henrick, E. (2013). Design research with educational systems: Investigating and supporting improvements in the quality of mathematics teaching and learning at scale. National Society for the Study of Education Yearbook, 112(2).
Collins, A. (1992). Toward a Design Science of Education. In E. Scanlon & T. O’Shea (Eds.), New directions in educational technology (pp. 15-22). Berlin: Springer-Verlag.
Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design Research: Theoretical and Methodological Issues. Journal of the Learning Sciences, 13(1), 15-42. doi: 10.1207/s15327809jls1301_2
Confrey, J. (2005). The evolution of design studies as methodology. The Cambridge handbook of the learning sciences, 135-151.
Cross, N. (2001). Designerly Ways of Knowing: Design Discipline Versus Design Science. Design Issues, 17(3), 49-55. doi: 10.1162/074793601750357196
DeBarger, A. H., Choppin, J., Beauvineau, Y., & Moorthy, S. (2013). Designing for productive adaptations of curriculum interventions. National Society for the Study of Education Yearbook, 112(2).
Dede, C. (2004). If Design-Based Research is the Answer, What is the Question? A Commentary on Collins, Joseph, and Bielaczyc; diSessa and Cobb; and Fishman, Marx, Blumenthal, Krajcik, and Soloway in the JLS Special Issue on Design-Based Research. Journal of the Learning Sciences, 13(1), 105-114. doi: 10.1207/s15327809jls1301_5
diSessa, A. A., & Cobb, P. (2004). Ontological Innovation and the Role of Theory in Design Experiments. Journal of the Learning Sciences, 13(1), 77-10327. doi: 10.1207/s15327809jls1301_4
Dolle, J., Gomez, L. M., Russell, J., & Bryk, A. S. (2013). More than a network: Building professional communities for educational improvement. National Society for the Study of Education Yearbook, 112(2), 443-463.
Donovan, M. S., Snow, C., & Daro, P. (2013). The SERP approach to problem-solving research, development, and implementation. National Society for the Study of Education Yearbook, 112(2), 400-425.
Edelson, D. (2002). Design Research: What We Learn When We Engage in Design. Journal of the Learning Sciences, 11(1), 105-121. doi: 10.1207/S15327809JLS1101_4
Fishman, B., Penuel, W. R., Allen, A., Cheng, B. H., & Sabelli, N. (2013). Design-based implementation research: An emerging model for transforming the relationship of research and practice. National Society for the Study of Education Yearbook, 112(2), 136-156.
Hoadley, C. M. (2004). Methodological alignment in design-based research. Educational Psychologist, 39(4), 203-212. doi: 10.1207/s15326985ep3904_2
Kirshner, B., & Polman, J. L. (2013). Adaptation by design: A context-sensitive, dialogic approach to interventions. National Society for the Study of Education Yearbook, 112(2), 215-236.
Levin, J. R., & O'Donnell, A. M. (1999). What to do about educational research's credibility gaps? Issues in Education, 5(2), 177-229. doi: 10.1016/S1080-9724(00)00025-2
Markauskaite, L. (2010). Digital media, technologies and scholarship: Some shapes of eResearch in educational inquiry. The Australian Educational Researcher, 37(4), 79-101. doi: 10.1007/BF03216938
Markauskaite, L., & Reimann, P. (2008). Enhancing and scaling-up design-based research: The potential of e-research. Paper presented at the Proceedings of the 8th international conference on International conference for the learning sciences-Volume 2.
McKay, T., Cantarero, A., Svihla, V., Yakes Jimenez, E., & Castillo, T. (2014, June 23-27). Becoming a Professional through Virtual Practice. Paper presented at the 11th International Conference of the Learning Sciences (ICLS2014), Boulder, CO.
McLaughlin, M., & London, R. A. (2013). Taking a societal sector perspective on youth learning and development. National Society for the Study of Education Yearbook, 112(2), 192-214.
National Research Council. (2002). Scientific Research in Education. Washington, DC: The National Academies Press.
O'Neill, D. K. (2012). Designs that fly: what the history of aeronautics tells us about the future of design-based research in education. International Journal of Research & Method in Education, 35(2), 119-140. doi: 10.1080/1743727X.2012.683573
Penuel, W. R., Coburn, C. E., & Gallagher, D. J. (2013). Negotiating Problems of Practice in Research–Practice Design Partnerships. National Society for the Study of Education Yearbook, 112(2), 237-255.
Penuel, W. R., & Fishman, B. J. (2012). Large‐scale science education intervention research we can use. Journal of Research in Science Teaching. doi: 10.3102/0013189X11421826
Penuel, W. R., Fishman, B. J., Haugan Cheng, B., & Sabelli, N. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40(7), 331-337. doi: 10.3102/0013189X11421826
Phillips, R., Gawel, D. J., Svihla, V., Brown, M., Vye, N. J., & Bransford, J. D. (2009). New technology supports for authentic science inquiry, practice, and assessment in the classroom. Paper presented at the AERA, San Diego.
Reeves, T. C. (2006). Design research from a technology perspective. Educational design research, 1(3), 52-66.
Sandoval, W. A. (2004). Developing learning theory by refining conjectures embodied in educational designs. Educational Psychologist, 39(4), 213-223. doi: 10.1207/s15326985ep3904_3
Segedy, J., Kinnebrew, J., & Biswas, G. (2012). Supporting student learning using conversational agents in a teachable agent environment. In J. van Aalst, K. Thompson, M. J. Jacobson & P. Reimann (Eds.), The future of learning: Proceedings of the 10th international conference of the learning sciences (ICLS 2012) – Volume 2, short papers, symposia, and abstracts (pp. 251-255). Sydney, Australia: ISLS.
Sloane, F. C. (2008). Randomized Trials in Mathematics Education: Recalibrating the Proposed High Watermark. Educational Researcher, 37(9), 624-630. doi: 10.3102/0013189X08328879
Stevens, R. (2013, 6/12-6/14). Big data, interaction analysis, and everything in between. Paper presented at the Games, Learning, Society 9.0, Madison, WI.
Svihla, V., Gawel, D. J., Brown, M., Moore, A., Vye, N. J., & Bransford, J. D. (2010). 21st Century Assessment: Redesigning to Optimize Learning. In K. Gomez, L. Lyons & J. Radinsky (Eds.), Learning in the Disciplines: Proceedings of the 9th International Conference of the Learning Sciences (ICLS) (Vol. 2, pp. 474-475). Chicago, IL: International Society of the Learning Sciences.
Svihla, V., & Linn, M. C. (2012a). A Design-based Approach to Fostering Understanding of Global Climate Change. International Journal of Science Education, 34(5), 651-676. doi: 10.1080/09500693.2011.597453
Svihla, V., & Linn, M. C. (2012b). Distributing practice: Challenges and opportunities for inquiry learning. In J. van Aalst, K. Thompson, M. J. Jacobson & P. Reimann (Eds.), The future of learning: Proceedings of the 10th international conference of the learning sciences (ICLS 2012) – Volume 1, Full Papers (pp. 371-378). Sydney, Australia: ISLS.
Svihla, V., Phillips, R., Gawel, D. J., Vye, N. J., Brown, M., & Bransford, J. D. (2009). A tool for 21st century learning and assessment. In A. Dimitracopoulou, C. O'Malley, D. Suthers & P. Reimann (Eds.), CSCL Practices: Proceedings of the 8th international conference on Computer supported collaborative learning (CSCL 09) (Vol. 2, pp. 46-48). Rhodes, Greece: International Society of the Learning Sciences.
Svihla, V., Vye, N. J., Brown, M., Phillips, R., Gawel, D. J., & Bransford, J. D. (2009). Interactive Learning Assessments for the 21st Century Education Canada, 49(3), 44-47.
Svihla, V., Yakes, E., Castillo, T., Cantarero, A., Valdez, I., & Dominguez, N. (2013). Interactive Learning Assessment: Providing Context and Simulating Professional Practices Proceedings of Games, Learning, Society 9.
The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. doi: 10.3102/0013189X032001005
Yakes, E., Cantarero, A., McKay, T., Svihla, V., Castillo, T., Valdez, I., & Hertel, J. (2013). Interactive Learning Assessment: Simulating Professional Practices. NACTA Journal, 57(Supplement 1).
Barab, S. A., & Squire, K. (2004). Design-Based Research: Putting a Stake in the Ground. Journal of the Learning Sciences, 13(1), 1-14. doi: 10.1207/s15327809jls1301_1
Bielaczyc, K. (2013). Informing design research: Learning from teachers' designs of social infrastructure. Journal of the Learning Sciences, 22(2), 258-311. doi: 10.1080/10508406.2012.691925
Borko, H., & Klingner, J. (2013). Supporting teachers in schools to improve their instructional practice. National Society for the Study of Education Yearbook, 112(2), 274-297.
Brown, A. L. (1992). Design Experiments: Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings. The Journal of the Learning Sciences, 2(2), 141-178. doi: 10.1207/s15327809jls0202_2
Cobb, P., Confrey, J., diSessa, A. A., Lehrer, R., & Schauble, L. (2003). Design Experiments in Educational Research. Educational Researcher, 32(1), 9-13. doi: 10.3102/0013189X032001009
Cobb, P., Jackson, K., Smith, T., Sorum, M., & Henrick, E. (2013). Design research with educational systems: Investigating and supporting improvements in the quality of mathematics teaching and learning at scale. National Society for the Study of Education Yearbook, 112(2).
Collins, A. (1992). Toward a Design Science of Education. In E. Scanlon & T. O’Shea (Eds.), New directions in educational technology (pp. 15-22). Berlin: Springer-Verlag.
Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design Research: Theoretical and Methodological Issues. Journal of the Learning Sciences, 13(1), 15-42. doi: 10.1207/s15327809jls1301_2
Confrey, J. (2005). The evolution of design studies as methodology. The Cambridge handbook of the learning sciences, 135-151.
Cross, N. (2001). Designerly Ways of Knowing: Design Discipline Versus Design Science. Design Issues, 17(3), 49-55. doi: 10.1162/074793601750357196
DeBarger, A. H., Choppin, J., Beauvineau, Y., & Moorthy, S. (2013). Designing for productive adaptations of curriculum interventions. National Society for the Study of Education Yearbook, 112(2).
Dede, C. (2004). If Design-Based Research is the Answer, What is the Question? A Commentary on Collins, Joseph, and Bielaczyc; diSessa and Cobb; and Fishman, Marx, Blumenthal, Krajcik, and Soloway in the JLS Special Issue on Design-Based Research. Journal of the Learning Sciences, 13(1), 105-114. doi: 10.1207/s15327809jls1301_5
diSessa, A. A., & Cobb, P. (2004). Ontological Innovation and the Role of Theory in Design Experiments. Journal of the Learning Sciences, 13(1), 77-10327. doi: 10.1207/s15327809jls1301_4
Dolle, J., Gomez, L. M., Russell, J., & Bryk, A. S. (2013). More than a network: Building professional communities for educational improvement. National Society for the Study of Education Yearbook, 112(2), 443-463.
Donovan, M. S., Snow, C., & Daro, P. (2013). The SERP approach to problem-solving research, development, and implementation. National Society for the Study of Education Yearbook, 112(2), 400-425.
Edelson, D. (2002). Design Research: What We Learn When We Engage in Design. Journal of the Learning Sciences, 11(1), 105-121. doi: 10.1207/S15327809JLS1101_4
Fishman, B., Penuel, W. R., Allen, A., Cheng, B. H., & Sabelli, N. (2013). Design-based implementation research: An emerging model for transforming the relationship of research and practice. National Society for the Study of Education Yearbook, 112(2), 136-156.
Hoadley, C. M. (2004). Methodological alignment in design-based research. Educational Psychologist, 39(4), 203-212. doi: 10.1207/s15326985ep3904_2
Kirshner, B., & Polman, J. L. (2013). Adaptation by design: A context-sensitive, dialogic approach to interventions. National Society for the Study of Education Yearbook, 112(2), 215-236.
Levin, J. R., & O'Donnell, A. M. (1999). What to do about educational research's credibility gaps? Issues in Education, 5(2), 177-229. doi: 10.1016/S1080-9724(00)00025-2
Markauskaite, L. (2010). Digital media, technologies and scholarship: Some shapes of eResearch in educational inquiry. The Australian Educational Researcher, 37(4), 79-101. doi: 10.1007/BF03216938
Markauskaite, L., & Reimann, P. (2008). Enhancing and scaling-up design-based research: The potential of e-research. Paper presented at the Proceedings of the 8th international conference on International conference for the learning sciences-Volume 2.
McKay, T., Cantarero, A., Svihla, V., Yakes Jimenez, E., & Castillo, T. (2014, June 23-27). Becoming a Professional through Virtual Practice. Paper presented at the 11th International Conference of the Learning Sciences (ICLS2014), Boulder, CO.
McLaughlin, M., & London, R. A. (2013). Taking a societal sector perspective on youth learning and development. National Society for the Study of Education Yearbook, 112(2), 192-214.
National Research Council. (2002). Scientific Research in Education. Washington, DC: The National Academies Press.
O'Neill, D. K. (2012). Designs that fly: what the history of aeronautics tells us about the future of design-based research in education. International Journal of Research & Method in Education, 35(2), 119-140. doi: 10.1080/1743727X.2012.683573
Penuel, W. R., Coburn, C. E., & Gallagher, D. J. (2013). Negotiating Problems of Practice in Research–Practice Design Partnerships. National Society for the Study of Education Yearbook, 112(2), 237-255.
Penuel, W. R., & Fishman, B. J. (2012). Large‐scale science education intervention research we can use. Journal of Research in Science Teaching. doi: 10.3102/0013189X11421826
Penuel, W. R., Fishman, B. J., Haugan Cheng, B., & Sabelli, N. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40(7), 331-337. doi: 10.3102/0013189X11421826
Phillips, R., Gawel, D. J., Svihla, V., Brown, M., Vye, N. J., & Bransford, J. D. (2009). New technology supports for authentic science inquiry, practice, and assessment in the classroom. Paper presented at the AERA, San Diego.
Reeves, T. C. (2006). Design research from a technology perspective. Educational design research, 1(3), 52-66.
Sandoval, W. A. (2004). Developing learning theory by refining conjectures embodied in educational designs. Educational Psychologist, 39(4), 213-223. doi: 10.1207/s15326985ep3904_3
Segedy, J., Kinnebrew, J., & Biswas, G. (2012). Supporting student learning using conversational agents in a teachable agent environment. In J. van Aalst, K. Thompson, M. J. Jacobson & P. Reimann (Eds.), The future of learning: Proceedings of the 10th international conference of the learning sciences (ICLS 2012) – Volume 2, short papers, symposia, and abstracts (pp. 251-255). Sydney, Australia: ISLS.
Sloane, F. C. (2008). Randomized Trials in Mathematics Education: Recalibrating the Proposed High Watermark. Educational Researcher, 37(9), 624-630. doi: 10.3102/0013189X08328879
Stevens, R. (2013, 6/12-6/14). Big data, interaction analysis, and everything in between. Paper presented at the Games, Learning, Society 9.0, Madison, WI.
Svihla, V., Gawel, D. J., Brown, M., Moore, A., Vye, N. J., & Bransford, J. D. (2010). 21st Century Assessment: Redesigning to Optimize Learning. In K. Gomez, L. Lyons & J. Radinsky (Eds.), Learning in the Disciplines: Proceedings of the 9th International Conference of the Learning Sciences (ICLS) (Vol. 2, pp. 474-475). Chicago, IL: International Society of the Learning Sciences.
Svihla, V., & Linn, M. C. (2012a). A Design-based Approach to Fostering Understanding of Global Climate Change. International Journal of Science Education, 34(5), 651-676. doi: 10.1080/09500693.2011.597453
Svihla, V., & Linn, M. C. (2012b). Distributing practice: Challenges and opportunities for inquiry learning. In J. van Aalst, K. Thompson, M. J. Jacobson & P. Reimann (Eds.), The future of learning: Proceedings of the 10th international conference of the learning sciences (ICLS 2012) – Volume 1, Full Papers (pp. 371-378). Sydney, Australia: ISLS.
Svihla, V., Phillips, R., Gawel, D. J., Vye, N. J., Brown, M., & Bransford, J. D. (2009). A tool for 21st century learning and assessment. In A. Dimitracopoulou, C. O'Malley, D. Suthers & P. Reimann (Eds.), CSCL Practices: Proceedings of the 8th international conference on Computer supported collaborative learning (CSCL 09) (Vol. 2, pp. 46-48). Rhodes, Greece: International Society of the Learning Sciences.
Svihla, V., Vye, N. J., Brown, M., Phillips, R., Gawel, D. J., & Bransford, J. D. (2009). Interactive Learning Assessments for the 21st Century Education Canada, 49(3), 44-47.
Svihla, V., Yakes, E., Castillo, T., Cantarero, A., Valdez, I., & Dominguez, N. (2013). Interactive Learning Assessment: Providing Context and Simulating Professional Practices Proceedings of Games, Learning, Society 9.
The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. doi: 10.3102/0013189X032001005
Yakes, E., Cantarero, A., McKay, T., Svihla, V., Castillo, T., Valdez, I., & Hertel, J. (2013). Interactive Learning Assessment: Simulating Professional Practices. NACTA Journal, 57(Supplement 1).