Difference between revisions of "Just Enough Practice"
Jump to navigation
Jump to search
Pinventado (talk | contribs) (Fix link to ASSISTments analysis) |
Pinventado (talk | contribs) (Update pattern format according to feedback from PLoP 2015 shepherding) |
||
| Line 11: | Line 11: | ||
}} | }} | ||
If | If academic risk takers become frustrated when they are asked to repeatedly answer problems that test skills they have already mastered, then change the problem type and/or topic after students master it. | ||
==Context== | ==Context== | ||
Students are asked to practice a particular skill through exercises in an online learning system. Teachers design the problems for the exercise in the online learning system. They also provide corresponding answers and feedback for each problem, and design their presentation sequence. Problems may vary in type (e.g., multiple choice, true or false), topic (e.g., addition, subtraction), and difficulty. | |||
==Problem== | ==Problem== | ||
Academic risk takers become frustrated when they are asked to repeatedly answer problems that test skills they have already mastered. | |||
==Forces== | |||
#'''Practice.''' Students need practice to learn a skill<ref>Clark, R. C., and Mayer, R. E. (2011). [http://www.wiley.com/WileyCDA/WileyTitle/productCd-0470874309.html E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning]. John Wiley & Sons.</ref><ref>Sloboda, J. A., Davidson, J. W., Howe, M. J., and Moore, D. G. (1996). [http://onlinelibrary.wiley.com/resolve/doi?DOI=10.1111/j.2044-8295.1996.tb02591.x The role of practice in the development of performing musicians]. British journal of psychology, 87(2), 287-310.Sweller, J., & Cooper, G. A. 1985. The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction, 2(1), 59--89.</ref><ref>Tuffiash, M., Roring, R. W., and Ericsson, K. A. (2007). [http://psycnet.apa.org/psycinfo/2007-14487-002 Expert performance in SCRABBLE: implications for the study of the structure and acquisition of complex skills]. Journal of Experimental Psychology: Applied, 13(3), 124.</ref>. It leads to greater improvements in performance during early sessions, but additional practice sessions lead to smaller improvement gains over time<ref>Rohrer, D. and Taylor, K. (2006). [http://eric.ed.gov/?id=ED505642 The effects of over-learning and distributed practice on the retention of mathematics knowledge]. Applied Cognitive Psychology, 20, 1209--1224.</ref>. | |||
#'''Expertise reversal.''' Presenting students information they already know can impose extraneous cognitive load and interfere with additional learning<ref>Sweller, J. (2004). [http://link.springer.com/article/10.1023%2FB%3ATRUC.0000021808.72598.4d Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture]. Instructional science, 32(1-2), 9-31.</ref>. | |||
#'''Risk taking.''' Academic risk takers are students who prefer challenging tasks because they want to maximize learning and feedback<ref>Clifford, M. M. (1988). [http://onlinelibrary.wiley.com/resolve/doi?DOI=10.1111/j.2044-8279.1988.tb00875.x Failure tolerance and academic risk‐taking in ten‐to twelve‐year‐old students]. British Journal of Educational Psychology, 58(1), 15-27.</ref><ref>Clifford, M. M. (1991). [http://www.tandfonline.com/doi/abs/10.1080/00461520.1991.9653135#.VZwH65NVhBc Risk taking: Theoretical, empirical, and educational considerations]. Educational Psychologist, 26(3-4), 263-297.</ref><ref>Meyer, D. K., and Turner, J. C. (2002). [http://www.tandfonline.com/doi/abs/10.1207/S15326985EP3702_5#.VZwIHZNVhBc Discovering emotion in classroom motivation research]. Educational psychologist, 37(2), 107-114.</ref>. They are often intrinsically motivated, explore concepts they do not understand, and can cope with negative emotions resulting from failure<ref>Boekaerts, M. (1993). [http://www.tandfonline.com/doi/abs/10.1207/s15326985ep2802_4#.VZwIZJNVhBc Being concerned with well-being and with learning]. Educational Psychologist, 28(2), 149-167.</ref>. | |||
#'''Limited resources.''' Student attention and patience is a limited resource possibly affected by pending deadlines, upcoming tests, achievement in previous learning experiences, motivation, personal interest, quality of instruction, and others<ref>Arnold, A., Scheines, R., Beck, J. E., and Jerome, B. (2005). [https://oli.cmu.edu/wp-oli/wp-content/uploads/2012/05/Arnold_2005_Time_and_Attention.pdf Time and attention: Students, sessions, and tasks]. In Proceedings of the AAAI 2005 Workshop Educational Data Mining (pp. 62-66).</ref><ref>Bloom, B. S. (1974). [http://psycnet.apa.org/journals/amp/29/9/682/ Time and learning]. American psychologist, 29(9), 682.</ref>. | |||
==Solution== | ==Solution== | ||
Therefore, change the problem type and/or topic after students master it | Therefore, change the problem type and/or topic after students master it. | ||
Student mastery can be assessed in different ways such as, counting the number of times a student correctly answered a problem type and/or topic, or using individualized statistical models for predicting student knowledge<ref>Yudelson, M. V., Koedinger, K. R., and Gordon, G. J. (2013). [http://link.springer.com/chapter/10.1007/978-3-642-39112-5_18 Individualized bayesian knowledge tracing models]. In Artificial Intelligence in Education (pp. 171-180). Springer Berlin Heidelberg.</ref>. | |||
==Consequences== | ==Consequences== | ||
===Benefits=== | ===Benefits=== | ||
# Students get enough practice to learn the skill, but not too much to over-practice it. | #Students get enough practice to learn the skill, but not too much to over-practice it. | ||
# Students | #Students do not spend unnecessary time practicing skills they already mastered. | ||
# Students | #Students practice on problems that challenge them. | ||
# | #Students with better learning experiences are more inclined to continue learning. | ||
===Liabilities=== | ===Liabilities=== | ||
# If skill mastery is incorrectly predicted, the system can still cause over-practice on a skill or worse, prevent students from practicing a skill enough before it is mastered. | #If skill mastery is incorrectly predicted, the system can still cause over-practice on a skill or worse, prevent students from practicing a skill enough before it is mastered. | ||
==Evidence== | ==Evidence== | ||
===Literature=== | ===Literature=== | ||
Cen, Koedinger and Junker (2007 | Cen, Koedinger and Junker (2007<ref>Cen, H., Koedinger, K. R., and Junker, B. 2007. [http://dl.acm.org/citation.cfm?id=1563681 Is Over Practice Necessary?-Improving Learning Efficiency with the Cognitive Tutor through Educational Data Mining]. Frontiers in Artificial Intelligence and Applications, 158, 511.</ref>) used data mining approaches to show that students had similar learning gains when they over-practiced a skill and stopped practicing a skill after mastery. However, it took less time when students stopped practicing after mastery. Instead of over-practicing, they suggested that students switch to learning other skills. | ||
===Discussion=== | |||
In a meeting with Ryan Baker and his team at Teacher's College in Columbia University, Neil Heffernan and his team at Worcester Polytechnic Institute, and Peter Scupelli and his team at the School of Design in Carnegie Mellon University (i.e., ASSISTments stakeholders), the team agreed that too much repetition can be problematic and controlling the number of times a problem type is presented to students can address the problem. | |||
David West, the pattern's shepherd at PLoP 2015, also considered the pattern definition acceptable. | |||
===Data=== | ===Data=== | ||
According to ASSISTments math online learning system data, frustration correlated with students repeatedly answering problems they have mastered. | |||
<!--===Applied evaluation=== | |||
Results from randomized controlled trials (RCTs) or similar tests that measures the pattern's effectiveness in an actual application. For example, compare student learning gains in an online learning system with and without applying the pattern. --> | |||
==Related patterns== | ==Related patterns== | ||
The pattern can be used in conjunction with [http://csis.pace.edu/~bergin/PedPat1.3.html#spiral Spiral] to help students master a subset of the larger topic through practice, before moving on to the next subtopic. | |||
==Example== | |||
A teacher designs homework with different types of math problems (e.g., decimal addition, subtraction, multiplication, and division). He/she can use the online learning system’s control mechanism to switch between problem types whenever a student shows mastery on a particular type. The number of times a student answered each problem type correctly can be used to identify mastery. For example, if the student correctly answers 3 decimal-addition problems, then the student will be asked to advance to decimal-subtraction problems. Otherwise, the student will continue answering decimal-addition problems. | |||
==References== | ==References== | ||
<references/> | <references/> | ||
[[Category:Design_patterns]] | <includeonly>[[Category:Design_patterns]]</includeonly> <!-- List of other categories the design pattern belongs to. The syntax for linking to a category is: [[Category:<Name of category]] --> | ||
Revision as of 12:50, 7 July 2015
| Just Enough Practice | |
 | |
| Contributors | |
|---|---|
| Last modification | July 7, 2015 |
| Source | {{{source}}} |
| Pattern formats | OPR Alexandrian |
| Usability | |
| Learning domain | General |
| Stakeholders | Students Teachers |
| Production | |
| Data analysis | Student affect and interaction behavior in ASSISTments |
| Confidence | |
| Evaluation | PLoP 2015 writing workshop Talk:ASSISTments |
| Application | ASSISTments |
| Applied evaluation | ASSISTments |
If academic risk takers become frustrated when they are asked to repeatedly answer problems that test skills they have already mastered, then change the problem type and/or topic after students master it.
Context
Students are asked to practice a particular skill through exercises in an online learning system. Teachers design the problems for the exercise in the online learning system. They also provide corresponding answers and feedback for each problem, and design their presentation sequence. Problems may vary in type (e.g., multiple choice, true or false), topic (e.g., addition, subtraction), and difficulty.
Problem
Academic risk takers become frustrated when they are asked to repeatedly answer problems that test skills they have already mastered.
Forces
- Practice. Students need practice to learn a skill[1][2][3]. It leads to greater improvements in performance during early sessions, but additional practice sessions lead to smaller improvement gains over time[4].
- Expertise reversal. Presenting students information they already know can impose extraneous cognitive load and interfere with additional learning[5].
- Risk taking. Academic risk takers are students who prefer challenging tasks because they want to maximize learning and feedback[6][7][8]. They are often intrinsically motivated, explore concepts they do not understand, and can cope with negative emotions resulting from failure[9].
- Limited resources. Student attention and patience is a limited resource possibly affected by pending deadlines, upcoming tests, achievement in previous learning experiences, motivation, personal interest, quality of instruction, and others[10][11].
Solution
Therefore, change the problem type and/or topic after students master it.
Student mastery can be assessed in different ways such as, counting the number of times a student correctly answered a problem type and/or topic, or using individualized statistical models for predicting student knowledge[12].
Consequences
Benefits
- Students get enough practice to learn the skill, but not too much to over-practice it.
- Students do not spend unnecessary time practicing skills they already mastered.
- Students practice on problems that challenge them.
- Students with better learning experiences are more inclined to continue learning.
Liabilities
- If skill mastery is incorrectly predicted, the system can still cause over-practice on a skill or worse, prevent students from practicing a skill enough before it is mastered.
Evidence
Literature
Cen, Koedinger and Junker (2007[13]) used data mining approaches to show that students had similar learning gains when they over-practiced a skill and stopped practicing a skill after mastery. However, it took less time when students stopped practicing after mastery. Instead of over-practicing, they suggested that students switch to learning other skills.
Discussion
In a meeting with Ryan Baker and his team at Teacher's College in Columbia University, Neil Heffernan and his team at Worcester Polytechnic Institute, and Peter Scupelli and his team at the School of Design in Carnegie Mellon University (i.e., ASSISTments stakeholders), the team agreed that too much repetition can be problematic and controlling the number of times a problem type is presented to students can address the problem.
David West, the pattern's shepherd at PLoP 2015, also considered the pattern definition acceptable.
Data
According to ASSISTments math online learning system data, frustration correlated with students repeatedly answering problems they have mastered.
Related patterns
The pattern can be used in conjunction with Spiral to help students master a subset of the larger topic through practice, before moving on to the next subtopic.
Example
A teacher designs homework with different types of math problems (e.g., decimal addition, subtraction, multiplication, and division). He/she can use the online learning system’s control mechanism to switch between problem types whenever a student shows mastery on a particular type. The number of times a student answered each problem type correctly can be used to identify mastery. For example, if the student correctly answers 3 decimal-addition problems, then the student will be asked to advance to decimal-subtraction problems. Otherwise, the student will continue answering decimal-addition problems.
References
- ↑ Clark, R. C., and Mayer, R. E. (2011). E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. John Wiley & Sons.
- ↑ Sloboda, J. A., Davidson, J. W., Howe, M. J., and Moore, D. G. (1996). The role of practice in the development of performing musicians. British journal of psychology, 87(2), 287-310.Sweller, J., & Cooper, G. A. 1985. The use of worked examples as a substitute for problem solving in learning algebra. Cognition and Instruction, 2(1), 59--89.
- ↑ Tuffiash, M., Roring, R. W., and Ericsson, K. A. (2007). Expert performance in SCRABBLE: implications for the study of the structure and acquisition of complex skills. Journal of Experimental Psychology: Applied, 13(3), 124.
- ↑ Rohrer, D. and Taylor, K. (2006). The effects of over-learning and distributed practice on the retention of mathematics knowledge. Applied Cognitive Psychology, 20, 1209--1224.
- ↑ Sweller, J. (2004). Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture. Instructional science, 32(1-2), 9-31.
- ↑ Clifford, M. M. (1988). Failure tolerance and academic risk‐taking in ten‐to twelve‐year‐old students. British Journal of Educational Psychology, 58(1), 15-27.
- ↑ Clifford, M. M. (1991). Risk taking: Theoretical, empirical, and educational considerations. Educational Psychologist, 26(3-4), 263-297.
- ↑ Meyer, D. K., and Turner, J. C. (2002). Discovering emotion in classroom motivation research. Educational psychologist, 37(2), 107-114.
- ↑ Boekaerts, M. (1993). Being concerned with well-being and with learning. Educational Psychologist, 28(2), 149-167.
- ↑ Arnold, A., Scheines, R., Beck, J. E., and Jerome, B. (2005). Time and attention: Students, sessions, and tasks. In Proceedings of the AAAI 2005 Workshop Educational Data Mining (pp. 62-66).
- ↑ Bloom, B. S. (1974). Time and learning. American psychologist, 29(9), 682.
- ↑ Yudelson, M. V., Koedinger, K. R., and Gordon, G. J. (2013). Individualized bayesian knowledge tracing models. In Artificial Intelligence in Education (pp. 171-180). Springer Berlin Heidelberg.
- ↑ Cen, H., Koedinger, K. R., and Junker, B. 2007. Is Over Practice Necessary?-Improving Learning Efficiency with the Cognitive Tutor through Educational Data Mining. Frontiers in Artificial Intelligence and Applications, 158, 511.