Difference between revisions of "Worked Examples"
Jump to navigation
Jump to search
Pinventado (talk | contribs) (Add link to ASSISTments as a data source) |
Sfrancisco (talk | contribs) (Edited reference) |
||
| (19 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
{{Infobox_designpattern | {{Infobox_designpattern | ||
| | |image=Worked_examples.png | ||
|contributor=[[Paul Salvador Inventado]], [[Peter Scupelli]] | |||
| | |source= Inventado and Scupelli (in press 2015)<ref name="Inventadoip">Inventado, P.S. & Scupelli, P. (in press 2015). [https://cmu.box.com/shared/static/m6qfs01z71gt38a7tf85gcgl8t84iw50.pdf A Data-driven Methodology for Producing Online Learning System Design Patterns]. In ''Proceedings of the 22nd Conference on Pattern Languages of Programs (PLoP 2015)''. New York:ACM.</ref>; Inventado and Scupelli (2015)<ref name="Inventado2015">Inventado, P. S. & Scupelli, P. (2015). Towards an open, collaborative repository for online learning system design patterns. eLearning Papers, 42(Design Patterns for Open Online Teaching):14-27.</ref> | ||
|dataanalysis=[[Analysis:Student_affect_and_interaction_behavior_in_ASSISTments#hintusage |Student affect and interaction behavior in ASSISTments]] | |||
|domain= General | |domain= General | ||
|stakeholders= Teachers | |stakeholders= Teachers, Students | ||
|evaluation = PLoP 2015 writing workshop <br/>[[Talk:ASSISTments]] | |evaluation = [http://www.openeducationeuropa.eu/en/paper/design-patterns-open-online-teaching-and-learning eLearning Papers] review<br/>[http://www.hillside.net/plop/2015/ PLoP 2015] shepherding and writing workshop<br/> [[Talk:ASSISTments]] | ||
|application = [[ASSISTments]] | |application = [[ASSISTments]] | ||
|appliedevaluation = [[ASSISTments]] | |appliedevaluation = [[ASSISTments]] | ||
}} | }} | ||
If | If a student doesn’t have an overview of how to solve the problem and where to begin, then provide a worked example so that students can have an overview of the procedures to follow<ref name="Inventadoip"/><ref name="Inventado2015"/>. | ||
==Context== | |||
Students are answering problem-solving activities on an online learning system to get practice with a particular type of skill. Students are implementing the design pattern {{Patternlink|Try It Yourself}}. | |||
== | ==Problem== | ||
Some students may be motivated to solve a problem, but do not know where to begin, and do not want to muddle their way through hints without an overview of the problem solving process first. | |||
== | ==Forces== | ||
#'''Prior knowledge.''' Students may be unable to solve a problem if they forget key facts, concepts, and processes<ref>Hume, G., Michael, J., Rovick, A., and Evens, M. (1996). [http://www.tandfonline.com/doi/abs/10.1207/s15327809jls0501_2 Hinting as a tactic in one-on-one tutoring]. ''The Journal of the Learning Sciences, 5''(1), 23-47.</ref>. | |||
#'''Randomness.''' When students do not know how to solve a problem, they may randomly combine elements to form a solution that may not solve the problem or even confuse themselves further<ref name="Sweller2004">Sweller, J. (2004). [http://link.springer.com/article/10.1023%2FB%3ATRUC.0000021808.72598.4d Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture]. ''Instructional science, 32''(1-2), 9-31.</ref>. | |||
#'''Affective entry.''' When students are unable to achieve their learning goals, they may become frustrated, discouraged of their abilities, and dislike the subject <ref name="Bloom1974">Bloom, B. S. (1974). [http://psycnet.apa.org/journals/amp/29/9/682/ Time and learning]. ''American psychologist, 29''(9), 682.</ref>. | |||
#'''Limited resources.''' Students may eventually give up if they are unable to solve the problem<ref>D’Mello, S., and Graesser, A. (2012). [http://www.sciencedirect.com/science/article/pii/S0959475211000806 Dynamics of affective states during complex learning]. ''Learning and Instruction, 22''(2), 145-157.</ref> | |||
== | ==Solution== | ||
Therefore, provide a worked example so that students can have an overview of the procedures to follow. Worked examples show a step-by-step process of solving a problem similar to the type of problem the student is currently asked to solve. Students may request for a worked example themselves, or the system could show the worked example automatically when a given condition is satisfied (e.g., too many incorrect attempts, too many hint requests, student’s answer is very different from the expected answer). | |||
=== | ==Consequences== | ||
=== | ===Benefits=== | ||
#Worked examples help students form new knowledge, which they can use to solve the current problem and similar problems in the future. | |||
#Students can pattern their solution on the worked example instead of finding solutions on their own. | |||
#Students will be more confident in their abilities and develop interest in the subject when they successfully apply the solution. | |||
#Worked examples may help guide students to solve the problem that they were not able to solve themselves<ref name="Vygotsky1962">Vygotsky, L. S. (1962). ''Language and thought.'' Massachusetts Institute of Technology Press, Ontario, Canada.</ref> | |||
== | ===Liabilities=== | ||
# Teachers | #Teachers and content experts will also need to provide worked examples for the problems they create. | ||
# | #The worked example may give away too much information (e.g., student would have already remembered the process if only two out of five steps were presented). | ||
#The online learning system will need to identify when to provide the worked example. Showing it too soon may take away possible learning opportunities, but showing it too late may no longer be helpful. | |||
== | ==Evidence== | ||
== | ===Literature=== | ||
Expert guidance can help students achieve difficult tasks within the Zone of Proximal Development, which they are unable to do on their own<ref name="Vygotsky1962"/>. Worked examples are one way of guiding student learning. It gives a step-by-step demonstration of how to perform a task or solve a problem. It helps novice learners form basic knowledge structures, which they can use to acquire new knowledge and skills through practice<ref>Clark, R. C., and Mayer, R. E. (2011). ''[http://www.wiley.com/WileyCDA/WileyTitle/productCd-0470874309.html E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning]''. John Wiley & Sons.</ref>. | |||
== | ===Discussion=== | ||
Shepherds, writing workshop participants, and learning system stakeholders (i.e., data mining experts, learning scientists, and educators) agreed that the design pattern’s solution could address the identified problem. | |||
=== | ===Data=== | ||
# | [[Analysis:Student_affect_and_interaction_behavior_in_ASSISTments#hintusage | ASSISTments online learning system data]] showed that students rapidly requested for all available hints when they did not know how to solve the problem (i.e., based on hint request and answer correctness features). Students could have used hints as a proxy for worked examples, which showed them the entire procedure for solving the problem. | ||
<!--===Applied evaluation=== | |||
Results from randomized controlled trials (RCTs) or similar tests that measures the pattern's effectiveness in an actual application. For example, compare student learning gains in an online learning system with and without applying the pattern. --> | |||
==Example== | ==Example== | ||
Worked examples are common strategies used in online learning systems to support student learning. Both [[Cognitive_tutor_algebra | Cognitive Tutor Algebra]] and [[Cognitive_tutor_geometry | Cognitive Tutor Geometry]] provide a button that students can click to request for a worked example<ref>Aleven, V., Mclaren, B., Roll, I., and Koedinger, K. (2006). [http://content.iospress.com/articles/international-journal-of-artificial-intelligence-in-education/jai16-2-02 Toward meta-cognitive tutoring: A model of help seeking with a Cognitive Tutor]. ''International Journal of Artificial Intelligence in Education, 16''(2), 101-128.</ref><ref>Koedinger, K. R., and Aleven, V. (2007). [http://link.springer.com/article/10.1007/s10648-007-9049-0 Exploring the assistance dilemma in experiments with cognitive tutors]. ''Educational Psychology Review, 19''(3), 239-264.</ref>. The [[ASSISTments]] online learning system also supports the creation of worked examples for problem solving activities<ref>Weitz, R., Salden, R. J. C. M., Kim, R. S., and Heffernan, N. T. (2010). [http://web.cs.wpi.edu/~nth/pubs_and_grants/papers/2011/Weitz_5_12%5B1%5D.pdf Comparing worked examples and tutored problem solving: Pure vs. mixed approaches]. In ''Proceedings of the Thirty-Second Annual Meeting of the Cognitive Science Society'' (pp. 2876-2881).</ref>. It gives content creators the flexibility in controlling where to attach the worked example and when to show it (e.g., hint, scaffold, scaffold on incorrect response). | |||
The figure below illustrates an example of a geometry problem and an associated worked example. It shows a step-by-step process of solving for the angle x, but uses a different problem so as not to give away the answer. | |||
[[File:Worked_examples_ex.png | center|800px]] | |||
==Related patterns== | ==Related patterns== | ||
Worked | The {{Patternlink|Worked Examples}} design pattern can be used to support student learning when they implement the {{Patternlink|Try It Yourself}}, {{Patternlink|Different Exercise Levels}}, or {{Patternlink|Build and Maintain Confidence}} design patterns. | ||
==References== | ==References== | ||
<references/> | <references/> | ||
[[Category:Design_patterns]][[Category:ASSISTments]] | ==External Links== | ||
*[http://assistments.org ASSISTments] | |||
* [http://www.carnegielearning.com/learning-solutions/software/cognitive-tutor/ Cognitive Tutor Software] | |||
[[Category:Design_patterns]] [[Category:ASSISTments]] [[Category:Full_Pattern]] [[Category:Pattern Language for Math problems and Learning Support in Online Learning Systems]] [[Category:Online Learning System]] [[Category:Intelligent Tutoring System]] | |||
Latest revision as of 18:40, 6 June 2017
| Worked Examples | |
 | |
| Contributors | Paul Salvador Inventado, Peter Scupelli |
|---|---|
| Last modification | June 6, 2017 |
| Source | Inventado and Scupelli (in press 2015)[1]; Inventado and Scupelli (2015)[2] |
| Pattern formats | OPR Alexandrian |
| Usability | |
| Learning domain | General |
| Stakeholders | Teachers, Students |
| Production | |
| Data analysis | Student affect and interaction behavior in ASSISTments |
| Confidence | |
| Evaluation | eLearning Papers review PLoP 2015 shepherding and writing workshop Talk:ASSISTments |
| Application | ASSISTments |
| Applied evaluation | ASSISTments |
If a student doesn’t have an overview of how to solve the problem and where to begin, then provide a worked example so that students can have an overview of the procedures to follow[1][2].
Context
Students are answering problem-solving activities on an online learning system to get practice with a particular type of skill. Students are implementing the design pattern Try It Yourself.
Problem
Some students may be motivated to solve a problem, but do not know where to begin, and do not want to muddle their way through hints without an overview of the problem solving process first.
Forces
- Prior knowledge. Students may be unable to solve a problem if they forget key facts, concepts, and processes[3].
- Randomness. When students do not know how to solve a problem, they may randomly combine elements to form a solution that may not solve the problem or even confuse themselves further[4].
- Affective entry. When students are unable to achieve their learning goals, they may become frustrated, discouraged of their abilities, and dislike the subject [5].
- Limited resources. Students may eventually give up if they are unable to solve the problem[6]
Solution
Therefore, provide a worked example so that students can have an overview of the procedures to follow. Worked examples show a step-by-step process of solving a problem similar to the type of problem the student is currently asked to solve. Students may request for a worked example themselves, or the system could show the worked example automatically when a given condition is satisfied (e.g., too many incorrect attempts, too many hint requests, student’s answer is very different from the expected answer).
Consequences
Benefits
- Worked examples help students form new knowledge, which they can use to solve the current problem and similar problems in the future.
- Students can pattern their solution on the worked example instead of finding solutions on their own.
- Students will be more confident in their abilities and develop interest in the subject when they successfully apply the solution.
- Worked examples may help guide students to solve the problem that they were not able to solve themselves[7]
Liabilities
- Teachers and content experts will also need to provide worked examples for the problems they create.
- The worked example may give away too much information (e.g., student would have already remembered the process if only two out of five steps were presented).
- The online learning system will need to identify when to provide the worked example. Showing it too soon may take away possible learning opportunities, but showing it too late may no longer be helpful.
Evidence
Literature
Expert guidance can help students achieve difficult tasks within the Zone of Proximal Development, which they are unable to do on their own[7]. Worked examples are one way of guiding student learning. It gives a step-by-step demonstration of how to perform a task or solve a problem. It helps novice learners form basic knowledge structures, which they can use to acquire new knowledge and skills through practice[8].
Discussion
Shepherds, writing workshop participants, and learning system stakeholders (i.e., data mining experts, learning scientists, and educators) agreed that the design pattern’s solution could address the identified problem.
Data
ASSISTments online learning system data showed that students rapidly requested for all available hints when they did not know how to solve the problem (i.e., based on hint request and answer correctness features). Students could have used hints as a proxy for worked examples, which showed them the entire procedure for solving the problem.
Example
Worked examples are common strategies used in online learning systems to support student learning. Both Cognitive Tutor Algebra and Cognitive Tutor Geometry provide a button that students can click to request for a worked example[9][10]. The ASSISTments online learning system also supports the creation of worked examples for problem solving activities[11]. It gives content creators the flexibility in controlling where to attach the worked example and when to show it (e.g., hint, scaffold, scaffold on incorrect response).
The figure below illustrates an example of a geometry problem and an associated worked example. It shows a step-by-step process of solving for the angle x, but uses a different problem so as not to give away the answer.
Related patterns
The Worked Examples design pattern can be used to support student learning when they implement the Try It Yourself, Different Exercise Levels, or Build and Maintain Confidence design patterns.
References
- ↑ 1.0 1.1 Inventado, P.S. & Scupelli, P. (in press 2015). A Data-driven Methodology for Producing Online Learning System Design Patterns. In Proceedings of the 22nd Conference on Pattern Languages of Programs (PLoP 2015). New York:ACM.
- ↑ 2.0 2.1 Inventado, P. S. & Scupelli, P. (2015). Towards an open, collaborative repository for online learning system design patterns. eLearning Papers, 42(Design Patterns for Open Online Teaching):14-27.
- ↑ Hume, G., Michael, J., Rovick, A., and Evens, M. (1996). Hinting as a tactic in one-on-one tutoring. The Journal of the Learning Sciences, 5(1), 23-47.
- ↑ Sweller, J. (2004). Instructional design consequences of an analogy between evolution by natural selection and human cognitive architecture. Instructional science, 32(1-2), 9-31.
- ↑ Bloom, B. S. (1974). Time and learning. American psychologist, 29(9), 682.
- ↑ D’Mello, S., and Graesser, A. (2012). Dynamics of affective states during complex learning. Learning and Instruction, 22(2), 145-157.
- ↑ 7.0 7.1 Vygotsky, L. S. (1962). Language and thought. Massachusetts Institute of Technology Press, Ontario, Canada.
- ↑ Clark, R. C., and Mayer, R. E. (2011). E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. John Wiley & Sons.
- ↑ Aleven, V., Mclaren, B., Roll, I., and Koedinger, K. (2006). Toward meta-cognitive tutoring: A model of help seeking with a Cognitive Tutor. International Journal of Artificial Intelligence in Education, 16(2), 101-128.
- ↑ Koedinger, K. R., and Aleven, V. (2007). Exploring the assistance dilemma in experiments with cognitive tutors. Educational Psychology Review, 19(3), 239-264.
- ↑ Weitz, R., Salden, R. J. C. M., Kim, R. S., and Heffernan, N. T. (2010). Comparing worked examples and tutored problem solving: Pure vs. mixed approaches. In Proceedings of the Thirty-Second Annual Meeting of the Cognitive Science Society (pp. 2876-2881).