{"id":95,"date":"2021-02-10T13:51:10","date_gmt":"2021-02-10T18:51:10","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/?post_type=chapter&#038;p=95"},"modified":"2021-03-30T15:22:19","modified_gmt":"2021-03-30T19:22:19","slug":"backwards-design","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/backwards-design\/","title":{"raw":"Outcomes Based Design","rendered":"Outcomes Based Design"},"content":{"raw":"<div class=\"mceTemp\"><\/div>\r\nOutcomes based design, sometimes referred to as <em>\"backwards design\"<\/em> or <em>\"<a href=\"https:\/\/cft.vanderbilt.edu\/guides-sub-pages\/understanding-by-design\/\" target=\"_blank\" rel=\"noopener\">understanding by design<\/a>,\"<\/em> is one example of a curriculum design model. While there are many such models, backwards design provides a structured process of identifying relevant learning outcomes and then designing instructional modules, teaching strategies, and assessment and evaluative events to support them. Because TBL places so much weight on learner outcomes, backwards design becomes the most logical tool to design a TBL course and modules.\r\n\r\n[caption id=\"attachment_322\" align=\"aligncenter\" width=\"530\"]<img class=\"wp-image-322 size-full\" src=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-content\/uploads\/sites\/1237\/2021\/02\/Biggs-Constructive-Alignment.gif\" alt=\"\" width=\"530\" height=\"530\" \/> <em>Using Biggs\u2019 Model of Constructive Alignment in Curriculum Design\/Introduction - UCD - CTAG, n.d<\/em>.[\/caption]\r\n\r\nWhile it is beyond the scope of this guide to completely cover curriculum design, this overview is intended to provide context for the foundation of TBL design. It is highly recommended to seek out courses on curriculum design, as well as TBL workshops.\r\n\r\n[embed]https:\/\/www.youtube.com\/watch?v=QbKx_tG99ho&amp;feature=youtu.be[\/embed]\r\n\r\nOutcomes based design occurs in three stages:\r\n<h5 style=\"padding-left: 40px\"><em><strong>1) Identify the Desired Outcomes<\/strong><\/em><\/h5>\r\nIn many cases, there is tendency to select readings and resources first and then developing activities and outcomes based on those. In designing a TBL course and individual modules, the first step is to begin at the end with desired outcomes and then work backwards to design the evaluative and assessment events to support the learning outcomes, and then developing the teaching and learning activities to ensure that they support the evaluative and assessment events (Bowen, 2017; McTighe &amp; Wiggins, 2012).\r\n\r\nIn reimagining a course with a focus on application, analysis and evaluation, the verbs selected for the outcomes become key. When developing a course and module outcomes, it is important to consider the question, \"what do I want the students to be able to DO at the end of this course or module?\" (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015).\r\n\r\n<a href=\"#Bloom's\">Bloom's taxonomy<\/a> of learning can be very helpful in identifying specific verbs to support this learning levelling.\r\n<h5 style=\"padding-left: 40px\"><em><strong>2) Determine Assessment Evidence<\/strong><\/em><\/h5>\r\nThe next step in outcomes based design is to determine what will indicate that students have achieved the desired learning outcomes. In most post-secondary institutions, this evidence will often be attached to a grade and traditionally take the form of quizzes, exams and assignments. In the TBL context, evidence of learning may or may not be attached to a grade, and can simply be an activity that gives the instructor the opportunity to offer <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/feedback#Assessment\/Evaluation\">feedback<\/a> to the student (Bowen, 2017; McTighe &amp; Wiggins, 2012).\u00a0In the TBL context specifically, evidence of successful learning is generated from the Readiness Assurance Tests (RAT) and the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/group-application-activities\/\">group application activities<\/a>. <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/assignment-design\/\">Assignment Design<\/a> should be undertaken intentionally and with consideration in order to meet the learning outcomes and support students in achieving the desired <a href=\"#Bloom's\">cognitive level of learning.<\/a>\r\n\r\nThe RAT will usually be comprised of multiple choice questions (MCQ) and associated with a low stakes grade. In most cases, the teams will perform better than most individuals and you will find that the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/trat\/\">Team Readiness Assurance Test (tRAT)<\/a> grade will be higher than the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/irat-2\/\">Individual Readiness Assurance Test (iRAT)<\/a>. Well designed MCQs must be designed using evidence based <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/multiple-choice-questions\/\">item response theory<\/a> in order to support conclusions drawn for both [pb_glossary id=\"423\"]formative assessment[\/pb_glossary] to support learning and [pb_glossary id=\"479\"]summative evaluation[\/pb_glossary] of learning.\r\n\r\nDevelopment of group application activities require equal attention and should follow the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/group-application-activities#4S\">4S framework<\/a> discussed later in this guide. These activities may be graded or ungraded and can be assessed by circulating through the teams (physically or virtually) while they engaged in the activity discussion and during the larger class discussion at the end (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015).\r\n<h5 style=\"padding-left: 40px\"><em><strong>3) Plan Learning Experiences and Instruction<\/strong><\/em><\/h5>\r\nThe final phase of outcome based design is to plan the learning activities. As with developing the assessment events, planning the learning activities also requires careful consideration and alignment to ensure that they support the assessments, which in turn support the outcomes. (Bowen, 2017; McTighe &amp; Wiggins, 2012).\r\n\r\nTraditionally these take the form of pre-class readings and lecture content and may still be components in your classroom. In your TBL adapted course, you will likely still have some form of <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/individual-pre-class-preparation\/\">pre-class preparation<\/a> and you may have some degree of <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/readiness-assurance-process#Clarification lecture\">clarification lecture<\/a> instruction as part of the [pb_glossary id=\"36\"]readiness assurance process[\/pb_glossary]. However, TBL learning and instructional events are often more active and learner involved, and depending on your design, you may find that these activities serve double duty as assessment tools as described above.\r\n\r\nThe RAT in particular, can serve as an instrumental learning activity due to the repeated exposure and opportunity for the learner to receive feedback, self-assess and apply new learning between the iRAT and tRAT phases of the RAP. The group application activities offer individuals learning support from the team as they collectively work through complex and relevant problems. Finally, all of these activities are completed with an open and resolving discussion of the problems presented, which manifests as a teaching opportunity for the instructor to provide feedback in the form of a consolidation of the learning (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015; Sibley &amp; Roberson, 2016).\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\"><strong><a id=\"Bloom's\"><\/a>Bloom's Taxonomy<\/strong><\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\nBloom's Taxonomy model was conceived of in 1949 and has since seen revision. While there are other models of learning cognition, Bloom's has been a mainstay for educators since its inception. It is used to guide educators as they codify their teaching and develop and measure learning goals and outcomes and (Adams, 2015; Anderson et al., 2001; Bouchard, 2011).\r\n\r\n&nbsp;\r\n<p style=\"text-align: center\">[h5p id=\"6\"]<\/p>\r\n<p style=\"text-align: right\"><em>(Image from: Ekaza, n.d.)<\/em><\/p>\r\n\r\n<\/div>\r\n<\/div>","rendered":"<div class=\"mceTemp\"><\/div>\n<p>Outcomes based design, sometimes referred to as <em>&#8220;backwards design&#8221;<\/em> or <em>&#8220;<a href=\"https:\/\/cft.vanderbilt.edu\/guides-sub-pages\/understanding-by-design\/\" target=\"_blank\" rel=\"noopener\">understanding by design<\/a>,&#8221;<\/em> is one example of a curriculum design model. While there are many such models, backwards design provides a structured process of identifying relevant learning outcomes and then designing instructional modules, teaching strategies, and assessment and evaluative events to support them. Because TBL places so much weight on learner outcomes, backwards design becomes the most logical tool to design a TBL course and modules.<\/p>\n<figure id=\"attachment_322\" aria-describedby=\"caption-attachment-322\" style=\"width: 530px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-322 size-full\" src=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-content\/uploads\/sites\/1237\/2021\/02\/Biggs-Constructive-Alignment.gif\" alt=\"\" width=\"530\" height=\"530\" \/><figcaption id=\"caption-attachment-322\" class=\"wp-caption-text\"><em>Using Biggs\u2019 Model of Constructive Alignment in Curriculum Design\/Introduction &#8211; UCD &#8211; CTAG, n.d<\/em>.<\/figcaption><\/figure>\n<p>While it is beyond the scope of this guide to completely cover curriculum design, this overview is intended to provide context for the foundation of TBL design. It is highly recommended to seek out courses on curriculum design, as well as TBL workshops.<\/p>\n<p><iframe loading=\"lazy\" id=\"oembed-1\" title=\"Backward Design Process\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/QbKx_tG99ho?feature=oembed&#38;rel=0\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Outcomes based design occurs in three stages:<\/p>\n<h5 style=\"padding-left: 40px\"><em><strong>1) Identify the Desired Outcomes<\/strong><\/em><\/h5>\n<p>In many cases, there is tendency to select readings and resources first and then developing activities and outcomes based on those. In designing a TBL course and individual modules, the first step is to begin at the end with desired outcomes and then work backwards to design the evaluative and assessment events to support the learning outcomes, and then developing the teaching and learning activities to ensure that they support the evaluative and assessment events (Bowen, 2017; McTighe &amp; Wiggins, 2012).<\/p>\n<p>In reimagining a course with a focus on application, analysis and evaluation, the verbs selected for the outcomes become key. When developing a course and module outcomes, it is important to consider the question, &#8220;what do I want the students to be able to DO at the end of this course or module?&#8221; (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015).<\/p>\n<p><a href=\"#Bloom's\">Bloom&#8217;s taxonomy<\/a> of learning can be very helpful in identifying specific verbs to support this learning levelling.<\/p>\n<h5 style=\"padding-left: 40px\"><em><strong>2) Determine Assessment Evidence<\/strong><\/em><\/h5>\n<p>The next step in outcomes based design is to determine what will indicate that students have achieved the desired learning outcomes. In most post-secondary institutions, this evidence will often be attached to a grade and traditionally take the form of quizzes, exams and assignments. In the TBL context, evidence of learning may or may not be attached to a grade, and can simply be an activity that gives the instructor the opportunity to offer <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/feedback#Assessment\/Evaluation\">feedback<\/a> to the student (Bowen, 2017; McTighe &amp; Wiggins, 2012).\u00a0In the TBL context specifically, evidence of successful learning is generated from the Readiness Assurance Tests (RAT) and the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/group-application-activities\/\">group application activities<\/a>. <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/assignment-design\/\">Assignment Design<\/a> should be undertaken intentionally and with consideration in order to meet the learning outcomes and support students in achieving the desired <a href=\"#Bloom's\">cognitive level of learning.<\/a><\/p>\n<p>The RAT will usually be comprised of multiple choice questions (MCQ) and associated with a low stakes grade. In most cases, the teams will perform better than most individuals and you will find that the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/trat\/\">Team Readiness Assurance Test (tRAT)<\/a> grade will be higher than the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/irat-2\/\">Individual Readiness Assurance Test (iRAT)<\/a>. Well designed MCQs must be designed using evidence based <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/multiple-choice-questions\/\">item response theory<\/a> in order to support conclusions drawn for both <a class=\"glossary-term\" aria-haspopup=\"dialog\" aria-describedby=\"definition\" href=\"#term_95_423\">formative assessment<\/a> to support learning and <a class=\"glossary-term\" aria-haspopup=\"dialog\" aria-describedby=\"definition\" href=\"#term_95_479\">summative evaluation<\/a> of learning.<\/p>\n<p>Development of group application activities require equal attention and should follow the <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/group-application-activities#4S\">4S framework<\/a> discussed later in this guide. These activities may be graded or ungraded and can be assessed by circulating through the teams (physically or virtually) while they engaged in the activity discussion and during the larger class discussion at the end (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015).<\/p>\n<h5 style=\"padding-left: 40px\"><em><strong>3) Plan Learning Experiences and Instruction<\/strong><\/em><\/h5>\n<p>The final phase of outcome based design is to plan the learning activities. As with developing the assessment events, planning the learning activities also requires careful consideration and alignment to ensure that they support the assessments, which in turn support the outcomes. (Bowen, 2017; McTighe &amp; Wiggins, 2012).<\/p>\n<p>Traditionally these take the form of pre-class readings and lecture content and may still be components in your classroom. In your TBL adapted course, you will likely still have some form of <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/individual-pre-class-preparation\/\">pre-class preparation<\/a> and you may have some degree of <a href=\"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/chapter\/readiness-assurance-process#Clarification lecture\">clarification lecture<\/a> instruction as part of the <a class=\"glossary-term\" aria-haspopup=\"dialog\" aria-describedby=\"definition\" href=\"#term_95_36\">readiness assurance process<\/a>. However, TBL learning and instructional events are often more active and learner involved, and depending on your design, you may find that these activities serve double duty as assessment tools as described above.<\/p>\n<p>The RAT in particular, can serve as an instrumental learning activity due to the repeated exposure and opportunity for the learner to receive feedback, self-assess and apply new learning between the iRAT and tRAT phases of the RAP. The group application activities offer individuals learning support from the team as they collectively work through complex and relevant problems. Finally, all of these activities are completed with an open and resolving discussion of the problems presented, which manifests as a teaching opportunity for the instructor to provide feedback in the form of a consolidation of the learning (Michaelsen &amp; Sweet, 2008; Roberson &amp; Franchini, 2014; Sibley &amp; Ostafichuk, 2015; Sibley &amp; Roberson, 2016).<\/p>\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\"><strong><a id=\"Bloom's\"><\/a>Bloom&#8217;s Taxonomy<\/strong><\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p>Bloom&#8217;s Taxonomy model was conceived of in 1949 and has since seen revision. While there are other models of learning cognition, Bloom&#8217;s has been a mainstay for educators since its inception. It is used to guide educators as they codify their teaching and develop and measure learning goals and outcomes and (Adams, 2015; Anderson et al., 2001; Bouchard, 2011).<\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center\">\n<div id=\"h5p-6\">\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-6\" class=\"h5p-iframe\" data-content-id=\"6\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"Bloom&#039;s Taxonomy\"><\/iframe><\/div>\n<\/div>\n<p style=\"text-align: right\"><em>(Image from: Ekaza, n.d.)<\/em><\/p>\n<\/div>\n<\/div>\n<div class=\"glossary\"><span class=\"screen-reader-text\" id=\"definition\">definition<\/span><template id=\"term_95_423\"><div class=\"glossary__definition\" role=\"dialog\" data-id=\"term_95_423\"><div tabindex=\"-1\"><p>Formative assessment refers to a variety of methods of collecting detailed information about student learning and implement strategies to augment and further that learning while it is happening. If there is a grade attached to a formative assessment, it is usually low stakes.<\/p>\n<p>The process of appraising for the purpose of providing feedback for learning and performance improvement. In general, is an ongoing and interactive process with low or no stakes events.<\/p>\n<p>\"When the chef tastes the soup\"<\/p>\n<\/div><button><span aria-hidden=\"true\">&times;<\/span><span class=\"screen-reader-text\">Close definition<\/span><\/button><\/div><\/template><template id=\"term_95_479\"><div class=\"glossary__definition\" role=\"dialog\" data-id=\"term_95_479\"><div tabindex=\"-1\"><p>A process of judging performance or work that has already occurred, determining the extent that objectives have been achieved and assigning a grade or rank.<\/p>\n<p>\"When the customer tastes the soup.\"<\/p>\n<\/div><button><span aria-hidden=\"true\">&times;<\/span><span class=\"screen-reader-text\">Close definition<\/span><\/button><\/div><\/template><template id=\"term_95_36\"><div class=\"glossary__definition\" role=\"dialog\" data-id=\"term_95_36\"><div tabindex=\"-1\"><p>A 4 stage process that occurs at the beginning of a TBL module designed to prepare students for the learning and assessment activities to come by ensuring the foundational content from the pre-class preparations can be remembered, understood and applied to some degree.<\/p>\n<p>The RAP consists of:<\/p>\n<p>IRAT<br \/>\nTRAT<br \/>\nAppeals<br \/>\nClarification lecture<\/p>\n<\/div><button><span aria-hidden=\"true\">&times;<\/span><span class=\"screen-reader-text\">Close definition<\/span><\/button><\/div><\/template><\/div>","protected":false},"author":2609,"menu_order":2,"comment_status":"closed","ping_status":"closed","template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-95","chapter","type-chapter","status-publish","hentry"],"part":57,"_links":{"self":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapters\/95","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/users\/2609"}],"replies":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/comments?post=95"}],"version-history":[{"count":24,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapters\/95\/revisions"}],"predecessor-version":[{"id":662,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapters\/95\/revisions\/662"}],"part":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/parts\/57"}],"metadata":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapters\/95\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/media?parent=95"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/pressbooks\/v2\/chapter-type?post=95"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/contributor?post=95"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/selkirktbl\/wp-json\/wp\/v2\/license?post=95"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}