{"id":111,"date":"2021-06-08T15:54:40","date_gmt":"2021-06-08T19:54:40","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/chapter\/impact-data-open-ubc\/"},"modified":"2022-04-26T11:02:24","modified_gmt":"2022-04-26T15:02:24","slug":"impact-data-open-ubc","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/chapter\/impact-data-open-ubc\/","title":{"raw":"Impact Data","rendered":"Impact Data"},"content":{"raw":"<a id=\"Data\"><\/a>Developing strategies and approaches to measuring the success of your open text project should be developed during the Project Plan stages. Collecting and analyzing this data will help you maintain accountability to the goals of your project and to understand whether your project is successful. Measuring success will depend on a few factors:\r\n<div class=\"wiki-embed wiki-target-url-not-set\">\r\n<div class=\"mw-parser-output\">\r\n<ol>\r\n \t<li>What constitutes success for your project and how will it be measured? Pedagogical innovation? Surveys? Interviews?<\/li>\r\n \t<li>Who do you need to report to about the open text project? Funders? Your institution? Department?<\/li>\r\n \t<li>What data is needed to indicate \"success\"? Adoption numbers? Students impacted?<\/li>\r\n \t<li>How do you need to use the data for your own portfolio? Tenure and promotion? Merit?<\/li>\r\n<\/ol>\r\nWorking through these questions will assist you in collecting the right metrics to report fully about the success of your project. This guide outlines the kinds of data that you can collect to frame discussions about your open textbook project and ensure you have reached your goals.\r\n<div class=\"wiki-embed-shell wiki-embed-fragment-count-2\">\r\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-0\" class=\"wikiembed-fragment wikiembed-fragment-counter-0 active tab-pane\">\r\n<h2><span id=\"Adoption_Data\" class=\"mw-headline\">Adoption Data<\/span><\/h2>\r\nCollecting adoption data can be a difficult process as it requires adopters to identify that they are using the text in their courses or instructional practices. Developing a feedback mechanism for your text that requests that adopters identify their use of the text is the easiest way to gather this data.\r\n\r\nTo begin, decide how you will track adoptions and what statistics you\u2019ll collect. For instance, you might want to track adoption trends by course level, type, term, or semester.\r\n\r\nThen identify the tool you will use to gather this data. For example, you can develop a <a class=\"external text\" href=\"https:\/\/it.ubc.ca\/services\/teaching-learning-tools\/survey-tool\" rel=\"nofollow\">Qualtrics<\/a> form located as a link on the homepage of your textbook, in the front matter of the text, or in a metadata field of your open textbook record to encourage self-reporting.\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\">\r\n<p class=\"textbox__title\">Examples - Calculus Volume 3 Adoption Metrics<\/p>\r\n\r\n<\/header>\r\n<div class=\"textbox__content\">\r\n\r\n<b><a class=\"external text\" href=\"https:\/\/open.bccampus.ca\/browse-our-collection\/find-open-textbooks\/?uuid=eb09279d-7658-48d9-a661-8b191eb9deda&amp;contributor=&amp;keyword=&amp;subject=\" rel=\"nofollow\">Calculus Volume 3 Adoption<\/a><\/b>\r\n<ul>\r\n \t<li><a class=\"external text\" href=\"https:\/\/open.bccampus.ca\/use-open-textbooks\/tell-us-youre-using-an-open-textbook\/\" rel=\"nofollow\">BCcampus Open Textbook Collection<\/a> - Data collected for textbook adoption includes the institutions and courses where the textbook is used as well as the cost savings for students.<\/li>\r\n \t<li><a class=\"external text\" href=\"https:\/\/openstax.org\/adoption?Calculus\" rel=\"nofollow\">Open Stax<\/a> - Data collected by use rather than adoption. The form is broken down into students, faculty, homeschooler, administrator, librarians, instructional designer, adjunct faculty, and other to create a more tailored data collection process.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<h2><span id=\"Open_Education_Repository_Data\" class=\"mw-headline\">Open Education Repository Data<\/span><\/h2>\r\nDepending on where you decide to host your open text you may be able to take advantage of the platform to gather analytics about your text's use. The data you can collect includes views (by year\/month), downloads (by year\/month), and user ratings and comments. While there may be many data options for you, you need to decide how you will use it and select what is most useful to your success measures.\r\n\r\n&nbsp;\r\n<div class=\"textbox textbox--examples\"><header class=\"textbox__header\"><b>Examples - Open Education Repository Data Collection<\/b><\/header>\r\n<div class=\"textbox__content\">\r\n\r\nThe following are examples of the kinds of data you can gather in UBC cIRcle, OER Commons, and MERLOT.\r\n\r\nUBC <a class=\"external text\" href=\"https:\/\/circle.ubc.ca\/\" rel=\"nofollow\">cIRcle<\/a>\r\n<ul>\r\n \t<li>Views and downloads by country; Views and downloads by month and year; Total views and downloads<\/li>\r\n<\/ul>\r\n<a class=\"external text\" href=\"https:\/\/www.oercommons.org\/\" rel=\"nofollow\">OER Commons<\/a>\r\n<ul>\r\n \t<li>Numbers of times a resource is viewed; Number of times a resource is saved; Ratings out of 5 stars; Comments<\/li>\r\n \t<li>If you have a paid <a class=\"external text\" href=\"https:\/\/help.oercommons.org\/support\/solutions\/articles\/42000060693-hubs-analytics-dashboard-dimension\" rel=\"nofollow\">OER Commons Hub<\/a>, there are additional metrics available.<\/li>\r\n<\/ul>\r\n<a class=\"external text\" href=\"https:\/\/www.merlot.org\/merlot\/\" rel=\"nofollow\">MERLOT<\/a>\r\n<ul>\r\n \t<li>User ratings; Comments; <a class=\"external text\" href=\"http:\/\/info.merlot.org\/merlothelp\/topic.htm#t=MERLOT_Peer_Review_Information.htm%23merlot-awards\" rel=\"nofollow\">Merlot\u00a0Awards System<\/a>;<\/li>\r\n \t<li>If you use the <a class=\"external text\" href=\"http:\/\/info.merlot.org\/merlothelp\/topic.htm#t=Content_Builder_Main_Menu.htm&amp;rhsearch=analytics\" rel=\"nofollow\">Content builder<\/a> you can add <a class=\"external text\" href=\"https:\/\/marketingplatform.google.com\/about\/analytics\/\" rel=\"nofollow\">Google Analytics<\/a> for additional metrics.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<h2><span id=\"Catalogue_Data\" class=\"mw-headline\">Catalogue Data<\/span><\/h2>\r\nIf you have made your open text available through <a class=\"external text\" href=\"https:\/\/circle.ubc.ca\/\" rel=\"nofollow\">cIRcle<\/a>, <a class=\"external text\" href=\"http:\/\/www.library.ubc.ca\/\" rel=\"nofollow\">Summon (General Search)<\/a>, and\/through the UBC Library <a class=\"external text\" href=\"http:\/\/webcat1.library.ubc.ca\/vwebv\/searchBasic\" rel=\"nofollow\">catalogue (Books &amp; Media)<\/a>, there may be some circulation and usage data that UBC Library can collect. To learn more about adding your textbook to UBC Library systems, review <a class=\"external text\" href=\"https:\/\/open.ubc.ca\/open-publishing-guide\/release-plan\/\" rel=\"nofollow\">Developing a Release Plan<\/a>.\r\n<h2><span id=\"Open_Monograph_Publisher_Data\" class=\"mw-headline\">Pressbooks Data<\/span><\/h2>\r\nIf you are using <a class=\"external text\" href=\"https:\/\/pressbooks.bccampus.ca\/\" rel=\"nofollow\">Pressbooks<\/a>, there are metrics available for the web version of your text. You can find metrics in the dashboard menu labeled \"WP-Piwik\". <a class=\"external text\" href=\"https:\/\/piwik.pro\/web-analytics\/?utm_campaign=search_RSA_Piwik-Brand_us&amp;utm_medium=cpc&amp;utm_source=google&amp;utm_term=piwik&amp;utm_campaign=%5BUS%5D%5Bsearch%5D%5Bbrand%5D+Piwik&amp;utm_source=adwords&amp;utm_medium=ppc&amp;hsa_tgt=kwd-17630746456&amp;hsa_grp=52217794725&amp;hsa_sr\" rel=\"nofollow\">Piwik Analytics<\/a> provides many data options, including:\r\n<ul>\r\n \t<li>Number of visitors in the last 12 months<\/li>\r\n \t<li>Number of visitors in the current month, including page views, time spent, maximum page viewed in one visit<\/li>\r\n \t<li>Pages viewed in the current month<\/li>\r\n \t<li>Cities of the visitors in the current month<\/li>\r\n \t<li>Keywords, Browsers, Type of technology, and more<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-0\" class=\"wikiembed-fragment wikiembed-fragment-counter-0 active tab-pane\">\r\n<dl>\r\n \t<dd>\r\n<dl>\r\n \t<dd>\r\n<dl>\r\n \t<dd><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1.602em;font-weight: bold;text-align: initial\">Evaluation Metrics<\/span><\/dd>\r\n<\/dl>\r\n<\/dd>\r\n<\/dl>\r\n<\/dd>\r\n<\/dl>\r\n<\/div>\r\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-1\" class=\"wikiembed-fragment wikiembed-fragment-counter-1 tab-pane\">\r\n\r\nWhile usage and adoption statistics provide part of the story of your open text's success, understanding the impact on students beyond cost savings can provide broader insights on the value of tailoring an open text for pedagogical purposes. This kind of evaluation may include the following questions:\r\n<ul>\r\n \t<li>What does \u2018impact\u2019 look like if considering innovation in teaching and learning?\r\n<ul>\r\n \t<li>A rise in grades<\/li>\r\n \t<li>Greater understanding of complex topic areas<\/li>\r\n \t<li>Increased engagement with the textbook and course content<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ul>\r\nFor support in developing an evaluation plan that addresses the pedagogical value of your open textbook project, contact the <a href=\"https:\/\/ctlt.ubc.ca\/\">Centre for Teaching and Learning Technology<\/a> (UBC Vancouver) or the <a href=\"https:\/\/ctl.ok.ubc.ca\/\">Centre for Teaching and Learning<\/a> (UBC Okanagan).\r\n\r\n<\/div>\r\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-2\" class=\"wikiembed-fragment wikiembed-fragment-counter-2 wikiembed-fragment-last tab-pane\">\r\n<h2><span id=\"Put_your_stats_to_work\" class=\"mw-headline\">Put Your Stats to Work!<\/span><\/h2>\r\n<h3><span id=\"UBC_Tenure_and_Promotion\" class=\"mw-headline\">UBC Tenure and Promotion<\/span><\/h3>\r\nIn 2017 UBC included language recognizing creation and adaptation of open educational resources (OER) in the institution's <a class=\"external text\" href=\"http:\/\/www.hr.ubc.ca\/faculty-relations\/files\/SAC-Guide.pdf\" rel=\"nofollow\">Guide to Reappointment, Promotion and Tenure Procedures at UBC.<\/a> The guide lists the following among several examples of evidence of educational leadership:\r\n<blockquote><i>Contributions to the practice and theory of teaching and learning literature, including publications in peer-reviewed and professional journals, conference publications, book chapters, textbooks and open education repositories\/resources<\/i> (p. 14).<\/blockquote>\r\nIn the <a class=\"external text\" href=\"http:\/\/www.hr.ubc.ca\/faculty-relations\/collective-agreements\/\" rel=\"nofollow\">UBC Faculty Association Collective Agreement<\/a>, \"educational leadership\" is one of the areas (along with teaching and service) in which candidates in the educational leadership faculty stream are evaluated for appointment, reappointment, tenure, promotion, and merit. It is defined in that agreement as:\r\n<blockquote><i>Activity taken at UBC and elsewhere to advance innovation in teaching and learning with impact beyond one\u2019s classroom<\/i> (Part 4.04).<\/blockquote>\r\nWhen considering how to talk about OER creation or adaptation as part of your annual report or dossier for reappointment, tenure, promotion or merit, given the definition of educational leadership above, you should work to show the impact of such work \"beyond your classroom,\" whether at UBC or elsewhere.\r\n\r\nPossible ways to report your open education activity in your annual report:\r\n<ul>\r\n \t<li>Reporting adoption statistics;<\/li>\r\n \t<li>Keep records of personal communications that give praise for the work or talk about how it's being used;<\/li>\r\n \t<li>Note any adaptations of the work by others;<\/li>\r\n \t<li>Solicit feedback from peers or students on their perceptions of the quality and usefulness of the work;<\/li>\r\n \t<li>Or other ways to show that the OER is being used and considered a valuable resource by others.<\/li>\r\n<\/ul>\r\n<h1>Adaption<\/h1>\r\n<ul>\r\n \t<li>Adapted from the <a class=\"external text\" href=\"https:\/\/etextbook.jiscinvolve.org\/wp\/7-measures-of-success\/#3\" rel=\"nofollow\">Measure of Success<\/a> section in <a class=\"external text\" href=\"https:\/\/etextbook.jiscinvolve.org\/wp\/1-introduction\/\" rel=\"nofollow\">Institution as e-Textbook Publishers<\/a> by <a class=\"external text\" href=\"https:\/\/www.jisc.ac.uk\/\" rel=\"nofollow\">JISC<\/a> licensed under a <a class=\"external text\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\" rel=\"nofollow\">CC BY licence.<\/a><\/li>\r\n \t<li>Adapted from the <a class=\"external text\" href=\"https:\/\/press.rebus.community\/the-rebus-guide-to-publishing-open-textbooks\" rel=\"nofollow\">The Rebus Guide to Publishing Open Textbooks (So Far)<\/a> by Apurva Ashok and Zoe Wake Hyde is licensed under a <a class=\"external text\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\" rel=\"nofollow\">Creative Commons Attribution 4.0 International License<\/a>, except where otherwise noted.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<\/div>\r\n<footer id=\"ubc7-footer\" class=\"expand\" role=\"contentinfo\">\r\n<div id=\"ubc7-unit-footer\" class=\"row-fluid expand\">\r\n<div class=\"container\">\r\n<div id=\"ubc7-unit-address\" class=\"span10\"><\/div>\r\n<\/div>\r\n<\/div>\r\n<div id=\"ubc7-minimal-footer\" class=\"row-fluid expand\">\r\n<div class=\"container\">\r\n<div class=\"span12\"><\/div>\r\n<\/div>\r\n<\/div>\r\n<\/footer>","rendered":"<p><a id=\"data\"><\/a>Developing strategies and approaches to measuring the success of your open text project should be developed during the Project Plan stages. Collecting and analyzing this data will help you maintain accountability to the goals of your project and to understand whether your project is successful. Measuring success will depend on a few factors:<\/p>\n<div class=\"wiki-embed wiki-target-url-not-set\">\n<div class=\"mw-parser-output\">\n<ol>\n<li>What constitutes success for your project and how will it be measured? Pedagogical innovation? Surveys? Interviews?<\/li>\n<li>Who do you need to report to about the open text project? Funders? Your institution? Department?<\/li>\n<li>What data is needed to indicate &#8220;success&#8221;? Adoption numbers? Students impacted?<\/li>\n<li>How do you need to use the data for your own portfolio? Tenure and promotion? Merit?<\/li>\n<\/ol>\n<p>Working through these questions will assist you in collecting the right metrics to report fully about the success of your project. This guide outlines the kinds of data that you can collect to frame discussions about your open textbook project and ensure you have reached your goals.<\/p>\n<div class=\"wiki-embed-shell wiki-embed-fragment-count-2\">\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-0\" class=\"wikiembed-fragment wikiembed-fragment-counter-0 active tab-pane\">\n<h2><span id=\"Adoption_Data\" class=\"mw-headline\">Adoption Data<\/span><\/h2>\n<p>Collecting adoption data can be a difficult process as it requires adopters to identify that they are using the text in their courses or instructional practices. Developing a feedback mechanism for your text that requests that adopters identify their use of the text is the easiest way to gather this data.<\/p>\n<p>To begin, decide how you will track adoptions and what statistics you\u2019ll collect. For instance, you might want to track adoption trends by course level, type, term, or semester.<\/p>\n<p>Then identify the tool you will use to gather this data. For example, you can develop a <a class=\"external text\" href=\"https:\/\/it.ubc.ca\/services\/teaching-learning-tools\/survey-tool\" rel=\"nofollow\">Qualtrics<\/a> form located as a link on the homepage of your textbook, in the front matter of the text, or in a metadata field of your open textbook record to encourage self-reporting.<\/p>\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\">\n<p class=\"textbox__title\">Examples &#8211; Calculus Volume 3 Adoption Metrics<\/p>\n<\/header>\n<div class=\"textbox__content\">\n<p><b><a class=\"external text\" href=\"https:\/\/open.bccampus.ca\/browse-our-collection\/find-open-textbooks\/?uuid=eb09279d-7658-48d9-a661-8b191eb9deda&amp;contributor=&amp;keyword=&amp;subject=\" rel=\"nofollow\">Calculus Volume 3 Adoption<\/a><\/b><\/p>\n<ul>\n<li><a class=\"external text\" href=\"https:\/\/open.bccampus.ca\/use-open-textbooks\/tell-us-youre-using-an-open-textbook\/\" rel=\"nofollow\">BCcampus Open Textbook Collection<\/a> &#8211; Data collected for textbook adoption includes the institutions and courses where the textbook is used as well as the cost savings for students.<\/li>\n<li><a class=\"external text\" href=\"https:\/\/openstax.org\/adoption?Calculus\" rel=\"nofollow\">Open Stax<\/a> &#8211; Data collected by use rather than adoption. The form is broken down into students, faculty, homeschooler, administrator, librarians, instructional designer, adjunct faculty, and other to create a more tailored data collection process.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<h2><span id=\"Open_Education_Repository_Data\" class=\"mw-headline\">Open Education Repository Data<\/span><\/h2>\n<p>Depending on where you decide to host your open text you may be able to take advantage of the platform to gather analytics about your text&#8217;s use. The data you can collect includes views (by year\/month), downloads (by year\/month), and user ratings and comments. While there may be many data options for you, you need to decide how you will use it and select what is most useful to your success measures.<\/p>\n<p>&nbsp;<\/p>\n<div class=\"textbox textbox--examples\">\n<header class=\"textbox__header\"><b>Examples &#8211; Open Education Repository Data Collection<\/b><\/header>\n<div class=\"textbox__content\">\n<p>The following are examples of the kinds of data you can gather in UBC cIRcle, OER Commons, and MERLOT.<\/p>\n<p>UBC <a class=\"external text\" href=\"https:\/\/circle.ubc.ca\/\" rel=\"nofollow\">cIRcle<\/a><\/p>\n<ul>\n<li>Views and downloads by country; Views and downloads by month and year; Total views and downloads<\/li>\n<\/ul>\n<p><a class=\"external text\" href=\"https:\/\/www.oercommons.org\/\" rel=\"nofollow\">OER Commons<\/a><\/p>\n<ul>\n<li>Numbers of times a resource is viewed; Number of times a resource is saved; Ratings out of 5 stars; Comments<\/li>\n<li>If you have a paid <a class=\"external text\" href=\"https:\/\/help.oercommons.org\/support\/solutions\/articles\/42000060693-hubs-analytics-dashboard-dimension\" rel=\"nofollow\">OER Commons Hub<\/a>, there are additional metrics available.<\/li>\n<\/ul>\n<p><a class=\"external text\" href=\"https:\/\/www.merlot.org\/merlot\/\" rel=\"nofollow\">MERLOT<\/a><\/p>\n<ul>\n<li>User ratings; Comments; <a class=\"external text\" href=\"http:\/\/info.merlot.org\/merlothelp\/topic.htm#t=MERLOT_Peer_Review_Information.htm%23merlot-awards\" rel=\"nofollow\">Merlot\u00a0Awards System<\/a>;<\/li>\n<li>If you use the <a class=\"external text\" href=\"http:\/\/info.merlot.org\/merlothelp\/topic.htm#t=Content_Builder_Main_Menu.htm&amp;rhsearch=analytics\" rel=\"nofollow\">Content builder<\/a> you can add <a class=\"external text\" href=\"https:\/\/marketingplatform.google.com\/about\/analytics\/\" rel=\"nofollow\">Google Analytics<\/a> for additional metrics.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<h2><span id=\"Catalogue_Data\" class=\"mw-headline\">Catalogue Data<\/span><\/h2>\n<p>If you have made your open text available through <a class=\"external text\" href=\"https:\/\/circle.ubc.ca\/\" rel=\"nofollow\">cIRcle<\/a>, <a class=\"external text\" href=\"http:\/\/www.library.ubc.ca\/\" rel=\"nofollow\">Summon (General Search)<\/a>, and\/through the UBC Library <a class=\"external text\" href=\"http:\/\/webcat1.library.ubc.ca\/vwebv\/searchBasic\" rel=\"nofollow\">catalogue (Books &amp; Media)<\/a>, there may be some circulation and usage data that UBC Library can collect. To learn more about adding your textbook to UBC Library systems, review <a class=\"external text\" href=\"https:\/\/open.ubc.ca\/open-publishing-guide\/release-plan\/\" rel=\"nofollow\">Developing a Release Plan<\/a>.<\/p>\n<h2><span id=\"Open_Monograph_Publisher_Data\" class=\"mw-headline\">Pressbooks Data<\/span><\/h2>\n<p>If you are using <a class=\"external text\" href=\"https:\/\/pressbooks.bccampus.ca\/\" rel=\"nofollow\">Pressbooks<\/a>, there are metrics available for the web version of your text. You can find metrics in the dashboard menu labeled &#8220;WP-Piwik&#8221;. <a class=\"external text\" href=\"https:\/\/piwik.pro\/web-analytics\/?utm_campaign=search_RSA_Piwik-Brand_us&amp;utm_medium=cpc&amp;utm_source=google&amp;utm_term=piwik&amp;utm_campaign=%5BUS%5D%5Bsearch%5D%5Bbrand%5D+Piwik&amp;utm_source=adwords&amp;utm_medium=ppc&amp;hsa_tgt=kwd-17630746456&amp;hsa_grp=52217794725&amp;hsa_sr\" rel=\"nofollow\">Piwik Analytics<\/a> provides many data options, including:<\/p>\n<ul>\n<li>Number of visitors in the last 12 months<\/li>\n<li>Number of visitors in the current month, including page views, time spent, maximum page viewed in one visit<\/li>\n<li>Pages viewed in the current month<\/li>\n<li>Cities of the visitors in the current month<\/li>\n<li>Keywords, Browsers, Type of technology, and more<\/li>\n<\/ul>\n<\/div>\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-0\" class=\"wikiembed-fragment wikiembed-fragment-counter-0 active tab-pane\">\n<dl>\n<dd>\n<dl>\n<dd>\n<dl>\n<dd><span style=\"font-family: 'Cormorant Garamond', serif;font-size: 1.602em;font-weight: bold;text-align: initial\">Evaluation Metrics<\/span><\/dd>\n<\/dl>\n<\/dd>\n<\/dl>\n<\/dd>\n<\/dl>\n<\/div>\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-1\" class=\"wikiembed-fragment wikiembed-fragment-counter-1 tab-pane\">\n<p>While usage and adoption statistics provide part of the story of your open text&#8217;s success, understanding the impact on students beyond cost savings can provide broader insights on the value of tailoring an open text for pedagogical purposes. This kind of evaluation may include the following questions:<\/p>\n<ul>\n<li>What does \u2018impact\u2019 look like if considering innovation in teaching and learning?\n<ul>\n<li>A rise in grades<\/li>\n<li>Greater understanding of complex topic areas<\/li>\n<li>Increased engagement with the textbook and course content<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>For support in developing an evaluation plan that addresses the pedagogical value of your open textbook project, contact the <a href=\"https:\/\/ctlt.ubc.ca\/\">Centre for Teaching and Learning Technology<\/a> (UBC Vancouver) or the <a href=\"https:\/\/ctl.ok.ubc.ca\/\">Centre for Teaching and Learning<\/a> (UBC Okanagan).<\/p>\n<\/div>\n<div id=\"fragment-5609b65f9e7afbc1f0744c201753e161-2\" class=\"wikiembed-fragment wikiembed-fragment-counter-2 wikiembed-fragment-last tab-pane\">\n<h2><span id=\"Put_your_stats_to_work\" class=\"mw-headline\">Put Your Stats to Work!<\/span><\/h2>\n<h3><span id=\"UBC_Tenure_and_Promotion\" class=\"mw-headline\">UBC Tenure and Promotion<\/span><\/h3>\n<p>In 2017 UBC included language recognizing creation and adaptation of open educational resources (OER) in the institution&#8217;s <a class=\"external text\" href=\"http:\/\/www.hr.ubc.ca\/faculty-relations\/files\/SAC-Guide.pdf\" rel=\"nofollow\">Guide to Reappointment, Promotion and Tenure Procedures at UBC.<\/a> The guide lists the following among several examples of evidence of educational leadership:<\/p>\n<blockquote><p><i>Contributions to the practice and theory of teaching and learning literature, including publications in peer-reviewed and professional journals, conference publications, book chapters, textbooks and open education repositories\/resources<\/i> (p. 14).<\/p><\/blockquote>\n<p>In the <a class=\"external text\" href=\"http:\/\/www.hr.ubc.ca\/faculty-relations\/collective-agreements\/\" rel=\"nofollow\">UBC Faculty Association Collective Agreement<\/a>, &#8220;educational leadership&#8221; is one of the areas (along with teaching and service) in which candidates in the educational leadership faculty stream are evaluated for appointment, reappointment, tenure, promotion, and merit. It is defined in that agreement as:<\/p>\n<blockquote><p><i>Activity taken at UBC and elsewhere to advance innovation in teaching and learning with impact beyond one\u2019s classroom<\/i> (Part 4.04).<\/p><\/blockquote>\n<p>When considering how to talk about OER creation or adaptation as part of your annual report or dossier for reappointment, tenure, promotion or merit, given the definition of educational leadership above, you should work to show the impact of such work &#8220;beyond your classroom,&#8221; whether at UBC or elsewhere.<\/p>\n<p>Possible ways to report your open education activity in your annual report:<\/p>\n<ul>\n<li>Reporting adoption statistics;<\/li>\n<li>Keep records of personal communications that give praise for the work or talk about how it&#8217;s being used;<\/li>\n<li>Note any adaptations of the work by others;<\/li>\n<li>Solicit feedback from peers or students on their perceptions of the quality and usefulness of the work;<\/li>\n<li>Or other ways to show that the OER is being used and considered a valuable resource by others.<\/li>\n<\/ul>\n<h1>Adaption<\/h1>\n<ul>\n<li>Adapted from the <a class=\"external text\" href=\"https:\/\/etextbook.jiscinvolve.org\/wp\/7-measures-of-success\/#3\" rel=\"nofollow\">Measure of Success<\/a> section in <a class=\"external text\" href=\"https:\/\/etextbook.jiscinvolve.org\/wp\/1-introduction\/\" rel=\"nofollow\">Institution as e-Textbook Publishers<\/a> by <a class=\"external text\" href=\"https:\/\/www.jisc.ac.uk\/\" rel=\"nofollow\">JISC<\/a> licensed under a <a class=\"external text\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\" rel=\"nofollow\">CC BY licence.<\/a><\/li>\n<li>Adapted from the <a class=\"external text\" href=\"https:\/\/press.rebus.community\/the-rebus-guide-to-publishing-open-textbooks\" rel=\"nofollow\">The Rebus Guide to Publishing Open Textbooks (So Far)<\/a> by Apurva Ashok and Zoe Wake Hyde is licensed under a <a class=\"external text\" href=\"https:\/\/creativecommons.org\/licenses\/by\/4.0\/\" rel=\"nofollow\">Creative Commons Attribution 4.0 International License<\/a>, except where otherwise noted.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<footer id=\"ubc7-footer\" class=\"expand\" role=\"contentinfo\">\n<div id=\"ubc7-unit-footer\" class=\"row-fluid expand\">\n<div class=\"container\">\n<div id=\"ubc7-unit-address\" class=\"span10\"><\/div>\n<\/div>\n<\/div>\n<div id=\"ubc7-minimal-footer\" class=\"row-fluid expand\">\n<div class=\"container\">\n<div class=\"span12\"><\/div>\n<\/div>\n<\/div>\n<\/footer>\n","protected":false},"author":1076,"menu_order":1,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-111","chapter","type-chapter","status-publish","hentry"],"part":106,"_links":{"self":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapters\/111","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/wp\/v2\/users\/1076"}],"version-history":[{"count":10,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapters\/111\/revisions"}],"predecessor-version":[{"id":1181,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapters\/111\/revisions\/1181"}],"part":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/parts\/106"}],"metadata":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapters\/111\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/wp\/v2\/media?parent=111"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/pressbooks\/v2\/chapter-type?post=111"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/wp\/v2\/contributor?post=111"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/openubcpub\/wp-json\/wp\/v2\/license?post=111"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}