{"id":90,"date":"2017-12-16T18:23:26","date_gmt":"2017-12-16T23:23:26","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/technicalwritingh5p\/chapter\/findingevaluating\/"},"modified":"2021-07-21T20:33:21","modified_gmt":"2021-07-22T00:33:21","slug":"findingevaluating","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/technicalwritingh5p\/chapter\/findingevaluating\/","title":{"raw":"5.2 Finding and Evaluating Research Sources","rendered":"5.2 Finding and Evaluating Research Sources"},"content":{"raw":"In this \u201cinformation age\u201d when so much information is available at our fingertips on the Internet, it is crucial to be able to critically search through the reams of information in order to select credible<\/em> sources that can provide reliable and useful<\/em> data to support your ideas and convince your audience. In the era of \u201cfake news,\u201d deliberate misinformation, and \u201calternative facts,\u201d developing the skill to evaluate the credibility of sources is critical.\r\n\r\nFrom your previous academic writing course, you are familiar with academic journals and how they differ from popular sources, as in Figure 5.2.1<\/strong>. If you would like to refresh your memory on this, watch UVic library's video on Scholarly and Popular Sources<\/a>. These contain peer-reviewed articles written by scholars, often presenting their original research, reviewing the original research of others, or performing a \u201cmeta-analysis\u201d (an analysis of multiple studies that analyze a given topic).\r\n
\"Magazines
Figure 5.2.1<\/strong> Examples of Popular vs Scholarly Sources.<\/em>[footnote]Cover images from journals are used to illustrate difference between popular and scholarly journals, and are for noncommercial, educational use only.[\/footnote]<\/figcaption><\/figure>\r\nScholarly articles published in academic journals are usually required sources in academic research essays; they are also an integral part of engineering projects and technical reports. Many projects require a literature review<\/a><\/strong>, which collects, summarizes and sometimes evaluates the work of researchers in this field whose work has been recognized as a valuable contribution to the \"state of the art.\" However, they are not the only kind of research you will find useful. Since you are researching in a professional field and preparing for the workplace, there are many credible kinds of sources you will draw on in a professional context. Table 5.2.1<\/strong> lists several types of sources you may find useful in researching your projects.\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
TABLE 5.2.1 Typical research sources for technical projects<\/caption>\r\n
[Skip Table<\/a>]\r\n<\/strong><\/td>\r\n<\/tr>\r\n
Source Type<\/strong><\/th>\r\nDescription<\/strong><\/th>\r\n<\/tr>\r\n
Academic Journals, Conference Papers, Dissertations, etc.<\/strong><\/th>\r\n\r\n

Scholarly (peer-reviewed) academic sources publish primary research done by professional researchers and scholars in specialized fields, as well as reviews of that research by other specialists in the same field.<\/p>\r\n

For example, the Journal of Computer and System Sciences<\/em> publishes original research papers in computer science and related subjects in system science; International Journal of Robotics and Animation<\/em> is one of the most highly ranked journals in the field.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Reference Works<\/strong><\/th>\r\n\r\n

Specialized encyclopaedias, handbooks and dictionaries can provide useful terminology and background information.<\/p>\r\n

For example, the Kirk-Othmer Encyclopedia of Chemical Technology<\/em> is a widely recognized authoritative source.<\/p>\r\n

Do not<\/strong> cite Wikipedia<\/em> or dictionary.com<\/em> in a technical report.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Books<\/strong>\r\n\r\nChapters in Books<\/strong><\/th>\r\n\r\n

Books written by specialists in a given field and contain a References section can be very helpful in providing in-depth context for your ideas.<\/p>\r\n

For example, Designing Engineers<\/em> by Susan McCahan et al. has an excellent chapter on effective teamwork<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Trade Magazines and Popular Science Magazines<\/strong><\/th>\r\n\r\n

Reputable trade magazines contain articles relating to current issues and innovations, and therefore they can be very useful in determining the \u201cstate of the art\u201d or what is \u201ccutting edge\u201d at the moment, or finding out what current issues or controversies are affecting the industry.<\/p>\r\n

Examples include Computerworld<\/em>, Wired<\/em>, and Popular Mechanics<\/em>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Newspapers <\/strong>(Journalism)<\/th>\r\n\r\n

Newspaper articles and media releases can offer a sense of what journalists and people in industry think the general public should know about a given topic. Journalists report on current events and recent innovations; more in-depth \u201cinvestigative journalism\u201d explores a current issue in greater detail. Newspapers also contain editorial sections that provide personal opinions on these events and issues.<\/p>\r\n

Choose well-known, reputable newspapers such as The New York Times<\/em>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Industry Websites <\/strong>(.com)<\/th>\r\n\r\n

Commercial websites are generally intended to \u201csell,\u201d so you have to select information carefully, but these websites can give you insights into a company\u2019s \u201cmission statement,\u201d organization, strategic plan, current or planned projects, archived information, White Papers, technical reports, product details, costs estimates, etc.<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Organization Websites<\/strong> (.org)<\/th>\r\n\r\n

A vast array of .org sites can be very helpful in supplying data and information. These are often public service<\/strong> sites and are designed to share information with the public.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Government Publications and Public Sector Web Sites <\/strong>(.gov\/.edu\/.ca)<\/th>\r\n\r\n

Government departments often publish reports and other documents that can be very helpful in determining public policy, regulations, and guidelines that should be followed.<\/p>\r\n

Statistics Canada<\/em><\/a>,[footnote]Government of Canada, Statistics Canada [online]. Available: http:\/\/www.statcan.gc.ca\/eng\/start<\/a>[\/footnote] for example, publishes a wide range of data.<\/p>\r\n

University web sites also offer a wide array of non-academic information, such as strategic plans, facilities information, etc.<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Patents<\/strong><\/th>\r\n\r\n

You may have to distinguish your innovative idea from previously patented ideas; you can look these up and get detailed information on patented or patent-pending ideas.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Public Presentations<\/strong><\/th>\r\n\r\n

Public Consultation meetings and representatives from industry and government speak to various audiences about current issues and proposed projects. These can be live presentations or video presentations available on YouTube<\/strong> or TED talks<\/strong>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Other<\/strong><\/th>\r\n\r\n

Can you think of some more? (Radio programs, Podcasts, Social Media, etc.<\/em>)<\/p>\r\n<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/a>The importance of critically evaluating your sources for authority, relevance, timeliness, and credibility cannot be overstated. <\/span>Anyone can put anything on the internet<\/em>; and people with strong web and document design skills can make this information look very professional and credible\u2014even if it isn't. Since much research is currently done online, and many sources are available electronically, developing your critical evaluation skills is crucial to finding valid, credible evidence to support and develop your ideas.\u00a0 In fact, this has become such a challenging issue that there are sites like this <\/span>List of Predatory Journals<\/a> that regularly update its online list of journals that subvert the peer review process and simply publish for profit.\r\n<\/span>\r\n\r\nReview your understanding of research sources with this H5P interactivity.\r\n\r\n[h5p id=\"49\"]\r\n\r\nMark Twain, supposedly quoting British Prime Minister Benjamin Disraeli, famously said, \"There are three kinds of <\/span>lies<\/span>: <\/span>lies<\/span>, <\/span>damned lies, and statistics<\/span>.\" On the other hand, <\/span>H.G. Wells has been (mis)quoted as stating, \"statistical thinking will one day be as necessary\u00a0for efficient citizenship as the ability to read and write.\"[footnote]\u201cWhat is the source of the H.G. Wells quote, \u2018Statistical thinking will one day be as necessary for efficient citizenship as the ability to read and write\/\u201d? Quora<\/em> n.d.[Online]. Available: https:\/\/www.quora.com\/What-is-the-source-of-the-H-G-Wells-quote-Statistical-thinking-will-one-day-be-as-necessary-for-efficient-citizenship-as-the-ability-to-read-and-write<\/a>[\/footnote] The fact that the actual sources of both of these \u201cquotations\u201d are unverifiable makes their sentiments no less true. The\u00a0effective use of statistics can play a critical role in influencing\u00a0public opinion as well as persuading in the workplace. However, as the fame of the first quotation indicates, statistics can be used to mislead rather than accurately inform\u2014whether intentionally or unintentionally.\r\n\r\nWhen evaluating research sources and presenting your own research, be careful to critically evaluate the authority<\/strong>, content<\/strong>, and purpose<\/strong> of the material, using questions in Table 5.2.2<\/strong>.\r\n\r\n\r\n\r\n\r\n\r\n\r\n
TABLE 5.2.2 Evaluate the authority, content, and purpose of information<\/caption>\r\n
[Skip Table<\/a>]\r\n<\/strong><\/td>\r\n<\/tr>\r\n
Authority<\/strong>\r\nResearchers\r\nAuthors\r\nCreators<\/th>\r\n\r\n

Who are the researchers\/authors\/creators? Who is their intended audience?<\/p>\r\n

What are their credentials\/qualifications? What else has this author written?<\/p>\r\n

Is this research funded? By whom? Who benefits?<\/p>\r\n

Who has intellectual ownership of this idea? How do I cite it?<\/p>\r\n

Where is this source published? What kind of publication is it?<\/p>\r\n

Authoritative <\/strong>Sources:<\/strong> written by experts for a specialized audience, published in peer-reviewed journals or by respected publishers, and containing well-supported, evidence-based arguments.<\/p>\r\n

Popular Sources:<\/strong> written for a general (or possibly niche) public audience, often in an informal or journalistic style , published in newspapers, magazines, and websites with a purpose of entertaining or promoting a product; evidence is often \u201csoft\u201d rather than hard.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

\r\n

Content<\/strong><\/p>\r\n<\/th>\r\n

\r\n

Methodology<\/strong><\/p>\r\n

What is the methodology of their study? Or how has evidence been collected?<\/p>\r\n

Is the methodology sound? Can you find obvious flaws?<\/p>\r\n

What is its scope? Does it apply to your project? How?<\/p>\r\n

How recent and relevant is it? What is the publication date or last update?<\/p>\r\n<\/td>\r\n<\/tr>\r\n

\r\n

Data<\/strong><\/p>\r\n

Is there sufficient data here to support their claims or hypotheses?<\/p>\r\n

Do they offer quantitative and\/or qualitative data?<\/p>\r\n

Are visual representations of the data misleading or distorted in some way?<\/p>\r\n<\/td>\r\n<\/tr>\r\n

\r\n

Purpose<\/strong>\r\nIntended Use and Intended Audience<\/p>\r\n<\/th>\r\n

\r\n

Why has this author presented this information to this audience?<\/p>\r\n

Why am I using this source?<\/p>\r\n

Will using this source bolster my credibility or undermine it?<\/p>\r\n

Am I \u201ccherry picking<\/strong>\u201d \u2013 the use of inadequate or unrepresentative data that only supports my position (and ignores substantial amount of data that contradicts it)?<\/p>\r\n

Could \u201ccognitive bias<\/strong>\u201d be at work here? Have I only consulted the kinds of sources I know will support my idea? Have I failed to consider alternative kinds of sources?<\/p>\r\n

Am I representing the data I have collected accurately?<\/p>\r\n

Are the data statistically relevant or significant?<\/p>\r\n<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n<\/a>Given the pie chart in Figure 5.2.2<\/strong>, if you only consulted articles that rejected global warming in a project related to that topic, you would be guilty of cherry picking and cognitive bias.\r\n

\"Pie<\/a>
Figure 5.2.2<\/strong> The number of articles that reject global warming out of all peer-reviewed climate articles within a 21 year time period. [footnote]\u201cWhy climate deniers have no credibility \u2014 in one pie chart,\u201d DeSmog Blog<\/em> [Online]. Available: https:\/\/www.desmogblog.com\/2012\/11\/15\/why-climate-deniers-have-no-credibility-science-one-pie-chart<\/a>[\/footnote]<\/em><\/figcaption><\/figure>\r\n

Beware of Logical Fallacies<\/h1>\r\n

There are many logical fallacies that both writers and readers can fall prey to (see Table 5.2.3<\/strong>). It is important to use data ethically and accurately, and to apply logic correctly and validly to support your ideas.<\/p>\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n
TABLE 5.2.3 Common logical fallacies<\/caption>\r\n
[Skip Table<\/a>]<\/td>\r\n<\/tr>\r\n
Bandwagon Fallacy<\/strong><\/th>\r\n\r\n

Argument from popularity \u2013 \u201ceveryone else is doing it, so we should too!\u201d<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Hasty <\/strong>Generalization<\/strong><\/th>\r\n\r\n

Using insufficient data to come to a general conclusion.<\/p>\r\n

An Australian stole my wallet; therefore, all Australians are thieves!<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Unrepresentative Sample<\/strong><\/th>\r\n\r\n

Using data from a particular subset and generalizing to a larger set that may not share similar characteristics.<\/p>\r\n

e.g.:\u00a0 giving a survey to only female students under 20 and generalizing results to all students<\/em>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

False Dilemma<\/strong><\/th>\r\n\r\n

\u201cEither\/or fallacy\u201d \u2013 presenting only two options when there are usually more possibilities to consider<\/p>\r\n

e.g.:\u00a0 You're either with us or against us.<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Slippery Slope<\/strong><\/th>\r\n\r\n

Claiming that a single cause will lead, eventually, to exaggerated catastrophic results.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Slanted <\/strong>Language<\/strong><\/th>\r\n\r\n

Using language loaded with emotional appeal and either positive or negative connotation to manipulate the reader<\/p>\r\n<\/td>\r\n<\/tr>\r\n

False Analogy<\/strong><\/th>\r\n\r\n

Comparing your idea to another that is familiar to the audience but which may not have sufficient similarity to make an accurate comparison<\/p>\r\n

e.g.:\u00a0Governing a country is like running a business.<\/em><\/p>\r\n<\/td>\r\n<\/tr>\r\n

Post hoc, ergo prompter hoc<\/em><\/strong><\/th>\r\n\r\n

\u201cAfter this; therefore, because of this\u201d<\/p>\r\n

e.g.<\/em>:\u00a0A happened, then B happened; therefore, A caused B<\/em>.<\/p>\r\n

Just because one thing happened first, does not necessarily mean that the first thing caused the second thing.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Begging the Question<\/strong><\/th>\r\n\r\n

Circular argument - assuming the truth of the conclusion by its premises.<\/p>\r\n

e.g<\/em>.<\/em>:\u00a0 I never lie; therefore, I must be telling the truth<\/em>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Ad hominem<\/em><\/strong><\/th>\r\n\r\n

An attack on the person making an argument does not really invalidate that person\u2019s argument. It might make them seem a bit less credible, but it does not dismantle the actual argument or invalidate the data.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Straw Man Argument<\/strong><\/th>\r\n\r\n

Making a \u201cstraw man\u201d argument means restating the opposing idea in an inaccurately absurd or simplistic manner to more easily refute or undermine it.<\/p>\r\n<\/td>\r\n<\/tr>\r\n

Others? <\/strong><\/th>\r\n\r\n

There are many more\u2026 can you think of some?<\/p>\r\n

For a bit of fun, check out Spurious Correlations<\/a>.<\/p>\r\n<\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n

<\/a>We all have biases when we write or argue; however, when evaluating sources, you want to be on the look out for bias that is unfair, one-sided, or slanted. Consider whether the author has acknowledged and addressed opposing ideas, potential gaps in the research, or limits of the data. Look at the kind of language the author uses: is it slanted, strongly connotative, or emotionally manipulative? Is the supporting evidence presented logically, credibly, and ethically? Has the author cherry-picked or misrepresented sources or ideas? Does the author rely heavily on emotional appeal?<\/p>\r\n\r\n

\r\n
\r\n\r\nCritical thinking<\/a> lies at the heart of evaluating sources. You want to be rigorous in your selection of evidence, because once you use it in your paper, it will either bolster your own credibility or undermine it.\r\n\r\n<\/div>\r\n<\/div>","rendered":"

In this \u201cinformation age\u201d when so much information is available at our fingertips on the Internet, it is crucial to be able to critically search through the reams of information in order to select credible<\/em> sources that can provide reliable and useful<\/em> data to support your ideas and convince your audience. In the era of \u201cfake news,\u201d deliberate misinformation, and \u201calternative facts,\u201d developing the skill to evaluate the credibility of sources is critical.<\/p>\n

From your previous academic writing course, you are familiar with academic journals and how they differ from popular sources, as in Figure 5.2.1<\/strong>. If you would like to refresh your memory on this, watch UVic library’s video on Scholarly and Popular Sources<\/a>. These contain peer-reviewed articles written by scholars, often presenting their original research, reviewing the original research of others, or performing a \u201cmeta-analysis\u201d (an analysis of multiple studies that analyze a given topic).<\/p>\n

\"Magazines
Figure 5.2.1<\/strong> Examples of Popular vs Scholarly Sources.<\/em>[1]<\/sup><\/a><\/figcaption><\/figure>\n

Scholarly articles published in academic journals are usually required sources in academic research essays; they are also an integral part of engineering projects and technical reports. Many projects require a literature review<\/a><\/strong>, which collects, summarizes and sometimes evaluates the work of researchers in this field whose work has been recognized as a valuable contribution to the “state of the art.” However, they are not the only kind of research you will find useful. Since you are researching in a professional field and preparing for the workplace, there are many credible kinds of sources you will draw on in a professional context. Table 5.2.1<\/strong> lists several types of sources you may find useful in researching your projects.<\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
TABLE 5.2.1 Typical research sources for technical projects<\/caption>\n
[Skip Table<\/a>]
\n<\/strong><\/td>\n<\/tr>\n
Source Type<\/strong><\/th>\nDescription<\/strong><\/th>\n<\/tr>\n
Academic Journals, Conference Papers, Dissertations, etc.<\/strong><\/th>\n\n

Scholarly (peer-reviewed) academic sources publish primary research done by professional researchers and scholars in specialized fields, as well as reviews of that research by other specialists in the same field.<\/p>\n

For example, the Journal of Computer and System Sciences<\/em> publishes original research papers in computer science and related subjects in system science; International Journal of Robotics and Animation<\/em> is one of the most highly ranked journals in the field.<\/p>\n<\/td>\n<\/tr>\n

Reference Works<\/strong><\/th>\n\n

Specialized encyclopaedias, handbooks and dictionaries can provide useful terminology and background information.<\/p>\n

For example, the Kirk-Othmer Encyclopedia of Chemical Technology<\/em> is a widely recognized authoritative source.<\/p>\n

Do not<\/strong> cite Wikipedia<\/em> or dictionary.com<\/em> in a technical report.<\/p>\n<\/td>\n<\/tr>\n

Books<\/strong><\/p>\n

Chapters in Books<\/strong><\/th>\n

\n

Books written by specialists in a given field and contain a References section can be very helpful in providing in-depth context for your ideas.<\/p>\n

For example, Designing Engineers<\/em> by Susan McCahan et al. has an excellent chapter on effective teamwork<\/p>\n<\/td>\n<\/tr>\n

Trade Magazines and Popular Science Magazines<\/strong><\/th>\n\n

Reputable trade magazines contain articles relating to current issues and innovations, and therefore they can be very useful in determining the \u201cstate of the art\u201d or what is \u201ccutting edge\u201d at the moment, or finding out what current issues or controversies are affecting the industry.<\/p>\n

Examples include Computerworld<\/em>, Wired<\/em>, and Popular Mechanics<\/em>.<\/p>\n<\/td>\n<\/tr>\n

Newspapers <\/strong>(Journalism)<\/th>\n\n

Newspaper articles and media releases can offer a sense of what journalists and people in industry think the general public should know about a given topic. Journalists report on current events and recent innovations; more in-depth \u201cinvestigative journalism\u201d explores a current issue in greater detail. Newspapers also contain editorial sections that provide personal opinions on these events and issues.<\/p>\n

Choose well-known, reputable newspapers such as The New York Times<\/em>.<\/p>\n<\/td>\n<\/tr>\n

Industry Websites <\/strong>(.com)<\/th>\n\n

Commercial websites are generally intended to \u201csell,\u201d so you have to select information carefully, but these websites can give you insights into a company\u2019s \u201cmission statement,\u201d organization, strategic plan, current or planned projects, archived information, White Papers, technical reports, product details, costs estimates, etc.<\/em><\/p>\n<\/td>\n<\/tr>\n

Organization Websites<\/strong> (.org)<\/th>\n\n

A vast array of .org sites can be very helpful in supplying data and information. These are often public service<\/strong> sites and are designed to share information with the public.<\/p>\n<\/td>\n<\/tr>\n

Government Publications and Public Sector Web Sites <\/strong>(.gov\/.edu\/.ca)<\/th>\n\n

Government departments often publish reports and other documents that can be very helpful in determining public policy, regulations, and guidelines that should be followed.<\/p>\n

Statistics Canada<\/em><\/a>,[2]<\/sup><\/a> for example, publishes a wide range of data.<\/p>\n

University web sites also offer a wide array of non-academic information, such as strategic plans, facilities information, etc.<\/em><\/p>\n<\/td>\n<\/tr>\n

Patents<\/strong><\/th>\n\n

You may have to distinguish your innovative idea from previously patented ideas; you can look these up and get detailed information on patented or patent-pending ideas.<\/p>\n<\/td>\n<\/tr>\n

Public Presentations<\/strong><\/th>\n\n

Public Consultation meetings and representatives from industry and government speak to various audiences about current issues and proposed projects. These can be live presentations or video presentations available on YouTube<\/strong> or TED talks<\/strong>.<\/p>\n<\/td>\n<\/tr>\n

Other<\/strong><\/th>\n\n

Can you think of some more? (Radio programs, Podcasts, Social Media, etc.<\/em>)<\/p>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

<\/a>The importance of critically evaluating your sources for authority, relevance, timeliness, and credibility cannot be overstated. <\/span>Anyone can put anything on the internet<\/em>; and people with strong web and document design skills can make this information look very professional and credible\u2014even if it isn’t. Since much research is currently done online, and many sources are available electronically, developing your critical evaluation skills is crucial to finding valid, credible evidence to support and develop your ideas.\u00a0 In fact, this has become such a challenging issue that there are sites like this <\/span>List of Predatory Journals<\/a> that regularly update its online list of journals that subvert the peer review process and simply publish for profit.
\n<\/span><\/p>\n

Review your understanding of research sources with this H5P interactivity.<\/p>\n

\n