In this “information age” when so much information is available at our fingertips on the Internet, it is crucial to be able to critically search through the reams of information in order to select credible sources that can provide reliable and useful data to support your ideas and convince your audience. In the era of “fake news,” deliberate misinformation, AI generated “deep fakes” and hallucinations, developing the skill to evaluate the credibility of sources is critical.

In your studies so far, you have likely been expected to read academic articles and understand how they differ from popular sources: they have different audiences who read for different purposes and expect different kinds of content and use of conventions.  Academic journals contain peer-reviewed articles written by scholars, often presenting their original research, reviewing the original research of others, or performing a “meta-analysis” (an analysis of multiple studies on a given topic).

Scholarly articles published in academic journals are usually required sources in academic research essays; they are also an integral part of engineering and business projects, as well as technical reports. Many projects require a literature review, which collects, summarizes and sometimes evaluates the work of researchers in this field whose work has been recognized as a valuable contribution to the “state of the art.” However, they are not the only kind of research you will find useful. Since you are researching in a professional field and preparing for the workplace, there are many credible kinds of sources you will draw on in a professional context. Table 5.3.1 lists several types of sources you may find useful in researching your projects.

Where to Look?

Researchers often use a variety of tools, depending on the type of research they want to do. Broad interdisciplinary search engines such as Google and Google scholar can be helpful in many cases, but in some instances, you may need to use more targeted tools like subject-specific databases.

The more specialized your search, the more likely you are to find credible research done by reliable expert researchers and professionals. Consulting a librarian is an effective step in your research process.  Librarians are experts in many of the fields you might be studying and can help you develop useful search terms and direct you to relevant data bases likely to hold the information your are searching for.

Evaluating Sources for Credibility

The importance of critically evaluating your sources for authority, relevance, timeliness, and credibility cannot be overstated. Anyone can put anything on the internet; and people with strong web and document design skills can make this information look very professional and credible—even if it isn’t. And as noted in Ch. 1.4, Gen AI is known for confidently producing inaccurate information and fabricating sources. Since much research is currently done online, and many sources are available electronically, developing your critical evaluation skills is crucial to finding valid, credible evidence to support and develop your ideas. Hana Lee Goldin’s “How to Spot AI Hallucinations like a Reference Librarian” should be considered required reading! 

H.G. Wells has been (mis)quoted as stating, “statistical thinking will one day be as necessary for efficient citizenship as the ability to read and write.”^[3] On the other hand, Mark Twain (supposedly quoting British Prime Minister Benjamin Disraeli) famously said, “There are three kinds of lies: lies, damned lies, and statistics.”  The fact that the actual sources of both of these “quotations” are unverifiable makes their sentiments no less true. The effective use of statistics can play a critical role in influencing public opinion as well as persuading in the workplace. However, as the fame of the second quotation indicates, statistics can be used to mislead rather than accurately inform—whether intentionally or unintentionally.

When evaluating research sources and presenting your own research, be careful to critically evaluate its authority, purpose content, and currency. 

Also evaluate your own process in selecting and using research sources:

• Why am I using this source? will it bolster the credibility of my argument?
• Am I “cherry picking” by using inadequate or unrepresentative data that only supports my position (and ignores substantial amount of data that contradicts it)?
• Could “cognitive bias” be at work here? Have I only consulted the kinds of sources I know will support my idea? Have I failed to consider alternative kinds of sources?
• Am I representing the data I have collected accurately?
• Are the data statistically relevant or significant to my argument?

Given the pie chart in Figure 5.3.3, if you only consulted articles that rejected global warming in a project related to the issue of climate change, you could be guilty of cherry picking and cognitive bias.

Beware of Logical Fallacies

There are many logical fallacies that both writers and readers can fall prey to (see Table 5.3.1). It is important to use data ethically and accurately, and to apply logic correctly and validly to support your ideas.

We all have biases when we write or argue; however, when evaluating sources, you want to be on the look out for bias that is unfair, one-sided, or discriminatory. Consider whether the author has acknowledged and addressed opposing ideas, potential gaps in the research, or limitations of the data. Look at the kind of language the author uses: is it slanted, strongly connotative, or emotionally manipulative? Is the supporting evidence presented logically, credibly, and ethically? Or has the author cherry-picked or misrepresented sources or ideas? Does the author rely heavily on emotional appeal?