Glossary

Categories that we use that are determined ahead of time, based on existing literature/knowledge.

a summary of the main points of an article

whether you can actually reach people or documents needed to complete your project

The idea that researchers are responsible for conducting research that is ethical, honest, and following accepted research practices.

In a measure, when people say yes to whatever the researcher asks, even when doing so contradicts previous answers.

research that is conducted for the purpose of creating social change

Research methodologies that center and affirm African cultures, knowledge, beliefs, and values. 

In nonequivalent comparison group designs, the process in which researchers match the population profile of the comparison and experimental groups.

what a researcher hopes to accomplish with their study

A type of reliability in which multiple forms of a tool yield the same results from the same participants.

the process of writing notes on an article

The identity of the person providing data cannot be connected to the data provided at any time in the research process, by anyone.

A statistical method to examine how a dependent variable changes as the value of a categorical independent variable changes

The potential for qualitative research findings to be applicable to other situations or with other people outside of the research study itself.

a statement about what you think is true backed up by evidence and critical thinking

Artifacts are a source of data for qualitative researcher that exist in some form already, without the research having to create it. They represent a very broad category that can range from print media, to clothing, to tools, to art, to live performances.

Comparable to the informed consent for BUT this is for children who are old enough to understand and make a decision about a research project.

The characteristics we assume about our data, like that it is normally distributed, that makes it suitable for certain types of statistical tests

The characteristics that make up a variable

An audit trail is a system of documenting in qualitative research analysis that allows you to link your final results with your original raw data. Using an audit trail, an independent researcher should be able to start with your results and trace the research process backwards to the raw data. This helps to strengthen the trustworthiness of the research.

For the purposes of research, authenticity means that we do not misrepresent ourselves, our interests or our research; we are genuine in our interactions with participants and other colleagues.

researcher gathers data from whatever cases happen to be convenient or available

Axial coding is phase of qualitative analysis in which the research will revisit the open codes and identify connections between codes, thereby beginning to group codes that share a relationship.

assumptions about the role of values in research

One of the three values indicated in the Belmont report. An obligation to protect people from harm by maximizing benefits and minimizing risks.

Biases are conscious or subconscious preferences that lead us to favor some things over others.

A distribution with two distinct peaks when represented on a histogram.

a group of statistical techniques that examines the relationship between two variables

A qualitative research technique where the researcher attempts to capture and track their subjective assumptions during the research process. * note, there are other definitions of bracketing, but this is the most widely used.

An acronym, BRUSO for writing questions in survey research. The letters stand for: “brief,” “relevant,” “unambiguous,” “specific,” and “objective.”

Case studies are a type of qualitative research design that focus on a defined case and gathers data to provide a very rich, full understanding of that case. It usually involves gathering data from multiple different sources to get a well-rounded case description.

variables whose values are organized into mutually exclusive groups but whose numerical values cannot be used in mathematical operations.

the idea that one event, behavior, or belief will result in the occurrence of another, subsequent event, behavior, or belief

a statistical test to determine whether there is a significant relationship between two categorical variables

Statistical tool used to asses the internal consistency of an instrument. See also split-half approach.

questions in which the researcher provides all of the response options

a sampling approach that begins by sampling groups (or clusters) of population elements and then selects elements from within those groups

A code is a label that we place on segment of data that seems to represent the main idea of that segment.

A document that we use to keep track of and define the codes that we have identified (or are using) in our qualitative data analysis.

Part of the qualitative data analysis process where we begin to interpret and assign meaning to the data.

When a participant faces undue or excess pressure to participate by either favorable or unfavorable means, this is known as coercion and must be avoided by researchers

predictable flaws in thinking

A type of longitudinal design where participants are selected because of a defining characteristic that the researcher is interested in studying. The same people don’t necessarily participate from year to year, but all participants must meet whatever categorical criteria fulfill the researcher’s primary interest.

Common method bias refers to the amount of spurious covariance shared between independent and dependent variables that are measured at the same point in time.

Someone who has the formal or informal authority to grant permission or access to a particular community.

the group of participants in our study who do not receive the intervention we are researching in experiments without random assignment

measurements of variables based on more than one one indicator

These are software tools that can aid qualitative researchers in managing, organizing and manipulating/analyzing their data.

A mental image that summarizes a set of similar observations, feelings, or ideas

a network of linked concepts that together provide a comprehensive understanding of a phenomenon

developing clear, concise definitions for the key concepts in a research question

A type of criterion validity. Examines how well a tool provides the same scores as an already existing tool administered at the same point in time.

The different levels of the independent variable in an experimental design.

a range of values in which the true value is likely to be, to provide a more accurate description of their data

For research purposes, confidentiality means that only members of the research team have access potentially identifiable information that could be associated with participant data. According to confidentiality, it is the research team's responsibility to restrict access to this information by other parties, including the public.

observing and analyzing information in a way that agrees with what you already think is true and excludes other alternatives

Conflicting allegiances.

a variable whose influence makes it difficult to understand the relationship between an independent and dependent variable

Consistency is the idea that we use a systematic (and potentially repeatable) process when conducting our research.

a characteristic that does not change in a study

Constant comparison reflects the motion that takes place in some qualitative analysis approaches whereby the researcher moves back and forth between the data and the emerging categories and evolving understanding they have in their results. They are continually checking what they believed to be the results against the raw data they are working with.

"when the construct measured is not identical across cultures or when behaviors that characterize the construct are not identical across cultures" (Meiring et al., 2005, p. 2)

Constructivist research is a qualitative design that seeks to develop a deep understanding of the meaning that people attach to events, experiences, or phenomena.

Conditions that are not directly observable and represent states of being, experiences, and ideas.

Content is the substance of the artifact (e.g. the words, picture, scene). It is what can actually be observed.

An approach to data analysis that seeks to identify patterns, trends, or ideas across qualitative data through processes of coding and categorization.

The extent to which a measure “covers” the construct of interest, i.e., it's comprehensiveness to measure the construct.

Context is the circumstances surrounding an artifact, event, or experience.

unintended influences on respondents’ answers because they are not related to the content of the item but to the context in which the item appears.

Research findings are applicable to the group of people who contributed to the knowledge building and the situation in which it took place.

a visual representation of across-tabulation of categorical variables to demonstrate all the possible occurrences of categories

required courses clinical practitioners must take in order to remain current with licensure

variables whose values are mutually exclusive and can be used in mathematical operations

In research design and statistics, a series of methods that allow researchers to minimize the effect of an extraneous variable on the dependent variable in their project.

the group of participants in our study who do not receive the intervention we are researching in experiments with random assignment

a confounding variable whose effects are accounted for mathematically in quantitative analysis to isolate the relationship between an independent and dependent variable

A convenience sample is formed by collecting data from those people or other relevant elements to which we have the most convenient access. Essentially, we take who we can get.

a relationship between two variables in which their values change together.

a statistically derived value between -1 and 1 that tells us the magnitude and direction of the relationship between two variables

when the values of two variables change at the same time

In qualitative data, coverage refers to the amount of data that can be categorized or sorted using the code structure that we are using (or have developed) in our study. With qualitative research, our aim is to have good coverage with our code structure.

The extent to which people’s scores on a measure are correlated with other variables (known as criteria) that one would expect them to be correlated with.

engaging with "the social, political, economic, and corporate systems that have power and influence over information production, dissemination, access, and consumption” (Gregory & Higgins, 2013, p.ix)

a paradigm in social science research focused on power, inequality, and social change

When a researcher collects data only once from participants using a questionnaire

spurious covariance between your independent and dependent variables that is in fact caused by systematic error introduced by culturally insensitive or incompetent research practices

the concept that scores obtained from a measure are similar when employed in different cultural populations

Research that portrays groups of people or communities as flawed, surrounded by problems, or incapable of producing change. 

An ordered outline that includes your research question, a description of the data you are going to use to answer it, and the exact analyses, step-by-step, that you plan to run to answer your research question.

A plan that is developed by a researcher, prior to commencing a research project, that details how data will be collected, stored and managed during the research project.

This is the document where you list your variable names, what the variables actually measure or represent, what each of the values of the variable mean if the meaning isn't obvious.

A data matrix is a tool used by researchers to track and organize data and findings during qualitative analysis.

Including data from multiple sources to help enhance your understanding of a topic

a searchable collection of information

A statement at the end of data collection (e.g. at the end of a survey or interview) that generally thanks participants and reminds them what the research was about, what it's purpose is, resources available to them if they need them, and contact information for the researcher if they have questions or concerns.

A decision-rule provides information on how the researcher determines what code should be placed on an item, especially when codes may be similar in nature.

Research methods that reclaim control over indigenous ways of knowing and being.

The act of breaking piece of qualitative data apart during the analysis process to discern meaning and ultimately, the results of the study.

The type of research in which a specific expectation is deduced from a general premise and then tested

An approach to data analysis in which the researchers begins their analysis using a theory to see if their data fits within this theoretical framework (tests the theory).

starts by reading existing theories, then testing hypotheses and revising or confirming the theory

a variable that depends on changes in the independent variable

research that describes or defines a particular phenomenon

A technique for summarizing and presenting data.

Participants are asked to select one of two possible choices, such as true/false, yes/no, or agree/disagree.

Participants are asked to select one of two possible choices, such as true/false, yes/no, or agree/disagree.

Having the ability to make decisions for yourself limited

Occurs when two variables move together in the same direction - as one increases, so does the other, or, as one decreases, so does the other

an academic field, like social work

Variables with finite value choices.

The extent to which scores on a measure are not correlated with measures of variables that are conceptually distinct.

“a planned process that involves consideration of target audiences and the settings in which research findings are to be received and, where appropriate, communicating and interacting with wider policy and…service audiences in ways that will facilitate research uptake in decision-making processes and practice” (Wilson, Petticrew, Calnan, & Natareth, 2010, p. 91)

how you plan to share your research findings

How you plan to share your research findings

the way the scores are distributed across the levels of that variable.

The analysis of documents (or other existing artifacts) as a source of data.

a question that asks more than one thing at a time, making it difficult to respond accurately

A combination of two people or objects

the units in your sampling frame, usually people or documents

Emergent design is the idea that some decision in our research design will be dynamic and change as our understanding of the research question evolves as we go through the research process. This is (often) evident in qualitative research, but rare in quantitative research.

in mixed methods research, this refers to the order in which each method is used, either concurrently or sequentially

report the results of a quantitative or qualitative data analysis conducted by the author

information about the social world gathered and analyzed through scientific observation or experimentation

research questions that can be answered by systematically observing the real world

when someone is treated unfairly in their capacity to know something or describe their experience of the world

assumptions about how we come to know what is real and true

A general approach to research that is conscientious of the dynamics of power and control created by the act of research and attempts to actively address these dynamics through the process and outcomes of research.

Often the end result of a phenomological study, this is a description of the lived experience of the phenomenon being studied.

unsuitable research questions which are not answerable by systematic observation of the real world but instead rely on moral or philosophical opinions

Ethnography is a qualitative research design that is used when we are attempting to learn about a culture by observing people in their natural environment.

research that evaluates the outcomes of a policy or program

a process composed of "four equally weighted parts: 1) current client needs and situation, (2) the best relevant research evidence, (3) client values and preferences, and (4) the clinician’s expertise" (Drisko & Grady, 2015, p. 275)

After the fact

characteristics that disqualify a person from being included in a sample

Exempt review is the lowest level of review. Studies that are considered exempt expose participants to the least potential for harm and often involve little participation by human subjects.

Exhaustive categories are options for closed ended questions that allow for every possible response (no one should feel like they can't find the answer for them).

Expanded field notes represents the field notes that we have taken during data collection after we have had time to sit down and add details to them that we were not able to capture immediately at the point of collection.

Expedited review is the middle level of review. Studies considered under expedited review do not have to go before the full IRB board because they expose participants to minimal risk. However, the studies must be thoroughly reviewed by a member of the IRB committee.

an operation or procedure carried out under controlled conditions in order to discover an unknown effect or law, to test or establish a hypothesis, or to illustrate a known law.

Refers to research that is designed specifically to answer the question of whether there is a causal relationship between two variables.

in experimental design, the group of participants in our study who do receive the intervention we are researching

explains why particular phenomena work in the way that they do; answers “why” questions

conducted during the early stages of a project, usually when a researcher wants to test the feasibility of conducting a more extensive study or if the topic has not been studied in the past

Having an objective person, someone not connected to your study, try to start with your findings and trace them back to your raw data using your audit trail. A tool to help demonstrate rigor in qualitative research.

This is a synonymous term for generalizability - the ability to apply the findings of a study beyond the sample to a broader population.

variables and characteristics that have an effect on your outcome, but aren't the primary variable whose influence you're interested in testing.

A purposive sampling strategy that selects a case(s) that represent extreme or underrepresented perspectives. It is a way of intentionally focusing on or representing voices that may not often be heard or given emphasis.

The extent to which a measurement method appears “on its face” to measure the construct of interest

when a measure does not indicate the presence of a phenomenon, when in reality it is present

when a measure indicates the presence of a phenomenon, when in reality it is not present

whether you can practically and ethically complete the research project you propose

Research methods in this tradition seek to, "remove the power imbalance between research and subject; (are) politically motivated in that (they) seeks to change social inequality; and (they) begin with the standpoints and experiences of women".^[1]

respondents to a survey who choose neutral response options, even if they have an opinion

Notes that are taken by the researcher while we are in the field, gathering data.

Questions that screen out/identify a certain type of respondent, usually to direct them to a certain part of the survey.

items on a questionnaire designed to identify some subset of survey respondents who are asked additional questions that are not relevant to the entire sample

respondents to a survey who choose a substantive answer to a question when really, they don’t understand the question or don’t have an opinion

Type of interview where participants answer questions in a group.

A document that will outline the instructions for conducting your focus group, including the questions you will ask participants. It often concludes with a debriefing statement for the group, as well.

A form of data gathering where researchers ask a group of participants to respond to a series of (mostly open-ended) questions.

Deliberate actions taken to impact a research project. For example deliberately falsifying data, plagiarism, not being truthful about the methodology, etc.

A table that lays out how many cases fall into each level of a varible.

A full board review will involve multiple members of the IRB evaluating your proposal. When researchers submit a proposal under full board review, the full IRB board will meet, discuss any questions or concerns with the study, invite the researcher to answer questions and defend their proposal, and vote to approve the study or send it back for revision. Full board proposals pose greater than minimal risk to participants. They may also involve the participation of vulnerable populations, or people who need additional protection from the IRB.

the people or organizations who control access to the population you want to study

The ability to apply research findings beyond the study sample to some broader population,

Findings form a research study that apply to larger group of people (beyond the sample). Producing generalizable findings requires starting with a representative sample.

(as in generalization) to make claims about a large population based on a smaller sample of people or items

research reports released by non-commercial publishers, such as government agencies, policy organizations, and think-tanks

A type of research design that is often used to study a process or identify a theory about how something works.

A form of qualitative analysis that aims to develop a theory or understanding of how some event or series of events occurs by closely examining
participant knowledge and experience of that event(s).

A composite scale using a series of items arranged in increasing order of intensity of the construct of interest, from least intense to most intense.

The quality of or the amount of difference or variation in data or research participants.

a graphical display of a distribution.

The quality of or the amount of similarity or consistency in data or research participants.

As researchers in the social science, we ourselves are the main tool for conducting our studies.

The US Department of Health and Human Services (USDHHS) defines a human subject as “a living individual about whom an investigator (whether professional or student) conducting research obtains (1) data through intervention or interaction with the individual, or (2) identifiable private information” (USDHHS, 1993, para. 1). [2]

a statement describing a researcher’s expectation regarding what they anticipate finding

A cyclical process of theory development, starting with an observed phenomenon, then developing or using a theory to make a specific prediction of what should happen if that theory is correct, testing that prediction, refining the theory in light of the findings, and using that refined theory to develop new hypotheses, and so on.

attempts to explain or describe your phenomenon exhaustively, based on the subjective understandings of your participants

A rich, deep, detailed understanding of a unique person, small group, and/or set of circumstances.

Tthe long-term condition that occurs at the end of a defined time period after an intervention.

The scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and, hence, to improve the quality and effectiveness of health services.

the impact your study will have on participants, communities, scientific knowledge, and social justice

Inclusion criteria are general requirements a person must possess to be a part of your sample.

causes a change in the dependent variable

a composite score derived from aggregating measures of multiple concepts (called components) using a set of rules and formulas

Clues that demonstrate the presence, intensity, or other aspects of a concept in the real world

In measurement, conditions that are subtle and complex that we must use existing knowledge and intuition to define.

In nonequivalent comparison group designs, the process by which researchers match individual cases in the experimental group to similar cases in the comparison group.

inductive reasoning draws conclusions from individual observations

An approach to data analysis in which we gather our data first and then generate a theory about its meaning through our analysis.

when a researcher starts with a set of observations and then moves from particular experiences to a more general set of propositions about those experiences

"a set of abilities requiring individuals to 'recognize when information is needed and have the ability to locate, evaluate, and use effectively the needed information" (American Library Association, 2020)

the accumulation of special rights and advantages not available to others in the area of information access

A process through which the researcher explains the research process, procedures, risks and benefits to a potential participant, usually through a written document, which the participant than signs, as evidence of their agreement to participate.

an administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated

The consistency of people’s responses across the items on a multiple-item measure. Responses about the same underlying construct should be correlated, though not perfectly.

Ability to say that one variable "causes" something to happen to another variable. Very important to assess when thinking about studies that examine causation such as experimental or quasi-experimental designs.

a paradigm based on the idea that social context and interaction frame our realities

The extent to which different observers are consistent in their assessment or rating of a particular characteristic or item.

the various aspects or dimensions that come together in forming our identity

A level of measurement that is continuous, can be rank ordered, is exhaustive and mutually exclusive, and for which the distance between attributes is known to be equal. But for which there is no zero point.

An interview guide is a document that outlines the flow of information during your interview, including a greeting and introduction to orient your participant to the topic, your questions and any probes, and any debriefing statement you might include. If you are part of a research team, your interview guide may also include instructions for the interviewer if certain things are brought up in the interview or as general guidance.

A questionnaire that is read to respondents

any possible changes in interviewee responses based on how or when the researcher presents question-and-answer options

A form of data gathering where researchers ask individual participants to respond to a series of (mostly open-ended) questions.

Type of reliability in which a rater rates something the same way on two different occasions.

a “gut feeling” about what to do based on previous experience

yer gut feelin'

occurs when two variables change in opposite directions - one goes up, the other goes down and vice versa

when the order in which the items are presented affects people’s responses

An iterative approach means that after planning and once we begin collecting data, we begin analyzing as data as it is coming in.  This early analysis of our (incomplete) data, then impacts our planning, ongoing data gathering and future analysis as it progresses.

a nonlinear process in which the original product is revised over and over again to improve it

One of the three ethical principles in the Belmont Report. States that benefits and burdens of research should be distributed fairly.

Someone who is especially knowledgeable about a topic being studied.

the words or phrases in your search query

When a participant's answer to a question is altered due to the way in which a question is written. In essence, the question leads the participant to answer in a specific way.

The level that describes the type of operations can be conducted with your data. There are four nominal, ordinal, interval, and ratio.

measuring people’s attitude toward something by assessing their level of agreement with several statements about it

A research process where you create a plan, you gather your data, you analyze your data and each step is completed before you proceed to the next.

a statistical technique that can be used to predict how an independent variable affects a dependent variable in the context of other variables.

A science that deals with the principles and criteria of validity of inference and demonstration: the science of the formal principles of reasoning.

A graphic depiction (road map) that presents the shared relationships among the resources, activities, outputs, outcomes, and impact for your program

Researcher collects data from participants at multiple points over an extended period of time using a questionnaire.

examining social structures and institutions

The strength of a correlation, determined by the absolute value of a correlation coefficient

a type of survey question that lists a set of questions for which the response options are all the same in a grid layout

A purposive sampling strategy where you choose cases because they represent a range of very different perspectives on a topic

Also called the average, the mean is calculated by adding all your cases and dividing the total by the number of cases.

One number that can give you an idea about the distribution of your data.

The process by which we describe and ascribe meaning to the key facts, concepts, or other phenomena under investigation in a research study.

The differerence between that value that we get when we measure something and the true value

Instrument or tool that operationalizes (measures) the concept that you are studying.

The value in the middle when all our values are placed in numerical order. Also called the 50th percentile.

Member checking involves taking your results back to participants to see if we "got it right" in our analysis. While our findings bring together many different peoples' data into one set of findings, participants should still be able to recognize their input and feel like their ideas and experiences have been captured adequately.

approach to recruitment where participants are members of an organization or social group with identified membership

Memoing is the act of recording your thoughts, reactions, quandaries as you are reviewing the data you are gathering.

A written agreement between parties that want to participate in a collaborative project.

examining interaction between groups and within communities

a study that combines raw data from multiple quantitative studies and analyzes the pooled data using statistics

a study that combines primary data from multiple qualitative sources and analyzes the pooled data

an explanation of why you chose the specific design of your study; why do your chosen methods fit with the aim of your research

A description of how research is conducted.

examining the smallest levels of interaction, usually individuals

Usually unintentional. Very broad category that covers things such as not using the proper statistics for analysis, injecting bias into your study and in interpreting results, being careless with your research methodology

when researchers use both quantitative and qualitative methods in a project

The most commonly occurring value of a variable.

concepts that are comprised of multiple elements

An empirical structure for measuring items or indicators of the multiple dimensions of a concept.

A group of statistical techniques that examines the relationship between at least three variables

Mutually exclusive categories are options for closed ended questions that do not overlap, so people only fit into one category or another, not both.

Those stories that we compose as human beings that allow us to make meaning of our experiences and the world around us

US legislation passed In 1974, which created the National Commission for the Protection of Human Subjects in Biomedical and Behavioral Research, which went on to produce The Belmont Report.

collecting data in the field where it naturally/normally occurs

Making qualitative observations that attempt to capture the subjects of the observation as unobtrusively as possible and with limited structure to the observation.

Including data that contrasts, contradicts, or challenges the majority of evidence that we have found or expect to find

occurs when two variables change in opposite directions - one goes up, the other goes down and vice versa

ensuring that we have correctly captured and reflected an accurate understanding in our findings by clarifying and verifying our findings with our participants

The idea that qualitative researchers attempt to limit or at the very least account for their own biases, motivations, interests and opinions during the research process.

The lowest level of measurement; categories cannot be mathematically ranked, though they are exhaustive and mutually exclusive

provides a more general, sweeping explanation that is universally true for all people

sampling approaches for which a person’s likelihood of being selected for membership in the sample is unknown

Referring to data analysis that doesn't examine how variables relate to each other.

If the majority of the targeted respondents fail to respond to a survey, then a legitimate concern is whether non-respondents are not responding due to a systematic reason, which may raise questions about the validity of the study’s results, especially as this relates to the representativeness of the sample.

The bias that occurs when those who respond to your request to participate in a study are different from those who do not respond to you request to participate in a study.

Simplified, a normal distribution of data occurs when the mean, mode and median are all equal; the distribution of value is symmetric at the center (around the mean); and exactly half of the values are found to the left of the mean (lower) and exactly half the values are to the right of the mean (higher). Given a large enough sample, many measures fall naturally into this patter (like height, age, and weight).

the assumption that no relationship exists between the variables in question

The Nuremberg Code is a 10-point set of research principles designed to guide doctors and scientists who conduct research on human subjects, crafted in response to the atrocities committed during the Holocaust.

a single truth, observed without bias, that is universally applicable

Observation is a tool for data gathering where researchers rely on their own senses (e.g. sight, sound) to gather information on a topic.

In measurement, conditions that are easy to identify and verify through direct observation.

The rows in your data set. In social work, these are often your study participants (people), but can be anything from census tracts to black bears to trains.

including more than one member of your research team to aid in analyzing the data

The federal government agency that oversees IRBs.

a statistical procedure to compare the means of a variable across three or more groups

assumptions about what is real and true

journal articles that are made freely available by the publisher

An initial phase of coding that involves reviewing the data to determine the preliminary ideas that seem important and potential labels that reflect their significance.  

sharing one's data and methods for the purposes of replication, verifiability, and collaboration of findings

Questions for which the researcher does not include response options, allowing for respondents to answer the question in their own words

The concrete and specific defintion of something in terms of the operations by which observations can be categorized.

process by which researchers spell out precisely how a concept will be measured in their study

Oral histories are a type of qualitative research design that offers a detailed accounting of a person's life, some event, or experience. This story(ies) is aimed at answering a specific research question.

verbal presentation of research findings to a conference audience

Level of measurement that follows nominal level. Has mutually exclusive categories and a hierarchy (rank order), but we cannot calculate a mathematical distance between attributes.

The final condition that occurs at the end of an intervention or program.

Extreme values in your data.

summarizes the incompatibility between a particular set of data and a proposed model for the data, usually the null hypothesis. The lower the p-value, the more inconsistent the data are with the null hypothesis, indicating that the relationship is statistically significant.

group presentations that feature experts on a given issue, with time for audience question-and-answer

A type of longitudinal design where the researchers gather data at multiple points in time and the same people participate in the survey each time it is administered.

a set of common philosophical (ontological, epistemological, and axiological) assumptions that inform research

Those who are asked to contribute data in a research study; sometimes called respondents or subjects.

An approach to research that more intentionally attempts to involve community members throughout the research process compared to more traditional research methods. In addition, participatory approaches often seek some concrete, tangible change for the benefit of the community (often defined by the community).

when a publisher prevents access to reading content unless the user pays money

A qualitative research tool for enhancing rigor by partnering with a peer researcher who is not connected with your project (therefore more objective), to discuss project details, your decision, perhaps your reflexive journal, as a means of helping to reduce researcher bias and maintain consistency and transparency in the research process.

a formal process in which other esteemed researchers and experts ensure your work meets the standards and expectations of the professional field

trade publications, magazines, and newspapers

the tendency for a pattern to occur at regular intervals

A qualitative research design that aims to capture and describe the lived experience of some event or "phenomenon" for a group of people.

Photovoice is a technique that merges pictures with narrative (word or voice data that helps that interpret the meaning or significance of the visual artifact. It is often used as a tool in CBPR.

Testing out your research materials in advance on people who are not included as participants in your study.

as a criteria for causal relationship, the relationship must make logical sense and seem possible

A purposive sampling strategy that focuses on selecting cases that are important in representing a contemporary politicized issue.

the larger group of people you want to be able to make conclusions about based on the conclusions you draw from the people in your sample

A statement about the researchers worldview and life experiences, specifically in respect to the research topic they are studying. It helps to demonstrate the subjective connection(s) the researcher has to the topic and is a way to encourage transparency in research.

Occurs when two variables move together in the same direction - as one increases, so does the other, or, as one decreases, so does the other

a paradigm guided by the principles of objectivity, knowability, and deductive logic

A measure of a participant's condition after an intervention or, if they are part of the control/comparison group, at the end of an experiment.

an experimental design in which participants are randomly assigned to control and treatment groups, one group receives an intervention, and both groups receive only a post-test assessment

presentations that use a poster to visually represent the elements of the study

the odds you will detect a significant relationship between variables when one is truly present in your sample

describe “how things are done” or comment on pressing issues in practice (Wallace & Wray, 2016, p. 20)

How well your findings can be translated and used in the "real world." For example, you may have a statistically significant correlation; however, the relationship may be very weak. This limits your abiltiy to use these data for real world change.

“learning by doing” that guides social work intervention and increases over time

a research paradigm that suspends questions of philosophical ‘truth’ and focuses more on how different philosophies, theories, and methods can be used strategically to resolve a problem or question within the researcher's unique context

A type of criterion validity that examines how well your tool predicts a future criterion.

A measure of a participant's condition before they receive an intervention or treatment.

a type of experimental design in which participants are randomly assigned to control and experimental groups, one group receives an intervention, and both groups receive pre- and post-test assessments

Data you have collected yourself.

in a literature review, a source that describes primary data collected and analyzed by the author, rather than only reviewing what other researchers have found

This means that one scientist could repeat another’s study with relative ease. By replicating a study, we may become more (or less) confident in the original study’s findings.

in cluster sampling, giving clusters different chances of being selected based on their size so that each element within those clusters has an equal chance of being selected

sampling approaches for which a person’s likelihood of being selected from the sampling frame is known

Probes a brief prompts or follow up questions that are used in qualitative interviewing to help draw out additional information on a particular question or idea.

An analysis of how well your program ended up running, and sometimes how well it's going in real time.

the "uptake of formal and informal learning opportunities that deepen and extend...professional competence, including knowledge, beliefs, motivation, and self-regulatory skills" (Richter, Kunter, Klusmann, Lüdtke, & Baumert, 2014)

The systematic process by which we determine if social programs are meeting their goals, how well the program runs, whether the program had the desired effect, and whether the program has merit according to stakeholders (including in terms of the monetary costs and benefits)

As researchers, this means we are extensively spending time with participants or are in the community we are studying.

a person who completes a survey on behalf of another person

Fake names assigned in research to protect the identity of participants.

claims about the world that appear scientific but are incompatible with the values and practices of science

The science of measurement. Involves using theory to assess measurement procedures and tools.

approach to recruitment where participants are sought in public spaces

In a purposive sample, participants are intentionally or hand-selected because of their specific expertise or experience.

data derived from analysis of texts. Usually, this is word data (like a conversation or journal entry) but can also include performances, pictures, and other means of expressing ideas.

qualitative methods interpret language and behavior to understand the world from the perspectives of other people

Research that involves the use of data that represents human expression through words, pictures, movies, performance and other artifacts.

numerical data

when a researcher administers a questionnaire verbally to participants

quantitative methods examine numerical data to precisely describe and predict elements of the social world

a subtype of experimental design that is similar to a true experiment, but does not have randomly assigned control and treatment groups

Research methods using this approach aim to question, challenge and/or reject knowledge that is commonly accepted and privileged in society and elevate and empower knowledge and perspectives that are often perceived as non-normative.

search terms used in a database to find sources of information, like articles or webpages

A research instrument consisting of a set of questions (items) intended to capture responses from participants in a standardized manner

A quota sample involves the researcher identifying a subgroups within a population that they want to make sure to include in their sample, and then identifies a quota or target number to recruit that represent each of these subgroups.

using a random process to decide which participants are tested in which conditions

Unpredictable error that does not result in scores that are consistently higher or lower on a given measure but are nevertheless inaccurate.

Errors lack any perceptable pattern.

an experiment that involves random assignment to a control and experimental group to evaluate the impact of an intervention or stimulus

An approach to sampling where all elements or people in a sampling frame have an equal chance of being selected for inclusion in a study's sample.

The difference between the highest and lowest scores in the distribution.

An ordered set of responses that participants must choose from.

The highest level of measurement. Denoted by mutually exclusive categories, a hierarchy (order), values can be added, subtracted, multiplied, and divided, and the presence of an absolute zero.

unprocessed data that researchers can analyze using quantitative and qualitative methods (e.g., responses to a survey or interview transcripts)

When respondents have difficult providing accurate answers to questions due to the passage of time.

Concept advanced by Albert Bandura that human behavior both shapes and is shaped by their environment.

The act of putting the deconstructed qualitative back together during the analysis process in the search for meaning and ultimately the results of the study.

the process by which the researcher informs potential participants about the study and attempts to get them to participate

A research journal that helps the researcher to reflect on and consider their thoughts and reactions to the research process and how it may be shaping the study

How we understand and account for our influence, as researchers, on the research process.

assuming that abstract concepts exist in some concrete, tangible way

The ability of a measurement tool to measure a phenomenon the same way, time after time. Note: Reliability does not imply validity.

a sample that looks like the population from which it was selected in all respects that are potentially relevant to the study

How closely your sample resembles the population from which it was drawn.

These are sites where contributing researchers can house data that other researchers can view and request permission to use

the methods researchers use to examine empirical data

a document produced by researchers that reviews the literature relevant to their topic and describes the methods they will use to conduct their study

The details/steps outlining how a study will be carried out.

The unintended influence that the researcher may have on the research process.

One of the three ethical principles espoused in the Belmont Report. Treating people as autonomous beings who have the right to make their own decisions. Acknowledging participants' personal dignity.

the answers researchers provide to participants to choose from when completing a questionnaire

Similar to other longitudinal studies, these surveys deal with changes over time, but like a cross-sectional study, they are administered only once. In a retrospective survey, participants are asked to report events from the past.

journal articles that summarize the findings other researchers and establish the state of the literature in a given topic area

Rigor is the process through which we demonstrate, to the best of our ability, that our research is empirically sound and reflects a scientific approach to knowledge building.

facilitated discussions on a topic, often to generate new ideas

the group of people you successfully recruit from your sampling frame to participate in your study

The number of cases found in your final sample.

Sampling bias is present when our sampling process results in a sample that does not represent our population in some way.

the set of all possible samples you could possibly draw for your study

The difference between what you find in a sample and what actually exists in the population from which the sample was drawn.

the list of people from which a researcher will draw her sample

The point where gathering more data doesn't offer any new ideas or perspectives on the issue you are studying.  Reaching saturation is an indication that we can stop qualitative data collection.

A graphical representation of data where the y-axis (the vertical one along the side) is your variable's value and the x-axis (the horizontal one along the bottom) represents the individual instance in your data.

Visual representations of the relationship between two interval/ratio variables that usually use dots to represent data points

a way of knowing that attempts to systematically collect and categorize facts or truths

Data someone else has collected that you have permission to use in your research.

study publicly available information or data that has been collected by another person

interpret, discuss, and summarize primary sources

the degree to which people in my sample differs from the overall population

the distance between the elements you select for inclusion in your study

Selective or theoretical coding is part of a qualitative analysis process that seeks to determine how important concepts and their relationships to each other come together, providing a theory that describes the focus of the study. It often results in an overarching or unifying idea tying these concepts together.

SDT articulates a meta-theory for framing motivational studies and the respective roles of intrinsic and extrinsic motivation in cognitive and social development and in individual differences. Conditions supporting the individual’s experience of autonomy, competence, and relatedness are argued to foster the most volitional and high quality forms of motivation and engagement for activities, including enhanced performance, persistence, and creativity.

A questionnaire that is distributed to participants (in person, by mail, virtually) to complete independently.

a participant answers questions about themselves

Composite (multi-item) scales in which respondents are asked to indicate their opinions or feelings toward a single statement using different pairs of adjectives framed as polar opposites.

An interview that has a general framework for the questions that will be asked, but there is more flexibility to pursue related topics that are brought up by participants than is found in a structured interview approach.

a classic work of research literature that is more than 5 years old and is marked by its uniqueness and contribution to professional knowledge” (Houser, 2018, p. 112)

in mixed methods research, this refers to the order each method is used

the words used to identify the organization and structure of your literature review to your reader

selecting elements from a list using randomly generated numbers

A distribution where cases are clustered on one or the other side of the median.

For a snowball sample, a few initial participants are recruited and then we rely on those initial (and successive) participants to help identify additional people to recruit. We thus rely on participants connects and knowledge of the population to aid our recruitment.

When a participant answers in a way that they believe is socially the most acceptable answer.

Social desirability bias occurs when we create questions that lead respondents to answer in ways that don't reflect their genuine thoughts or feelings to avoid being perceived negatively.

the science of humanity, social interactions, and social structures

A reliability evaluation that examines the internal consistency of a a measurement tool. This process involves comparing one half of a tool to the other half of the same tool and evaluating the results.

when a relationship between two variables appears to be causal but can in fact be explained by influence of a third variable

The people and organizations that have some interest in or will be effected by our program.

The ability to fail to accept the null hypotheses (i.e., actually find what you are seeking)

"Assuming that the null hypothesis is true and the study is repeated an infinite number times by drawing random samples from the same populations(s), less than 5% of these results will be more extreme than the current result" (Cassidy et al., 2019, p. 233).

the characteristic by which the sample is divided in stratified random sampling

dividing the study population into subgroups based on a characteristic (or strata) and then drawing a sample from each subgroup

Interview that uses a very prescribed or structured approach, with a rigid set of questions that are asked very consistently each time, with little to no deviation

Numbers or a series of numbers, symbols and letters assigned in research to both organize data as it is collected, as well as protecting the identity of participants.

one truth among many, bound within a social and cultural context

The use of questionnaires to gather data from multiple participants.

A distribution with a roughly equal number of cases on either side of the median.

(also known as bias) refers to when a measure consistently outputs incorrect data, usually in one direction and due to an identifiable process

Errors that are generally predictable.

journal articles that identify, appraise, and synthesize all relevant studies on a particular topic (Uman, 2011, p.57)

selecting every kth element from your sampling frame

a quick, condensed summary of the report’s key findings arranged by row and column

knowledge that is difficult to express in words and may be conveyed more through intuition or feelings

the group of people whose needs your study addresses

approach to recruitment where participants are based on some personal characteristic or group association

as a criteria for causal relationship, the cause must come before the effect

any findings that follow from constructivist studies are not inherently applicable to other people or situations, as their realities may be quite different

review primary and secondary sources

The extent to which scores obtained on a scale or other measure are consistent across time

The measurement error related to how a test is given; the conditions of the testing, including environmental conditions; and acclimation to the test itself

The Belmont Report is a document outlining basic ethical principles for research on human subjects in the United States and is the foundation of work conducted by IRBs in carrying out their task of overseeing protection of human subjects in research (National Commission for the Protection of Human Subjects in Biomedical and Behavioral Research, 1979).

published works that document a scholarly conversation on a specific topic within and between disciplines

Thematic analysis is an approach to qualitative analysis, in which the researcher attempts to identify themes or patterns across their data to better understand the topic being studied.

A visual representation of how each individual category fits with the others when using thematic analysis to analyze your qualitative data.

discuss a theory, conceptual model, or framework for understanding a problem

a set of concepts and relationships scientists use to explain the social world

A thick description is a very complete, detailed, and illustrative of the subject that is being described.

A demonstration that a change occurred after an intervention. An important criterion for establishing causality.

a set of measurements taken at intervals over a period of time

periodicals directed to members of a specific profession which often include information about industry trends and practical information for people working in the field

To type out the text of recorded interview or focus group.

Sharing your typed up transcript with the participant to give them a chance to verify that you captured their thoughts and values correctly, and allow them to expand or revise their thoughts as appropriate.

The process of research is record and described in such a way that the steps the researcher took throughout the research process are clear.

ensuring that everyone receives the same, or close to the same, treatment as possible

A type of longitudinal survey where the researchers gather data at multiple times, but each time they ask different people from the group they are studying because their concern is capturing the sentiment of the group, not the individual people they survey.

"Tri-agency" and “Canadian agencies” refers to the three federal research funding agencies—The Canadian Institutes of Health Research (CIHR), Natural Sciences and Engineering Research Council (NSERC), and Social Sciences and Humanities Research Council.

Triangulation of data refers to the use of multiple types, measures or sources of data in a research project to increase the confidence that we have in our findings.

An experimental design in which one or more independent variables are manipulated by the researcher (as treatments), subjects are randomly assigned to different treatment levels (random assignment), and the results of the treatments on outcomes (dependent variables) are observed

Trustworthiness is a quality reflected by qualitative research that is conducted in a credible way; a way that should produce confidence in its findings.

Data that accurately portrays information that was shared in or by the original source.

The level of confidence that research is obtained through a systematic and scientific process and that findings can be clearly connected to the data they are based on (and not some fabrication or falsification of that data).

a statistical procedure to compare the means of a variable across groups using multiple independent variables to distinguish among groups

We mistakenly reject the null hypothesis when it was in fact true.

A purposive sampling strategy where you select cases that represent the most common/ a commonly held perspective.

concepts that are expected to have a single underlying dimension

A distribution with one distinct peak when represented on a histogram.

entity that a researcher wants to say something about at the end of her study (individual, group, or organization)

the entities that a researcher actually observes, measures, or collects in the course of trying to learn something about her unit of analysis (individuals, groups, or organizations)

discrete segments of data

Univariate data analysis is a quantitative method in which a variable is examined individually to determine its distribution.

Interviews that contain very open-ended talking prompt that we want participants to respond to, with much flexibility to follow the conversation where it leads.

The extent to which the scores from a measure represent the variable they are intended to.

The extent to which the levels of a variable vary around their central tendency (the mean, median, or mode).

“a logical grouping of attributes that can be observed and measured and is expected to vary from person to person in a population” (Gillespie & Wagner, 2018, p. 9)

The name of your variable.

People who are at risk of undue influence or coercion. Examples are children, prisoners, parolees, and persons with impaired mental capabilities. Additional groups may be vulnerable if they are deemed to be unable to give consent.

interactive presentations which go hands-on with audience members to teach them new skills