{"id":77,"date":"2019-09-17T12:19:29","date_gmt":"2019-09-17T16:19:29","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/chapter\/correlational-research\/"},"modified":"2019-09-17T12:25:40","modified_gmt":"2019-09-17T16:25:40","slug":"correlational-research","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/chapter\/correlational-research\/","title":{"raw":"Correlational Research","rendered":"Correlational Research"},"content":{"raw":"\n<div class=\"bcc-box bcc-highlight\">\n<h3>Learning Objectives<\/h3>\n<ol class=\"c28 lst-kix_list_96-0 start\" start=\"1\">\n\t<li class=\"c7 c23 c36\"><span class=\"c13 c1\">Define correlational research and give several examples.<\/span><\/li>\n\t<li class=\"c33 c23 c36\"><span class=\"c13 c1\">Explain why a researcher might choose to conduct correlational research rather than experimental research or another type of nonexperimental research.<\/span><\/li>\n<\/ol>\n<\/div>\n<h2 class=\"c4\"><span class=\"c18 c1\">What Is Correlational Research?<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Correlational research is a type of nonexperimental research in which the researcher measures two variables and assesses the statistical relationship (i.e., the correlation) between them with little or no effort to control extraneous variables. There are essentially two reasons that researchers interested in statistical relationships between variables would choose to conduct a correlational study rather than an experiment. The first is that they do not believe that the statistical relationship is a causal one. For example, a researcher might evaluate the validity of a brief extraversion test by administering it to a large group of participants along with a longer extraversion test that has already been shown to be valid. This researcher might then check to see whether participants\u2019 scores on the brief test are strongly correlated with their scores on the longer one. Neither test score is thought to cause the other, so there is no independent variable to manipulate. In fact, the terms&nbsp;<\/span><em><span class=\"c8 c1\">independent variable<\/span><\/em><span class=\"c1\">&nbsp;and <\/span><span class=\"c8 c1\"><em>dependent variabl<\/em>e<\/span><span class=\"c1\">&nbsp;do not apply to this kind of research.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">The other reason that researchers would choose to use a correlational study rather than an experiment is that the statistical relationship of interest is thought to be causal, but the researcher&nbsp;<\/span><em><span class=\"c8 c1\">cannot<\/span><\/em><span class=\"c1\">&nbsp;manipulate the independent variable because it is impossible, impractical, or unethical. For example, Allen Kanner and his colleagues thought that the number of \u201cdaily hassles\u201d (e.g., rude salespeople, heavy traffic) that people experience affects the number of physical and psychological symptoms they have (Kanner, Coyne, Schaefer, &amp; Lazarus, 1981)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\"><\/span><span class=\"c1\">[footnote]Kanner, A. D., Coyne, J. C., Schaefer, C., &amp; Lazarus, R. S. (1981). Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. <em>Journal of Behavioural Medicine, 4<\/em>, 1\u201339.[\/footnote]. But because they could not&nbsp;<\/span><em><span class=\"c8 c1\">manipulate<\/span><\/em><span class=\"c1\">&nbsp;the number of daily hassles their participants experienced, they had to settle for&nbsp;<\/span><em><span class=\"c8 c1\">measuring<\/span><\/em><span class=\"c1\">&nbsp;the number of daily hassles\u2014along with the number of symptoms\u2014using self-report questionnaires. Although the strong positive relationship they found between these two variables is consistent with their idea that hassles cause symptoms, it is also consistent with the idea that symptoms cause hassles or that some third variable (e.g., neuroticism) causes both.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">A common misconception among beginning researchers is that correlational research must involve two quantitative variables, such as scores on two extraversion tests or the number of hassles and number of symptoms people have experienced. However, the defining feature of correlational research is that the two variables are measured\u2014neither one is manipulated\u2014and this is true regardless of whether the variables are quantitative or categorical. Imagine, for example, that a researcher administers the Rosenberg Self-Esteem Scale to 50 American university students and 50 Japanese university students. Although this \u201cfeels\u201d like a between-subjects experiment, it is a correlational study because the researcher did not manipulate the students\u2019 nationalities. The same is true of the study by Cacioppo and Petty comparing professors and factory workers in terms of their need for cognition. It is a correlational study because the researchers did not manipulate the participants\u2019 occupations.<\/span><\/p>\n<p class=\"c4\"><span class=\"c22\">Figure 7.2 <\/span><span class=\"c1\">shows data from a hypothetical study on the relationship between whether people make a daily list of things to do (a \u201cto-do list\u201d) and stress. Notice that it is unclear whether this design is an experiment or a correlational study because it is unclear whether the independent variable was manipulated. If the researcher randomly assigned some participants to make daily to-do lists and others not to, then it is an experiment. If the researcher simply asked participants whether they made daily to-do lists, then it is a correlational study. The distinction is important because if the study was an experiment, then it could be concluded that making the daily to-do lists reduced participants\u2019 stress. But if it was a correlational study, it could only be concluded that these variables are related. Perhaps being stressed has a negative effect on people\u2019s ability to plan ahead (the directionality problem). Or perhaps people who are more conscientious are more likely to make to-do lists and less likely to be stressed (the third-variable problem). The crucial point is that what defines a study as experimental or correlational is not the variables being studied, nor whether the variables are quantitative or categorical, nor the type of graph or statistics used to analyze the data. It is&nbsp;<\/span><span class=\"c8 c1\">how<\/span><span class=\"c1\">&nbsp;the study is conducted.<\/span><\/p>\n\n\n[caption id=\"attachment_387\" align=\"aligncenter\" width=\"900\"]<a href=\"http:\/\/opentextbc.ca\/researchmethods\/wp-content\/uploads\/sites\/37\/2015\/09\/7.2.png\"><img src=\"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-content\/uploads\/sites\/834\/2019\/09\/7.2.png\" alt=\"Figure 7.2 Results of a Hypothetical Study on Whether People Who Make Daily To-Do Lists Experience Less Stress Than People Who Do Not Make Such Lists\" class=\"wp-image-387 size-full\" height=\"433\" width=\"900\"><\/a> Figure 7.2 Results of a Hypothetical Study on Whether People Who Make Daily To-Do Lists Experience Less Stress Than People Who Do Not Make Such Lists[\/caption]\n<h2 class=\"c4\"><span class=\"c18 c1\">Data Collection in Correlational Research<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Again, the defining feature of correlational research is that neither variable is manipulated. It does not matter how or where the variables are measured. A researcher could have participants come to a laboratory to complete a computerized backward digit span task and a computerized risky decision-making task and then assess the relationship between participants\u2019 scores on the two tasks. Or a researcher could go to a shopping mall to ask people about their attitudes toward the environment and their shopping habits and then assess the relationship between these two variables. Both of these studies would be correlational because no independent variable is manipulated. However, because some approaches to data collection are strongly associated with correlational research, it makes sense to discuss them here. The two we will focus on are naturalistic observation and archival data. A third, survey research, is discussed in its own chapter, <a href=\"http:\/\/opentextbc.ca\/researchmethods\/part\/survey-research\/\">Chapter 9<\/a>.<\/span><\/p>\n\n<h2 class=\"c4\"><span class=\"c2 c1\">Naturalistic Observation<\/span><\/h2>\n<p class=\"c4\"><strong><span class=\"c35 c1\">Naturalistic&nbsp;observation<\/span><\/strong><span class=\"c1\">&nbsp;is an approach to data collection that involves observing people\u2019s behaviour in the environment in which it typically occurs. Thus naturalistic observation is a type of field research (as opposed to a type of laboratory research). It could involve observing shoppers in a grocery store, children on a school playground, or psychiatric inpatients in their wards. Researchers engaged in naturalistic observation usually make their observations as unobtrusively as possible so that participants are often not aware that they are being studied. Ethically, this method is considered to be acceptable if the participants remain anonymous and the behaviour occurs in a public setting where people would not normally have an expectation of privacy. Grocery shoppers putting items into their shopping carts, for example, are engaged in public behaviour that is easily observable by store employees and other shoppers. For this reason, most researchers would consider it ethically acceptable to observe them for a study. On the other hand, one of the arguments against the ethicality of the naturalistic observation of \u201cbathroom behaviour\u201d discussed earlier in the book is that people have a reasonable expectation of privacy even in a public restroom and that this expectation was violated.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Researchers Robert Levine and Ara Norenzayan used naturalistic observation to study differences in the \u201cpace of life\u201d across countries (Levine &amp; Norenzayan, 1999)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\">[footnote]Levine, R. V., &amp; Norenzayan, A. (1999). The pace of life in 31 countries. <em>Journal of Cross-Cultural Psychology, 30<\/em>, 178\u2013205.[\/footnote].<\/span><span class=\"c1\"> One of their measures involved observing pedestrians in a large city to see how long it took them to walk 60 feet. They found that people in some countries walked reliably faster than people in other countries. For example, people in Canada and Sweden covered 60 feet in just under 13 seconds on average, while people in Brazil and Romania took close to 17 seconds.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Because naturalistic observation takes place in the complex and even chaotic \u201creal world,\u201d there are two closely related issues that researchers must deal with before collecting data. The first is sampling. When, where, and under what conditions will the observations be made, and who exactly will be observed? Levine and Norenzayan described their sampling process as follows:<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">\u201cMale and female walking speed over a distance of 60 feet was measured in at least two locations in main downtown areas in each city. Measurements were taken during main business hours on clear summer days. All locations were flat, unobstructed, had broad sidewalks, and were sufficiently uncrowded to allow pedestrians to move at potentially maximum speeds. To control for the effects of socializing, only pedestrians walking alone were used. Children, individuals with obvious physical handicaps, and window-shoppers were not timed. Thirty-five men and 35 women were timed in most cities.\u201d (p. 186)<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Precise specification of the sampling process in this way makes data collection manageable for the observers, and it also provides some control over important extraneous variables. For example, by making their observations on clear summer days in all countries, Levine and Norenzayan controlled for effects of the weather on people\u2019s walking speeds.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">The second issue is measurement. What specific behaviours will be observed? In Levine and Norenzayan\u2019s study, measurement was relatively straightforward. They simply measured out a 60-foot distance along a city sidewalk and then used a stopwatch to time participants as they walked over that distance. Often, however, the behaviours of interest are not so obvious or objective. For example, researchers Robert Kraut and Robert Johnston wanted to study bowlers\u2019 reactions to their shots, both when they were facing the pins and then when they turned toward their companions (Kraut &amp; Johnston, 1979)<\/span><span class=\"c22\">[footnote]Kraut, R. E., &amp; Johnston, R. E. (1979). Social and emotional messages of smiling: An ethological approach. <em>Journal of Personality and Social Psychology, 37<\/em>, 1539\u20131553.[\/footnote]. <\/span><span class=\"c29 c22\"><\/span><span class=\"c1\">But what \u201creactions\u201d should they observe? Based on previous research and their own pilot testing, Kraut and Johnston created a list of reactions that included \u201cclosed smile,\u201d \u201copen smile,\u201d \u201claugh,\u201d \u201cneutral face,\u201d \u201clook down,\u201d \u201clook away,\u201d and \u201cface cover\u201d (covering one\u2019s face with one\u2019s hands). The observers committed this list to memory and then practiced by coding the reactions of bowlers who had been videotaped. During the actual study, the observers spoke into an audio recorder, describing the reactions they observed. Among the most interesting results of this study was that bowlers rarely smiled while they still faced the pins. They were much more likely to smile after they turned toward their companions, suggesting that smiling is not purely an expression of happiness but also a form of social communication.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">When the observations require a judgment on the part of the observers\u2014as in Kraut and Johnston\u2019s study\u2014this process is often described as&nbsp;<\/span><strong><span class=\"c35 c1\">coding<\/span><\/strong><span class=\"c1\">. Coding generally requires clearly defining a set of target behaviours. The observers then categorize participants individually in terms of which behaviour they have engaged in and the number of times they engaged in each behaviour. The observers might even record the duration of each behaviour. The target behaviours must be defined in such a way that different observers code them in the same way. This difficulty with coding is the issue of interrater reliability, as mentioned in <a href=\"http:\/\/opentextbc.ca\/researchmethods\/part\/psychological-measurement\/\">Chapter 5<\/a>. Researchers are expected to demonstrate the interrater reliability of their coding procedure by having multiple raters code the same behaviours independently and then showing that the different observers are in close agreement. Kraut and Johnston, for example, video recorded a subset of their participants\u2019 reactions and had two observers independently code them. The two observers showed that they agreed on the reactions that were exhibited 97% of the time, indicating good interrater reliability.<\/span><\/p>\n\n<h2 class=\"c4\"><span class=\"c2 c1\">Archival Data<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Another approach to correlational research is the use of&nbsp;<\/span><strong><span class=\"c35 c1\">archival&nbsp;data<\/span><\/strong><span class=\"c1\">, which are data that have already been collected for some other purpose. An example is a study by Brett Pelham and his colleagues on \u201cimplicit egotism\u201d\u2014the tendency for people to prefer people, places, and things that are similar to themselves (Pelham, Carvallo, &amp; Jones, 2005)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\">[footnote]Pelham, B. W., Carvallo, M., &amp; Jones, J. T. (2005). Implicit egotism. <em>Current Directions in Psychological Science, 14<\/em>, 106\u2013110.[\/footnote].<\/span><span class=\"c1\"> In one study, they examined Social Security records to show that women with the names Virginia, Georgia, Louise, and Florence were especially likely to have moved to the states of Virginia, Georgia, Louisiana, and Florida, respectively.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">As with naturalistic observation, measurement can be more or less straightforward when working with archival data. For example, counting the number of people named Virginia who live in various states based on Social Security records is relatively straightforward. But consider a study by Christopher Peterson and his colleagues on the relationship between optimism and health using data that had been collected many years before for a study on adult development (Peterson, Seligman, &amp; Vaillant, 1988)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\">[footnote]Peterson, C., Seligman, M. E. P., &amp; Vaillant, G. E. (1988). Pessimistic explanatory style is a risk factor for physical illness: A thirty-five year longitudinal study. <em>Journal of Personality and Social Psychology, 55<\/em>, 23\u201327.[\/footnote].<\/span><span class=\"c1\"> In the 1940s, healthy male college students had completed an open-ended questionnaire about difficult wartime experiences. In the late 1980s, Peterson and his colleagues reviewed the men\u2019s questionnaire responses to obtain a measure of explanatory style\u2014their habitual ways of explaining bad events that happen to them. More pessimistic people tend to blame themselves and expect long-term negative consequences that affect many aspects of their lives, while more optimistic people tend to blame outside forces and expect limited negative consequences. To obtain a measure of explanatory style for each participant, the researchers used a procedure in which all negative events mentioned in the questionnaire responses, and any causal explanations for them, were identified and written on index cards. These were given to a separate group of raters who rated each explanation in terms of three separate dimensions of optimism-pessimism. These ratings were then averaged to produce an explanatory style score for each participant. The researchers then assessed the statistical relationship between the men\u2019s explanatory style as undergraduate students and archival measures of their health at approximately 60 years of age. The primary result was that the more optimistic the men were as undergraduate students, the healthier they were as older men. Pearson\u2019s&nbsp;<\/span><em><span class=\"c8 c1\">r<\/span><\/em><span class=\"c1\">&nbsp;was +.25.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">This method is an example of&nbsp;<\/span><strong><span class=\"c35 c1\">content&nbsp;analysis<\/span><\/strong><span class=\"c1\">\u2014a family of systematic approaches to measurement using complex archival data. Just as naturalistic observation requires specifying the behaviours of interest and then noting them as they occur, content analysis requires specifying keywords, phrases, or ideas and then finding all occurrences of them in the data. These occurrences can then be counted, timed (e.g., the amount of time devoted to entertainment topics on the nightly news show), or analyzed in a variety of other ways.<\/span><\/p>\n\n<div class=\"bcc-box bcc-success\">\n<h3>Key Takeaways<\/h3>\n<ul class=\"c28 lst-kix_list_97-0 start\">\n\t<li class=\"c7 c80 c36\"><span class=\"c66 c60 c1\">Correlational research involves measuring two variables and assessing the relationship between them, with no manipulation of an independent variable.<\/span><\/li>\n\t<li class=\"c33 c36 c80\"><span class=\"c66 c60 c1\">Correlational research is not defined by where or how the data are collected. However, some approaches to data collection are strongly associated with correlational research. These include naturalistic observation (in which researchers observe people\u2019s behaviour in the context in which it normally occurs) and the use of archival data that were already collected for some other purpose.<\/span><\/li>\n<\/ul>\n<\/div>\n<div class=\"bcc-box bcc-info\">\n<h3>Exercises<\/h3>\n<ol class=\"c28 lst-kix_list_98-0 start\" start=\"1\">\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">Discussion: For each of the following, decide whether it is most likely that the study described is experimental or correlational and explain why.<\/span>\n<ol>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">An educational researcher compares the academic performance of students from the \u201crich\u201d side of town with that of students from the \u201cpoor\u201d side of town.<\/span><\/li>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A cognitive psychologist compares the ability of people to recall words that they were instructed to \u201cread\u201d with their ability to recall words that they were instructed to \u201cimagine.\u201d<\/span><\/li>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A manager studies the correlation between new employees\u2019 college grade point averages and their first-year performance reports.<\/span><\/li>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">An automotive engineer installs different stick shifts in a new car prototype, each time asking several people to rate how comfortable the stick shift feels.<\/span><\/li>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A food scientist studies the relationship between the temperature inside people\u2019s refrigerators and the amount of bacteria on their food.<\/span><\/li>\n\t<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A social psychologist tells some research participants that they need to hurry over to the next building to complete a study. She tells others that they can take their time. Then she observes whether they stop to help a research assistant who is pretending to be hurt.<\/span><\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/div>\n","rendered":"<div class=\"bcc-box bcc-highlight\">\n<h3>Learning Objectives<\/h3>\n<ol class=\"c28 lst-kix_list_96-0 start\" start=\"1\">\n<li class=\"c7 c23 c36\"><span class=\"c13 c1\">Define correlational research and give several examples.<\/span><\/li>\n<li class=\"c33 c23 c36\"><span class=\"c13 c1\">Explain why a researcher might choose to conduct correlational research rather than experimental research or another type of nonexperimental research.<\/span><\/li>\n<\/ol>\n<\/div>\n<h2 class=\"c4\"><span class=\"c18 c1\">What Is Correlational Research?<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Correlational research is a type of nonexperimental research in which the researcher measures two variables and assesses the statistical relationship (i.e., the correlation) between them with little or no effort to control extraneous variables. There are essentially two reasons that researchers interested in statistical relationships between variables would choose to conduct a correlational study rather than an experiment. The first is that they do not believe that the statistical relationship is a causal one. For example, a researcher might evaluate the validity of a brief extraversion test by administering it to a large group of participants along with a longer extraversion test that has already been shown to be valid. This researcher might then check to see whether participants\u2019 scores on the brief test are strongly correlated with their scores on the longer one. Neither test score is thought to cause the other, so there is no independent variable to manipulate. In fact, the terms&nbsp;<\/span><em><span class=\"c8 c1\">independent variable<\/span><\/em><span class=\"c1\">&nbsp;and <\/span><span class=\"c8 c1\"><em>dependent variabl<\/em>e<\/span><span class=\"c1\">&nbsp;do not apply to this kind of research.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">The other reason that researchers would choose to use a correlational study rather than an experiment is that the statistical relationship of interest is thought to be causal, but the researcher&nbsp;<\/span><em><span class=\"c8 c1\">cannot<\/span><\/em><span class=\"c1\">&nbsp;manipulate the independent variable because it is impossible, impractical, or unethical. For example, Allen Kanner and his colleagues thought that the number of \u201cdaily hassles\u201d (e.g., rude salespeople, heavy traffic) that people experience affects the number of physical and psychological symptoms they have (Kanner, Coyne, Schaefer, &amp; Lazarus, 1981)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\"><\/span><span class=\"c1\"><a class=\"footnote\" title=\"Kanner, A. D., Coyne, J. C., Schaefer, C., &amp; Lazarus, R. S. (1981). Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. Journal of Behavioural Medicine, 4, 1\u201339.\" id=\"return-footnote-77-1\" href=\"#footnote-77-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a>. But because they could not&nbsp;<\/span><em><span class=\"c8 c1\">manipulate<\/span><\/em><span class=\"c1\">&nbsp;the number of daily hassles their participants experienced, they had to settle for&nbsp;<\/span><em><span class=\"c8 c1\">measuring<\/span><\/em><span class=\"c1\">&nbsp;the number of daily hassles\u2014along with the number of symptoms\u2014using self-report questionnaires. Although the strong positive relationship they found between these two variables is consistent with their idea that hassles cause symptoms, it is also consistent with the idea that symptoms cause hassles or that some third variable (e.g., neuroticism) causes both.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">A common misconception among beginning researchers is that correlational research must involve two quantitative variables, such as scores on two extraversion tests or the number of hassles and number of symptoms people have experienced. However, the defining feature of correlational research is that the two variables are measured\u2014neither one is manipulated\u2014and this is true regardless of whether the variables are quantitative or categorical. Imagine, for example, that a researcher administers the Rosenberg Self-Esteem Scale to 50 American university students and 50 Japanese university students. Although this \u201cfeels\u201d like a between-subjects experiment, it is a correlational study because the researcher did not manipulate the students\u2019 nationalities. The same is true of the study by Cacioppo and Petty comparing professors and factory workers in terms of their need for cognition. It is a correlational study because the researchers did not manipulate the participants\u2019 occupations.<\/span><\/p>\n<p class=\"c4\"><span class=\"c22\">Figure 7.2 <\/span><span class=\"c1\">shows data from a hypothetical study on the relationship between whether people make a daily list of things to do (a \u201cto-do list\u201d) and stress. Notice that it is unclear whether this design is an experiment or a correlational study because it is unclear whether the independent variable was manipulated. If the researcher randomly assigned some participants to make daily to-do lists and others not to, then it is an experiment. If the researcher simply asked participants whether they made daily to-do lists, then it is a correlational study. The distinction is important because if the study was an experiment, then it could be concluded that making the daily to-do lists reduced participants\u2019 stress. But if it was a correlational study, it could only be concluded that these variables are related. Perhaps being stressed has a negative effect on people\u2019s ability to plan ahead (the directionality problem). Or perhaps people who are more conscientious are more likely to make to-do lists and less likely to be stressed (the third-variable problem). The crucial point is that what defines a study as experimental or correlational is not the variables being studied, nor whether the variables are quantitative or categorical, nor the type of graph or statistics used to analyze the data. It is&nbsp;<\/span><span class=\"c8 c1\">how<\/span><span class=\"c1\">&nbsp;the study is conducted.<\/span><\/p>\n<figure id=\"attachment_387\" aria-describedby=\"caption-attachment-387\" style=\"width: 900px\" class=\"wp-caption aligncenter\"><a href=\"http:\/\/opentextbc.ca\/researchmethods\/wp-content\/uploads\/sites\/37\/2015\/09\/7.2.png\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-content\/uploads\/sites\/834\/2019\/09\/7.2.png\" alt=\"Figure 7.2 Results of a Hypothetical Study on Whether People Who Make Daily To-Do Lists Experience Less Stress Than People Who Do Not Make Such Lists\" class=\"wp-image-387 size-full\" height=\"433\" width=\"900\" \/><\/a><figcaption id=\"caption-attachment-387\" class=\"wp-caption-text\">Figure 7.2 Results of a Hypothetical Study on Whether People Who Make Daily To-Do Lists Experience Less Stress Than People Who Do Not Make Such Lists<\/figcaption><\/figure>\n<h2 class=\"c4\"><span class=\"c18 c1\">Data Collection in Correlational Research<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Again, the defining feature of correlational research is that neither variable is manipulated. It does not matter how or where the variables are measured. A researcher could have participants come to a laboratory to complete a computerized backward digit span task and a computerized risky decision-making task and then assess the relationship between participants\u2019 scores on the two tasks. Or a researcher could go to a shopping mall to ask people about their attitudes toward the environment and their shopping habits and then assess the relationship between these two variables. Both of these studies would be correlational because no independent variable is manipulated. However, because some approaches to data collection are strongly associated with correlational research, it makes sense to discuss them here. The two we will focus on are naturalistic observation and archival data. A third, survey research, is discussed in its own chapter, <a href=\"http:\/\/opentextbc.ca\/researchmethods\/part\/survey-research\/\">Chapter 9<\/a>.<\/span><\/p>\n<h2 class=\"c4\"><span class=\"c2 c1\">Naturalistic Observation<\/span><\/h2>\n<p class=\"c4\"><strong><span class=\"c35 c1\">Naturalistic&nbsp;observation<\/span><\/strong><span class=\"c1\">&nbsp;is an approach to data collection that involves observing people\u2019s behaviour in the environment in which it typically occurs. Thus naturalistic observation is a type of field research (as opposed to a type of laboratory research). It could involve observing shoppers in a grocery store, children on a school playground, or psychiatric inpatients in their wards. Researchers engaged in naturalistic observation usually make their observations as unobtrusively as possible so that participants are often not aware that they are being studied. Ethically, this method is considered to be acceptable if the participants remain anonymous and the behaviour occurs in a public setting where people would not normally have an expectation of privacy. Grocery shoppers putting items into their shopping carts, for example, are engaged in public behaviour that is easily observable by store employees and other shoppers. For this reason, most researchers would consider it ethically acceptable to observe them for a study. On the other hand, one of the arguments against the ethicality of the naturalistic observation of \u201cbathroom behaviour\u201d discussed earlier in the book is that people have a reasonable expectation of privacy even in a public restroom and that this expectation was violated.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Researchers Robert Levine and Ara Norenzayan used naturalistic observation to study differences in the \u201cpace of life\u201d across countries (Levine &amp; Norenzayan, 1999)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\"><a class=\"footnote\" title=\"Levine, R. V., &amp; Norenzayan, A. (1999). The pace of life in 31 countries. Journal of Cross-Cultural Psychology, 30, 178\u2013205.\" id=\"return-footnote-77-2\" href=\"#footnote-77-2\" aria-label=\"Footnote 2\"><sup class=\"footnote\">[2]<\/sup><\/a>.<\/span><span class=\"c1\"> One of their measures involved observing pedestrians in a large city to see how long it took them to walk 60 feet. They found that people in some countries walked reliably faster than people in other countries. For example, people in Canada and Sweden covered 60 feet in just under 13 seconds on average, while people in Brazil and Romania took close to 17 seconds.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Because naturalistic observation takes place in the complex and even chaotic \u201creal world,\u201d there are two closely related issues that researchers must deal with before collecting data. The first is sampling. When, where, and under what conditions will the observations be made, and who exactly will be observed? Levine and Norenzayan described their sampling process as follows:<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">\u201cMale and female walking speed over a distance of 60 feet was measured in at least two locations in main downtown areas in each city. Measurements were taken during main business hours on clear summer days. All locations were flat, unobstructed, had broad sidewalks, and were sufficiently uncrowded to allow pedestrians to move at potentially maximum speeds. To control for the effects of socializing, only pedestrians walking alone were used. Children, individuals with obvious physical handicaps, and window-shoppers were not timed. Thirty-five men and 35 women were timed in most cities.\u201d (p. 186)<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">Precise specification of the sampling process in this way makes data collection manageable for the observers, and it also provides some control over important extraneous variables. For example, by making their observations on clear summer days in all countries, Levine and Norenzayan controlled for effects of the weather on people\u2019s walking speeds.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">The second issue is measurement. What specific behaviours will be observed? In Levine and Norenzayan\u2019s study, measurement was relatively straightforward. They simply measured out a 60-foot distance along a city sidewalk and then used a stopwatch to time participants as they walked over that distance. Often, however, the behaviours of interest are not so obvious or objective. For example, researchers Robert Kraut and Robert Johnston wanted to study bowlers\u2019 reactions to their shots, both when they were facing the pins and then when they turned toward their companions (Kraut &amp; Johnston, 1979)<\/span><span class=\"c22\"><a class=\"footnote\" title=\"Kraut, R. E., &amp; Johnston, R. E. (1979). Social and emotional messages of smiling: An ethological approach. Journal of Personality and Social Psychology, 37, 1539\u20131553.\" id=\"return-footnote-77-3\" href=\"#footnote-77-3\" aria-label=\"Footnote 3\"><sup class=\"footnote\">[3]<\/sup><\/a>. <\/span><span class=\"c29 c22\"><\/span><span class=\"c1\">But what \u201creactions\u201d should they observe? Based on previous research and their own pilot testing, Kraut and Johnston created a list of reactions that included \u201cclosed smile,\u201d \u201copen smile,\u201d \u201claugh,\u201d \u201cneutral face,\u201d \u201clook down,\u201d \u201clook away,\u201d and \u201cface cover\u201d (covering one\u2019s face with one\u2019s hands). The observers committed this list to memory and then practiced by coding the reactions of bowlers who had been videotaped. During the actual study, the observers spoke into an audio recorder, describing the reactions they observed. Among the most interesting results of this study was that bowlers rarely smiled while they still faced the pins. They were much more likely to smile after they turned toward their companions, suggesting that smiling is not purely an expression of happiness but also a form of social communication.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">When the observations require a judgment on the part of the observers\u2014as in Kraut and Johnston\u2019s study\u2014this process is often described as&nbsp;<\/span><strong><span class=\"c35 c1\">coding<\/span><\/strong><span class=\"c1\">. Coding generally requires clearly defining a set of target behaviours. The observers then categorize participants individually in terms of which behaviour they have engaged in and the number of times they engaged in each behaviour. The observers might even record the duration of each behaviour. The target behaviours must be defined in such a way that different observers code them in the same way. This difficulty with coding is the issue of interrater reliability, as mentioned in <a href=\"http:\/\/opentextbc.ca\/researchmethods\/part\/psychological-measurement\/\">Chapter 5<\/a>. Researchers are expected to demonstrate the interrater reliability of their coding procedure by having multiple raters code the same behaviours independently and then showing that the different observers are in close agreement. Kraut and Johnston, for example, video recorded a subset of their participants\u2019 reactions and had two observers independently code them. The two observers showed that they agreed on the reactions that were exhibited 97% of the time, indicating good interrater reliability.<\/span><\/p>\n<h2 class=\"c4\"><span class=\"c2 c1\">Archival Data<\/span><\/h2>\n<p class=\"c4\"><span class=\"c1\">Another approach to correlational research is the use of&nbsp;<\/span><strong><span class=\"c35 c1\">archival&nbsp;data<\/span><\/strong><span class=\"c1\">, which are data that have already been collected for some other purpose. An example is a study by Brett Pelham and his colleagues on \u201cimplicit egotism\u201d\u2014the tendency for people to prefer people, places, and things that are similar to themselves (Pelham, Carvallo, &amp; Jones, 2005)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\"><a class=\"footnote\" title=\"Pelham, B. W., Carvallo, M., &amp; Jones, J. T. (2005). Implicit egotism. Current Directions in Psychological Science, 14, 106\u2013110.\" id=\"return-footnote-77-4\" href=\"#footnote-77-4\" aria-label=\"Footnote 4\"><sup class=\"footnote\">[4]<\/sup><\/a>.<\/span><span class=\"c1\"> In one study, they examined Social Security records to show that women with the names Virginia, Georgia, Louise, and Florence were especially likely to have moved to the states of Virginia, Georgia, Louisiana, and Florida, respectively.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">As with naturalistic observation, measurement can be more or less straightforward when working with archival data. For example, counting the number of people named Virginia who live in various states based on Social Security records is relatively straightforward. But consider a study by Christopher Peterson and his colleagues on the relationship between optimism and health using data that had been collected many years before for a study on adult development (Peterson, Seligman, &amp; Vaillant, 1988)<\/span><span class=\"c22\"><\/span><span class=\"c29 c22\"><a class=\"footnote\" title=\"Peterson, C., Seligman, M. E. P., &amp; Vaillant, G. E. (1988). Pessimistic explanatory style is a risk factor for physical illness: A thirty-five year longitudinal study. Journal of Personality and Social Psychology, 55, 23\u201327.\" id=\"return-footnote-77-5\" href=\"#footnote-77-5\" aria-label=\"Footnote 5\"><sup class=\"footnote\">[5]<\/sup><\/a>.<\/span><span class=\"c1\"> In the 1940s, healthy male college students had completed an open-ended questionnaire about difficult wartime experiences. In the late 1980s, Peterson and his colleagues reviewed the men\u2019s questionnaire responses to obtain a measure of explanatory style\u2014their habitual ways of explaining bad events that happen to them. More pessimistic people tend to blame themselves and expect long-term negative consequences that affect many aspects of their lives, while more optimistic people tend to blame outside forces and expect limited negative consequences. To obtain a measure of explanatory style for each participant, the researchers used a procedure in which all negative events mentioned in the questionnaire responses, and any causal explanations for them, were identified and written on index cards. These were given to a separate group of raters who rated each explanation in terms of three separate dimensions of optimism-pessimism. These ratings were then averaged to produce an explanatory style score for each participant. The researchers then assessed the statistical relationship between the men\u2019s explanatory style as undergraduate students and archival measures of their health at approximately 60 years of age. The primary result was that the more optimistic the men were as undergraduate students, the healthier they were as older men. Pearson\u2019s&nbsp;<\/span><em><span class=\"c8 c1\">r<\/span><\/em><span class=\"c1\">&nbsp;was +.25.<\/span><\/p>\n<p class=\"c4\"><span class=\"c1\">This method is an example of&nbsp;<\/span><strong><span class=\"c35 c1\">content&nbsp;analysis<\/span><\/strong><span class=\"c1\">\u2014a family of systematic approaches to measurement using complex archival data. Just as naturalistic observation requires specifying the behaviours of interest and then noting them as they occur, content analysis requires specifying keywords, phrases, or ideas and then finding all occurrences of them in the data. These occurrences can then be counted, timed (e.g., the amount of time devoted to entertainment topics on the nightly news show), or analyzed in a variety of other ways.<\/span><\/p>\n<div class=\"bcc-box bcc-success\">\n<h3>Key Takeaways<\/h3>\n<ul class=\"c28 lst-kix_list_97-0 start\">\n<li class=\"c7 c80 c36\"><span class=\"c66 c60 c1\">Correlational research involves measuring two variables and assessing the relationship between them, with no manipulation of an independent variable.<\/span><\/li>\n<li class=\"c33 c36 c80\"><span class=\"c66 c60 c1\">Correlational research is not defined by where or how the data are collected. However, some approaches to data collection are strongly associated with correlational research. These include naturalistic observation (in which researchers observe people\u2019s behaviour in the context in which it normally occurs) and the use of archival data that were already collected for some other purpose.<\/span><\/li>\n<\/ul>\n<\/div>\n<div class=\"bcc-box bcc-info\">\n<h3>Exercises<\/h3>\n<ol class=\"c28 lst-kix_list_98-0 start\" start=\"1\">\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">Discussion: For each of the following, decide whether it is most likely that the study described is experimental or correlational and explain why.<\/span>\n<ol>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">An educational researcher compares the academic performance of students from the \u201crich\u201d side of town with that of students from the \u201cpoor\u201d side of town.<\/span><\/li>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A cognitive psychologist compares the ability of people to recall words that they were instructed to \u201cread\u201d with their ability to recall words that they were instructed to \u201cimagine.\u201d<\/span><\/li>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A manager studies the correlation between new employees\u2019 college grade point averages and their first-year performance reports.<\/span><\/li>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">An automotive engineer installs different stick shifts in a new car prototype, each time asking several people to rate how comfortable the stick shift feels.<\/span><\/li>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A food scientist studies the relationship between the temperature inside people\u2019s refrigerators and the amount of bacteria on their food.<\/span><\/li>\n<li class=\"c7 c171 c233\"><span class=\"c10 c1\">A social psychologist tells some research participants that they need to hurry over to the next building to complete a study. She tells others that they can take their time. Then she observes whether they stop to help a research assistant who is pretending to be hurt.<\/span><\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/div>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-77-1\">Kanner, A. D., Coyne, J. C., Schaefer, C., &amp; Lazarus, R. S. (1981). Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. <em>Journal of Behavioural Medicine, 4<\/em>, 1\u201339. <a href=\"#return-footnote-77-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><li id=\"footnote-77-2\">Levine, R. V., &amp; Norenzayan, A. (1999). The pace of life in 31 countries. <em>Journal of Cross-Cultural Psychology, 30<\/em>, 178\u2013205. <a href=\"#return-footnote-77-2\" class=\"return-footnote\" aria-label=\"Return to footnote 2\">&crarr;<\/a><\/li><li id=\"footnote-77-3\">Kraut, R. E., &amp; Johnston, R. E. (1979). Social and emotional messages of smiling: An ethological approach. <em>Journal of Personality and Social Psychology, 37<\/em>, 1539\u20131553. <a href=\"#return-footnote-77-3\" class=\"return-footnote\" aria-label=\"Return to footnote 3\">&crarr;<\/a><\/li><li id=\"footnote-77-4\">Pelham, B. W., Carvallo, M., &amp; Jones, J. T. (2005). Implicit egotism. <em>Current Directions in Psychological Science, 14<\/em>, 106\u2013110. <a href=\"#return-footnote-77-4\" class=\"return-footnote\" aria-label=\"Return to footnote 4\">&crarr;<\/a><\/li><li id=\"footnote-77-5\">Peterson, C., Seligman, M. E. P., &amp; Vaillant, G. E. (1988). Pessimistic explanatory style is a risk factor for physical illness: A thirty-five year longitudinal study. <em>Journal of Personality and Social Psychology, 55<\/em>, 23\u201327. <a href=\"#return-footnote-77-5\" class=\"return-footnote\" aria-label=\"Return to footnote 5\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":65,"menu_order":2,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-77","chapter","type-chapter","status-publish","hentry"],"part":73,"_links":{"self":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapters\/77","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/wp\/v2\/users\/65"}],"version-history":[{"count":1,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapters\/77\/revisions"}],"predecessor-version":[{"id":181,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapters\/77\/revisions\/181"}],"part":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/parts\/73"}],"metadata":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapters\/77\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/wp\/v2\/media?parent=77"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/pressbooks\/v2\/chapter-type?post=77"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/wp\/v2\/contributor?post=77"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/rmethodspsych\/wp-json\/wp\/v2\/license?post=77"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}