Survey research, as with all methods of data collection, comes with both strengths and weaknesses. We will examine both in the following sections.

Strengths of survey method

Researchers employing survey methods to collect data enjoy a number of benefits. First, surveys are an excellent way to gather lots of information from many people and they are relatively cost effective.

Related to the benefit of cost effectiveness is a survey’s potential for generalizability. Because surveys allow researchers to collect data from very large samples for a relatively low cost, survey methods lend themselves to probability sampling techniques, which we discussed in Chapter VII, Probabilistic and Non-Probabilistic Sampling Techniques. Of all the data-collection methods described in this text, survey research is probably the best method to use when one hopes to gain a representative picture of the attitudes and characteristics of a large group.

Survey research also tends to be a reliable method of inquiry. This is because surveys are standardized in that the same questions, phrased in exactly the same way, are posed to participants. Other methods, such as qualitative interviewing, which you will learn about in Chapter X, “Qualitative Data Collection Methods,” do not offer the same level of consistency that a quantitative survey offers. This is not to say that all surveys are always reliable. A poorly phrased question can cause respondents to interpret its meaning differently, which can reduce that question’s reliability. One strength of survey methodology is its potential to produce reliable results.

The versatility of survey research is also an asset. Surveys are used by all kinds of people in all kinds of professions. The versatility offered by survey research means that understanding how to construct and administer surveys is a useful skill to have for all kinds of jobs. For example, lawyers often use surveys in their efforts to select juries.  Social service and other organizations (e.g., churches, clubs, fundraising groups, activist groups) use them to evaluate the effectiveness of their efforts. Businesses use them to learn how to market their products.  Governments use them to understand community opinions and needs, and politicians and media outlets use surveys to understand their constituencies.

In sum, the following are benefits of survey research:

1. Cost-effective
2. Generalizable
3. Reliable
4. Versatile

Weaknesses of survey method

As with all methods of data collection, survey research also comes with a few drawbacks. First, while one might argue that surveys are flexible in the sense that we can ask any number of questions on any number of topics in them, the fact that the survey researcher is generally stuck with a single instrument for collecting data (the questionnaire) means that surveys could also be described as inflexible. For example, suppose you mail a survey out to 1,000 people and then discover, as responses start coming in, that your phrasing on a particular question seems to be confusing a number of respondents. At this stage, it is too late for a do-over or to change the question for the respondents who have not yet returned their surveys (however, if you conduct a pilot study first, you should avoid such a situation occurring). When conducting in-depth interviews, on the other hand, a researcher can provide respondents further explanation if they are confused by a question and can tweak their questions as they learn more about how respondents seem to understand them.

Validity can also be a problem with surveys. Survey questions are standardized; thus, it can be difficult to ask anything other than very general questions that a broad range of people will understand. Because of this, survey results may not be as valid as results obtained using methods of data collection that allow a researcher to more comprehensively examine whatever topic is being studied.

In sum, potential drawbacks to survey research include the following:

1. Inflexibility
2. Validity

Text Attributions

• This chapter has been adapted from Chapter 8.2 in Principles of Sociological Inquiry, which was adapted by the Saylor Academy without attribution to the original authors or publisher, as requested by the licensor. © Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License.