Print

How to Craft a Successful Research Question – PSY

Count the number of concepts or phenomena that your research problem statement proposes to investigate. Do not include any concepts or phenomena that define the population, only those to be directly measured or examined or described. If your research problem statement contains only one concept or phenomenon to investigate, skip to Part 2 of the Activity. If it contains two or more concepts or phenomena, use Part 1. Follow the steps in your chosen part sequentially.

Part 1: Crafting Quantitative Research Questions

  1. Start with your research problem (developed in Track I and no doubt revised as your lit review developed). On a sheet of paper, write down the concepts and the target population in the problem statement. Identify the IVs, the DVs, and any sample variables. Next, write down all the sample variables and sample characteristics your research problem contains. If your problem statement does not identify the target population in enough detail to identify the characteristics or variables of the sample, go back to the literature and determine what they should be.

    Note: Learners who are proposing a qualitative (one-concept) problem, for the sake of practice, please re-tool it as a two-concept correlational problem.

    Practice example: The research problem is the impact of emotional intelligence, learning style, and personality type on job satisfaction in health care managers is not known. Your list of concepts would be:

    • Emotional intelligence (IV 1).
    • Learning style (IV 2).
    • Personality type (IV 3).
    • Job satisfaction (DV).
    • Health care managers (sample).

    Immediately, you notice that "health care managers" is a very broad category and does not help you determine specific sample characteristics and variables. A quick review of your literature suggests that you should study female managers working in specialty clinics. So to your list you add to "health care managers":

    • Female (sample variable)
    • Health care managers (sample characteristic)
    • In specialty medical clinics (sample variable).

    Apply: Do Step 1 with your own research problem.

  2. Next, write down exactly the form of measurement that your problem requires. The main forms include:

    • Differences between IV-based groups on a DV score (used for causal and predictive questions).
    • Correlations between two or more variables (used for correlational questions).
    • Measures of individual variables (used for descriptive questions, usually subquestions).

    Practice Example: In the example, what is not known is the impact of the three IVs on the DV. Therefore, the kind of relationship we are seeking will be a causal relationship, based on that word impact. The word effect can be substituted, making even clearer that the relationship we are after is a causal one.

    Apply: Do Step 2 with your own research problem.

  3. Now, craft a conceptual version of your question using these ingredients. After you have a draft, examine it carefully. Does your question:

    • Clearly name the variables you are going to measure?
    • Clearly identify which are the IV and which are the DV (if applicable)?
    • Clearly indicate what relationship between or among the variables will be investigated (by words such as relationship, correlation, cause, affect, effect, influence, difference, predict, impact, and so on)?
    • The characteristics and sample variables of the sample?
    • End in a question mark, and have the characteristics of a good English sentence?

    If it misses on any point, correct it.

    Practice Example: A first draft of the conceptual version of the example might be:

    What is the impact of personality type on the job satisfaction of female health care managers in specialty medical clinics?

    If we are actually interested in whether this IV predicts the DV—prediction being a type of impact—another version might be:

    Is personality type a predictor of job satisfaction in female health care managers in specialty medical clinics?
    Apply: Do Step 3, the conceptual version, for your own research question.

  4. Write an operational version of the research question.

    Practice Example: To determine effects (or impacts), one must do an experimental or a quasi-experimental design. This means that two or more groups are formed and the different effects on the IV are compared in those groups. To get to that, we look at the IV (or individual IVs if there is more than one). We ask ourselves what levels of the variable we are interested in. In reviewing the literature, we found that the so-called Big Five personality traits (Costa & McCrae, 1992) are widely used. This shows us five levels of personality type. But perhaps for some reason, we are most interested in the impact of extroversion and conscientiousness for the variable personality type.

    Therefore, we might have an operational version of the research question that looks like this:

    Are there statistically significant differences in levels of job satisfaction for female health care managers in specialty medical clinics who are highly extroverted compared with those who are highly conscientious.

    Apply: Do step 4 for your own research question.

  5. The next step is to examine your research question and write any necessary subquestions. Use your operational version for this step. The basic approach is to write a descriptive question for each of the variables being investigated, as well as for any sample variable that must be measured.

    Practice Example: Our question has three variables to be measured, and therefore we have three subquestions to write:

    • Level of job satisfaction (DV).

      What are the levels of job satisfaction in female health care managers in specialty medical clinics?

    • Level of extroversion (IV), needed to assign participants to the "high extroversion" group.

      What are the levels of extroversion in in female health care managers in specialty medical clinics?

    • Level of conscientiousness (IV 2), needed to assign participants to the "high conscientiousness" group.

      What are the levels of conscientiousness in in female health care managers in specialty medical clinics?

  6. Finally, write a set of hypotheses for each of the main questions and any subquestions that require at least a correlational analysis. If there are more than one question or subquestion that asked for at least a correlation (for example, if a complex main question requires a series of subquestions about correlations), we would make hypotheses for any question that requires a correlational analysis or stronger. We do not make hypotheses about descriptive questions, only correlational or difference questions.

    Practice Example: Because we have only one main question, we will need two hypotheses, a null and an alternate.

    • Null hypothesis (H0): There will be no statistically significant differences in levels of job satisfaction for female health care managers in specialty medical clinics who are highly extroverted compared with those who are highly conscientious.
    • Alternate hypothesis (H1): There will be statistically significant differences in levels of job satisfaction for female health care managers in specialty medical clinics who are highly extroverted compared with those who are highly conscientious.

    Prepare to Revise and Rewrite Your Question as Your Lit Review Deepens

    Your search of the literature about your topic and research question will continue until you complete your dissertation. When you find new research that changes the nature or focus of your problem statement, your question will need to be revised accordingly. This is quite common. So plan to keep revisiting your research problem and question regularly, up to the point where they have been finally approved by your dissertation committee and the IRB and you are ready to start your participant recruitment. That question and only that question will be your final edition.

Part 2: Crafting Qualitative Research Questions

  1. Start with your research problem (developed in Track I and no doubt revised in the interim, as your lit review developed). On a sheet of paper, write down the concept or the phenomenon to be investigated; write it as clearly as you can. Next, write down all the sample characteristics your research population requires. If your problem statement does not identify the target population in enough detail to identify the characteristics of the sample, go back to the literature and determine what they should be.

    Note: Learners proposing a quantitative research problem should, for the sake of practice here, select only one concept from their research problem and work out a research question on that single concept.

    Practice example: The research problem is how psychology students in an online graduate program describe their experience of the process of assimilating and accommodating complex psychological theories. Your concept or phenomenon statement would be:

    • The experience of assimilating and accommodating complex psychological theories (the terms are borrowed from Piaget's theory of the process of learning).

    Your sample characteristics identified in the problem statement would be:

    • Graduate students in psychology.

    Immediately, you notice that while the phenomenon is stated reasonably clearly (psychologists know what Piaget's terms mean), the sample characteristics are quite broadly stated. "Graduate students in psychology" does not help you determine specific sample characteristics to screen for. A quick review of your literature and reflection on your personal interests suggests that you should study female doctoral students in online programs affiliated with on-ground universities. Even that is too broad. There are many specializations within psychology, and at least two doctoral degrees, the PsyD and the PhD. So to your list of sample characteristics, you decide to add:

    • Female (some literature suggests that complex theory is a kind of narrative more comfortable for males).
    • PhD students (the degree that is research and theory oriented).
    • In neuropsychology, social psychology, and forensic psychology (specializations that require mastery of complex theories).
    • Taking online courses within a doctoral program affiliated with an on-ground institution.

    Apply: Do Step 1 with your own research problem.

  2. Next, write down exactly the form of inquiry that your problem requires. The main forms in qualitative research include:

    • Conversational inquiry (talking with the participants). Typical words for this might be "describe," "relate," "discuss," and similar words.
    • Observational inquiry (observing them in their natural habitat and operations). Typical words for this might be "researcher observe," "researcher describes the behavior of," or similar constructions.
    • Inquiry of texts (analyzing written documents, journals, or other productions that cast light on the research problem). Words suggesting this might include "what do texts reveal," "how do documents describe . . ." and similar constructions.
    • Inquiry of objects and images (artifacts). Words suggesting this might include "what do artifacts indicate" or "how do images and artifacts reveal …"

    Practice Example: In the example, the research problem (what is not known) is how these graduate students describe their personal experiences in coming to terms with and mastering (assimilating and accommodating) complex theories. Obviously, you could choose either a conversational inquiry or an analysis of texts. The latter might demonstrate accommodation (mastery), but would it allow you to learn about the experience of developing mastery (that is, of assimilating and then accommodating new learning)? It seems reasonable, then, since the problem is to learn how they describe their experiences of this process, to use a conversational inquiry.

    Apply: Do Step 2 with your own research problem.

  3. Now, craft a conceptual version of your question using these ingredients. After you have a draft question, examine it carefully. Does your question:

    • Clearly name the phenomenon you are going to investigate?
    • Clearly indicate the characteristics of the sample?
    • Clearly identify the kind of inquiry to be carried out, using words like "describe," "observe," "analyze," and the like?
    • End in a question mark, and have the characteristics of a good English sentence?

    If it misses on any point, correct it.

    Practice Example: Taking into account all these ingredients, a first draft of the conceptual version of the example might be:

    How do women studying neuropsychology, social psychology, or forensic psychology in online PhD programs offered by a traditional on-ground graduate institution, describe their process of assimilating and accommodating complex psychological theory?
    Apply: Do step 3, the conceptual version, for your own research question.

  4. Rewrite the research question as often as it takes to make it crystal clear, succinct, and yet complete. Work with the grammar to make the English reading of the sentence more graceful and clear.

    Prepare to revise and Rewrite Your Question as Your Lit Review Deepens

    Your search of the literature about your topic and research question will continue until you complete your dissertation. When you find new research that changes the nature or focus of your problem statement, your question will need to be revised accordingly. This is quite common. So plan to keep revisiting your research problem and question regularly, up to the point where they have been finally approved by your dissertation committee and the IRB and you are ready to start your participant recruitment. That question and only that question will be your final edition.

Reference

Costa, P. T., & McCrae, R. R. (1992). Revised NEO personality inventory (NEO-PI-R) and NEO five-factor inventory (NEO-FFI) professional manual. Odessa, FL: Psychological Assessment Resources, Inc.


Doc. reference: phd_t2_psy_u04s4_h04_craftque.html