Available Research Designs Based on Example Research Questions – SOBT

"How will training in four optimism competencies--confidence, control, self-awareness, and success—increase employee optimism?" (Steinwall, 2006).

The question implies a cause-effect relationship between training (independent variables) and optimism (dependent variable). A random sample of the employees was randomly assigned to either a training group or a control group. The control group received no training. The use of random selection, coupled with random assignment to training conditions and a control group, implies a true experiment.

How will training (using non-randomly assigned participants) in four optimism competencies--confidence, control, self-awareness, and success—increase employee optimism?

The research question could be the same as the experimental one. The question implies a cause-effect relationship between training (independent variable) and optimism (dependent variable).  This is used when it is impossible to randomly assign participants to experimental and control groups such as in naturalistic experiments where participants are already in the groups. The question implies a cause-effect relationship. The external validity is not as strong as that of the true experimental design.

For air traffic controllers in managerial roles, what are the differences in leadership styles by gender? (adapted from Krear-Klostermeier, 2012).

Typically focuses on group differences and may use historical data/secondary data to relate possible causes of current condition. This does not measure or imply causation.

“What is the role of the middle manager’s strategic activities, attitudes, beliefs, that affect employees’ contributions to emergent environmental strategy?” (Porter, 2006)

The case study uses one or a small number of cases for the sample and conducts and in-depth, intensive study with a high degree of intensiveness. This studied using two companies and multi-levels of analysis, middle managers and employees, eco-innovation was explored with a statistical approach. Explanatory research operates within the boundaries of selected organizations defined as cases. Quantitative case studies may also investigate longitudinal data from single bounded organizations and might include some qualitative artifacts. This is an excellent design for secondary data. Defining a case study as qualitative or quantitative is a matter of degree based on the research question deemed to have the highest priority.

Often critical realist research case studies use multi-methods and multi-levels to explain mechanisms that generate an event. In essence, the question asks what caused events associated with the phenomenon to happen. This is an emerging technique in Information Systems research.

What is the relationship between the manager’s goal directedness, generalized trust, and decision-making style? (adapted from Osborne, 2011).

The empirical study focuses on predictions or relationship among variables. The research sought to explain/predict the dependent variable, decision-making style (measured with the General Decision Making Styles inventory), with two independent variables--goal directedness (measured with the Hope Scale) and generalized trust (measured with the Rotter Interpersonal Trust Scale). The sample was a probability constructed panel data from a commercial vendor. Often surveys are used for data collection with the general linear model for statistical analysis.

“To what extent does the existence of a Project Management Organization (PMO) or PMO functions when a formal PMO was not present contribute to reported IT project success?" (Stewart, 2010)

Seeks to make inferences about the beliefs, behaviors and attitudes of population based on a probability sample. Descriptive surveys which only summarize data, are not appropriate for dissertations, but are highly informative about the sample participants. This type of survey can be expanded to explore multiple differences in variables. Survey research methods are also used as a data collection strategy in other designs.

How can specific characteristics of email correspondence be used to identify e-styles? How do e-styles and in-person styles correlate? How can managers learn to adapt e-styles to communicate more effectively with staff at remote locations to increase trust, build relationships, and improve productivity? (adapted from Firari, 2007).

This study created and analyzed a neural network to test hypotheses about the e-communication styles. Neural network analysis is one technique in data mining and analytics. Other models found in Decision Science, Management Science, Project Management, Operations Management and Finance include quantitative applications such as Analytical Hierarchal Processing, Forecasting, Decision Theory, Mathematical Programming, Data Mining, Inventory Models, Neural Networks, Quantitative Delphi, and Simulations with applications to organizational problems.

“What is the actual decision-making process followed with the a Western-Japanese product development organization? What are the underlying factors that lead to the observed decision-making phenomena (decision reversals, changes of direction, project stops and starts? To what extent do cultural differences between the location operation and the corporate headquarters act as the most salient root cause of the observed decision-making phenomena? To what extent do operational differences, such as organizational design, IT strategy, product design strategy and team operation, play a role in causing the observed decision-making phenomena?” (Marion, 2006)

Multiple new product development cases purposively selected within a single company were studied to analyze the differences and similarities in the role of information management and decision making processes. The study is bounded by investigation new product developments in one, international corporation. Interview, archival records, and multiple artifacts were the data source. Embedded might be quantitative surveys, statistical and analytical modeling.

Which aspects of organizational performance do senior managers of high performing organizations consider in the strategy development process?

Which measures of organizational performance do senior managers of high performing organizations employ in the strategy development process?

How have the number, type and the utilization of metrics changed over the past decade?  How do the number, type and the utilization of metrics in the strategy development and implementation processes differ among Malcolm Baldrige National Quality Award recipients in the sectors of manufacturing, small business, and service? (Adapted from Ulrich, 2012, unpublished)

The study is bounded by organizational Baldrige Award Recipients with multi-methods used for in-depth analysis of the cases. Many case studies also contain quantitative element and use statistical analyses, but are framed in the qualitative style of inquiry. Defining a case study as qualitative or quantitative is a matter of degree based on the research question deemed to have the highest priority.

How do attorneys and human resource managers who practice mediation describe their experience of doing so?

“Describe their experience” implies many designs within qualitative methodology.  In this case, the experience is of a certain professional practice. The research interest can include both their own personal feelings and reflections on doing that work, and the practices, pitfalls, rewards, and challenges.  Their descriptions, to be thorough, should include details of everyday life in that practice—how the meetings are organized, frequency, and so on.  All these things are not appropriate for phenomenology, which focuses on the ‘lived experience,’ the internal cognitive/affective experiencing of something as it happens in the moment.  Nor is the question quite appropriate for grounded theory, which asks for descriptions of the experience of some kind of process.

"What are the roles and responsibilities of the Fortune 1000 diversity officer, as defined and in practice? How is organizational support demonstrated for the diversity officer and the diversity initiative? What factors facilitate and hinder the success of the diversity officer’s efforts? What conflicts or challenges occur in the implementation of the diversity initiative?" (Moses, 2010)

Like the previous question, the phenomenon to be described is an external one, involving non-psychological aspects. This is ideally suited to generic qualitative inquiry. Often there are multiple research questions and multiple interview questions.

“What are the perspectives of information security and privacy experts on future security and privacy implications of healthcare industry digitization that relate to medical identity theft?” (Adeyemo, 2012).

The Delphi technique can be applied for forecasting or communications from a panel of experts using multiple rounds of data collection for numerical data which tends to get closer to an “average” value. This study was combined with sampling and analysis methods also found in grounded theory. The Delphi technique is frequently used in a quantitative analytical study.

How do middle-level managers in large corporate organizations describe the transition from employee to manager?

Grounded theory describes and explains a process—how the participants accomplished a certain outcome—and thus is a description of a longitudinal phenomenon rather than a cross-sectional one. Although lacking the word “process,” the “transition” idea substitutes for it, and the question suggests grounded theory.

What is the lived experience of anger of middle managers in accounting firms?

This is the classic kind of phenomenological question.  First, “lived experience” identifies the everyday, non-reflective, as-it-happens kind of consciousness.  Second, “anger” is a classic interior phenomenon, the experience of which is private, occurs in one’s consciousness, and cannot be directly observed by others. There is only one research question in phenomenology.

“Is there the ability to develop and use a tool to reliably and repeatedly provide comparable results in testing wireless systems and protocols, without the need of using a real-world, physical wireless infrastructure, using a commercially available simulation. Through the use of the artifact, and a controlled simulation environment, can the results be repeated?” (Peacock, 2012)

Seeks to create innovations that define the ideas, practices, technical capabilities, and products through which the analysis, design, implementation, and use of information systems can be effectively and efficiently accomplished. The innovative artifact, the development of a virtual wireless network model, enables the developer to input data into a simulation tool. The design artifact must meet the identified business need with a defined goal of utility.