QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

Embed Size (px)

Citation preview

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    1/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 1 of 24

    UNIVERSITY OF OSLOFaculty of Mathematics and NaturalSciences

    INF5220 Qualitative ResearchMethods

    Spring 2006 (intensive course)Initial draft for PhD upgrade document.

    Working title: Making scientific

    management more scientific: On the

    application of action research in quality

    management and process improvement

    Written by:Petter gland

    Delivered:June 15th, 2006

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    2/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 2 of 24

    Table of Contents1 Introduction................................................................................................................. 3

    1.1 Background......................................................................................................... 31.2 Research setting .................................................................................................. 3

    1.3 Research problems.............................................................................................. 4

    1.4 Intended readership and expected results ........................................................... 5

    2 Related research.......................................................................................................... 62.1 Various types of action research......................................................................... 6

    2.2 Problems of action research................................................................................ 6

    2.3 Action research and the Shewhart cycle ............................................................. 6

    2.4 Action research and systems thinking................................................................. 72.5 Action research and statistical thinking.............................................................. 8

    2.6 Flow .................................................................................................................... 8

    3 Methodology............................................................................................................. 103.1 Population and data........................................................................................... 10

    3.2 Apparatus and materials.................................................................................... 10

    3.3 Procedures......................................................................................................... 114 Current status ............................................................................................................ 12

    4.1 The COBOL programmers at NTAX ............................................................... 12

    4.2 The software documentation process at NTAX................................................ 13

    4.3 The NTAX management information system................................................... 134.4 Quality management outside NTAX ................................................................ 14

    5 Future plans............................................................................................................... 15

    5.1 Philosophy of science ....................................................................................... 15

    5.2 Knowledge management................................................................................... 165.3 Process improvement........................................................................................ 17

    5.4 Information infrastructures ............................................................................... 18

    5.5 Next version of upgrade document................................................................... 18

    References......................................................................................................................... 21

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    3/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 3 of 24

    1 Introduction

    The activity of quality control and process improvement is very similar to doing research,and the main drive behind my PhD is how to improve the process of quality management

    by making the process gradually more and more similar to academic research.

    1.1 Background

    To my knowledge, there are two major issues that seem to put the development and

    maintenance of quality management systems in danger:

    The traditional way of installing systems top-down is not a robust way ofintroducing a new way of thinking, and such TQM-programs often fail.

    People performing quality management are seldom good at taking their ownmedicine, i.e. they are not good at controlling and improving their own processesin a systematic and scientific fashion.

    In 1996 I had been working on a mismanaged software development water-fall projectfor some years. By chance I got hold of Kevin Kellys Out of control (1994), and my

    perspective on quality control and software management changed completely. From then

    on I started thinking of software development as managing complex adaptive systems

    (CAS) and of the programmer as an integrated part of the system being developed. As itis difficult to plan and measure progress when following a CAS approach, it struck me

    that the best way of monitoring and improving my own progress would be by thinking of

    the process as of doing scientific research.

    In 2000 I tried applying the same methodology for organizing quality management at theNorwegian Directorate of Taxes, and read the management theories of Taylor, Shewhart,

    Deming and others who saw (quality) management as a way of doing research.

    In 2005 I was given the opportunity to work more closely with academia to develop themethod of doing action research in ones own organization.

    1.2 Research setting

    My research is funded by NTAX, and according to my contract with NTAX the researchis expected to contribute to adding to international quality management certifications.

    In writing the PhD thesis Im drawing upon past experiences from The Norwegian

    Meteorological Institute (DNMI) and The Norwegian Directorate of Taxes (NTAX). I

    also continue to perform some minor quality control experiments at NTAX in order totest and experiment with new insights evolving during the PhD research period.

    I also plan to carry out some experiments and evaluations in respect of how quality

    management is carried out at the University of Oslo, and I also have a second supervisorat Det Norske Veritas that may give me access to certain aspects of how quality

    management is carried out at the organization.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    4/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 4 of 24

    1.3 Research problems

    In my experience, what seems to be the best way to deal with (1) the lack of robustness in

    top-down development of TQM projects and (2) the lack of rigor in how qualitymanagement is being carried out, is to research the problem of improving the qualityimprovement processes that are being managed within the organization. In ISO

    9000:2000 and other bodies of quality management knowledge, such processes are often

    referred to as plan-do-check-act cycles (PDCA-cycles), an industrial parallel to what isreferred to as action research (AR) in academia.

    What I see as the key issue for improving TQM programs is to improve the way AR isdesigned and implemented. I describe the research questions as follows:

    Is it possible to use the framework of total quality management for producingacademic research?

    If possible, how does one implement research in a simple and efficient manner?I see four major aspects that motivates seeing process improvement from the perspectiveof action research:

    1) The PDCA-cycle and similar cycles for managing continuous improvement in

    organizations is similar to Kurt Lewins action research cycle. Taylor (1911) wanted todevelop a scientific way of managing organizations. Shewhart (1938) saw strong

    resemblences between performing quality control and testing hypoteses in empirical

    research. As quality management is about predicting processes and cataloguing errors in

    order to improve the system, the aim of action research and TQM in an organization issimilar. In TQM new knowledge must be relevant and useful for improving the

    organization, in action research new knowledge must be relevant and useful for

    academia.

    2) Even if an organization were to adopt the formula of action research rather than TQM,literature on action research reveals that one of the major problems with the paradigm is

    the problem of making interesting theoretical contributions when solving interesting

    practical problems or solving interesting practical problems when trying to make

    interesting theoretical contributions. Adding insight on how to do academic researchwithin the TQM framework could consequently add to the understanding of how to

    succeed with action research.

    3) One of the aims of TQM is to learn from other organizations, e.g. through use ofbenchmarks. Making it possible for the organization to tap into the continuously

    evolving body of knowledge of academic management theory could be of practical use

    for the organization.

    4) The peering review quality control of academic research seems like a relevant

    mechanism for applying quality control on the people responsible for organizationalquality management.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    5/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 5 of 24

    1.4 Intended readership and expected results

    Although people working with quality management may be isolated in organizations,

    there are journals and conferences for sharing insights. Personally Im a member of theAmerican Sociey for Quality and meet annually with the Norwegian forum for QualityProfessionals (QUALIS). Apart from wanting to contribute to the Information Systems

    research community, where both AR and Management Information Systems (MIS) such

    as quality management systems are important issues, I have the particular audience ofquality management professionals in mind as an intended readers.

    Figure 1 illustrates the five phases of doing AR and how each cycle in the method isexpected to add clearer insight as scope is narrowed down with each iteration.

    The expected results of the research will be an interpretation of the AR model in the

    context of doing quality management. This will be done by adding guidelines andstructure on how to apply the AR model in an efficient manner.

    Figure 1. Action research spiral (Routio, 2005).

    There are two problems often associated with action research:

    Failing in terms of research: AR becomes too focused on action, thus producingnot too interesting research.

    Failing in terms of action: Organizational change and improvements break downthe moment the AR is completed.

    It is the aim of the PhD research to add insights on how to minimize these two risks whenimplementing AR for doing quality management.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    6/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 6 of 24

    2 Related research

    The term action research seems to have been first used by Kurt Lewin (1946), todescribe a cyclic approach for doing research that includes planning, acting, observing

    and reflecting. Due to various issues, such as problems related to objectivity and

    repeatability, there have been some controversy in academia as to whether AR is aframework for doing science.

    2.1 Various types of action research

    Various styles of action research has evolved, such as Canonical Action Research (CAR),Participatory Action Research (PAR) and various styles where the number of steps in the

    cycles and the implications of each step varies (Robson, 1993: pp. 438-443). The aim of

    my thesis is to investigate aspects of AR that may prove useful from the point of view of

    quality control, and thus I use this chapter to indicate some of the aspects that seem torelate to Demings philosophy of quality management (Deming, 1986; 1992).

    Yet I have not been able to classify and map the different types AR, but in order to dealmore deeply with the differences and similarities between the Lewin-inspired action

    research and the Deming-inspired process improvement style, more literature research is

    needed.

    2.2 Problems of action research

    Due to problems with traditional (positivist) research in organizations, Susman andEvered (1978) argue the need for action research and suggest strict formal procedures for

    doing action research in a controllable and repeatable manner. Whether it is possible toput action research into the Webern iron cage of making it compliant with the ISO

    9001:2000 requirements is something I have not seen being asked yet, although this is anidea I try to follow at the Norwegian Directorate of Taxes (SKD, 2006).

    There seems to be two major problems in AR that we have noticed in several books andarticles:

    AR consists of Action and Research, but often AR projects ends up as eitherAction or Research.

    The purpose of the researcher in an AR team may be to help some changemanagement program, but often all change ends when the research ends. Creatingsustainable change is difficult.

    I need to do more focused literature research on AR in order to classify problems and tryto figure out to which extent I believe the TQM approach to AR might be helpful.

    2.3 Action research and the Shewhart cycle

    Action Research (AR), as originally conceptualized by Lewin, operates within an

    epistemology that links knowing with doing or knowing with change. Originally the

    research paradigm was made to fit with Lewins force field theory for obtaining change,

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    7/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 7 of 24

    but there are now different schools of AR each defining the ideology and methodology of

    the approach in slightly different ways. One way of creating a fusion between AR and

    TQM, may perhaps be to follow the epistemology of Shewhart and Deming, looking at

    AR from the perspective of American pragmatism.

    The action research approach in TQM, as defined as the PDCA-cycle in the ISO

    9000:2000 standards, and the Shewhart-cycle by Deming (1986), looks as illustrated in

    the diagram below.

    Figure 2. The action research model for quality improvement (Deming, 1986).

    2.4 Action research and systems thinkingLilienfelds ideological analysis of systems theory (1978) is interesting. He links aspectsof power and hierarchy with the systems view of the world, but he does not take complex

    adaptive systems into account, and neither does he talk about second order cybernetics

    where the observer is a part of the system to be observed.

    Figure 3. Illustration of the organization as a system (Deming, 1986).

    The main focus in Demings The New Economy (1992) is the view of the organizationas a system, and, as I understand it, what he means by a system is that what he illustrates

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    8/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 8 of 24

    in the figure above. Seeing artifacts and people flowing through the processes, implies an

    ontology that makes statistical thinking suited as a standard epistemology.

    Checkland (1981) has written on systems thinking and action research. The way Iunderstand him, is that he manages to produce an ontology similar to that of Actor-

    Network Theory (ANT) by including the observer into the system that is being observed.

    If the researcher is manipulating the reality of the people being researched, we get into

    the situation of a (post-modern) self-referential system as basis for ontology andepistemology.

    2.5 Action research and statistical thinking

    While Lewins theories of action research and organizational change were based on the

    metaphor of mathematical models for explaining force fields in physics, my impression isthat action research is mostly conducted as a way of combining qualitative research and

    action, although I get the impression that quantitative methods may be included. The

    Shewhart-cycle, on the other hand, has statistical experiments in the organization as the

    starting point, but may also include qualitative studies if this is appropriate for theunderstanding of the processes to be investigated.

    As pointed out by Gitlow (1992), even though Deming was a statistician, often he did not

    apply numbers at all. Statistical thinking may be more powerful than statistical practice.These insights seem to be similar to what we see in people like John Urry trying to

    explain social phenomena through use of mathematical concepts of fluids and dynamic

    systems theory, although strictly from a metaphorical point of view.

    When Deming talks about statistical process control, this is done for the purpose of

    investigating whether a process is stable or not. Normally the process is expected to be

    stable, and statistical methods are applied for collecting data and finding out whetherthere are signals indicating the process is not stable.

    The question of stability and instability plays an important role in the development ofcomplexity theory, such as Complex Adaptive Systems (CAS), where a different systems

    approach may be used for evolving systems or networks of systems when traditional

    systems engineering methods are less efficient.

    CAS may also prove to be an interesting design strategy for building quality management

    systems. Goldstein (1994) has suggested some ways of doing action research in unstable

    organizations, applying the Lewins standard framework, but rather thinking along

    models of CAS than those of force fields for gaining insights on what may producesustainable change.

    2.6 Flow

    Deming (1992) summarized his quality management philosophy to consist of (1)

    appreciation for a system, (2) understanding variation, (3) theory of knowledge, and (4)psychology. In the subsections above, I have addressed his first three issues. The points

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    9/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 9 of 24

    he makes about psychology, strikes me as similar to those of Csikszentmihalyi (1990),

    focusing on the inner motivation of people in order to achieve high quality output.

    Figure 4. Conditions for optimal subjective performance (Csikszentmihalyi, 1990).

    There may be some insights on the meaning of quality in books like Computers in

    context (Dahlbom & Mathiassen, 1993), perhaps adding more to the understanding of

    epistemological and ontological issues for understanding process improvement through

    the process of action research.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    10/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 10 of 24

    3 Methodology

    The main purpose of this chapter is describe how I plan to investigate the research AR ina systematic manner, making it possible for other researchers to check and repeat the

    procedures in order to verify the results or criticize the approach.

    3.1 Population and data

    When investigating a method rather than investigating people or a phenomenon, it seems

    to me the natural perspective should be the perspective of hermeneutics, i.e. trying to

    interpret the various writings on AR and TQM in hermeneutic circles that are supposed togradually converge into a theory, a framework or a model for applying AR in a TQM

    context.

    However, for testing whether this model will be able to improve the quality andefficiency of implementing and maintaining TQM in organizations, not only literature

    studies will be done, but also practical tests, evaluating people doing AR in a TQM

    context for investigating what are the problems they are struggling with and how can weimprove the framework for doing AR in order to solve of compensate such problems.

    Furthermore, in addition to carrying out experiments, the relevance of AR in a TQMsetting should also be investigated through interviewing people in the TQM community.

    Do the TQM practitioners see them selves as researchers, like Taylor, Shewhart and

    Deming did, or do they think of themselves more like engineers or use other metaphors

    for understanding their own work?

    The population to be studied in this research is the mathematical set S of all possible

    ways to construct a cyclic process improvement program. Lewins original concept of

    AR and Demings PDCA cycle could represent two pointsx andy in S. The quest wouldbe to identify what relevant structures that may turn Sinto a topological space and then tofind a method z that satisfies the criteria of being an optimal or close to optimal AR

    strategy for doing TQM.

    3.2 Apparatus and materials

    As we want to describe the space of action research cycles in a mathematical or semi-

    mathematical language, the soft systems thinking approach of Checkland (1981) seems

    like a good starting model for building ideas.

    Choosing hermeneutics as a research framework, the ontology consists of how concepts

    are related and the corresponding epistemology will be that of trying to attain a subjective

    understanding and to try to convey this understanding through the use of language and

    signs.

    As a mental model evolves, showing how the various ideas and concepts fit together, the

    model will be challenged through thought-experiments and probably also by real

    experiments in organizations, in order to check whether the new insights will result inmajor changes in how the action research projects are designed and implemented.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    11/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 11 of 24

    Further testing of the ideas will then be done by interviewing action research experts and

    quality control experts, in order to identify similarities and differences between what the

    new model suggests and what we observe is being done in practice.

    3.3 Procedures

    As a part of the aspect of testing the new AR models in the organization, a typical way of

    installing ISO 9001:2000 through AR could be to have the action researcher define

    flowcharts, measurements, statistics and procedures for his own part of the system, andthen gradually spin a co-web of TQM around the people and units he is researching,

    resulting in the ISO 9001:2000 practices remaining and improving even after the AR is

    completed.

    In the diagram below is an illustration of the hermeneutic circle as I plan to use it for

    gradually increasing in-depth understanding of the AR method.

    Figure 5. Hermeneutic circle (Grassie, 1994).

    The point of the illustration is not to explain the principles of hermeneutics, nor to say

    that I have chosen one hermeneutical approach rather than another, but simply to point

    out that hermeneutics can be thought of as a procedure for managing meaning throughlife and text. In other words, in order to avoid confusion between the two scientific

    paradigms, I want a graphical illustration that says that AR is the object for research

    (figure 1) and the hermeneutic circle is the method of research (figure 5).

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    12/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 12 of 24

    4 Current status

    The thesis is currently expected to be comprised of 5-6 papers, addressing various issuesrelated to action research in the context of quality management and process improvement.

    So far Ive written one paper on COBOL programming for the IRIS 29 conference inHelsingr 12.-15. August 2006. While still collecting data for further updates on the

    COBOL paper, Im also collecting data as part of an experiment on software

    documentation. Wanting to see how these two separate quality processes can be linked,

    After than I plan to look at some high-level part of the NTAX management system, andIm also planning to interview some quality management professionals.

    4.1 The COBOL programmers at NTAX

    Ive written an IRIS article on the COBOL programmers, but its a problematic paperbecause, even though the empirical data may be interesting, the paper is not clear on what

    research questions it is trying to solve. The focus of the paper is on the sociology of

    COBOL programmers, managers and quality management. Rather than problemizing theuse of action research, it serves more as an example of how the action research approach

    was used for gaining insights on programmer psychology by seeing how and why they

    reacted to being part of a SPI process.

    The process of writing the paper has been very useful for learning about writing in

    general, discussing ideas, submitting, getting reviews, reviewing other papers and

    understanding various practical issues related to be a research scientist.

    There are many ideas in the COBOL paper, but the major reason for making it

    problematic is that it is written from the perspective of the action researcher inside the

    NTAX organization, researching the sociology of the IT department in order to betterunderstand whether the COBOL quality management system is under control and find outwhat to do in order to make it work even better. This is, however, not the same problem

    that Im trying to address through this thesis. In this thesis I want to look at how action

    researchers (like the person in NTAX) are applying the method of action research, and to

    draw insights from this to understand and improve action research as a TQMmethodology. If I were to follow the path of the current COBOL paper, I would be

    writing a thesis on programmer psychology (or programmer sociology), not a thesis on

    quality management and process improvement.

    Nevertheless, as Ive now written a piece of action research on COBOL programmers, I

    could now use this paper as one of several papers of people applying action research for

    achieving process improvement and thus try to generalize and learn something from it.

    My vision for this PhD research is to make quality practitioners in all organizations intoaction researchers, contributing papers similar to the COBOL paper, to be judged by peer

    reviews for relevant journals and conferences.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    13/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 13 of 24

    4.2 The software documentation process at NTAX

    In the case of the COBOL programmers, I had seven years of data, showing continuous

    improvement. For the documentation process I have about five years of observations, butunlike the programmers and their managers, who all felt unhappy being monitored bytheir own standards and own measurement programs, the psychology or sociological

    patterns of the people writing technical documentation is different.

    The people writing technical documentation are also responsible for running the

    programs made by the programmers, and they get very little feedback for what they are

    doing, except when there are breakdowns or problems. Being monitored and measuredagainst documentation standards has been well received both by the people writing the

    documentation and their managers. The results of the measurements show that they are

    good and improving. Everybody are happy. The Hawthorn effect seems to be working

    nicely.

    Given a more positive environment for exploring the methods of quality control, my aim

    has been to gradually remove myself from the part of the quality control by assessing

    others doing quality control rather than doing the control myself. The measurements in

    this case is increasingly becoming meta-measurements, checking to which extent thequality control within this environment (how the people are checking and measuring each

    other) seems to work as a stable process.

    While I have just started writing a paper on this, I need to figure out how I can address

    the population of people doing quality control rather than the people doing the actual

    work.

    4.3 The NTAX management information system

    The two processes Ive discussed so far are interesting in illustrating problems and

    aspects of establishing quality control routines, but the processes are rather remote to the

    core business processes of NTAX. In order to measure what counts, I need to look at the

    indicators that the Department of Finance are using for monitoring NTAX.

    Having previously focused on this from a practical point of view, I have twelve years of

    data showing the annual inflow of taxes and the outflow of NTAX production costs. As

    one should expect this quotient to decrease over time, due to efficiency increases at

    NTAX, or at least remain stable, I have used this indicator as a total business index.However, as this may be sensitive data (even though it is publicly accessible), Im not

    sure as to whether I should focus on this index or find other indices that might be less

    sensitive.

    Once again, it is the action research process that I want to address, and not the object that

    the action researcher is studying. However, in order to achieve success in qualitymanagement it is generally recommended that one tries focusing on improving processes

    that matters to those who are responsible for the quality of the organization (e.g. Oakland,

    1999: 21-43; ISO, 2000b: chapter 5). How to select targets for process improvementseems to be relevant and interesting question when performing action research. Based on

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    14/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 14 of 24

    my personal experience, I would say that this is perhaps the most important and

    challenging questions of all AR questions in the context of TQM.

    4.4 Quality management outside NTAXWorking as a quality management professional, Ive subscribed to various quality

    management journals, participated in conferences, visited other organizations, spokenwith other quality professionals, participated in electronic discussion forums etc., in order

    to learn and share experiences on how to improve organizational performance.

    Investigating the population of quality managers, what should one expect to find?

    Deming (1986: 469-470) expects the following:

    What would be the minimum qualifications for this job? (1) equivalent of a masters degree in

    statistical theory; (2) experience in industry or in government; (3) authorship of published papers

    in theory and in practice of statistical methodology; (4) demonstrated ability to teach and to leadtop management toward constant improvement of quality and productivity. He himself will

    constantly improve his education.

    Although I have not performed any formal investigations, I have only met a few people

    who seem to fit this description, although none so far in Norway. In fact, most of the

    people I meet as quality managers for NTAX subcontractors, at quality managementconferences or elsewhere, seem unfit for quality management according to the Deming

    criteria.

    Not expecting to learn much about quality management from interviewing quality

    managers, one could nevertheless learn something about what quality managers tend tosee as the most challenging aspects of improving organizations, what has been most

    successful, what has been least successful etc.

    In august I plan to participate in the annual Norwegian conference for EOQ certified

    quality managers. I am now in the process of planning questionnaires and interviews.

    I am also hope to be meeting with my second supervisor at Det Norske Veritas as quickly

    as possible, in order to ask whether he can put me in contact with the internal quality

    management at DNV for discussing the research project.

    Being a PhD student makes me a part of academia and consequently an observer ofvarious initiatives and processes aimed at improving the PhD process and the quality of

    research. As the approach for doing so seems far more consistent with the ideas ofDeming and TQM than what I have observed in industry, it seems like a golden

    opportunity to try to document and research how this part of the UiO quality management

    system works.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    15/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 15 of 24

    5 Future plans

    As a part of the PhD studies, I have planned for a theoretical curriculum consisting offour courses. I have used these courses as structure for this final chapter.

    5.1 Philosophy of science

    For me, the most useful aspects of the course INF5220, apart from the practical aspects,

    were the issues related to the philosophy of science. Talking about systems thinking,

    Checkland (1981: 101) makes some comments on the observer making systems

    descriptions that seems equally relevant for a researcher building theory regardless offramework:

    Our observer may have various motives for making his systems description, and the latter will

    reflect the nature of his motivation. He may be motivated by curiosity, aiming only to observe anddescribe in order to ascertain whether clear and intelligible descriptions are possible in systems

    terms. or he may want to make use of a systems description in some kind of problem-solving. Or

    he may want to bring about changes in a part of reality, his motive may be one of design. These

    motivations reflect three different roles for the observer. he may be a natural historian,

    describing and classifying, a manager or an engineer.

    From my current understanding of how action research is being used as a framework forresearch within the IS group at UiO, I get the impression that it is mostly implemented

    with an ontology corresponding to how a natural historian would see the world, rather

    than through the lens of a manager or an engineer.

    When applying the action research paradigm to total quality control, there are similarconsideration to take. Should we select and ontology and epistemology corresponding tothat of a manager, as Deming (1986; 1992) does, or to that of an engineer, as Juran

    (1964) does, or that of a natural historian, as Crosby (1979) does. Each of these three

    quality gurus see the problems and issues of quality management differently, and offer

    different solutions.

    However, the different approaches may be of different use depending on what kind of

    problem is currently at focus. If it is a problem of enrolling people into an ideology of

    quality then the storytelling manners of Crosby may be the right approach. It if is actionand design of the quality management system that is important, then Juran may be the

    greater authority, while Deming may have the best insights when it comes to issues ofmanagement, prediction and control.

    While Deming, Juran and Crosby are always mentioned in introductory courses and

    books on quality management, representing different approaches to quality, sometimes

    indicating that their ways may be similar to that of a scientist, an engineer and asalesperson, Ive never seen anybody going more deeply into their respective

    epistemologies and indicating how the different approaches may be useful in various

    iterations of the action research, depending on what of problem one is trying to solve.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    16/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 16 of 24

    Rather to the contrary, I get the impression that some people (e.g. Avison, Lau, Myers &

    Nielsen, 1999) see academia as a war between qualitative and quantitative research and

    that AR is one of the weapons used by the qualitative researchers. This, however, strikes

    me as contradictory to the original ideas of Lewin (1946), where he talks about thedifficulty of progressing if we do not have benchmarks for measuring progress.

    Burrell and Morgan (1979) has written an influential book on how various research

    paradigms add different perspectives on problems and there is no true perspective onanything before we understand the intentions of the observer. To which extent scientists

    performing action research are changing their epistemologies corresponding to the

    problems they investigate, or whether they are brainwashed into seeing the world froma singular perspective, is something I think would be interesting looking into, both from

    the perspective of quality management practitioners and people doing action research in

    academia.

    5.2 Knowledge management

    In the first report I made for the INF5190 course, I tried to understand the KM conceptsfrom the perspective of TQM, and thus focusing on explicit knowledge rather than on the

    tacit knowledge which was what the course mainly focused on. Through this perspective,

    however, I gain a very clear understanding of the difference between data, information

    and knowledge, linking the KM concepts with the information theory of Shannon andWeaver (1949) and the philosophy of science as used in quality control by people like

    Shewhart (1938) and Deming (1986; 1992).

    In the next report I prepared for the course, I tried to figure out how Nonaka & Takeuchi(1995) and Kuhn (1962) both used Polanyis concept of tacit knowledge in what

    seemed to be natural interpretations, and yet they seemed to about two completely

    different things. The un-articulate knowledge in performing something like swimming orriding a bike is different from the un-articulate knowledge in a mythology, making people

    behave in accordance with certain values and beliefs.

    What I suggested in the report, is that there seems to be need for another dimension in

    addition to the line between tacit and explicit. In retrospect I wonder if this additional

    dimension is what defines the Burrell and Morgan matrix (1979), but I have not yet come

    across any explicit discussion of this. On the contrary, to me it seems like people in KMliterature are confusing the concepts of tacit knowledge in action and ideas. However I

    need to consider more carefully what consequences (the so what) in KM when these

    issues are confused before considering whether it might be relevant planning for an

    article on knowledge management.

    A third idea struck me shortly before the exam, and that relates to how the word

    knowledge is used in KM. Rather than restricting the use of the word to justified true

    beliefs or the epistemology of Popper, Kuhn or similar, when it comes to the problem ofmanaging knowledge, knowledge appears to be any idea, belief or behaviour. In fact,the whole of KM looks very much like memetics (Brodie, 1996) from this perspective,

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    17/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 17 of 24

    an insight that made it remarkably more easy to understand the problems and various

    solutions to knowledge management (creation, codification and transfer of knowledge).

    Im not currently aware of to which extent there is an established relationship betweenmemetics and KM in academic literature. Before going deeper into this, I should need to

    look more into role of KM in TQM, i.e. how does KM or memetics seem relevant for

    managing knowledge about errors, knowledge about problem, knowledge about how to

    solve problems etc. To which extent would it for instance be interesting to study thesimilarities of Crosbys ideas on culture and motivation (1979) and what Dawkins (1976)

    has to say on brainwashing and religious beliefs?

    There may be potentially many things to discuss within the IS community here, as there

    is a strong focus on communities of practice, globalization, information infrastructures,

    situated learning, culture etc., but I need to see how the possible insights could relate to

    action research before looking more deeply into this.

    5.3 Process improvement

    Although I havent taken this course yet, Ive gone through some of the INF5180 lecture

    notes and read some of the course literature. Much of it relates to quality management. It

    uses CMMI as a framework for discussing processes improvement, and it seems to place

    CMMI in the context of scientific management and total quality management. In otherwords, this is the course that corresponds more or less directly to my current way of

    thinking, and it uses the same models and methods that I would use for improving

    processes. I do not expect many new insights.

    It could be interesting to try to contribute something to the theory being discussed here,

    but the way of designing waterfall projects for installing process improvement systems

    etc is not the way I prefer to work and neither is it a way I believe is a particularly goodway of working with these issues. Current experience from how DNV is trying to aid

    NTAX in getting certified to the ISO 9001:2000 standard, and my experience with the

    Wipro CMM assessment, tells me that the traditional top-down way of installing a qualitymanagement system through the use of some great project is not the best way of doing it.

    It may perhaps be a good way of getting the infrastructure for running the quality

    management system, but it doesnt take into account that it is difficult to know how to

    design quality indicators and know what to measure.

    As I start gaining insights into the AR process, viewing the organization from a CAS

    perspective (e.g. Battram, 1996; Axelrod, 2000) could prove a good way of seeing how

    one should think strategically for aligning the development of the ManagementInformation System (MIS) with the hostile and continuously changing environment.

    Insights or ideas from the information infrastructure literature may be useful (e.g. Ciborra

    et al, 2000).

    Im not yet sure to which extent Lean Management (Womack & Jones, 2003; Liker,2004) will be a part of the course, but if there is one major management fad to contain

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    18/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 18 of 24

    some very good ideas for improving quality management and implementing the Deming

    perspective on quality, it seems to be this one (cf. Seddon, 1997).

    5.4 Information infrastructuresINF5210 is another course I havent taken yet, but as Ive read some of the literature that

    is used in the course, I feel I have a sufficient working knowledge to know what thetheory is about. In fact, some of the most insightful comments Ive read on II are the

    review comments Hanseth and Lyttainen received when trying to have his latest II article

    published in ISR, asking about how II relates to CAS and whether it makes sense to linkANT with CAS (as the authors try to do).

    In a recent PhD trial lecture (Nielsen, 2006), the candidate talked on the relationship

    between information systems and information infrastructures, viewing informationsystems from the perspective of general systems theory (e.g. Lilienfeld, 1978; Checkland,

    1981), characterizing systems thinking on one hand and information infrastructure

    thinking on the other. While being an interesting presentation, I think he was basically

    wrong in seeing the structures as different. In my current understanding of the concepts,information infrastructures is a special case of CAS, applied on information systems, and

    CAS in itself is a part of the systems theory.

    However, there are those who disagree (e.g. Stacey et al, 2000), seeing complexitythinking (e.g. CAS) as radically different from systems thinking. I need to go deeper into

    their arguments, but my initial feeling is that Stacey and the information infrastructure

    people are either not very well read on systems thinking or are (deliberately?)

    misunderstanding some of the core ideas of systems theory. Due to my critical commentsand interest in systems theory, I have been asked by Nielsen to contribute on a paper on

    information systems and information infrastructures.

    Im not critical of information infrastructure as a concept per se, however. In the PhD

    proposal, I focused on the complexity of large bureaucracies, such as the Norwegian

    Directorate of Taxes, and how Information Infrastructure theory (or Complex AdaptiveSystems, CAS) might be a good approach for a robust quality management system

    (QMS) design.

    5.5 Next version of upgrade document

    This is what the PhD Manual (UiO, 2006) says about the upgrade document:

    By the end of the first year, the student shall develop and present a 1st

    year report that will make their

    research visible to the group and assure that they are, or alternatively provide apt support to make

    them, on course to successfully complete their PhD. The content of the 1st

    year report should include

    the following (8,000-12,000 words in total):

    Thesis title Introduction Problem Area Description, and Research questions The significance of the issue to be discussed by the proposed research, and why further

    research on the issue is required.

    How the research issue related to/draws upon existing research and is discussed in therelevant literature which should be critically reviewed.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    19/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 19 of 24

    The theoretical approach/framework being followed and how this compares with possiblealternative approaches.

    Any preliminary fieldwork that has been carried out or previous work done by the studentwith is being drawn upon.

    Research design and methodology to be employed, as well as a justification for this approach. Intended plan for fieldwork, if relevant, including arrangements for access. Anticipated outcomes of the proposed research.

    As I got my PhD proposal accepted on the 9 th of March 2006, it feels a bit early

    presenting an upgrade document, as I have not yet a full overview of related research andI do not even have a full understanding of the research question Im trying to answer.

    When I wrote the initial PhD proposal, I had only a superficial understanding of theculture and ideas of the Information Systems Group at the Institute of Informatics at the

    University of Oslo. My ambition for doing a PhD in quality management has been that

    of having a background in industrial mathematics from 1991 and working in the field of

    software engineering and quality control for 15 years.

    When working with quality control and process improvement, the mode of working

    seems to be to be similar to that of doing action research. However, unlike the researchtradition of information systems (IS), my approach has not been qualitative. It has been a

    mixture of qualitative and quantitative methods, with a focus on applying quantitative

    methods due to the belief of what gets measured gets done.

    However, as I gradually get to know the IS community, I get the impression that the kind

    of problems that I need to address in order to be a part of this community are the socio-

    technical problems that may have implications for design of information systems, or inmy case Management Information Systems (MIS).

    Consequently, in this first attempt to write an upgrade document, I have tried to refocus

    my research problem from problems related to the role of the quality manager of large

    public organizations to the problems of designing and continually redesigningManagement Information Systems in compliance with the requirements and guideless of

    the ISO 9000 series and additional international, regional and de factor standards such as

    EFQM, CMMI, TickIT, ITIL and CobiT.

    Designing management information systems is a non-trivial task. In my research

    proposal I tried to characterize the MIS from the perspective of CAS in order to stimulatea distributed approach for growing information systems rather than the traditional top-

    down approach. Such a change implies a change in control strategy, moving from central

    control to distributed control (preferably some kind of self-control) as can be seen in

    how an ant colony or a bee swarm seem to function (Kelly, 1994).

    In this initial draft of the PhD upgrade document, I have tried to reformulate the original

    research question by focusing how one should control the people responsible for quality

    control (or improve the people responsible for process improvement) by aligning qualitymanagement (interpreted as industrial research) with academic research.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    20/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 20 of 24

    At the moment, I see this as a major improvement on my PhD research design. No

    matter what might be the findings after three years of research, investigating and

    evaluating how other scientists are using action research, I believe it could be of interestboth for the research community, the quality management community and certainly of

    high personal interest for me.

    Although I hope to make some further modifications on this document for presenting thestatus of my research on the 11 th PhD Days Workshop in September 2006, my aim is to

    complete and present the PhD upgrade document as soon as I have completed the exams

    at the end of the fall semester 2006.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    21/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 21 of 24

    References

    Avison, D., Lau, F., Myers, M. and Nielsen, P. A. (1999). Action Research,Communications of the ACM, 42(1), 94-97.

    Axelrod, R. and Cohen, M. D. (2000). Harnessing complexity: Organizational

    implications of a scientific frontier. Free Press: New York.

    Brodie, R. (1996). Virus of the Mind: An introduction to the field of memetics, Integral

    Press: New York.

    Burrell,G. and Morgan, G. (1979). Sociological Paradigms and Organisational

    Analysis: Elements of the Sociology of Corporate Life, Heinemann: London.

    Csikzentmihalyi, M. (1990). Flow: The Psychology of optimal experience. Harper &

    Row: New York.

    Ciborra. C. et al (2000). From control to drift: The dynamics of corporate informationinfrastructures. Oxford University Press: Oxford.

    Coghlan, D. & Brannick, T. (2001). Doing Action Research in Your Own Organization,

    SAGE: London.

    Crosby, P. B. (1979). Quality is Free: The art of making quality certain. Mentor: New

    York.

    Easterby-Smith, M., Thorpe, R. and Lowe, A. (2002).Management Research: An

    Introduction. Second Edition. Sage Publications: London.

    Battram, A. (1996). Navigating Complexity: The Essential Guide to Complexity Theory

    in Business and Management, The Industrial Society: London.

    Checkland, P. (1981). Systems Thinking, Systems Practice. Wiley: Chichester.

    Ciborra, C. U. (2000). From Control To Drift: The Dynamics of Corporate Information

    Infrastructures, Oxford University Press: Oxford.

    Collis, J. and Hussey, R. (2003). Business Research: A practical guide for

    undergraduate and postgraduate students, 2nd Edition, Palgrave Macmillan: New York.

    Dahlbom, B. and Mathiassen, L. (1993). Computers in Context: The Philosophy and

    Practice of Systems Design, Blackwell: Oxford.

    Dawkins, R. (1976). The Selfish Gene. Oxford University Press: Oxford.

    Deming, W. E. (1986). Out of the Crisis. MIT Press: Cambridge.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    22/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 22 of 24

    Deming, W. E. (1992). The New Economics. Second Edition. MIT Press: Cambridge.

    DNV (2005). Kvalitetsarbeid i IT-funksjonen, Vurdering av systemet for kvalitetsstyring

    i IT-funksjonen i Skattedirektoratet, Rapport unntatt offentlighet, 03.10.2005, Det Norske

    Veritas: Hvik.

    Dooley, K. (2002). Organizatonal Complexity,International Encyclopedia of Businessand Management, M. Warner (ed.), Thompson Learning: London, p. 5013-5022.

    Dooley, K., T. Johnson, and D. Bush (1995). TQM, chaos, and complexity,Human

    Systems Management, 14(4): 1-16.

    Gitlow, H. S. (1992). Thanks for the Michi in Voehl, F. (1992) Deming: The Way We

    Knew Him.

    Goldstein, J. (1994). The unshackled organization: Facing the challenge ofunpredictability through spontanous reorganization, Productivity Press.

    Grassie, W. (1994). Reinventing Nature: Science Narratives as Myths for an EndangeredPlanet (chapter 3), http://www.voicenet.com/~grassie/essays/ch3.html.

    Hanseth, O. (2005). Globally Scaleable Information Structures presentation at PhDDays Workshop in Information systems, 30 Sept 1 Oct 2005, Department of

    Informatics, University of Oslo: Oslo.

    ISO (2000a). Quality management systems Fundamentals and vocabulary (ISO

    9000:2000), International Standards Organization: Geneve.

    ISO (2000b). Quality management systems Requirements (ISO 9001:2000),

    International Standards Organization: Geneve.

    ISO (2000c). Quality management systems Guidelines for performance improvements(ISO 9004:2000), International Standards Organization: Geneve.

    Juran, J. M. (1964). Managerial Breakthrough. McGraw-Hill: New York.

    Kelly, K. (1994). Out Of Control: The New Biology of Machines, Social Systems and the

    Economics World, Addison-Wesley: New York.

    Kuhn, T. (1962). The Structure of Scientific Revolutions. University of Chicago Press:

    Chicago.

    Lewin, K. (1946). Action Research and Minority Problems. Journal of Social Issues, 2,

    34-36. 286, 438.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    23/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 23 of 24

    Liker, J. (2004). The Toyota Way, Addison-Wesley: New York.

    Lilienfeld, R. (1978). The Rise of Systems Theory: An Ideological Analysis, Wiley-

    Interscience: New York.

    Morgan, G. (1997).Images of Organization, SAGE Publishing: London.

    Nielsen, P. (2006). Systems theory and information infrastructure. Trial lecture for thePhD defense committee.

    Oakland, J. S. (1999). Total Organizational Excellence: Achieving world-class

    performance. Butterworth-Heinemann: Oxford.

    Mintzberg, H. (1983). Structure in Fives: Designing Effective Organizations, Prentice-

    Hall: Upper Saddle River, New Jersey.

    Nonaka, I. and Takeuchi, H. (1995). The Knowledge-Creating Company. Oxford

    University Press: Oxford.

    NTAX (1997). Strategi, politikk og standarder for IT-sikkerhet i Skatteetaten, Version

    2.1, SKD no. 6/96, Directorate of Taxes: Oslo.

    NTAX (1998). Strategisk plan for bruk av IT i Skatteetaten, Version 1.3 , SKD no. 62/96,

    Directorate of Taxes: Oslo.

    NTAX (2001). Stillingsbeskrivelse Kvalitetssjef (underdirektr), Notat 21.03.01,Directorate of Taxes, IT department: Oslo.

    NTAX (2006). Opprydding og standardisering av COBOL-programvare. Versjon 0.9.

    24.01.2006, Directorate of Taxes, IT department: Oslo.

    Oakland, J.S. (2001). Total Organizational Excellence: Achieving World-Class

    Performance, Butterworth-Heinemann: Oxford.

    Power, M. (1997). The Audit Society: Rituals of Verification. Oxford University Press:

    Oxford.

    Robson, C. (1993). Real World Research: A Resource for Social Scientists and

    Practitioner-Researchers, Blackwell: Oxford UK & Cambridge US.

    Routio, P. (2005). Methods of arteology: Developing a task,

    http://www.uiah.fi/projects/metodi/120.htm (accessed June 13th, 2006).

    Shannon, C. E. and Weaver, W. (1949). The Mathematical Theory of Communication.

    University of Illinois Press: Chicago.

  • 7/29/2019 QUALITATIVE RESEARCH METHODS cc INF5220.pdf*Title: (Required field)

    24/24

    INF5220 Qualitative Research Methods

    Spring 2006 Page 24 of 24

    Shewhart, W. A. (1938). Statistical Method from the Viewpoint of Quality Control.

    Dover: New York.

    Seddon, J. (1997).In pursuit of quality: The case against ISO 9000. Oak TreePressBooks: London.

    Stacey, R., Griffin, D. and Shaw, P. (2000). Complexity and Management: Fad or

    Radical Challenge? Routledge: London.

    Statskonsult (2002). Organisering av IT-funksjonen i Skatteetaten, Statskonsult: Oslo.

    Urry, J. (2003) Global Complexity, Polity: Cambridge.

    Susman, G. and Evered, R. (1978). An assessment of the scientific merits of action

    research. Administrative Science Quarterly 23, 528-603.

    Taylor, F. W. (1911). The Principles of Scientific Management. Harper & Row: New

    York.

    UiO (2006). Phd Manual, Information Systems Group, Department of Informatics,

    University of Oslo, http://www.ifi.uio.no/forskning/grupper/is/docs/PhDManual.pdf.

    Voehl, F. (1992)Deming: The Way We Knew Him, St. Lucie Press: Delray Beach,Florida.

    Womack, J.P. and Jones, D.T. (2003).Lean Thinking: Banish Waste and Create Wealth

    in Your Corporation, 2nd Edition, Free Press Business.