Skip to main content
Springer Nature Link
Log in

Qualitative Research Methods for Evaluating Computer Information Systems

  • Chapter
Evaluating the Organizational Impact of Healthcare Information Systems

Part of the book series: Health Informatics ((HI))

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A.F. Dowling, Jr. Do hospital staff interfere with computer system implementation? Health Care Management Review 5 (1980) 23–32.

    PubMed  Google Scholar 

  2. B. Kaplan, Evaluating informatics applications—some alternative approaches: Theory, social interactionism, and call for methodological pluralism, International Journal of Medical Informatics 64 (2001) 39–56.

    CAS  PubMed  Google Scholar 

  3. B. Kaplan, Evaluating informatics applications—clinical decision support systems literature review, International Journal of Medical Informatics 64 (2001) 15–37.

    CAS  PubMed  Google Scholar 

  4. R. Kling and W. Scacchi, The web of computing: Computer technology as social organization, in: M.C. Yovitz, editor Advances in Computers, Vol. 21 (Academic Press, New York, 1982), pp. 2–90.

    Google Scholar 

  5. J.A. Maxwell, Qualitative Research Design: An Interactive Approach (Sage Publications, Thousand Oaks, CA, 1996).

    Google Scholar 

  6. B. Kaplan and N.T. Shaw, People, organizational, and social issues: Future directions in evaluation research, Methods of Information in Medicine 43 (2004) 215–231.

    CAS  PubMed  Google Scholar 

  7. M.B. Miles and A.M. Huberman, Qualitative Data Analysis: An Expanded Sourcebook (Sage Publications, Beverly Hills, CA, 1994).

    Google Scholar 

  8. M. Hammersley and P. Atkinson, Ethnography: Principles in Practice (Routledge, London, 1995).

    Google Scholar 

  9. N. Denzin and Y. Lincoln, Handbook of Qualitative Research (Sage Publications, Thousand Oaks, CA, 2000).

    Google Scholar 

  10. M.Q. Patton, Qualitative Research and Evaluation Methods (Sage Publications, Thousand Oaks, CA, 2001).

    Google Scholar 

  11. A.S. Lee, J. Liebenau, and J.I. DeGross, Information Systems and Qualitative Research: IFIP Transactions (Chapman and Hall, London, 1997).

    Google Scholar 

  12. J.A. Maxwell, Realism and the role of the researcher in qualitative psychology, in: M. Kiegelmann, editor, The Role of the Researcher in Qualitative Psychology (Verlag Ingeborg Huber, Tuebingen, Germany, 2002), pp. 11–30.

    Google Scholar 

  13. B. Kaplan, D.P. Truex III, D. Wastell, A.T. Wood-Harper, and J.I. DeGross, Relevant Theory and Informed Practice: Looking Forward from a 20 Year Perspective on IS Research (Kluwer Academic Publishers, London, 2004).

    Google Scholar 

  14. T.D. Cook and C.S. Reichardt, Qualitative and Quantitative Methods in Evaluation Research (Sage Publications, Beverly Hills, 1979).

    Google Scholar 

  15. T.D. Jick, Mixing qualitative and quantitative methods: Triangulation in action, in: J.V. Maanen, editor, Qualitative Methodology (Sage Publications, Beverly Hills, CA, 1983), pp. 135–148.

    Google Scholar 

  16. B. Kaplan and D. Duchon, Combining qualitative and quantitative approaches in information systems research: A case study, Management Information Systems Quarterly 12 (1988) 571–586.

    Google Scholar 

  17. L.H. Kidder and M. Fine, Qualitative and quantitative methods: When stories converge, in: M.M. Mark and R.L. Shotland, editors, Multiple Methods in Program Evaluation (Jossey-Bass, San Francisco, 1987), pp. 57–75.

    Google Scholar 

  18. J.A. Maxwell, P.G. Bashook, and L.J. Sandlow, Combining ethnographic and experimental methods in educational research: A case study, in: D.M. Fetterman and M.A. Pitman, editors, Educational Evaluation: Ethnography in Theory, Practice, and Politics (Sage Publications, Beverly Hills, CA, 1986), pp. 121–143.

    Google Scholar 

  19. J.C. Greene and V.J. Caracelli, Advances in Mixed-Method Evaluation: The Challenges and Benefits of Integrating Diverse Paradigms. New Directions for Evaluation, Vol. 74 (Summer 1997) (Jossey-Bass, San Francisco, 1997).

    Google Scholar 

  20. A. Tashakkori and C. Teddlie, Mixed Methodology: Combining Qualitative and Quantitative Approaches (Sage Publications, Thousand Oaks CA, 1998).

    Google Scholar 

  21. J.A. Maxwell and D. Loomis, Mixed methods design: An alternative approach, in: A. Tashakkori and C. Teddlie, editors, Handbook of Mixed Methods in Social and Behavioral Research (Sage Publications, Thousand Oaks, CA, 2002), pp. 241–271.

    Google Scholar 

  22. A. Tashakkori and C. Teddlie, Handbook of Mixed Methods in Social and Behavioral Research (Sage Publications, Thousand Oaks, CA, 2002).

    Google Scholar 

  23. H. Wolcott, Writing Up Qualitative Research (Sage Publications, Thousand Oaks, CA, 1990).

    Google Scholar 

  24. E.M. Rogers, Diffusion of Innovations (The Free Press, New York, 2003).

    Google Scholar 

  25. B. Kaplan, Computer Rorschach test: What do you see when you look at a computer? Physicians & Computing 18 (2001) 12–13.

    Google Scholar 

  26. T. Cook, Randomized experiments in education: A critical examination of the reasons the educational evaluation community has offered for not doing them, Educational Evaluation and Policy Analysis 24 (2002) 175–199.

    Google Scholar 

  27. W.R. Shadish, T.D. Cook, and D.T. Campbell, Experimental and Quasi-Experimental Designs for Generalized Causal Inference (Houghton Mifflin, Boston, 2002).

    Google Scholar 

  28. J.A. Maxwell, Causal explanation, qualitative research, and scientific inquiry in education, Educational Researcher 33 (2004) 3–11.

    Google Scholar 

  29. M.L. Markus and D. Robey, Information technology and organizational change: Causal structure in theory and research, Management Science 34 (1988) 583–598.

    Google Scholar 

  30. B. Kaplan, Impact of a clinical laboratory computer system: Users’ perceptions, in: R. Salamon, B.I. Blum, and J.J. Jørgensen, editors, Medinfo 86: Fifth Congress on Medical Informatics, North-Holland, Amsterdam (1986) 1057–1061.

    Google Scholar 

  31. B. Kaplan, Initial impact of a clinical laboratory computer system: Themes common to expectations and actualities, Journal of Medical Systems 11 (1987) 137–147.

    Article  CAS  PubMed  Google Scholar 

  32. B. Kaplan and D. Duchon, A job orientation model of impact on work seven months post-implementation, in: B. Barber, D. Cao, D. Qin, and G. Wagner, editors, Medinfo 89: Sixth Conference on Medical Informatics, North-Holland, Amsterdam (1989) pp. 1051–1055.

    Google Scholar 

  33. R.K. Yin, Case Study Research: Design and Methods (Sage Publications, Thousand Oaks, CA, 1984).

    Google Scholar 

  34. E.M. Rogers, Diffusion of Innovations (The Free Press, New York, 1983).

    Google Scholar 

  35. H.P. Lundsgaarde, P.J. Fischer, and D.J. Steele, Human Problems in Computerized Medicine (The University of Kansas, Lawrence, KS, 1981).

    Google Scholar 

  36. P.J. Fischer, W.C. Stratman, and H.P. Lundsgaarde, User reaction to PROMIS: Issues related to acceptability of medical innovations, in: J.G. Anderson and S.J. Jay, editors, Use and Impact of Computers in Clinical Medicine (Springer, New York, 1987), pp. 284–301.

    Google Scholar 

  37. R. Hirschheim and H.K. Klein, Four paradigms of information systems development, Communications of the ACM 32 (1989) 1199–1216.

    Article  Google Scholar 

  38. B. Kaplan. User acceptance of medical computer applications: A diffusion approach, in: B.I. Blum, editors, Proceedings of the Symposium on Computing Applications in Medical Care, Silver Spring, IEEE Computer Society Press (1982), pp. 398–402.

    Google Scholar 

  39. B. Kaplan, The computer as Rorschach: Implications for management and user acceptance, in: R.E. Dayhoff, editor, Proceedings Symposium Computing Application Medical Care, Silver Spring, IEEE Computer Society Press (1983), pp. 664–667.

    Google Scholar 

  40. B. Kaplan, The influence of medical values and practices on medical computer applications, in: J.G. Anderson and S.J. Jay, editors, Use and Impact of Computers in Clinical Medicine (Springer, New York, 1987), pp. 39–50.

    Google Scholar 

  41. C. Sicotte, J. Denis, and P. Lehoux, The computer-based patient record: A strategic issue in process innovation, Journal of Medical Systems 22 (1998) 431–443.

    CAS  PubMed  Google Scholar 

  42. C. Sicotte, J. Denis, P. Lehoux, and F. Champagne, The computer-based patient record: Challenges toward timeless and spaceless medical practice, Journal of Medical Systems 22 (1998) 237–256.

    CAS  PubMed  Google Scholar 

  43. B. Kaplan, Models of change and information systems research, in: H.-E. Nissen, H.K. Klein, and R. Hirschheim, editors, Information Systems Research: Contemporary Approaches and Emergent Traditions (North Holland, Amsterdam, 1991), pp. 593–611.

    Google Scholar 

  44. B. Kaplan, D.P. Truex III, D. Wastell, and A.T. Wood-Harper, Young Turks, Old Guardsmen, and the conundrum of the broken mold: A progress report on twenty years of IS research, in: B. Kaplan, D.P. Truex III, D. Wastell, A.T. Wood-Harper, and J.I. De Gross, editors, Information Systems Research: Relevant Theory and Informed Practice (Kluwer Academic Publishers, Boston, Dordrecht, London, 2004) pp. 1–18.

    Google Scholar 

  45. B.G. Glaser and A.L. Strauss, The Discovery of Grounded Theory: Strategies for Qualitative Research (Aldine, New York, 1967).

    Google Scholar 

  46. A. Strauss and J.M. Corbin, Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (Sage Publications, Thousand Oaks, CA, 1998).

    Google Scholar 

  47. E.G. Guba and Y.S. Lincoln, Fourth Generation Evaluation (Sage Publications, Newbury Park, CA, 1989).

    Google Scholar 

  48. B. Kaplan, National Health Service reforms: Opportunities for medical informatics research, in: K.C. Lun, P. Deglulet, T.E. Piemme, and O. Reinhoff, editors, Medinfo 92: Seventh Conference on Medical Informatics, Amsterdam, Elsevier Science Publishers (1992), pp. 1166–1171.

    Google Scholar 

  49. T.V. Bonoma, Case research in marketing: Opportunities, problems, and a process, Journal of Marketing Research 22 (1985) 199–208.

    Google Scholar 

  50. D.E. Forsythe, B. Buchanan, J. Osheroff, and R. Miller, Expanding the concept of medical information: An observational study of physicians’ information needs, Computers and Biomedical Research 25 (1992) 181–200.

    Article  CAS  PubMed  Google Scholar 

  51. J. Osheroff, D. Forsythe, B. Buchanan, R. Bankowitz, B. Blumenfeld, and R. Miller, Physicians’ information needs: Analysis of clinical questions posed during patient care activity, Annals of Internal Medicine 14 (1991) 576–581.

    Google Scholar 

  52. B. Kaplan, Objectification and negotiation in interrupting clinical images: Implications for computer-based patient records, Artificial Intelligence in Medicine 7 (1995) 439–454.

    Article  CAS  PubMed  Google Scholar 

  53. D. Fafchamps, C.Y. Young, and P.C. Tang, Modelling work practices: Input to the design of a physician’s workstation, in: P.D. Clayton, editor, Proceedings Symposium Computing Application Medical Care, New York, McGraw Hill (1991), pp. 788–792.

    Google Scholar 

  54. R.A. Krueger and M.A. Casey, Focus Groups: A Practical Guide for Applied Research (Sage Publications, Thousand Oaks, CA, 2000).

    Google Scholar 

  55. J.M. Nyce and W.I. Graves, The construction of knowledge in neurology: Implications for hypermedia system development, Artificial intelligence in Medicine 29 (1990) 315–322.

    Google Scholar 

  56. B. Kaplan, Development and acceptance of medical information systems: An historical overview, Journal of Health and Human Resources Administration 11 (1988) 9–29.

    CAS  PubMed  Google Scholar 

  57. M.H. Agar, The Professional Stranger: An Informal Introduction to Ethnography (Academic Press, New York, 1980).

    Google Scholar 

  58. H. Wolcott, Writing Up Qualitative Research (Sage Publications, Thousand Oaks, CA, 2001).

    Google Scholar 

  59. E. Mishler, Research Interviewing: Context and Narrative. (Harvard University Press, Cambridge, MA, 1986).

    Google Scholar 

  60. J.P. Gee, S. Michaels, and M.C. O’Connor, Discourse analysis, in: M.D. LeCompte, W.L. Millroy, and J. Preissle, editors, The Handbook of Qualitative Research in Education, Vol. 227–291 (Academic Press, San Diego, 1992).

    Google Scholar 

  61. C.K. Riessman, Narrative Analysis (Sage Publications, Thousand Oaks, CA, 1993).

    Google Scholar 

  62. G. Psathas, Conversation Analysis: The Study of Talk-in-Interaction (Sage Publications, Thousand Oaks, CA, 1955).

    Google Scholar 

  63. I.E. Seidman, Interviewing as Qualitative Research: A Guide for Researchers in Education and the Social Sciences (Teachers College Press, New York, 1998).

    Google Scholar 

  64. F. Erickson, Ethnographic microanalysis of interaction, in: M.D. LeCompte, W.L. Millroy, and J. Preissle, editors, The Handbook of Qualitative Research in Education (Academic Press, San Diego, 1992), pp. 201–225.

    Google Scholar 

  65. A. Coffey and P. Atkinson, Making Sense of Qualitative Data (Sage Publications, Thousand Oaks, CA, 1996).

    Google Scholar 

  66. E. Weitzman and M. Miles, Computer Programs for Qualitative Data Analysis (Sage Publications, Thousand Oaks, CA, 1995).

    Google Scholar 

  67. E. Weitzman, Software and qualitative research, in: N. Denzin and Y. Lincoln, editors, Handbook of Qualitative Research (Sage Publications, Thousand Oaks, CA, 2000), pp. 803–820.

    Google Scholar 

  68. P. Eckert, Jocks and Burnouts: Social Categories and Identity in the High School (Teachers College Press, New York, 1989).

    Google Scholar 

  69. J. Kirk and M.L. Miller, Reliability and Validity in Qualitative Research (Sage Publications, Thousand Oaks, CA, 1986).

    Google Scholar 

  70. M.A. Eisenhart and K.R. Howe, Validity in educational research, in: M.D. LeCompte, W.L. Millroy, and J. Preissle, editors, The Handbook of Qualitative Research in Education (Academic Press, San Diego, 1992), pp. 643–680.

    Google Scholar 

  71. J.A. Maxwell, Understanding and validity in qualitative research, Harvard Educational Review 62 (1992) 279–300.

    Google Scholar 

  72. J.A. Maxwell, Using qualitative methods for causal explanation, Field Methods 16(3), (August 2004), pp. 243–264.

    Article  Google Scholar 

  73. H.S. Becker, Field work evidence, in: H.S. Becker, editor, Sociological Work: Method and Substance (Aldine, Chicago, 1970), pp. 39–62.

    Google Scholar 

  74. E. Bredo and W. Feinberg, Part two: The interpretive approach to social and educational research, in: E. Bredo and W. Feinberg, editors, Knowledge and Values in Social and Educational Research (Temple University Press, Philadelphia, 1982), pp. 115–128.

    Google Scholar 

  75. M.H. Agar, Speaking of Ethnography (Sage Publications, Beverly Hills, CA, 1986).

    Google Scholar 

  76. I. Benbasat, D.K. Goldstein, and M. Mead, The case research strategy in studies of information systems, MIS Quarterly 11 (1987) 369–386.

    Google Scholar 

  77. M.G. Trend, On the reconciliation of qualitative and quantitative analyses: A case study, in: T.D. Cook and C.S. Reichardt, editors, Qualitative and Quantitative Methods in Evaluation Research (Sage Publications, Beverly Hills, CA, 1979), pp. 68–86.

    Google Scholar 

  78. B. Kaplan, L. Kvasny, S. Sawyer, and E.M. Trauth, New words and old books: Challenging conventional discourses about domain and theory in information systems research, in: M.D. Myers, E.A. Whitley, E. Wynn, and J.I. De Gross, editors, Global and Organizational Discourse About Information Technology (Kluwer Academic Publishers, London, 2002), pp. 539–545.

    Google Scholar 

  79. B. Kaplan, P.F. Brennan, A.F. Dowling, C.P. Friedman, and V. Peel, Towards an informatics research agenda: Key people and organizational issues, Journal of the American Medical Informatics Association 8 (2001) 234–241.

    Google Scholar 

  80. B. Kaplan, A model comprehensive evaluation plan for complex information systems: Clinical imaging systems as an example, in: A. Brown and D. Remenyi, editors, Proceedings 2nd European Conference on Information Technology Investment Evaluation, Henley on Thames, Birmingham, England, Operational Research Society (1995), pp. 14–181.

    Google Scholar 

  81. B. Kaplan, Organizational evaluation of medical information systems, in: C.P. Friedman and J.C. Wyatt, editors, Evaluation Methods in Medical Informatics (Springer, New York, 1997), pp. 255–280.

    Google Scholar 

  82. B. Kaplan, Addressing organizational issues into the evaluation of medical systems, Journal of the American Medical Informatics Association 4 (1997) 94–101.

    CAS  PubMed  Google Scholar 

  83. R. Kling, Social analyses of computing: Theoretical perspectives in recent empirical research, ACM Computing Surveys 12 (1980) 61–110.

    Article  Google Scholar 

  84. K. Lyytinen, Different perspectives on information systems: Problems and solutions, ACM Computing Surveys 19 (1987) 5–46.

    Article  Google Scholar 

  85. E. Mumford, G. Fitzgerald, R. Hirschheim, and A.T. Wood-Harper. Research Methods in Information Systems (North Holland, Amsterdam, 1985).

    Google Scholar 

  86. H.-E. Nissen, H.K. Klein, and R. Hirschheim. Information Systems Research: Contemporary Approaches and Emergent Traditions (North Holland, Amsterdam, 1991).

    Google Scholar 

  87. S. Turkle, The Second Self: Computers and the Human Spirit (Simon & Schuster, New York, 1984).

    Google Scholar 

  88. S. Turkle, Life on the Screen: Identity in the Age of the Internet (Simon & Schuster, New York, 1995).

    Google Scholar 

  89. S. Zuboff, In the Age of the Smart Machine: The Future of Work and Power (Basic Books, New York, 1988).

    Google Scholar 

  90. G. Walsham, Interpreting Information Systems in Organizations (Wiley, Chichester, 1993).

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Yale Center for Medical Informatics, Yale University School of Medicine, New Haven, CT, 06520

    Bonnie Kaplan PhD (Lecturer and President)

  2. Kaplan Associates, Hamden, CT, 06517, USA

    Bonnie Kaplan PhD (Lecturer and President)

  3. Graduate School of Education, George Mason University, Fairfax, VA, 22030, USA

    Joseph A. Maxwell PhD (Associate Professor)

Authors
  1. Bonnie Kaplan PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joseph A. Maxwell PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. American College of Medical Informatics, USA

    James G. Anderson PhD (Professor of Medical Sociology, Professor of Health Communication Fellow and Co-Director of the Rural Center for AIDS/STD Prevention) (Professor of Medical Sociology, Professor of Health Communication Fellow and Co-Director of the Rural Center for AIDS/STD Prevention)

  2. Department of Sociology and Anthropology, Purdue University, West Lafayette, IN, 47907, USA

    James G. Anderson PhD (Professor of Medical Sociology, Professor of Health Communication Fellow and Co-Director of the Rural Center for AIDS/STD Prevention) (Professor of Medical Sociology, Professor of Health Communication Fellow and Co-Director of the Rural Center for AIDS/STD Prevention)

  3. Nursing Research and Development, Cedars-Sinai Medical Center and Burns and Allen Research Institute, Los Angeles, CA, 90048, USA

    Carolyn E. Aydin PhD (Research Scientist) (Research Scientist)

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

Kaplan, B., Maxwell, J.A. (2005). Qualitative Research Methods for Evaluating Computer Information Systems. In: Anderson, J.G., Aydin, C.E. (eds) Evaluating the Organizational Impact of Healthcare Information Systems. Health Informatics. Springer, New York, NY. https://doi.org/10.1007/0-387-30329-4_2

Download citation

  • DOI: https://doi.org/10.1007/0-387-30329-4_2

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-387-24558-4

  • Online ISBN: 978-0-387-30329-1

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy