Field Notes ยท Topic

IS Research Methods

Design science, empirical methods, mixed methods, SEM, survey design, and the methodological foundations of IS scholarship.

44 notes

  1. AI & Agentic SystemsHuman-AI Collaboration Needs a Stopwatch, Not Only a SurveyIn three studies of AI help at work, what people believed about their speed and what was measured did not match, and the gap ran in both directions.5 min read
  2. IS Research MethodsAction Research in IS: When the Researcher Is Also the IntervenerAction research asks you to help solve a real problem while studying it. The dual role is genuinely difficult, and the rigor vs. relevance tension never fully resolves.7 min read
  3. AI & Agentic SystemsAI and the Labor Market: What IS Research Can ContributeEconomists study macro displacement. IS researchers can study what actually happens inside organizations when AI changes specific jobs, roles, and power structures.6 min read
  4. AI & Agentic SystemsCritical Realism Explains Why AI Models Are Not the Mechanisms They SimulateAI models predict patterns in observed data but never access the generative mechanisms that produce them. Critical realism tells us why that ceiling is not a technical problem.6 min read
  5. AI & Agentic SystemsAI Is Forcing IS Research Methods to Evolve. Here Is What Should Change.IS research methods assume technology is stable and humans adapt. AI inverts that assumption, and our methods have not caught up.7 min read
  6. AI & Agentic SystemsAutonomous AI Agents: When the System Makes Decisions Without AskingAI agents that plan, act, and iterate without human input are moving into enterprise deployment. The accountability questions this raises do not have clean answers yet.7 min read
  7. IS Research MethodsCase Study Research in IS: What Yin Actually SaidIS loves case studies and sometimes misuses them. Robert Yin's framework tells you exactly when a case study is the right choice and what rigor looks like in that context.7 min read
  8. IS Research MethodsCommon Method Bias and Why Your Survey Results Might Be WrongPodsakoff et al. (2003) documented how collecting both variables from the same person at the same time inflates correlations artificially. This is still one of the most cited papers in IS research.7 min read
  9. AI & Agentic SystemsThe Theory I Thought Was Pointless Until My Third ReadI rolled my eyes when a study partner said critical realism was important. Three reads later I apologized, at least internally.6 min read
  10. IS Research MethodsThe World Exists Whether You Measure It or NotCritical realism says reality has layers we cannot fully observe, and most IS research ignores the deepest one.7 min read
  11. IS Research MethodsDesign Science Is Not Just Building ThingsBuilding a working artifact is necessary but not sufficient for design science research. The real question is whether your artifact produces generalizable knowledge grounded in theory.7 min read
  12. IS Research MethodsDesign Science Research in IS: Building Things That Produce KnowledgeHevner et al. (2004) argued that IS should not only explain and predict but also build and evaluate artifacts. Twenty years later, the paper still shapes how we think about what counts as IS research.7 min read
  13. IS Research MethodsDigital Colonialism and the Western Default in IS ResearchA handful of US and Chinese companies control most of the internet's infrastructure. IS research still treats Western organizational contexts as the default.6 min read
  14. AI & Agentic SystemsDigital Ethics: Beyond ComplianceCompliance asks 'are we allowed to do this?' Ethics asks 'should we do this?' In most organizations, the first question is answered and the second is never asked.6 min read
  15. IS Research MethodsEndogeneity: The Problem That Invalidates More IS Research Than People AdmitEndogeneity biases OLS estimates in ways that make conclusions systematically wrong. IS research has significant exposure that is underacknowledged.6 min read
  16. IS Research MethodsWhat Ethnography Actually Demands of an IS ResearcherEthnography means embedding yourself in a setting long enough to see what is really happening, not the version people perform for a survey.7 min read
  17. IS Research MethodsGrounded Theory in IS: Let the Data Lead, Except When It Doesn'tGlaser and Strauss said to let theory emerge from data, not from prior frameworks. IS researchers often invoke grounded theory while doing something considerably different.7 min read
  18. IS Research MethodsHyperautomation: The Gap Between the Gartner Term and the Factory FloorGartner coined hyperautomation to describe end-to-end automation of any automatable process. Most organizations are still struggling to automate one process well.7 min read
  19. Comps & ReflectionsIS Journals and How the Publishing Game Actually WorksAcademic publishing in IS is slow, opaque, and high-stakes. Understanding the game is as important as doing good research.6 min read
  20. Comps & ReflectionsWhat IS PhD Programs Teach and What They Don'tGoing through an IS PhD program has been genuinely valuable. It has also revealed some consistent gaps between what the curriculum covers and what doing IS research actually requires.6 min read
  21. IS Research MethodsWhat I Wish I Had Known Before Starting an IS PhDThe things I wish someone had said to me before I started: about reading, theory, reviewers, advisors, and the strange valley you fall into around year two.6 min read
  22. IS Research MethodsIS Research Borrows Constantly. That's the Problem and the Point.IS draws its theories from economics, sociology, psychology, and computer science. The result is a discipline with a persistent identity problem and an unusual opportunity.6 min read
  23. IS Research MethodsThe IS Success Model and What It Misses TodayDeLone and McLean built the most cited IS success model for transactional systems. Most software today is something else entirely.6 min read
  24. IS Research MethodsThe Theory-Practice Gap in IS: Who Is This Research For?IS research is supposed to matter to both academics and practitioners. In practice, two separate conversations are happening with almost no crossover.6 min read
  25. IS Research MethodsIT Capability and Organizational Performance: What the Research ShowsThe productivity paradox asked why IT spending didn't show up in productivity data. The answer turned out to be about capability, not spending.6 min read
  26. IS Research MethodsLongitudinal Research Design: Why Cross-Sectional Studies Miss Half the StoryMost IS research uses cross-sectional data collected at one point in time. That design cannot establish causation or capture how effects evolve.6 min read
  27. IS Research MethodsMeasurement Invariance and the Assumption Few Papers TestWhen IS researchers compare survey results across groups, they assume the constructs mean the same thing to everyone. Most papers never test this. The test is called measurement invariance.7 min read
  28. IS Research MethodsMixed Methods Research: When One Approach Is Not EnoughSome IS research questions cannot be answered with quantitative or qualitative methods alone. Mixed methods combines both, intentionally.6 min read
  29. IS Research MethodsNetwork Effects and Platform Theory: Why Platforms Are DifferentMetcalfe's Law, two-sided markets, and the chicken-and-egg problem are not just business stories. They are IS research problems about sociotechnical infrastructure.7 min read
  30. IS Research MethodsPlatform Capitalism and the Digital Labor QuestionNick Srnicek's platform capitalism framework explains how companies extract value by controlling infrastructure. IS researchers can study what this does to worker agency.6 min read