Field Notes ยท Topic
IS Research Methods
Design science, empirical methods, mixed methods, SEM, survey design, and the methodological foundations of IS scholarship.
- AI & Agentic SystemsHuman-AI Collaboration Needs a Stopwatch, Not Only a SurveyIn three studies of AI help at work, what people believed about their speed and what was measured did not match, and the gap ran in both directions.
- IS Research MethodsAction Research in IS: When the Researcher Is Also the IntervenerAction research asks you to help solve a real problem while studying it. The dual role is genuinely difficult, and the rigor vs. relevance tension never fully resolves.
- AI & Agentic SystemsAI and the Labor Market: What IS Research Can ContributeEconomists study macro displacement. IS researchers can study what actually happens inside organizations when AI changes specific jobs, roles, and power structures.
- AI & Agentic SystemsCritical Realism Explains Why AI Models Are Not the Mechanisms They SimulateAI models predict patterns in observed data but never access the generative mechanisms that produce them. Critical realism tells us why that ceiling is not a technical problem.
- AI & Agentic SystemsAI Is Forcing IS Research Methods to Evolve. Here Is What Should Change.IS research methods assume technology is stable and humans adapt. AI inverts that assumption, and our methods have not caught up.
- AI & Agentic SystemsAutonomous AI Agents: When the System Makes Decisions Without AskingAI agents that plan, act, and iterate without human input are moving into enterprise deployment. The accountability questions this raises do not have clean answers yet.
- IS Research MethodsCase Study Research in IS: What Yin Actually SaidIS loves case studies and sometimes misuses them. Robert Yin's framework tells you exactly when a case study is the right choice and what rigor looks like in that context.
- IS Research MethodsCommon Method Bias and Why Your Survey Results Might Be WrongPodsakoff et al. (2003) documented how collecting both variables from the same person at the same time inflates correlations artificially. This is still one of the most cited papers in IS research.
- AI & Agentic SystemsThe Theory I Thought Was Pointless Until My Third ReadI rolled my eyes when a study partner said critical realism was important. Three reads later I apologized, at least internally.
- IS Research MethodsThe World Exists Whether You Measure It or NotCritical realism says reality has layers we cannot fully observe, and most IS research ignores the deepest one.
- IS Research MethodsDesign Science Is Not Just Building ThingsBuilding a working artifact is necessary but not sufficient for design science research. The real question is whether your artifact produces generalizable knowledge grounded in theory.
- IS Research MethodsDesign Science Research in IS: Building Things That Produce KnowledgeHevner et al. (2004) argued that IS should not only explain and predict but also build and evaluate artifacts. Twenty years later, the paper still shapes how we think about what counts as IS research.
- IS Research MethodsDigital Colonialism and the Western Default in IS ResearchA handful of US and Chinese companies control most of the internet's infrastructure. IS research still treats Western organizational contexts as the default.
- AI & Agentic SystemsDigital Ethics: Beyond ComplianceCompliance asks 'are we allowed to do this?' Ethics asks 'should we do this?' In most organizations, the first question is answered and the second is never asked.
- IS Research MethodsEndogeneity: The Problem That Invalidates More IS Research Than People AdmitEndogeneity biases OLS estimates in ways that make conclusions systematically wrong. IS research has significant exposure that is underacknowledged.
- IS Research MethodsWhat Ethnography Actually Demands of an IS ResearcherEthnography means embedding yourself in a setting long enough to see what is really happening, not the version people perform for a survey.
- IS Research MethodsGrounded Theory in IS: Let the Data Lead, Except When It Doesn'tGlaser and Strauss said to let theory emerge from data, not from prior frameworks. IS researchers often invoke grounded theory while doing something considerably different.
- IS Research MethodsHyperautomation: The Gap Between the Gartner Term and the Factory FloorGartner coined hyperautomation to describe end-to-end automation of any automatable process. Most organizations are still struggling to automate one process well.
- Comps & ReflectionsIS Journals and How the Publishing Game Actually WorksAcademic publishing in IS is slow, opaque, and high-stakes. Understanding the game is as important as doing good research.
- Comps & ReflectionsWhat IS PhD Programs Teach and What They Don'tGoing through an IS PhD program has been genuinely valuable. It has also revealed some consistent gaps between what the curriculum covers and what doing IS research actually requires.
- IS Research MethodsWhat I Wish I Had Known Before Starting an IS PhDThe things I wish someone had said to me before I started: about reading, theory, reviewers, advisors, and the strange valley you fall into around year two.
- IS Research MethodsIS Research Borrows Constantly. That's the Problem and the Point.IS draws its theories from economics, sociology, psychology, and computer science. The result is a discipline with a persistent identity problem and an unusual opportunity.
- IS Research MethodsThe IS Success Model and What It Misses TodayDeLone and McLean built the most cited IS success model for transactional systems. Most software today is something else entirely.
- IS Research MethodsThe Theory-Practice Gap in IS: Who Is This Research For?IS research is supposed to matter to both academics and practitioners. In practice, two separate conversations are happening with almost no crossover.
- IS Research MethodsIT Capability and Organizational Performance: What the Research ShowsThe productivity paradox asked why IT spending didn't show up in productivity data. The answer turned out to be about capability, not spending.
- IS Research MethodsLongitudinal Research Design: Why Cross-Sectional Studies Miss Half the StoryMost IS research uses cross-sectional data collected at one point in time. That design cannot establish causation or capture how effects evolve.
- IS Research MethodsMeasurement Invariance and the Assumption Few Papers TestWhen IS researchers compare survey results across groups, they assume the constructs mean the same thing to everyone. Most papers never test this. The test is called measurement invariance.
- IS Research MethodsMixed Methods Research: When One Approach Is Not EnoughSome IS research questions cannot be answered with quantitative or qualitative methods alone. Mixed methods combines both, intentionally.
- IS Research MethodsNetwork Effects and Platform Theory: Why Platforms Are DifferentMetcalfe's Law, two-sided markets, and the chicken-and-egg problem are not just business stories. They are IS research problems about sociotechnical infrastructure.
- IS Research MethodsPlatform Capitalism and the Digital Labor QuestionNick Srnicek's platform capitalism framework explains how companies extract value by controlling infrastructure. IS researchers can study what this does to worker agency.
- IS Research MethodsPLS vs. CB-SEM: The Statistics Debate That Will Not DieThe debate over which SEM approach to use in IS research has run for decades and produces more heat than light. Here is what actually matters.
- IS Research MethodsQualitative Coding and the Rigor ProblemRigor in qualitative IS research is contested and often reduced to one number: intercoder reliability. That number matters but it is not the whole story, and sometimes it is not even the right question.
- IS Research MethodsQuant vs Qual Is Really a Debate About ParadigmsThe quant-versus-qual fight in IS research is the most tribal and the most misunderstood. The actual debate is about paradigms, not methods.
- IS Research MethodsThe Replication Crisis and What It Means for IS ResearchA large-scale effort to replicate psychology findings triggered a reckoning across social sciences. IS research is not immune, and the field has a long way to go.
- Comps & ReflectionsWhen a New Label on an Old Idea Falls Short of a ContributionMost IS papers are improvements dressed as inventions. Sun et al. say you need novelty, rigor, and relevance, not two out of three.
- IS Research MethodsSurvey Response Scales and Why Your Five Points Might Not Mean What You ThinkIS survey research defaults to Likert-type scales without much thought. The choices made about scale design shape what respondents report and how results can be analyzed.
- IS Research MethodsSystematic Literature Reviews and the Discipline of Not Picking FavoritesA systematic literature review uses explicit, reproducible criteria to select and synthesize research. The point is to minimize the selection bias of traditional narrative reviews.
- IS Research MethodsTechnical Skills Every IS Researcher Actually NeedsIS research lives between computer science and management. Here is what I have found useful and what I think the field gets wrong about technical skills.
- IS Research MethodsPlatform Design Is Not Neutral. Democracy Pays the Price.Cambridge Analytica. The Facebook Papers. Recommendation algorithms and radicalization. IS researchers studying social media cannot pretend these are side effects.
- IS Research MethodsTheory Testing vs. Theory Building: When Each Is AppropriateIS research tests existing theory more than it builds new theory. There is value in testing. But after hundreds of TAM extensions, we should be honest about how small the marginal contribution of each new study has become.
- IS Research MethodsYour Regression Can't Explain a DivorceMohr warned us in 1982 that variance and process theories answer different questions and need different evidence. Most IS research still evaluates process stories with variance criteria. Here is why that is a mistake.
- Comps & ReflectionsWhat Makes a Good IS Paper?Technically correct IS papers fail all the time. The difference between a paper that passes review and one that advances the field is harder to name than it sounds.
- IS Research MethodsWhen Bit Strings Get Social PowerA digital object is more than code on a server. Faulkner and Runde show that bit strings occupy social positions with rights and responsibilities, and that changes everything about how we study IT.
- IS Research MethodsYour Paradigm Is Not NeutralPositivist, interpretive, and critical realist research each carry assumptions about what is real and how we can know it. None of them is just a method choice.
No notes found. Try another word or topic.