Field Notes ยท Topic

Trust & Security

Trust calibration, cybersecurity, privacy, and the human factors that determine whether people rely on secure systems.

34 notes

  1. AI & Agentic SystemsAI Alignment Has a Stakeholder ProblemAlignment is usually described as alignment with human values. The papers that built the method say it aligned models to a small group of people, and IS research on trust shows that creator, user and system pull in different directions.5 min read
  2. AI & Agentic SystemsAI Alignment Is a Promise the Organization MakesWhen an organization's AI contradicts what the organization says it values, trust and reliance fall. Alignment is also a promise about control and accountability across a supply chain, which brings security into the picture.5 min read
  3. AI & Agentic SystemsSuperintelligence Risk Is Managed by Organizations, Not Only by ModelsThe most practical part of the catastrophic risk literature is about safety culture, separation of duties and stolen model weights. That is organizational and security ground, and IS already studies it.4 min read
  4. AI & Agentic SystemsAI Chatbots Feel Like the Richest Medium but Behave Like a Search EngineAI chatbots feel like a face to face conversation but function like a search engine with a confidence problem. Media richness theory explains why that mismatch is dangerous.6 min read
  5. AI & Agentic SystemsWhy Better Models Alone Won't Solve the Hallucination Trust ProblemHallucination is framed as a retrieval bug to be engineered away. Lee and See would call it a trust calibration failure, and that framing changes the solution entirely.6 min read
  6. AI & Agentic SystemsAI Safety Frameworks Are PMT Without Using the NameAI safety warnings raise threat appraisal sky high. Without coping appraisal, they produce fear control, not safety.6 min read
  7. AI & Agentic SystemsAI Security Platforms Are Governance Boundary ResourcesWhen 80% of unauthorized AI use is internal policy violations, AI security platforms are governance products, not security products.6 min read
  8. AI & Agentic SystemsAfter AI Hallucinates, How Does It Earn Trust Back?AI trust repair is not about rebuilding a relationship. It is about recalibration. The IS trust literature has been explaining this for two decades.6 min read
  9. AI & Agentic SystemsCARE Treats Privacy as a Question of DignityMost people think digital privacy is about data breaches. Leidner and Tona's CARE framework says it is really about whether your dignity can survive digitization.6 min read
  10. AI & Agentic SystemsConfidential Computing Changes the Privacy CalculusHardware-level encryption during processing changes the risk side of the privacy calculus. IS privacy models were built for a world that no longer exists.6 min read
  11. Comps & ReflectionsThe CrowdStrike Outage and Why Every 'Minor Update' Is a Structural RiskA routine config update grounded airlines and froze hospitals. The risk was not the update but the architecture that pushed it everywhere at once.6 min read
  12. Trust & SecurityCybersecurity in Critical Infrastructure: When the Stakes Are PhysicalMost cyber attacks hit data. Critical infrastructure attacks hit pipelines, power grids, and hospitals. The consequences are physical, and the security disciplines are different.6 min read
  13. Trust & SecurityCybersecurity Mesh: When the Perimeter Finally Stopped Making SenseThe castle-and-moat model of security was built for a world where the data stayed inside. That world is gone.6 min read
  14. AI & Agentic SystemsDigital Provenance Is Trust Calibration InfrastructureDigital provenance (BOMs, attestation databases, watermarking) gives users verifiable information about system origin and integrity. It is the first trust calibration mechanism that works at infrastructure level rather than requiring individual evaluation.5 min read
  15. Comps & ReflectionsDigital Sovereignty and the Politics of Where Your Data LivesWhere data is stored and processed has become a geopolitical question, not just a technical one. GDPR, Schrems II, and chip export controls explain why.6 min read
  16. AI & Agentic SystemsEdge AI Moves Computation Into the Physical World. STS Says That Changes Everything.When AI runs on a factory sensor or hospital monitor instead of the cloud, the technical subsystem becomes physically distributed and harder to monitor. STS theory warned us seventy years ago what happens next.5 min read
  17. IT Governance & StrategyEdge Computing and the Governance Problem Few Teams Planned ForEdge computing moves computation to where data is generated. The latency gains are real. The governance problem that follows is harder than most enterprise IT teams planned for.7 min read
  18. Trust & SecurityEdTech and the Learning Analytics ProblemLearning analytics platforms collect enormous amounts of student behavior data. Whether that data measures learning, or just measures clicking, is a much harder question.6 min read
  19. AI & Agentic SystemsThe EU AI Act Is Institutional Theory Playing Out in Real TimeThe EU AI Act hits all three of Scott's institutional pillars at once. Here is why that makes it the most consequential IS policy since GDPR.7 min read
  20. Trust & SecurityFear Does Not Make People SecureSecurity awareness training loves a good scare story. The research says fear without efficacy produces denial, not compliance.7 min read
  21. Comps & ReflectionsMental Health Apps: Good Intentions, Mixed EvidenceHundreds of millions of people have downloaded mental health apps. The clinical evidence is mixed, the privacy practices are questionable, and the regulation barely touches it.6 min read
  22. IT Governance & StrategyOpen Data and the Politics of Government TransparencyOpen data initiatives promise neutral access to government information. What gets published, in what format, and how usable it is reflects political choices.6 min read
  23. Trust & SecurityOpen Source Software and Its Underfunded GovernanceOpenSSL secured a significant fraction of internet traffic and was maintained by a handful of developers on a shoestring budget. Heartbleed made that fact impossible to ignore.6 min read
  24. Comps & ReflectionsPreemptive Cybersecurity Needs Protection Motivation Theory to WorkPredicting attacks is useless if nobody acts on the warning. PMT explains why organizations stall on preemptive security.6 min read
  25. IS TheoryThe Privacy Paradox Is Rational If You Stop Calling It IrrationalPeople share data on fitness apps but panic about Facebook. The so-called privacy paradox disappears once you realize the calculus includes factors researchers kept ignoring.6 min read
  26. Technology AdoptionWhy Security Training Produces Compliance TheaterProtection motivation theory says fear without efficacy backfires. Most security training does exactly that.6 min read
  27. IT Governance & StrategyQuantum Computing and What It Actually Means for Information SystemsQuantum hardware is real, but enterprise-ready it is not. Here is what the IS field should be watching anyway.7 min read
  28. Comps & ReflectionsSurveillance Capitalism and What Your Data Is Actually ForZuboff's argument is not just that companies collect too much data. It is that behavioral data has become raw material for a specific economic logic aimed at predicting and modifying what you do next.6 min read
  29. AI & Agentic SystemsSynthetic Data: Training AI Without Real People's InformationSynthetic data offers a way to train AI on sensitive domains without exposing real people's records. The privacy tradeoff is real but often misunderstood.7 min read
  30. AI & Agentic SystemsThe Specification Error in Your Trust VariableTrust, trustworthiness, reliance, and delegation operate at different levels with different antecedents. Treating them as interchangeable is not a measurement choice, it is a theoretical mistake.6 min read