Managing Data Complexity in Defense Operations

In my previous post, I explored the hidden costs of data silos. Today, I want to share practical steps that deliver value without requiring immediate organisational restructuring or technology overhauls. The journey from siloed to integrated data follows a maturity curve, beginning with quick wins and progressing toward more substantial transformation. For immediate progress: 1) Identify your "golden datasets": Focus on the 20% of data driving 80% of decisions. Prioritise customer, product, and financial datasets that cross departmental boundaries. 2) Create a simple business glossary: Document how terms differ across departments. When Finance defines "revenue" differently than Sales, capturing both definitions creates transparency without forcing uniformity. 3) Implement read-only integration patterns: Establish one-way flows where analytics platforms access source data without disrupting existing systems. These connections create cross-silo visibility with minimal risk. 4) Build a culture of trust: Reward cross-departmental collaboration. Create incentives that make data sharing a path to recognition rather than a threat to influence or expertise. 5) Establish cross-functional data forums: Host regular meetings where data users share challenges and use cases, building relationships while identifying practical integration opportunities. As these initiatives gain traction, organisations can advance to more substantial approaches: 6) Match your approach to complexity: Smaller organisations often succeed with centralised data management, while larger enterprises typically require domain-centric strategies. 7) Apply bounded contexts: Map where business domains have distinct needs and terminology, creating clear translation points between areas like Sales, Finance, and Operations. 8) Adopt a data product mindset: Designate product owners for critical datasets who treat data as a product with clear consumers and quality standards rather than simply an asset to be stored. 9) Develop a federated metadata approach: Catalogue not just what exists, but how data relates across domains, making relationships between siloed systems explicit. 10) Maintain disciplined data modelling: Well-structured data within domains makes integration between them far more manageable, regardless of your architectural approach. This stepped approach delivers immediate value while building momentum for more sophisticated strategies. The most successful organisations pair technical solutions with cultural transformation, recognising that effective data integration is ultimately about people collaborating across boundaries. In my next post, I'll explore how governance models evolve with data integration maturity. What approaches have you found most effective in addressing data silos? #DataStrategy #DataCulture #DataGovernance #Innovation #Management

The European Reality: Capability, Unity, and the Illusion of Control Part 0 was about control. Part 1 was about sovereignty. Part 2 is about the layer everything depends on- data. This is where the real problem starts. Not AI. Not platforms. Not procurement. Data. In defence, data is not clean, structured, and ready for models. It is scattered across PowerPoints, Excel sheets, legacy systems, air-gapped networks, and human workflows. It is overclassified, inconsistently governed, difficult to access, and often impossible to use at operational speed. And yet, we are building systems that assume it is all available, reliable, and ready. That gap is not technical. It is structural. It is driven by decades of underinvestment, fragmented legal frameworks, overclassification, slow clearance processes, and a culture where the safest decision is often to lock everything down rather than make it usable. At the same time, modern decision systems depend entirely on data quality, accessibility, and trust. No data → no capability. Bad data → dangerous capability. This is the silent failure layer. It is also the reason why many defence AI ambitions look impressive on slides but struggle in reality. In this part, I break down: - why the data problem exists - why it is so hard to fix - how overclassification and fragmentation create operational risk - why “just give us the data” does not work - and what needs to change if Europe wants real capability, not just digital ambition Because before we talk about algorithms, we need to understand the foundation they stand on. And right now, that foundation is far weaker than we admit. Full article below. #DefenceTransformation #DataGovernance #DigitalSovereignty #ArchitectureMatters

The Defence Science and Technology Laboratory (Dstl) and Frazer-Nash have cracked a significant challenge that's been plaguing military strategists for years: making sense of the overwhelming volumes of data generated during wargaming exercises. Their groundbreaking 6-month research demonstrates how large language models (LLMs) can transform complex battlefield simulation outputs into actionable intelligence, dramatically reducing the burden on analysts whilst enhancing strategic decision-making capabilities. What makes this development particularly compelling is the practical application of Retrieval Augmented Generation (RAG) combined with local LLMs to interrogate scenarios from platforms like Command: Modern Operations. Unlike public AI tools such as ChatGPT, these locally-deployed systems offer enhanced privacy and data control—crucial for defence applications. The research showed that LLMs can summarise complex multi-domain engagements involving sea, air, and land units, helping analysts understand battlefield outcomes and the key factors driving them with unprecedented speed and accuracy. The implications extend far beyond data processing efficiency. This approach strengthens training benefits, improves resilience and preparedness, and creates a flexible framework that can evolve with changing demands. For defence professionals grappling with increasingly complex scenarios and shrinking analysis timeframes, this research offers a glimpse into how AI can augment human expertise rather than replace it, ultimately enhancing our collective defence capabilities. #DefenceTechnology #ArtificialIntelligence

Your complex $1m data architecture is built in 2015 and looks like vendor expo at a Gartner event. You are spending more time maintaining it than driving impact. Tightly coupled. Over-engineered. And allergic to change. Doing litterly more harm than good. You built data foundation like it’s 2015. Meanwhile, the defense sector, the one with more risk, regulation, and bureaucracy than anyone, is doing it differently. They call it data flexibility and being agile. Was talking to the data leader of a big defense manufacturer and realized their operations were being slowed by 200+ systems. They didn’t buy more tools, created more pipelines. They stopped, looked at the mess, and asked one hard question: “How can we move faster without rebuilding everything?” Flexible scalable data architeriture. They built a foundation that can absorb change, not crumble under it. What they did differently: 1. Rationalized first. They killed redundant systems before they modernized. No more patchwork of “legacy + shiny new.” One unified platform, one source of truth, one model. Centrelize, Standradize data, but federate the use of it. Stop chasing perfection, and 'future tense'. Data only valuable if used. 2. Standardized everything. Every pipeline, schema, and permission model followed the same rules. No cowboy connectors. No hidden spreadsheets No redunded tables or pipelines ( like v3 or v3_realfinal) Create a semantic and consumer layer where you centrelize all, but remain agility. Most teams spent 80% time uplifting then providing impact. 3. Built governance into the foundation. I hate 'governance' documentation. Not as policy docs, but as code. They automated trust: lineage, access, compliance. Hits all from trust, adoption, scale and impact. 4. Designed for agility. They didn’t just centralize data, they made it modular. Imagine like building legos. Thats how you should you think about data foundation. Add a new source, new data product, deploy an AI use case… without ripping up the foundation each time. Most teams spent more time fixing rather providing impact. 5. Agility, People & Literalcy They invested in data literacy, not just data engineering. Literlcy is not training or workshop. It's providing clear ideas, feedback on what is possible with data, ai etc. End users could trust, and act data without anyone. Compared to others, and one one manufactuerer who recently audit said: “We have everything, but nothing works together.” Their architecture looked like a vendor expo at Gartner event. Data team spends 80% time firefighting pipelines instead of delivering impact. You’re slow because you’ve built rigid systems. You need fewer tools and scalable architecture. Architeirture needs to adapt to business, not the other way around. → Comment below "Scale" and will sent you full playbook on building a scalable agile data architecture without risking never-ending rebuilds

A coherent & focused Department of Defense (DOD) effort is underway to modernize how the US military will develop, implement, & manage our Command and Control (C2) capabilities to prevail in all operational domains, across echelons, & with our mission partners. The Joint All Domain Command & Control (JADC2) provides a coherent approach for shaping future Joint Force C2 capabilities & is intended to produce the warfighting capability to sense, make sense, & act at all levels & phases of war, across all domains, & with partners, to deliver information advantage at the speed of relevance. As an approach, JADC2 transcends any single capability, platform, or system; it provides an opportunity to accelerate the implementation of needed technological advancement & doctrinal change in the way the Joint Force conducts C2. JADC2 will enable the Joint Force to use increasing volumes of data, employ automation & artificial intelligence, rely upon a secure & resilient infrastructure, & act inside an adversary's decision cycle. The JADC2 Strategy articulates three guiding C2 functions of ‘sense,’ ‘make sense,’ & ‘act,’ and an additional five enduring lines of effort (LOEs) to organize & guide actions to deliver materiel & non-materiel JADC2 capabilities. The LOEs are: (1) Establish the Data Enterprise; (2) Establish the Human Enterprise; (3) Establish the Technical Enterprise; (4) Integrate Nuclear C2 & Communications (NC2/NC3) with JADC2; and (5) Modernize Mission Partner Information Sharing. The strategy provides six guiding principles to promote coherence of effort across the DOD in delivering materiel & non-materiel JADC2 improvements. These principles are: (1) Information Sharing capability improvements are designed and scaled at the enterprise level; (2) Joint Force C2 improvements employ layered security features; (3) JADC2 data fabric consists of efficient, evolvable, and broadly applicable common data standards and architectures; (4) Joint Force C2 must be resilient in degraded & contested electromagnetic environments; (5) DOD development & implementation processes must be unified to deliver more effective cross-domain capability options; and, (6) DOD development & implementation processes must execute at faster speeds. The JADC2 Strategy concludes that the use of an enterprise-wide, holistic approach for implementing materiel and non-materiel C2 capabilities is urgently needed to ensure the Joint Force Commander’s ability to gain and maintain information & decision advantage against global adversaries. Last week, I attended the Secure Interoperability in the Tactical Environment (SITE) Summit 3.0. We addressed many of the LOE from a data and security perspective with our mission partners. #army #dod #defenseindustry #commandandcontrol

Lower operating costs, faster decisions, and better data control are the outcomes that Defense leaders are increasingly seeking as AI transitions from pilots to real mission use. In discussions with senior DoD leaders, there is a growing acknowledgment that architecture is crucial. A cloud-only AI model does not always align with operational realities, particularly in contested, disconnected, or time-critical environments. The path forward is leaning towards a hybrid approach. Centralized cloud environments are vital for training, collaboration, and scalability. However, inference, analytics, and decision support are most effective when situated closer to the mission—at the edge—where latency, resiliency, and trust are paramount. A representative analysis we've reviewed illustrates this point: shifting inference and analytics closer to the edge led to a reduction in ongoing AI run-rate costs by approximately 50%, while significantly enhancing responsiveness for operators and analysts. For Defense CIOs, these discussions are not merely theoretical technology debates. Hybrid AI architectures are influencing mission readiness, resilience, and long-term budget sustainability. If you are navigating similar tradeoffs, I would appreciate the opportunity to exchange insights and learn from your experiences.

The "Speed of War" isn't a buzzword—it's a requirement. Recent Warfighter Exercises (WFX) prove it: Our headquarters are drowning in data but starving for actionable insights. We are still trying to win modern battles with "digitized analog" processes—manual slides, fragmented chats, and disconnected trackers. Onebrief is changing the game. It’s not just another tool; it’s an AI-powered Operating System for Commanders to drive the planning process. ✅ Sync at Scale: One update to a "Card" (task/risk) flows instantly from Corps to Division. ✅ Kill the Drudgery: Automated workflows replace 20+ hours of manual slide deck maintenance per week. ✅ Unified Truth: Real-time data integration across NIPR, SIPR, and JWICS. ✅ Decide Faster: Transform complex data into actionable insights before the enemy can react. From the single services to Joint Staff, the shift toward data-centric C2 is here. Stop managing slides and start mastering the domain. The future of the battlefield belongs to those who can synthesize information the fastest. Are you ready? #DefenseTech #JADC2 #Onebrief #WFX #ModernWarfare #CommandAndControl #Innovation

🚨 The Military Has a Data Problem 🚨 Listen Up! Commanders don’t want an explanation; they want to know Mission Success. Most Military ORSAs live in the top left quadrant of this chart, focused on data analysis for operations. They export from SQL into Excel, they use pivot tables, and then make a PowerPoint slide w/ a flat image. That’s valuable. But it’s not what generals need to win in an information-driven battlespace. 📊 In business, the sweet spot is the bottom right: ✅ Deep technical chops ✅ Direct alignment to mission/business outcomes ✅ Clear ROI 💡 In the Army, this means a role that links AI, predictive analytics, and decision science directly to operational outcomes — not just reports and PowerPoints. I can hear the Strawman arguments now - 'but, we are not a business!' You're Right, we have a higher standard for the American people because we are using their money (Tax $). The gap is real. Current State: Analysts who produce data summaries and readiness briefs. Future State: Decision scientists who optimize operations, forecast outcomes, and integrate AI into command decision-making. 🎯 Imagine if every Soldier & ORSA could operate in the “What Generals Need” quadrant, combining Operational context + Advanced analytics + Systematic problem-solving frameworks + Production-ready decision support tools. The payoff? Faster, better, and more survivable decisions in complex environments. Question for my network. How do we upskill and restructure our analyst corps so that military data talent isn’t just looking at the past, but shaping the future? U.S. Army Reserve Careers Group (ARCG), US Army, US Army Artificial Intelligence Integration Center (AI2C), Line of Departure US Army Journals, U.S. Army Recruiting Command (USAREC), #Army #DataScience #MilitaryAI #ORSAs #DecisionScience #Leadership #AI #DigitalTransformation