From the conversations I am having at the moment, 𝐀𝐈 𝐢𝐬 𝐫𝐞𝐬𝐡𝐚𝐩𝐢𝐧𝐠 𝐭𝐡𝐞 𝐉𝐚𝐯𝐚 𝐰𝐨𝐫𝐥𝐝 𝐟𝐚𝐬𝐭𝐞𝐫 𝐭𝐡𝐚𝐧 𝐦𝐨𝐬𝐭 𝐭𝐞𝐚𝐦𝐬 𝐞𝐱𝐩𝐞𝐜𝐭𝐞𝐝. A year ago, most of my discussions were about cost, performance, and Java modernisation. Now, more and more of those same conversations are drifting into AI. Not as a separate topic, but as something teams are trying to layer into what they already run. This changes the way people think about building applications. There is less focus on services and APIs and more on agents, context, and orchestration. But with that comes a lot of uncertainty. Integrating models, managing context, and making outputs reliable enough for production is not straightforward, especially in environments where stability really matters. 𝐓𝐞𝐚𝐦𝐬 𝐰𝐚𝐧𝐭 𝐭𝐨 𝐦𝐨𝐯𝐞 𝐪𝐮𝐢𝐜𝐤𝐥𝐲 𝐰𝐢𝐭𝐡 𝐀𝐈, 𝐛𝐮𝐭 𝐭𝐡𝐞𝐲 𝐚𝐫𝐞 𝐚𝐥𝐬𝐨 𝐫𝐞𝐬𝐩𝐨𝐧𝐬𝐢𝐛𝐥𝐞 𝐟𝐨𝐫 𝐬𝐲𝐬𝐭𝐞𝐦𝐬 𝐭𝐡𝐚𝐭 𝐜𝐚𝐧𝐧𝐨𝐭 𝐚𝐟𝐟𝐨𝐫𝐝 𝐭𝐨 𝐛𝐫𝐞𝐚𝐤. Maintainability, scalability, and predictability in production are still the baseline. AI just adds another layer on top that needs to fit into that reality. It is also interesting to see how Java itself is adapting. Tooling is starting to bring more structure to AI use cases, whether that is working with embeddings, vector search, or just making these systems feel a bit more deterministic. There is even a shift in how code is evolving. Some teams are already experimenting with AI to refactor and simplify existing code, which feels like the early stages of a broader shift in how development happens. 𝐓𝐡𝐚𝐭 𝐠𝐚𝐩 𝐛𝐞𝐭𝐰𝐞𝐞𝐧 𝐞𝐱𝐩𝐞𝐫𝐢𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧 𝐚𝐧𝐝 𝐩𝐫𝐨𝐝𝐮𝐜𝐭𝐢𝐨𝐧 𝐢𝐬 𝐰𝐡𝐞𝐫𝐞 𝐭𝐡𝐞 𝐫𝐞𝐚𝐥 𝐜𝐨𝐧𝐯𝐞𝐫𝐬𝐚𝐭𝐢𝐨𝐧𝐬 𝐚𝐫𝐞 𝐡𝐚𝐩𝐩𝐞𝐧𝐢𝐧𝐠. Azul is hosting a virtual session on April 14 to dig into this in more detail, alongside people who work on this day-to-day. I have added the registration link in the comments for anyone interested. #Java #AI #SoftwareEngineering #EnterpriseIT
Great post Emma! A reason I left Azul in 2023 was Azul's lack of engagement in the Java in prod AI discussion, specifically MLOps as the production play around DSML (this was pre-ChatGPT).I may have been too hasty. As you point out, as things move to prod (and thus from Python too Java, etc), scalability, control and good practice matters. And industry is *really* struggling to make that shift with GenAI, copilots + Agentic AI. Now is the time. I hope Java is not too late to the agentic party. In MLOps, Python v C v Rust v Java v other stuff discussions were happening visibly in the active MLOPs (many 10's of thousands) Community, and no Java folks were present at that sizeable table. As ChatGPT and RAG hit, vector embeddings/search/tooling leadership came from the like of Weaviate and Qdrant, not the Java community, in the same channels.Agentic production discussions *are* happening in anger, more broadly now and an order of magnitude larger. So g'luck with the Conference! I love what I also see across the wider Java community - influencer Michael Drogalis made a great post just yesterday on Java and GPUs, the write-ups from Artur Skoworonski are genius, and the great new JAX and DevOxx agendas are refreshing!
https://www.azul.com/webinars/ai4j-intelligent-java-conference/register/