DevOps Journey - Week 12 🚀 This week in my DevOps journey with Nana Janashia, I explored one of the most powerful skills in modern engineering: Automation with Python (Boto3). Instead of just learning concepts, I built real automation scripts that interact directly with AWS: Automated EC2 health checks (state + status monitoring) Built a scheduler to run tasks automatically (no manual execution) Automated tagging of resources across regions Created EKS cluster status scripts (status, version, endpoint) Implemented automated backups using volume snapshots Built a cleanup system to remove old snapshots and reduce cost Learned how to restore EC2 volumes from backups (real recovery scenario) 💡 Key takeaway: Not everything should be done with Terraform. Terraform → Best for infrastructure provisioning (state + idempotency) Python → Best for automation, monitoring, and operational tasks Also learned something critical: 👉 Automation is not just about making things work 👉 It’s about handling failures properly (error handling, rollback logic) This week really showed me how DevOps goes beyond tools — it’s about choosing the right tool for the right job and building systems that are reliable, efficient, and scalable. Excited to keep building 🚀 #DevOps #Python #AWS #Boto3 #Automation #CloudComputing #TechJourney #LearningInPublic
DevOps Journey with Python Automation on AWS
More Relevant Posts
-
⭐ Most platform engineers I know use Cursor for autocomplete. That's like using a excavator to dig a hole with a teaspoon attachment. I spent the last few weeks going deep on Cursor Agent — not the tab-complete, the actual agent mode — specifically for infrastructure and DevOps work. What I found changed how I think about the tool entirely. The agent doesn't just edit files. It: → Queries your live Kubernetes cluster before making a change → Catches open PRs that would conflict with what you're about to do → Investigates a 5xx incident across GitHub, kubectl, and your deploy history — in one conversation → Runs terraform validate, reads the error, fixes it, runs again — without you typing a command But the part nobody talks about: Out of the box, it's generic. It doesn't know your naming conventions, your module patterns, your "never touch this file" rules. Once you configure it properly — 6 files, maybe 2 hours of setup — it's a different tool entirely. I wrote the full breakdown. What MCP actually is, how the agent calls tools under the hood, every config file your team needs to replicate this, and 6 real use cases with exact prompts. If you work in platform or DevOps, this one's worth the read. Part 1 (link in the comment) and Part 2: https://lnkd.in/gpXdFjRU #DevOps #PlatformEngineering #Kubernetes #Terraform #CursorAI #AITools #SRE
To view or add a comment, sign in
-
Starting my DevOps journey. I’ve begun learning DevOps to strengthen my understanding of modern backend systems and deployment practices. Currently following a structured learning resource by Faizal Menon that covers core concepts like CI/CD, containerization (Docker), and infrastructure basics. Here is the resource I’m learning from: https://lnkd.in/gSgjtVZt My goal is to build hands-on projects and apply these concepts in real-world scenarios. If you have any suggestions or beginner-friendly resources, I would appreciate your guidance. #DevOps #LearningJourney #BackendDevelopment #ContinuousLearning
Full Stack AI DevOps Course + Real Projects 🚀 | Docker + Kubernetes + CI/CD + Terraform | Job Ready
https://www.youtube.com/
To view or add a comment, sign in
-
If you are still hand-writing the 10th nearly identical Terraform module, that is not craftsmanship. That is unpaid toil. Same with manually debugging the same Kubernetes YAML issues for the 50th time, or rewriting boilerplate CI/CD config from scratch every new repo. That is not "job security". It is you acting like a very slow, very expensive script. AI is not just for CEOs writing investor emails. It is absolutely for infra and DevOps engineers who are tired of: - Copy pasting the same Terraform patterns with tiny variations - Hunting the same Kubernetes indentation or apiVersion bugs - Rebuilding the same GitHub Actions / GitLab CI skeletons I use AI to generate the first draft of modules, Helm templates, and pipeline configs, then I review, harden, and standardize them. The value is not in typing YAML faster. The value is in designing better architectures, clearer incident patterns, and safer defaults. If we cling to low-value work as our identity, we are volunteering to be replaced by the people who automate it. If we use AI to kill the toil, we get to spend more time on the parts of this craft that actually require judgment and experience. #devops #cloudengineering #platformengineering
To view or add a comment, sign in
-
-
🚀 Many beginners confuse code with algorithms — I used to do the same. As a DevOps engineer, I’ve learned that: 👉 Algorithm = your thinking (steps to solve a problem) 👉 Code = implementation of that thinking I recently wrote a simple example of Linear Search using environments like dev, stg, prd — something we use in real DevOps workflows. 💡 Key takeaway: If your logic is clear, your code becomes simple. Also, don’t ignore time complexity: Single loop → O(n) Nested loops → O(n²) Efficiency matters, especially in automation and CI/CD pipelines. If you're starting your DevOps or coding journey, focus on logic first — tools come later. Blog Link: https://lnkd.in/dDMhjdSw , https://lnkd.in/dU7ePf5r #DevOps #Algorithms #Python #Learning #Programming #Automation #Tech #Beginners #SoftwareEngineering #Cloud
To view or add a comment, sign in
-
🚀 From Confusion to Containers — My Docker Journey When I first heard about Docker, it felt complex. Containers, images, volumes, networking — everything sounded overwhelming. But once I got my hands dirty, everything changed. 💡 Docker is not just a tool — it’s a mindset. It teaches you how to build, ship, and run applications consistently across any environment. No more: ❌ “It works on my machine” ❌ Dependency conflicts ❌ Environment mismatches Instead, you get: ✅ Reproducible environments ✅ Faster deployments ✅ Scalable architecture ✅ Clean DevOps workflows 🔧 What I’ve learned so far: How to containerize full-stack applications Writing efficient Dockerfiles (multi-stage builds 🔥) Managing containers, images, and networks Debugging real-world issues inside containers Connecting services like Node.js + PostgreSQL using Docker 🌱 The biggest lesson? Consistency beats complexity. Once you understand the basics, Docker becomes your superpower. This is just the beginning of my DevOps journey — next stop: Kubernetes ☸️ If you're learning Docker, stay consistent. It’s worth it 💯 #Docker #DevOps #LearningJourney #CloudComputing
To view or add a comment, sign in
-
The "Python for DevOps" Hook: Stop trying to force your YAML to think. In the DevOps world, we spend 90% of our time in YAML. It’s great for configuration, but the moment you need complex logic, conditional loops, or custom API integrations, YAML starts to feel like a straightjacket. Recently, I noticed our cloud costs creeping up due to "zombie" resources - unattached storage volumes and old snapshots that were no longer linked to any active instances. Instead of manually auditing every region or writing a massive, brittle bash script, I used Python and the Boto3 library. I wrote a script that: >>Scanned all regions for unattached EBS volumes. >>Filtered them by "Age" (older than 30 days). >>Sent a summary report to Slack for approval before triggering a bulk deletion. Why Python is still a DevOps superpower in 2026: -> Bespoke Automation: Handling complex "if/then" logic for resource lifecycle management that standard tools miss. -> Data Processing: Quickly parsing through thousands of lines of cloud metadata. -> Safety Nets: Building in custom dry-run modes and Slack notifications to ensure we don't delete something critical. The Result: We cut our monthly storage waste by nearly 20% and removed the manual overhead of "cloud cleaning" forever. DevOps isn't just about knowing the tools; it's about knowing when to build your own. #DevOps #Python #Automation #AWS #CloudCostOptimization #SRE
To view or add a comment, sign in
-
Kubernetes: CrashLoopBackOff at 2am The most dreaded status in Kubernetes: CrashLoopBackOff Pod starts. Crashes. Kubernetes restarts it. Crashes again. Repeat forever. It works perfectly in docker-compose. Breaks the moment it hits Kubernetes. Here's the exact debugging process that saved me: Step 1: kubectl logs <pod-name> → See the actual application error. This is usually enough. Step 2: kubectl describe pod <pod-name> → Shows events: image pull failures, resource limits hit, liveness probe failures Step 3: kubectl get pod <pod-name> -o yaml → Full pod spec. Compare against what you intended to deploy. In my case, Step 1 showed it immediately: sqlalchemy.exc.OperationalError: could not connect to server environment variable DATABASE_URL is not set The DATABASE_URL env variable was defined in docker-compose.yml. It was never added to the Kubernetes deployment YAML. docker-compose and Kubernetes don't share config. They never did. One missing environment variable. Six hours of confusion if you don't know where to look. Bookmark these three commands. You will use them every single week as a DevOps engineer. What's the Kubernetes error that took you the longest to debug? 👇 #Kubernetes #DevOps #Debugging #CrashLoopBackOff #CloudNative #SRE #PlatformEngineering
To view or add a comment, sign in
-
🐳 Dockerfile Commands – DevOps Basics You Should Know If you're working with Docker, understanding Dockerfile commands is very important for building optimized container images. Here are the most commonly used Dockerfile commands: 🔹 FROM – Base image for the container Example: FROM openjdk:17-jdk-slim 🔹 WORKDIR – Sets the working directory inside container Example: WORKDIR /app 🔹 COPY – Copies files from local system to container Example: COPY target/app.jar app.jar 🔹 ADD – Similar to COPY but supports URLs and tar extraction 🔹 RUN – Executes commands during image build Example: RUN apt-get update && apt-get install -y curl 🔹 CMD – Default command to run when container starts Example: CMD ["java","-jar","app.jar"] 🔹 ENTRYPOINT – Runs container as executable 🔹 EXPOSE – Exposes container port Example: EXPOSE 8080 🔹 ENV – Sets environment variables Example: ENV SPRING_PROFILES_ACTIVE=prod 🔹 VOLUME – Creates mount point for persistent storage 🔹 USER – Runs container as specific user 💡 Dockerfile Best Practice: Use Multi-Stage Builds to reduce image size and improve security. Example Flow: FROM → WORKDIR → COPY → RUN → CMD If you are learning DevOps, Dockerfile is one of the most important topics to master. #Docker #DevOps #Containers #Kubernetes #Cloud #Dockerfile #OpenSource #SoftwareEngineering
To view or add a comment, sign in
-
🚀 Introducing DevOpsToolkit — Built for Engineers, by an Engineer After intense building, refining, and pushing boundaries… I’m excited to finally share something I’ve been working on: 👉 A unified DevOps & Platform Engineering toolkit designed to simplify, accelerate, and automate everyday engineering workflows. 🔧 What it brings: • Ready-to-use DevOps scripts (Bash, Python, PowerShell) • Kubernetes & Docker generators (YAML, Helm-ready) • CI/CD pipeline builders (Jenkins, GitHub Actions, GitLab, more) • Cloud-ready configurations (multi-provider mindset) • Security, observability, and automation utilities • Smart AI-powered assistance (early stage, evolving fast) 💡 Built with a simple idea: Instead of searching, rewriting, and debugging the same things again and again… 👉 Why not have everything in one place, ready to use? ⚡ What’s coming next: • BYOK (Bring Your Own Key) for LLM integrations • DevOps command simulation (learn by seeing what happens internally) • Intelligent tool recommendations This is just the beginning — the vision is much bigger: ➡️ A self-evolving DevOps ecosystem with thousands of tools and generators. 🌐 Try it here: https://devopstoolkit.dev/ Would love your feedback, ideas, and brutal honesty 🙌 Let’s build something powerful together. DEVOPS INSTITUTE Agentic DevOps DevOpsCube DevOps Learner Community IBM Amazon Web Services (AWS) #DevOps #PlatformEngineering #Kubernetes #Docker #Cloud #Automation #AI #SRE #DevSecOps #ibmchampion #devopsinstitute #peoplecertambassador #gitlabcertified #devopstoolkit #devopstoolkit.dev
To view or add a comment, sign in
-
Building Beyond Infrastructure Provisioning — Automating Platform Operations Provisioning infrastructure with Terraform is important, but the real challenge often comes after deployment — coordinating operations, handling failures, and keeping teams informed. To solve this, I built a modular Python-based Platform Automation System that automates common platform tasks across cloud and Kubernetes environments. What it does: Automates workflows like: AWS account creation S3 bucket management Lambda deployment and deletion Kubernetes pod restarts Grafana dashboard provisioning Tracks success and failure of each task Measures execution time and estimated manual effort Sends real-time Slack notifications for visibility Why Python? Terraform provisions infrastructure. Python orchestrates operations — handling decisions, retries, reporting, and notifications. This project focuses on improving operational efficiency, reliability, and visibility, which are key requirements in modern DevOps and Platform Engineering teams. Always learning. Always building. # Explore the full implementation and architecture: https://lnkd.in/eFKSF6eq #DevOps #PlatformEngineering #CloudEngineering #Python #Automation #AWS #Kubernetes
To view or add a comment, sign in
-
Explore related topics
Explore content categories
- Career
- Productivity
- Finance
- Soft Skills & Emotional Intelligence
- Project Management
- Education
- Technology
- Leadership
- Ecommerce
- User Experience
- Recruitment & HR
- Customer Experience
- Real Estate
- Marketing
- Sales
- Retail & Merchandising
- Science
- Supply Chain Management
- Future Of Work
- Consulting
- Writing
- Economics
- Artificial Intelligence
- Employee Experience
- Workplace Trends
- Fundraising
- Networking
- Corporate Social Responsibility
- Negotiation
- Communication
- Engineering
- Hospitality & Tourism
- Business Strategy
- Change Management
- Organizational Culture
- Design
- Innovation
- Event Planning
- Training & Development