Python Loops: FOR and WHILE Explained

🚀 Day 12/20 — Python for Data Engineering Filtering & Selecting Data (Pandas) Now that we know what a DataFrame is… 👉 The real work starts here: getting only the data you need 🔹 Selecting Columns df["name"] 👉 Select a single column df[["name", "salary"]] 👉 Select multiple columns 🔹 Filtering Rows df[df["salary"] > 50000] 👉 Get rows based on condition 🔹 Multiple Conditions df[(df["salary"] > 50000) & (df["age"] < 30)] 👉 Combine conditions 🔹 Why This Matters Reduce unnecessary data Focus on relevant records Improve performance 🔹 Real-World Use 👉 Raw Data → Filter → Useful Data 💡 Quick Summary Selecting = columns Filtering = rows 💡 Something to remember You don’t need all the data… You need the right data. #Python #DataEngineering #DataAnalytics #LearningInPublic #TechLearning #Databricks

Most analysts don’t struggle with analysis. They struggle with repeating the same work every single day. Downloading files. Cleaning the same columns. Updating reports. Copy-pasting into Excel. 👉 This is where Python scripting changes everything. Instead of doing tasks manually, you can: • automate data cleaning • process multiple files in seconds • generate reports automatically • build reusable workflows What takes 1–2 hours manually can often be done in a few seconds. 🧠 Why Python matters in Data Analysis Because real-world work is not just: ❌ SQL queries ❌ dashboards It’s also: ✔ messy data ✔ repetitive tasks ✔ recurring reports Python helps you move from: 👉 manual work → automated systems ⚙️ Simple ways to start using Python • Save your cleaning logic as reusable scripts • Use loops to process multiple files • Automate Excel instead of manual formulas • Schedule scripts for daily/weekly reports • Combine SQL + Python for end-to-end workflows 📦 Most used libraries • pandas → data cleaning & manipulation • numpy → numerical operations • openpyxl / xlsxwriter → Excel automation • os / glob → handling multiple files • schedule → automation 🔥 Final thought The difference between analysts is simple: 👉 Some repeat work every day 👉 Others automate it once and reuse forever #DataAnalytics #Python #Automation #DataAnalyst #LearningInPublic #Analytics #Productivity #SQL

Most data analysts are not missing tools. They are missing impact. They can: - Write SQL - Build dashboards - Run Python scripts But still struggle to answer: 👉 So what should the business do next? Without that answer, analysis becomes reporting not decision support. The real gap is not technical. It’s thinking in terms of business decisions. Data alone has no value. Decisions do. #python #DataScience #Pandas #Tableau #DataAnalysis #JupyterNotebook #PowerBI

🚀 Built a Python Project: Corporate Data Analyzer Most business users struggle to analyze raw data efficiently without technical tools. So I built a simple desktop application to solve this problem. 💡 What it does: • Import CSV / Excel data • Perform GroupBy & aggregations (sum, mean, max, etc.) • Generate interactive charts (Bar, Line, Pie) • Export reports (Excel/CSV) • Export charts as PNG 🛠 Tech Stack: Python | Pandas | Tkinter | NumPy | Matplotlib 📊 This project helped me improve: ✔ Data analysis using Pandas ✔ GUI development using Tkinter ✔ Data visualization using Matplotlib ✔ Building end-to-end real-world tools 🔗 GitHub Repository: https://lnkd.in/giyeMwRd I’d really appreciate your feedback and suggestions! #Python #DataAnalytics #Projects #GitHub #Learning #DataScience #Portfolio #OpenToWork

🚀 Day 11/20 — Python for Data Engineering Introduction to Pandas (DataFrames) So far, we’ve been working with: lists dictionaries basic file handling But real-world data is not handled like that. 👉 We need something more powerful. That’s where Pandas comes in. 🔹 What is Pandas? Pandas is a Python library used for: 👉 handling structured data 👉 analyzing datasets 👉 performing data transformations 🔹 What is a DataFrame? A DataFrame is: 👉 a table (like Excel or SQL table) 👉 rows + columns 🔹 Creating a DataFrame import pandas as pd data = { "name": ["Alice", "Bob"], "salary": [50000, 60000] } df = pd.DataFrame(data) print(df) 🔹 Reading Data into DataFrame df = pd.read_csv("data.csv") 👉 Most common real-world usage 🔹 Why Pandas Matters Easy data manipulation SQL-like operations Works well with large datasets Foundation for data engineering tasks 🔹 Real-World Use 👉 Raw data → DataFrame → Transform → Output 💡 Quick Summary Pandas helps you work with data like tables in Python. 💡 Something to remember If SQL is how you query data… Pandas is how you work with it in Python. #Python #DataEngineering #DataAnalytics #LearningInPublic #TechLearning #Databricks

Built an Automated Data Profiling & Insight Generation API, turning raw CSV data into meaningful insights in seconds! As part of my data analytics journey, I developed a scalable system using FastAPI that simplifies the entire data analysis workflow — from upload to insights 📊 🔍 What it does: • Processes CSV datasets and generates automated insights like statistical summaries & correlation matrices • Handles datasets with 50K+ rows & 20+ columns efficiently • Performs data cleaning (missing values, duplicates, type normalization), improving data quality by ~35% • Uses optimized Pandas operations to reduce execution time by ~40% • Built with a modular architecture (routes, services, utils) for scalability ⚙️ Tech Stack: Python | FastAPI | Pandas | NumPy | SQL | Matplotlib | Postman | Render 🌐 Deployed the API on Render and tested endpoints using Postman 🎥 Also created a YouTube video explaining the complete project & workflow This project reflects my focus on building practical, scalable data solutions that can be used in real-world analytics scenarios. GitHub Link: https://lnkd.in/dXyY-ty4 Streamlit: https://lnkd.in/d6bjPKuW Live Link: https://lnkd.in/dru34GKa YouTube link: https://lnkd.in/dxzfpvpq Would love to connect with professionals and recruiters in the data space 🤝 #DataAnalytics #DataAnalyst #Python #FastAPI #DataScience #MachineLearning #Pandas #NumPy #SQL #DataProjects #PortfolioProject

🚀 From Excel Problem ➜ Python Solution 🐍📊 Today while practicing Excel VLOOKUP, I noticed something interesting. Whenever using VLOOKUP, we need to manually count the column index number inside the table array. Example: =VLOOKUP(B10,B2:C7,2,TRUE) Here, 2 means return value from the 2nd column of the selected range. 💡 That made me curious... Instead of manually counting columns every time, why not build a small Python utility that converts Excel column letters into numbers? So I started working on this idea: A ➜ 1 B ➜ 2 Z ➜ 26 AA ➜ 27 AB ➜ 28 And wrote a Python function to automate the conversion. 🐍 def MSExcel(S): # Convert Excel column letters to numbers This may look small, but moments like this remind me that problem-solving starts with curiosity. Sometimes the best projects come from everyday pain points while learning tools like Excel. 💬 Would love suggestions from Excel experts , Python developers & Data Analyst: How would you improve this idea? #Excel #Python #Automation #DataAnalytics #LearningInPublic #Data Analytics #ProblemSolving #VLOOKUP #CodingJourney #Curiosity #Productivity

🚀 Day 1/20 — Python for Data Engineering From SQL to Python: The Next Step After spending time with SQL, I realized something: 👉 SQL helps us query data 👉 But real-world data engineering needs more than that. We need to: process data transform data move data across systems That’s where Python comes in. 🔹 Why Python? Python helps us go beyond querying: ✅ Process data from multiple sources ✅ Build data pipelines ✅ Automate workflows ✅ Handle large datasets efficiently 🔹 Simple Example import pandas as pd df = pd.read_csv("data.csv") print(df.head()) 👉 From raw file → usable data in seconds 🔹 SQL vs Python (Simple View) SQL → Get the data Python → Work with the data Together, they form the foundation of data engineering. 💡 Quick Summary SQL is where data access begins. Python is where data engineering truly starts. 💡 Something to remember SQL gets the data. Python makes the data useful. #Python #DataEngineering #DataAnalytics #LearningInPublic #TechLearning #Databricks

I Tracked My Expenses Using Python & NumPy — Here's What ₹38,940 Taught Me About My Spending Habits I built a Personal Finance Tracker using just Python and NumPy — no Pandas, no fancy libraries. Here's what I discovered about my own spending 👇 The project started simple: a CSV file with 50 transactions across 3 months. But when I ran the numbers through NumPy, the insights hit different. What the data revealed: • Shopping eats 40% of my budget — with just 6 transactions • My Top 5 purchases alone = 36% of total spending • Average spend (₹779) vs Median (₹465) — proof that a few big buys skew everything • 56% of money goes to just 11 "high-tier" transactions What I actually built: → Read raw CSV data using Python's csv module → Converted everything to NumPy arrays for fast computation → Used np.sum(), np.mean(), np.max(), np.median(), np.std() → Boolean masking to filter by category & month → np.argsort() to rank top expenses → np.percentile() for distribution analysis → A formatted summary report printed right to the console. Key takeaway: You don't need complex tools to get powerful insights. NumPy + a CSV file + curiosity = real, actionable data about your life. Watch the screen recording below to see the full report output! This is Week 1 of my Python data journey. Next stop: Pandas & Matplotlib. #NumPy #DataAnalysis #PersonalFinance #LearningInPublic #PythonProjects #BuildInPublic #Python #DataScience #CodeNewbie #Programming #TechTwitter #DataDriven #100DaysOfCode #FinanceTracker