Raj Halwai’s Post

🚀 Day 10/70 – Introduction to NumPy (Entering Real Analytics) Today I started learning NumPy 📊 NumPy (Numerical Python) is a powerful library used for numerical computations in Python. It is faster and more efficient than normal Python lists for mathematical operations. 📌 Why NumPy is Important in Data Analytics? ✔ Handles large datasets efficiently ✔ Supports multi-dimensional arrays ✔ Performs fast mathematical operations ✔ Foundation for Pandas & Machine Learning 📌 Installing NumPy Python id="p4y2zn" pip install numpy 📌 Creating a NumPy Array Python id="k8s9d1" import numpy as np arr = np.array([10, 20, 30, 40]) print(arr) 📌 Basic Operations Python id="w2mx5v" print(arr + 5) # Add 5 to each element print(arr * 2) # Multiply each element print(np.mean(arr)) # Average 👉 NumPy automatically applies operations to all elements (vectorization). 📊 Why This Is Powerful? In normal Python: Python id="q1b9er" numbers = [10, 20, 30, 40] new_list = [] for num in numbers: new_list.append(num * 2) With NumPy: Python id="c7u3ks" arr = np.array([10, 20, 30, 40]) print(arr * 2) Cleaner + Faster 🔥 #Day10 #NumPy #Python #DataAnalytics #LearningInPublic #FutureDataAnalyst #70DaysChallenge

I stopped using Python loops for array operations. Here’s why. I’ll be honest—I used to be a "loop person." When I first started working with large datasets, writing a Python loop just felt natural. It was easy to read and easy to write. But as my data grew, my performance tanked. I finally got tired of waiting for my code to finish and decided to time it. One single switch from a standard loop to a NumPy vectorized operation changed everything. The result? My processing time dropped from 12 seconds to 0.3 seconds. That is a 40x speedup by changing just one line of code. Here is the breakdown of what happened: import time, numpy as np data = list(range(1_000_000)) The slow way (Python Loop) start = time.time() result = [x**2 for x in data] print(f"Loop: {time.time()-start:.2f}s") # ~0.40s The fast way (NumPy Vectorization) arr = np.array(data) start = time.time() result = arr**2 print(f"NumPy: {time.time()-start:.4f}s") # ~0.003s So why is NumPy so much faster?  It boils down to three things: 1. It runs on compiled C code (bypassing the slow Python interpreter). 2. It uses contiguous memory (the CPU can grab data way faster). 3. It skips the "interpreter tax" on every single element in your array. I tell my students this all the time now: If you are looping over numbers, you are probably leaving performance on the table. In ML tasks like feature scaling or distance calculations, this isn't just a "nice-to-have"—it's a requirement. New habit: Before you write 'for x in...', ask yourself if NumPy can do it in one line. Your future self (and your CPU) will thank you. What’s the biggest performance win you've found recently? I'd love to hear about it in the comments! #Python #NumPy #DataScience #MachineLearning #PerformanceOptimization

A few days ago I posted about how SQL forces you to think in layers. What I didn't mention is how differently it feels compared to Python, which I've been learning for a while now. I came across an article by Benn Stancil that finally put it into words for me: SQL is like a basic Lego set. Limited pieces, but they always fit together predictably. You know what you're building. Data rolls downhill like a snowball, collecting and compressing until you get your answer. Python is more like specialized Lego sets. Seaborn, Pandas, Scikit-learn — each library is its own world. Together they can build almost anything, but sometimes you just have to trust the result. Data branches out like a web. I'm still figuring out which way of thinking I prefer honestly. But I'm starting to see why people say you need both. If you're learning both, which one are you finding harder to wrap your head around? #SQL #Python #DataAnalytics

A small but powerful data lesson I’ve been revisiting lately: SQL helps you ask the right questions. Python helps you explore the answers. SQL is incredible for: filtering large datasets aggregating data efficiently understanding what is happening Python shines when you want to: clean and transform messy data explore patterns and outliers visualise trends and test assumptions What I’m learning is that the real strength isn’t choosing one over the other — it’s knowing when to use each and how they work together in a data workflow. Strong data analysis isn’t about tools alone; it’s about clarity of thinking. #Python #SQL #DataAnalytics #OpenData #LearningInPublic #DataSkills #MScJourney

The difference between knowing Pandas and actually using it effectively is mastering the right 15-20 functions. When working with data in Python, Pandas isn’t just a library. It’s the layer where raw data turns into insight. Most analysis workflows rely on a small set of functions used really well. Data Importing Functions like read_csv(), read_excel(), read_sql(), read_json() help you pull data from almost any source into a usable format. Data Cleaning fillna(), dropna(), sort_values(), groupby(), rename() are what turn messy, real-world data into something you can trust. Data Exploration & Statistics head(), describe(), mean(), median(), std(), min(), max() give you a fast sense of patterns, ranges, and anomalies. You don’t need to know everything in Pandas to be effective. You need to understand why and when to use these core functions. Strong analysis comes from mastering the basics. What's the one Pandas function you find yourself using constantly?

𝐎𝐧𝐞 𝐭𝐡𝐢𝐧𝐠 𝐈’𝐦 𝐧𝐨𝐭𝐢𝐜𝐢𝐧𝐠 𝐰𝐡𝐢𝐥𝐞 𝐥𝐞𝐚𝐫𝐧𝐢𝐧𝐠 𝐝𝐚𝐭𝐚 𝐚𝐧𝐚𝐥𝐲𝐬𝐢𝐬 While practicing Python and SQL lately, one thing is becoming very clear, data analysis is not just about tools. Most of the time actually goes into understanding the data itself. Looking at patterns, asking the right questions, and figuring out what the numbers really represent. Even small exercises start getting interesting when you try to interpret the results instead of just writing code. Still early in the journey, but slowly getting more comfortable working with data and thinking more analytically. #DataAnalytics #Python #SQL #LearningJourney

🎉Welcome to Episode 6 of my Data Cleaning with Pandas series 🚀 In this tutorial, we learn how to clean and standardize text columns such as Country, Gender, using Python and Pandas. Text data often contains: Extra spaces Inconsistent capitalization Duplicate formatting Hidden errors If not cleaned properly, grouping and analysis can produce incorrect results. In this video, you will learn: 🔶 How to inspect unique values using .unique() 🔶 Standardize capitalization using .str.title() 🔶.loc function 🔶 Validate cleaned data correctly This is a must-know skill for aspiring Data Analysts and Python beginners. 📂 Tools Used: Python Pandas Jupyter Notebook 🎥 Watch the full Data Cleaning Series here:https://lnkd.in/dYapcaMv #Python #Pandas #DataCleaning #DataAnalysis #DataScience #JupyterNotebook #LearnPython #AminuAnalyst

🐍 One Python trick that saves me hours every week (and most people ignore it) I used to write 10–15 lines just to clean and summarise a messy dataset. Then I started using method chaining in Pandas — and I haven’t gone back since. Instead of this 👇 df = pd.read_csv("sales.csv") df = df.dropna() df = df.rename(columns={"amt": "amount"}) df = df[df["amount"] > 0] df = df.groupby("region")["amount"].sum() You can write this. 👇 result = ( pd.read_csv("sales.csv") .dropna() .rename(columns={"amt": "amount"}) .query("amount > 0") .groupby("region")["amount"].sum() ) ---> Same output. ---> Fewer variables. ---> Much cleaner logic. 💡 Why this matters in real work: → Easier to debug (one clear pipeline) → More readable for others (flows like a sentence) → Less friction in notebooks (fewer reruns, less clutter) I use this daily — from cleaning raw data to preparing features for models. The best part? You don’t need new tools. It’s already built into Pandas. Most people just never use it this way. 💬 What’s your go-to Pandas trick? I’m collecting the best ones — drop yours below 👇 #DataScience #Python #Pandas #DataAnalytics #DataEngineering #Analytics #MachineLearning #LearnInPublic #CodingTips #TechCareers

Recently I’ve been diving deeper into NumPy, one of the most fundamental libraries for numerical computing in Python. Instead of just using it in code, I wanted to understand how it actually works and why it’s so powerful. Here are some key things I learned: • NumPy Arrays (ndarray) NumPy uses homogeneous arrays, meaning all elements share the same data type. This allows efficient memory usage and fast numerical computation. • Why NumPy is fast NumPy is largely implemented in C, which allows Python to perform vectorized operations much faster than traditional Python loops. • Array creation methods I practiced creating arrays using functions like: np.array(), np.arange(), np.ones(), np.zeros(), np.identity(), and np.random.random(). • Understanding array attributes Learning attributes like ndim, shape, size, itemsize, and dtype helped me better understand how data is stored internally. • Array operations and statistics NumPy makes it easy to perform vectorized operations and statistical computations like: mean, median, variance, standard deviation, and dot products. • Data manipulation I explored powerful tools like: Indexing and slicing Iterating arrays with np.nditer() Reshaping with reshape() Flattening arrays with ravel() Transposing arrays with .T • Combining and splitting arrays Using functions like np.hstack(), np.vstack(), np.hsplit(), and np.vsplit(). What I’m realizing is that NumPy is the foundation for most of the Python data ecosystem — including libraries like Pandas, SciPy, and many machine learning frameworks. Every concept I learn here is another step toward becoming better in data science and machine learning. Small progress every day compounds. #Python #NumPy #LearningInPublic #DataScienceJourney #MachineLearning 😊 🗒️

Python made data cleaning feel less painful. When I first started working with datasets, I didn’t realize how messy real data can be. Missing values. Duplicate rows. Inconsistent formats. But learning basic Python libraries like: • Pandas – for handling and cleaning data • NumPy – for numerical operations • Matplotlib / Seaborn – for visualization changed how I approach analysis. Most of analytics isn’t fancy models. It’s cleaning and preparing data properly. And honestly, that’s where the real learning begins. #MBAAnalytics #PythonForDataAnalysis #DataCleaning #LearningJourney #BusinessAnalytics