Data Visualization in Python: Telling the Truth About Data

📊𝗗𝗮𝘆 𝟲𝟳 𝗼𝗳 𝗠𝘆 𝗗𝗮𝘁𝗮 𝗦𝗰𝗶𝗲𝗻𝗰𝗲 & 𝗗𝗮𝘁𝗮 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗝𝗼𝘂𝗿𝗻𝗲𝘆 Today I explored an important Python concept that strengthens how we safely handle data structures in real-world analytics projects — Dictionary Comparison, Shallow Copy, and Deep Copy. At first, copying a dictionary may look simple. But when working with nested data structures like JSON files, API responses, configuration objects, or feature-engineered datasets, understanding how Python handles memory references becomes extremely important. Here’s what I learned today: 🔹 Dictionary Comparison in Python Dictionary comparison helps verify whether two datasets or configurations are identical by checking both keys and values. This is especially useful during data validation, debugging transformations, and ensuring correctness in preprocessing pipelines. Example use cases: • Checking whether cleaned data matches expected output • Validating configuration dictionaries in ML workflows • Comparing original vs transformed datasets during feature engineering This improves reliability and reduces silent errors in analytics workflows. 🔹 Shallow Copy – Understanding Reference Behavior A shallow copy creates a new dictionary object, but nested objects inside the dictionary still reference the same memory locations as the original dictionary. That means: If we modify nested elements, the changes appear in both copies. This concept is important when working with: • Nested dictionaries • Lists inside dictionaries • Structured dataset representations Shallow copy is faster and memory-efficient, but must be used carefully in data preprocessing tasks. Example: Useful when copying only top-level structures without modifying nested elements. 🔹 Deep Copy – Creating Fully Independent Data Structures A deep copy creates a completely independent duplicate of the dictionary, including all nested objects. That means: Changes made in one dictionary will NOT affect the other dictionary. This is extremely useful in Data Science when: • Performing multiple transformation experiments on the same dataset • Creating safe backup versions of datasets before cleaning • Handling nested JSON responses from APIs • Building reliable machine learning preprocessing pipelines Deep copy ensures data integrity and prevents accidental overwriting of original datasets. 💡 Key Learning Insight from Today Understanding how Python handles memory references is not just a programming concept — it directly impacts how safely and efficiently we manipulate datasets in analytics and machine learning workflows. The more I learn about Python internals like these, the more confident I feel working with real-world data structures used in Data Science projects. #Day67 #PythonLearning #DataScienceJourney #DataAnalytics #LearningInPublic #PythonForDataScience #FutureDataScientist #WomenInTech #ConsistencyMatters

We need to start caring about data packaging again. I migrated Rahu’s Python AST from a pointer-heavy recursive structure to an arena-backed one, and it improved both analysis and lookup much more than I expected. Rahu is a Python language server I’m building from scratch in Go. The old AST used separate structs, pointers, and slices to model recursive trees. That made it easy to work with, but it also meant many small allocations, pointer chasing, and poor cache locality in hot paths. The new AST is stored as a flat arena: compact nodes in a contiguous slice, stable NodeIDs, sibling-linked children, and side tables for names, strings, and numbers. A good example is attribute access. In the old AST, obj.field was an Attribute node pointing to both the base expression and a separate Name node. In the new one, it’s just a NodeAttribute plus child IDs into the same array. Traversal involves indexed access instead of following heap pointers. The result: AnalysisSmall: ~84 µs → ~55 µs AnalysisMedium: ~183 µs → ~117 µs AnalysisLarge: ~2.15 ms → ~1.85 ms DefinitionLookup: ~205 ns → ~30 ns HoverLookup: ~207 ns → ~34 ns DefinitionLookupAll: ~12.2 µs → ~1.36 µs The geomean across the benchmark set dropped by about 45%. Some construction-heavy paths worsened slightly, which is expected: the arena model added bookkeeping and shifted work into indexing and side tables. The edit-time analysis path improved, and lookup improved significantly, which matters more for the actual LSP experience. The main takeaway for me was simple: data layout matters. I didn’t change the language features. I changed AST storage and traversal, and that had a large effect on end-to-end performance.

Python Series – Day 22: Data Cleaning (Make Raw Data Useful!) Yesterday, we learned Pandas🐼 Today, let’s learn one of the most important real-world skills in Data Science: 👉 Data Cleaning 🧠 What is Data Cleaning Data Cleaning means fixing messy data before analysis. It includes: ✔️ Missing values ✔️ Duplicate rows ✔️ Wrong formats ✔️ Extra spaces ✔️ Incorrect values 📌 Clean data = Better results Why It Matters? Imagine this data: | Name | Age | | ---- | --- | | Ali | 22 | | Sara | NaN | | Ali | 22 | Problems: ❌ Missing value ❌ Duplicate row 💻 Example 1: Check Missing Values import pandas as pd df = pd.read_csv("data.csv") print(df.isnull().sum()) 👉 Shows missing values in each column. 💻 Example 2: Fill Missing Values df["Age"].fillna(df["Age"].mean(), inplace=True) 👉 Replaces missing Age with average value. 💻 Example 3: Remove Duplicates df.drop_duplicates(inplace=True) 💻 Example 4: Remove Extra Spaces df["Name"] = df["Name"].str.strip() 🎯 Why Data Cleaning is Important? ✔️ Better analysis ✔️ Better machine learning models ✔️ Accurate reports ✔️ Professional workflow ⚠️ Pro Tip 👉 Real projects spend more time cleaning data than modeling 🔥 One-Line Summary Data Cleaning = Convert messy data into useful data 📌 Tomorrow: Data Visualization (Matplotlib Basics) Follow me to master Python step-by-step 🚀 #Python #Pandas #DataCleaning #DataScience #DataAnalytics #Coding #MachineLearning #LearnPython #MustaqeemSiddiqui

April 4, 2026. Day 2 of the new month. Still moving. Introduction to Data Visualization with Matplotlib — 4 hours — DataCamp. First course in the Data Visualization in Python track. And I want to talk about visualization honestly. Because there's a conversation here that goes deeper than charts and graphs. I've been visualizing data for a while now. Matplotlib has been in my toolkit. I've used it in projects — plotted distributions, drawn correlation matrices, built figures for EDA reports. So technically, I've been here before. But here's what I've come to understand about revisiting tools you think you already know: familiarity is not the same as fluency. I could produce a chart. I couldn't always produce the right chart, built the right way, communicating the right thing with intention and precision. There's a difference. Matplotlib is one of those libraries that rewards depth. On the surface it looks straightforward — you call a function, a plot appears. But underneath, it has a full object-oriented architecture. Figures. Axes. Artists. A structured way of thinking about every visual element as something you can control deliberately. Most people — myself included at earlier stages — use Matplotlib like a blunt instrument when it's actually a precision tool. This course made me slow down and learn the precision. And as someone who has spent over 10 years in a classroom drawing diagrams on a board — sketching graphs of quadratic functions, plotting velocity-time relationships in Physics, drawing titration curves in Chemistry — I know what it means to make a visual land. I know the difference between a graph that confuses and a graph that clarifies. I know that the choice of scale, label, color, and emphasis changes what a student — or a stakeholder — takes away completely. That teaching instinct is now being formalized into code. And it feels right. I'm also stepping into this new track — **Data Visualization in Python** — with a clear sense of where it fits in the bigger picture. Visualization is not decoration. It's not the thing you do after the "real" analysis. It IS part of the analysis. It's how you find patterns before you can name them. It's how you communicate what the data revealed after you've named them. Yesterday I completed the Data Manipulation in Python track — NumPy and pandas, the engine and the structure. Today, Matplotlib — the voice. The way data speaks to people who weren't in the room when it was collected. These things connect. Deliberately. That's the whole point. April is already demanding. But so am I. 📊 #Matplotlib #DataVisualization #Python #DataCamp #DataVisualizationInPython #DataScience #DataAnalysis #ContinuousLearning #3MTT #DeepTechReady #Nigeria #RealTalk #BuildingInPublic #April #TheGrind

🚀 My Data Science Learning Journey: NumPy & Pandas Over the past few days, I’ve been diving deep into the foundations of Data Analysis using Python, focusing on NumPy and Pandas—two of the most powerful libraries every data enthusiast should master. Here’s a quick snapshot of what I explored 👇 🔹 📌 NumPy (From Basics to Advanced) Array creation & comparison with Python lists Understanding array properties: shape, size, dimensions, data types Mathematical & aggregation operations Indexing, slicing, and boolean masking Reshaping & manipulating arrays Advanced operations: append, concatenate, stack, split Broadcasting & vectorization for optimized performance Handling missing values with np.isnan, np.nan_to_num 🔹 📊 Pandas Part 1 – Data Handling Essentials Reading data from CSV, Excel, JSON files Saving/exporting data into different formats Exploring datasets using .head(), .tail(), .info(), .describe() Understanding dataset structure (shape, columns) Filtering rows & selecting columns efficiently 🔹 📈 Pandas Part 2 – Advanced Data Analysis DataFrame modifications (add, update, delete columns) Handling missing data using isnull(), dropna(), fillna(), interpolate() Sorting and aggregating data GroupBy operations for insights Merging, joining, and concatenating datasets 💡 Key Takeaway: Learning these libraries helped me understand how raw data is transformed into meaningful insights—efficiently and at scale. 📂 I’ve also documented my entire learning through hands-on notebooks covering concepts + code implementations. 🔥 What’s Next? Moving forward, I’m planning to explore: ➡️ Data Visualization (Matplotlib & Seaborn) ➡️ Exploratory Data Analysis (EDA) ➡️ Machine Learning basics #DataScience #Python #NumPy #Pandas #LearningJourney #MachineLearning #DataAnalytics #Students #Tech

From data → meaningful insight (a 💡 moment at King’s College London) There’s something satisfying about watching a dataset speak. I joined a Python seminar at King’s (with Le Wagon), and it felt less like “learning code” and more like learning how to listen to data properly. A few practical habits that stayed with me: 🔹 Start by protecting your raw data Before doing anything, make a copy of your dataset. It’s a small act, but it gives you freedom — to explore, test, and even make mistakes without losing your starting point. 🔹 Look before you clean Use simple checks to understand what you’re working with: things like .info() and .describe() tell you a lot. And not everything needs cleaning.🧼 It’s a skill knowing what to leave untouched. 🔹 Let simple commands do meaningful work Something as straightforward as counting categories (like blood types in a population dataset) can reveal the shape of the data almost instantly. 🔹 Transformation is where things begin to open up Converting a column into the right format — for example, turning dates into proper datetime — suddenly allows you to see time, patterns, and change. 🔹 Stay with one visualisation method (at first) There’s method in choosing one tool and using it well: matplotlib, seaborn, or something more interactive like plotly. They all offer something slightly different — but depth comes from staying with one long enough to understand its rhythm. 🔹 Use spaces like Google Colab to experiment freely A simple, open environment tests ideas quickly — no pressure, just exploration. And often, the first insight is already there — just waiting to be surfaced. 🔹 Keep returning to the source Where has the data come from? Without that grounding, even the cleanest analysis can drift. But what I liked most was this idea: 💡 Data doesn’t just need processing — it needs interpretation. There’s a kind of patience to it. You don’t force insight out. You let it emerge, step by step. Just one small shift in the pipeline, and the dataset becomes something you can move through. For anyone working across data, bioinformatics, or analytics — what’s one small habit that’s changed how you work with data? #Python #DataScience #DataAnalytics #Bioinformatics #Pandas #DataCleaning #DataVisualization #Seaborn #Matplotlib #Plotly #GoogleColab #KingsCollegeLondon #LeWagon #STEM #AI #MachineLearning #Coding #TechSkills #Analytics #DataDriven

Pandas Cheatsheet for Data Analysts: From Data Loading to Merging If you’re working with data in Python, mastering Pandas is essential. This cheatsheet covers the core operations every data analyst should know—from reading data to advanced transformations. 🔹 Reading & Inspecting Data Quickly load and understand your dataset: pd.read_csv() → Load data .head() → Preview rows .shape, .dtypes → Structure & types .describe() → Statistical summary 🔹 Selecting & Filtering Data Extract specific data efficiently: Select columns: df['col'], df[['col1','col2']] Filter rows: df[df['age'] > 30] Conditional filters: (df['dept']=='Sales') & (df['age']>28) Position vs label: .iloc[] vs .loc[] 🔹 Handling Missing Values Clean your dataset for better accuracy: Detect: .isnull().sum() Remove: .dropna() Fill values: .fillna(0) or mean/median 🔹 Grouping & Aggregation Summarize data insights: groupby() with functions like mean, count Custom aggregation using .agg() 🔹 Merging & Joining Data Combine datasets effectively: pd.merge(df1, df2, on='id') Types: left, inner, etc. 💡 Key Insight: Pandas transforms raw data into actionable insights. Mastering these operations is the foundation of data analysis, machine learning, and AI workflows. #Python #Pandas #DataAnalysis #DataScience #MachineLearning #DataAnalytics #PythonProgramming #LearnPython #DataEngineer #AI #DataCleaning #DataVisualization #Coding #TechSkills #CheatSheet

🚀 Python for Data Science: Beyond the Basics with Seaborn.... Data visualization is not just about plotting graphs—it’s about extracting meaningful insights from data. While working with Seaborn, I compiled a quick revision of core concepts along with a few advanced additions that are often overlooked. 🔹 Core Seaborn Concepts - Statistical visualization built on Matplotlib - High-level API for attractive and informative plots - Common workflow: 1. Prepare data 2. Set aesthetics 3. Plot 4. Customize 📊 Key Plot Types - Categorical: "stripplot", "swarmplot", "barplot", "countplot" - Distribution: "distplot", "histplot", "kdeplot" - Regression: "regplot", "lmplot" - Matrix: "heatmap" - Axis Grids: "FacetGrid", "PairGrid", "JointGrid" 🎨 Customization Essentials - Styles: "whitegrid", "darkgrid" - Context: "talk", "paper", "notebook" - Color palettes for better storytelling - Axis control, labels, and layout tuning --- 💡 Additional Important Concepts (Advanced Layer) 🔸 1. Seaborn vs Matplotlib - Seaborn = High-level (quick insights) - Matplotlib = Low-level (full control) - Best practice: Use Seaborn + customize with Matplotlib 🔸 2. Wide-form vs Long-form Data - Wide-form: Columns represent variables - Long-form: Each row = observation (preferred in Seaborn) 🔸 3. Statistical Estimation - Seaborn automatically computes: - Mean - Confidence Intervals (CI) - Example: "barplot()" shows mean + CI, not raw values 🔸 4. Faceting (Very Important for Analysis) - Split data across dimensions using: - "FacetGrid" - "col", "row", "hue" - Enables multi-dimensional analysis 🔸 5. KDE (Kernel Density Estimation) - Smooth representation of distribution - Better than histogram for understanding probability density 🔸 6. Pairwise Relationships - "pairplot()" for quick EDA - Detects correlation, trends, and outliers 🔸 7. Heatmaps for Correlation - Essential for feature selection in ML - Works well with correlation matrices --- ⚠️ Common Mistakes - Using wrong plot type for data - Ignoring data format (wide vs long) - Misinterpreting confidence intervals - Overloading plots with unnecessary styling --- 📌 Takeaway Seaborn is not just a plotting library—it’s a statistical visualization tool. Mastering it means understanding both visualization and the underlying data distribution. If you're into Data Science or Machine Learning, strong visualization skills will significantly improve your analytical thinking and model interpretation. #DataScience #Python #Seaborn #MachineLearning #DataVisualization #EDA #AI #Programming #Analytics

🚀 Top Python Libraries Every Data Professional Should Know In today’s data-driven world, Python continues to dominate as the go-to language for data professionals. Whether you're working in data analytics, machine learning, or big data, mastering the right libraries can significantly boost your productivity and impact. Here’s a quick overview of essential Python libraries: 🔹 NumPy – The foundation for numerical computing and array operations 🔹 Pandas – Powerful tool for data cleaning, transformation, and analysis 🔹 Matplotlib & Plotly – From basic charts to interactive dashboards 🔹 SciPy – Advanced scientific and statistical computations 🔹 Scikit-learn – Machine learning made simple (classification, regression, clustering) 🔹 TensorFlow & PyTorch – Deep learning and neural network development 🔹 PySpark – Big data processing with distributed computing 🔹 Jupyter Notebook – Interactive environment for exploration and storytelling 🔹 SQLAlchemy – Seamless database interaction using Python 🔹 Selenium & BeautifulSoup – Web scraping and automation tools 🔹 FastAPI & Flask – Building APIs and deploying ML models efficiently 💡 As a data analyst, choosing the right tools is not just about learning syntax—it’s about solving real-world problems efficiently. 📊 Personally, I’ve found combining Pandas + SQL + Power BI to be a powerful stack for turning raw data into actionable insights. What’s your go-to Python library for data projects? Let’s discuss 👇 #DataAnalytics #Python #MachineLearning #DataScience #AI #BigData #PowerBI #SQL #Learning #CareerGrowth