Pandas Cheatsheet for Data Analysts: Loading, Merging, and More

The AI Data Analyst Roadmap in 6 Steps 🚀 Becoming a Data Analyst isn't just about knowing Python or SQL; it’s about the entire ecosystem—from messy data collection to delivering business impact. In 2026, the "AI" part is the real game-changer. It’s not just about cleaning data anymore; it’s about automating that cleaning and building predictive models that actually move the needle. Which of these 6 pillars are you focusing on this week? • Data Collection 🌐 • Data Cleaning 🧹 • Data Analysis 📊 • Machine Learning/AI 🤖 • Data Visualization 📈 • Business Insights 💡 Drop a comment below! 👇 #DataAnalytics #IndiaTech #DataScience #PowerBI #Python #CareerGrowth #AI

🧹 𝗦𝘁𝗲𝗽𝘀 𝘁𝗼 𝗖𝗹𝗲𝗮𝗻 𝗮 𝗗𝗮𝘁𝗮𝘀𝗲𝘁 𝗶𝗻 𝗣𝘆𝘁𝗵𝗼𝗻 1️⃣ Load the Dataset Import the dataset into Python for analysis. Use pandas to read files Common formats: CSV, Excel, JSON Example: pd.read_csv("data.csv") 2️⃣ Explore the Data Understand the structure and contents. Check rows and columns View sample records Inspect data types Common methods: df.head() df.info() df.describe() 3️⃣ Handle Missing Values Identify and deal with missing data. Options: Remove missing rows Fill with mean/median Fill with constant value Examples: df.dropna() df.fillna(value) 4️⃣ Remove Duplicates Eliminate duplicate records that can skew analysis. Example: df.drop_duplicates() 5️⃣ Fix Data Types Ensure columns have correct formats. Examples: Convert text to numbers Convert strings to dates Example: pd.to_datetime(df["date"]) 6️⃣ Handle Outliers Detect and treat unusual values. Common techniques: IQR method Z-score Capping values Purpose: reduce bias in models and analysis. 7️⃣ Standardize Data Make data consistent. Examples: Lowercase text Trim spaces Standardize categories Example: df["city"].str.lower().str.strip() 8️⃣ Encode Categorical Variables Convert text categories into numeric form for ML. Methods: One-hot encoding Label encoding Example: pd.get_dummies(df) 9️⃣ Feature Engineering Create useful new variables from existing data. Examples: Age from birthdate Price per unit Ratios or aggregations 🔟 Validate and Save Clean Data Check the final dataset and export it. Verify transformations Save cleaned dataset Example: df.to_csv("clean_data.csv", index=False) ✅ Result: A clean, structured dataset ready for analysis or machine learning.

Learning Python is one thing. Actually working with data is a completely different game. This document walks through Pandas from the ground up to advanced concepts, focusing on how data is handled in real scenarios 👇 📘 What’s covered: • 🧱 Core fundamentals → Series, indexing, slicing, and data structures • 📊 DataFrames in depth → Creating, filtering, sorting, and transforming data • 🔗 Data merging & concatenation → Combining datasets like a real-world project • 📈 Data visualization → Line, bar, histogram, box plots, and more • 🧮 Statistics & analysis → Mean, correlation, skewness, aggregations • 🧹 Data cleaning & preprocessing → Handling missing values, duplicates, and transformations • 🧠 Advanced concepts → GroupBy, MultiIndex, hierarchical data • 📅 Working with time & dates → Filtering and structuring time-based data • 📂 File handling → Reading and writing CSV/Excel efficiently 💡 Why this matters: • 🚀 Turns raw data into actionable insights • 🧩 Builds the foundation for data science & ML • ⚡ Improves efficiency when working with large datasets • 🔍 Helps you understand data, not just code 🎯 Who this is for: • Beginners starting with data analysis • Developers transitioning into data roles • Data analysts sharpening their Pandas skills • Anyone working with structured data Pandas is not just a library. It’s one of the most important tools for thinking in data. #Python #Pandas #DataAnalysis #DataScience #MachineLearning #DataEngineering #Analytics #Programming #BigData #LearnToCode

From data → meaningful insight (a 💡 moment at King’s College London) There’s something satisfying about watching a dataset speak. I joined a Python seminar at King’s (with Le Wagon), and it felt less like “learning code” and more like learning how to listen to data properly. A few practical habits that stayed with me: 🔹 Start by protecting your raw data Before doing anything, make a copy of your dataset. It’s a small act, but it gives you freedom — to explore, test, and even make mistakes without losing your starting point. 🔹 Look before you clean Use simple checks to understand what you’re working with: things like .info() and .describe() tell you a lot. And not everything needs cleaning.🧼 It’s a skill knowing what to leave untouched. 🔹 Let simple commands do meaningful work Something as straightforward as counting categories (like blood types in a population dataset) can reveal the shape of the data almost instantly. 🔹 Transformation is where things begin to open up Converting a column into the right format — for example, turning dates into proper datetime — suddenly allows you to see time, patterns, and change. 🔹 Stay with one visualisation method (at first) There’s method in choosing one tool and using it well: matplotlib, seaborn, or something more interactive like plotly. They all offer something slightly different — but depth comes from staying with one long enough to understand its rhythm. 🔹 Use spaces like Google Colab to experiment freely A simple, open environment tests ideas quickly — no pressure, just exploration. And often, the first insight is already there — just waiting to be surfaced. 🔹 Keep returning to the source Where has the data come from? Without that grounding, even the cleanest analysis can drift. But what I liked most was this idea: 💡 Data doesn’t just need processing — it needs interpretation. There’s a kind of patience to it. You don’t force insight out. You let it emerge, step by step. Just one small shift in the pipeline, and the dataset becomes something you can move through. For anyone working across data, bioinformatics, or analytics — what’s one small habit that’s changed how you work with data? #Python #DataScience #DataAnalytics #Bioinformatics #Pandas #DataCleaning #DataVisualization #Seaborn #Matplotlib #Plotly #GoogleColab #KingsCollegeLondon #LeWagon #STEM #AI #MachineLearning #Coding #TechSkills #Analytics #DataDriven

🚀 #Day5 of #100DaysOfGenAIDataEngineering Topic: Mastering Pandas for Real-World Data Transformation Raw data is messy. Your job as a data engineer is to make it usable, reliable, and scalable. Today, I focused on Pandas — the most powerful tool for data manipulation in Python. 🔹 What I did today: - Worked with DataFrames & Series - Practiced: - Filtering & selecting data - Handling missing values (NaN) - GroupBy & aggregations - Performed data cleaning & transformation - Merged datasets using: - join, merge, concat - Converted raw JSON/CSV into structured format 🔹 Why this is important: In real-world pipelines: - Data is never clean - You’ll spend 70–80% of time on data cleaning Without Pandas: ❌ Complex transformations ❌ Inefficient workflows With Pandas: ✅ Fast data wrangling ✅ Easy transformations ✅ Strong foundation before PySpark Even in GenAI: - Preparing text data - Structuring embeddings input - Cleaning datasets before LLM pipelines Everything starts here. 🔹 Who should do this: - Data Engineers building ETL pipelines - Anyone transitioning into GenAI / AI workflows - Analysts moving towards engineering roles If you can’t clean data efficiently, you can’t build pipelines. 🔹 Key Learnings: - Master groupby + aggregation (very important) - Understand merge vs join vs concat - Always handle missing data properly - Think in terms of transformations, not steps 🔥 “Clean data is not given. It’s engineered.” Day 5 complete. Real engineering starts with messy data. Follow along if you're building towards GenAI Data Engineering mastery in 2026. #GenAI #Pandas #Python #DataEngineering #AI #ETL #LearningInPublic

🚀 Mastering Data Analysis with Pandas 🐼 Data is the new fuel, and Pandas is one of the most powerful tools to handle it efficiently. From loading datasets to cleaning, transforming, and analyzing data — Pandas makes everything seamless and fast. Whether you're just starting your journey in Data Science or sharpening your skills, these essential Pandas functions are your foundation: ✔ Data Loading ("read_csv", "read_excel") ✔ Data Exploration ("head", "info", "describe") ✔ Data Cleaning ("dropna", "fillna", "drop_duplicates") ✔ Data Manipulation ("groupby", "merge", "pivot_table") ✔ Indexing & Filtering ("loc", "iloc", "query") 💡 The key to becoming a great Data Scientist is not just learning tools — it's practicing them consistently on real-world data. Start small, stay consistent, and build projects that solve real problems. Your future in Data Science starts today! 🔥 #DataScience #Python #Pandas #MachineLearning #AI #DataAnalytics #100DaysOfCode #Coding #Programmer #Developers #Tech #BigData #Analytics #LearnToCode #DataScientist #CodingLife #FutureTech #LinkedInGrowth #ViralPost #TrendingNow

🚀 Day 67 - Data Input & Output (I/O) with Pandas Today’s focus was on one of the most practical aspects of data analysis — getting data in and out efficiently using Pandas. 📊 Here’s what I explored today: 🔹 Reading CSV Files Learned how to load structured data into DataFrames using simple and powerful functions. 🔹 Writing Data to CSV Understood how to save processed data back into CSV format for sharing and reuse. 🔹 Exporting DataFrames Practiced exporting cleaned and transformed datasets into CSV files with control over formatting. 🔹 Working with JSON Files Explored how to read JSON data and convert it into structured DataFrames. 🔹 Parsing JSON Datasets Learned how to handle nested and complex JSON structures effectively. 💡 Key Takeaway: Efficient data handling is the backbone of any data workflow. Mastering I/O operations in Pandas makes it much easier to move between raw data and meaningful insights. On to the next step in the journey! 🔥 #Day67 #DataScience #Python #Pandas #DataAnalytics #LearningJourney #AI #MachineLearning

🚀 My Data Science Learning Journey: NumPy & Pandas Over the past few days, I’ve been diving deep into the foundations of Data Analysis using Python, focusing on NumPy and Pandas—two of the most powerful libraries every data enthusiast should master. Here’s a quick snapshot of what I explored 👇 🔹 📌 NumPy (From Basics to Advanced) Array creation & comparison with Python lists Understanding array properties: shape, size, dimensions, data types Mathematical & aggregation operations Indexing, slicing, and boolean masking Reshaping & manipulating arrays Advanced operations: append, concatenate, stack, split Broadcasting & vectorization for optimized performance Handling missing values with np.isnan, np.nan_to_num 🔹 📊 Pandas Part 1 – Data Handling Essentials Reading data from CSV, Excel, JSON files Saving/exporting data into different formats Exploring datasets using .head(), .tail(), .info(), .describe() Understanding dataset structure (shape, columns) Filtering rows & selecting columns efficiently 🔹 📈 Pandas Part 2 – Advanced Data Analysis DataFrame modifications (add, update, delete columns) Handling missing data using isnull(), dropna(), fillna(), interpolate() Sorting and aggregating data GroupBy operations for insights Merging, joining, and concatenating datasets 💡 Key Takeaway: Learning these libraries helped me understand how raw data is transformed into meaningful insights—efficiently and at scale. 📂 I’ve also documented my entire learning through hands-on notebooks covering concepts + code implementations. 🔥 What’s Next? Moving forward, I’m planning to explore: ➡️ Data Visualization (Matplotlib & Seaborn) ➡️ Exploratory Data Analysis (EDA) ➡️ Machine Learning basics #DataScience #Python #NumPy #Pandas #LearningJourney #MachineLearning #DataAnalytics #Students #Tech

📊 Understanding Frequency in Data Analysis In data analysis, frequency shows which values appear more often. 🔹 What is Frequency? Frequency tells us how many times a value appears in a dataset. 🔹 Why is it Important? It helps us understand data distribution and identify patterns easily. 📊 Types of Frequency in Data Analysis 🔹 1. Absolute Frequency It is the exact number of times a value appears in a dataset. 👉 Example: 5 appears 3 times → frequency = 3 🔹 2. Relative Frequency It shows the proportion (or percentage) of each value compared to total data. 👉 Formula: Frequency ÷ Total observations 🔹 3. Cumulative Frequency It is the running total of frequencies, adding values step by step. 👉 Helps understand data distribution up to a certain point 💻 Python Code – Frequency Example Python import pandas as pd # Sample data data = [1, 2, 2, 3, 3, 3, 4] df = pd.DataFrame(data, columns=["Values"]) # Absolute Frequency frequency = df["Values"].value_counts() # Relative Frequency relative_frequency = df["Values"].value_counts(normalize=True) # Cumulative Frequency cumulative_frequency = frequency.cumsum() print(frequency) print(relative_frequency) print(cumulative_frequency) ✨ Output Insight value_counts() → gives count of each value normalize=True → gives percentage (relative frequency) cumsum() → gives cumulative #HOPE AI Logeshwari Parthiban Ramisha Rani K #DataScience #DataAnalysis #Python #Pandas #Statistics #MachineLearning #Analytics #LearningJourney #DataVisualization #ExploratoryDataAnalysis #Coding #LinkedInLearning

🧠 Day 9 of 30 — Data Visualisation: Matplotlib vs Seaborn Numbers alone do not tell a story. Charts do. 📊 Today I learned the two most powerful  Python libraries for Data Visualisation — Matplotlib and Seaborn. Here is the key difference: Matplotlib: → Full control over every detail → More code — more customisation → Best for precise, custom charts Seaborn: → Built on top of Matplotlib → Less code — beautiful by default → Best for statistical visualisations 5 charts every data analyst must know: 1️⃣ Bar Chart — Compare values across categories 2️⃣ Line Chart — Show trends over time 3️⃣ Scatter Plot — Find correlations in data 4️⃣ Heatmap — Spot patterns at a glance 5️⃣ Histogram — Understand data distribution The best part about Seaborn? A beautiful heatmap in just one line: sns.heatmap(df.corr(), annot=True,  cmap='coolwarm') That is it. One line. Production-ready chart. 🔥 Tomorrow → Day 10: SQL for Data Analytics — the skill every data professional needs. Follow along — let us learn together! 🚀 Which chart type do you use most? Drop a comment below! 👇 #DataVisualisation #Matplotlib #Seaborn #Python #LearnInPublic #Day9of30 #DataAnalytics #AI #100DaysOfAI #ayyappanm #OpenToWork