Mastering Python File Handling: A Deep Dive

Python Data Structures Explained: List, Tuple, Set, and Dictionary 🐍 Understanding Python’s core data structures is key to writing clean, efficient, and organized code. Here’s a quick guide: 1️⃣ List • Ordered collection of items. • Mutable: you can add, remove, or change elements. • Duplicates allowed. • Use case: When you need a collection that can change over time. eg: fruits = ['apple', 'banana', 'cherry', 'apple'] 2️⃣ Tuple • Ordered collection of items. • Immutable: cannot be changed after creation. • Duplicates allowed. • Use case: Fixed data that should not change. eg: coordinates = (10, 20, 30) 3️⃣ Set • Unordered collection of unique items. • Mutable: can add/remove elements. • No duplicates allowed. • Use case: When you need unique items or to remove duplicates from a list. eg: colors = {'red', 'green', 'blue'} 4️⃣ Dictionary • Unordered collection of key-value pairs. • Mutable: can add, update, or remove key-value pairs. • Keys must be unique; values can repeat. • Use case: Mapping one piece of data to another, like a name to an age. eg: person = {'name': 'pooja', 'age': 22, 'city': 'India'} 💡 Key Takeaways: • Use List for general collections, • Tuple for fixed data, • Set for unique items, • Dictionary for mapping key-value pairs. Python makes managing data simple and efficient! Mastering these structures is a must for any aspiring programmer. #Python #DataStructures #Programming #CodingTips #LearnPython

From SQL to Python: The Data Structures Cheat Sheet If you’re moving from SQL to Python, the hardest part isn’t the logic — it’s understanding when to use [], {}, or (). I spent months confused about Python data structures until I realized this: I already understood them — I just didn’t know it yet. Here’s how SQL concepts map perfectly to Python data structures: Lists = SELECT results You fetch multiple rows in SQL. In Python, a list stores multiple items — flexible and dynamic. Tuples = Read-only rows Just like fixed records in SQL — you can read them, not modify them. Sets = SELECT DISTINCT Removes duplicates automatically, ensuring unique values. Dictionaries = Single table row Think of it as one record: Column name = Key Cell value = Value Once you see it this way, Python becomes less intimidating — it’s just SQL in another language. If you understand SQL, you already understand Python data structures. You just haven’t made the connection yet. credit- Karina Samsonova

Python File Handling File Handling helps us store data permanently in files and use it whenever needed. It includes operations like opening, reading, writing, and handling errors in files. 1️⃣ Opening a File We use `open()` function. python file = open("demo.txt", "r") # r = read mode print("File opened successfully") file.close() 2️⃣ Reading from a File python file = open("demo.txt", "r") content = file.read() print(content) file.close() 3️⃣ Writing to a File python file = open("demo.txt", "w") # w = write mode file.write("Hello, File Handling!") file.close() 4️⃣ Using `with` Statement Automatically closes file → safer & easier python with open("demo.txt", "r") as file: print(file.read()) 5️⃣ Working with Binary Files** Example: writing binary data (like images) python with open("image.jpg", "rb") as file: data = file.read() 6️⃣ Error Handling in Files python try: with open("unknown.txt", "r") as file: print(file.read()) except FileNotFoundError: print("File not found!") #Python #FileHandling #CodingForBeginners #LearningEveryday

Here are the basic steps to read and work with files using pandas in Python: Step(i) Data Creation: Creates a Pandas DataFrame, a two-dimensional labelled data structure, with columns "Name" "Age" and "Sex" Step(ii) Column Access: Accesses the "Age" column from the DataFrame df. Returns a Pandas Series object containing the age values for each row. Step(iii) Create a Series: Creates a Pandas Series named "Age" containing the values 12, 55, and 87. Step(iv) Load the Data: Loads the "train.csv" file into a pandas DataFrame named titanic and displays its first 5 rows. Step(v) dtypes dtypes in Python, specifically within the context of data analysis using the Pandas library, provides a concise overview of the data types present in each column of the titanic DataFrame. Step(vi) info() The code titanic.info() in Python, assuming titanic is a Pandas DataFrame, provides a detailed summary of the data it holds. 1. It displays information like the total number of rows and columns in the DataFrame. 2. It reveals the data type of each column (e.g., integer, float, string). 3. It highlights any missing values present within the data, allowing you to identify potential areas for data cleaning.

📦 Variables and Data Types in Python - A Beginner’s Guide When I first started learning Python, I kept hearing words like variables and data types - and honestly, they sounded more complicated than they really are 😅 But once I understood them, everything else in Python started to make sense. Here’s how I like to explain it 👇 🧠 What’s a Variable? Think of a variable as a box that stores information. You give it a name, and Python remembers what’s inside. name = "Blessing" age = 20 Now, anytime you use name or age, Python knows what you mean. 🧩 Common Data Types in Python Every variable holds a type of data. Some of the most common are: # Text name = "Blessing" # str # Numbers age = 21 # int height = 5.6 # float # True/False is_student = True # bool # Collections hobbies = ["coding", "reading"] # list Each data type behaves differently - and together, they form the foundation of Python programming. 🪄 Why It Matters Variables and data types are the building blocks of every Python project - from simple scripts to data science models. They make your code flexible, readable, and powerful. And here’s the cool part... Python automatically figures out the data type for you. x = 5 # int x = "Five" # now a string Dynamic, right? 💡 Quick Tips ✅ Use descriptive variable names total_score, user_age ❌ Avoid vague ones like x1 or thing Good naming = clean, understandable code. Learning variables and data types might seem basic, but it’s truly the first real step toward thinking like a programmer. Once you get this right, Python starts to feel a lot more natural, almost like writing in plain English. 💬 What was the first variable you ever created in Python? Mine was the classic: x = 10 😂 #Python #LearningJourney #DataScience #Programming #CodeNewbie #WomenInTech

🧠 Deep Dive into Strings and Lists in Python 🐍 In today’s Python class, I explored two powerful and frequently used data types — Strings and Lists, along with their types and methods! 🔹 STRINGS A String is a sequence of characters enclosed within single, double, or triple quotes. Strings are immutable, meaning their content cannot be changed once created. 📘 Example: text = "Python Programming" 👉 Types of Strings: Single-line String: "Hello World" Multi-line String: '''This is a multi-line string''' ✨ Common String Methods: upper() – Converts to uppercase lower() – Converts to lowercase title() – Capitalizes each word replace(old, new) – Replaces text find(sub) – Finds substring position split() – Splits string into list join() – Joins list into string strip() – Removes spaces 📘 Example: msg = " hello python " print(msg.strip().title()) # Hello Python 🔹 LISTS A List is an ordered, mutable collection that can hold multiple data types. Lists allow insertion, deletion, and modification of elements. 📘 Example: fruits = ["apple", "banana", "cherry"] 👉 Types of Lists: Homogeneous List: Same type of data → [1, 2, 3] Heterogeneous List: Mixed data → [1, "apple", 3.5] Nested List: List inside another list → [1, [2, 3], 4] ✨ Common List Methods: append() – Adds element at end insert(index, value) – Adds at specific position remove(value) – Removes specific element pop(index) – Removes by position sort() – Sorts the list reverse() – Reverses the list extend(iterable) – Adds multiple elements clear() – Removes all elements 📘 Example: numbers = [3, 1, 4] numbers.sort() print(numbers) # [1, 3, 4] #Python #PythonProgramming #Programming #Coding #Developer #SoftwareDevelopment #Tech #Technology Codegnan

Python | Reading contents of PDF using OCR (Optical Character Recognition) Required Installations: pip3 install PIL pip3 install pytesseract pip3 install pdf2image sudo apt-get install tesseract-ocr Below is the implementation: # Requires Python 3.6 or higher due to f-strings # Import libraries import platform from tempfile import TemporaryDirectory from pathlib import Path import pytesseract from pdf2image import convert_from_path from PIL import Image if platform.system() == "Windows": # We may need to do some additional downloading and setup... # Windows needs a PyTesseract Download # https://lnkd.in/gxbQmHuj pytesseract.pytesseract.tesseract_cmd = ( r"C:\Program Files\Tesseract-OCR\tesseract.exe" ) # Windows also needs poppler_exe path_to_poppler_exe = Path(r"C:\.....") # Put our output files in a sane place... out_directory = Path(r"~\Desktop").expanduser() else: out_directory = Path("~").expanduser() # Path of the Input pdf PDF_file = Path(r"d.pdf") # Store all the pages of the PDF in a variable image_file_list = [] text_file = out_directory / Path("out_text.txt") def main(): ''' Main execution point of the program''' with TemporaryDirectory() as tempdir: # Create a temporary directory to hold our temporary images. """ Part #1 : Converting PDF to images """ if platform.system() == "Windows": pdf_pages = convert_from_path( PDF_file, 500, poppler_path=path_to_poppler_exe ) else: pdf_pages = convert_from_path(PDF_file, 500) # Read in the PDF file at 500 DPI # Iterate through all the pages stored above for page_enumeration, page in enumerate(pdf_pages, start=1): # enumerate() "counts" the pages for us. # Create a file name to store the image filename = f"{tempdir}\page_{page_enumeration:03}.jpg" # Declaring filename for each page of PDF as JPG # For each page, filename will be: # PDF page 1 -> page_001.jpg # PDF page 2 -> page_002.jpg # PDF page 3 -> page_003.jpg # .... # PDF page n -> page_00n.jpg # Save the image of the page in system page.save(filename, "JPEG") image_file_list.append(filename) """ WARS... Emmanuel Macron Giorgia Meloni Obama for America Hillary Clinton Ted Cruz Bundesagentur für Arbeit Helmut-Schmidt-Universität/Universität der Bundeswehr Hamburg Michael Fritz Sahra Wagenknecht Robert Habeck FDP Freie Demokraten CDU Deutschlands Konrad-Adenauer-Stiftung Nadine Schön BNI Chapter Alexander von Humboldt German Advisory Council on Global Change Socialists and Democrats Group in the European Parliament Political Scientists POLITICO Europe Federal Bank Federal Bureau of Investigation (FBI) NATO G20 Munich Security Conference

🔥 PYTHON WEEKEND! 🔥 Here are 15 frequently asked Python questions every Data Engineer should know: 1. How can you eliminate duplicates from a list while keeping the original order intact? 2. How would you flatten a nested list without using recursion? 3. Explain the difference between a shallow copy and a deep copy in Python with an example. 4. How can you combine two dictionaries without losing values for duplicate keys? 5. Show how to read and process a large CSV file in chunks without loading it entirely into memory. 6. What’s an efficient way to parse a large JSON file in Python? 7. Given a log file with millions of lines, how would you find the top 10 most frequent error messages? 8. How do you read and process compressed files such as .gz or .zip using Python? 9. Write a Python snippet to convert a CSV file into Parquet format using Pandas. 10. Demonstrate how to handle missing values in a Pandas DataFrame—both by filling and removing them. 11. How do you perform an inner join on multiple columns between two DataFrames? 12. For a time-series DataFrame, how can you resample the data weekly and compute the total for each week? 13. What’s a good way to identify and remove outliers from data using Pandas or NumPy? 14. Write code to group data by a column and apply multiple aggregation functions in one line. 15. How would you design a retry mechanism in Python for failed API calls in an ETL workflow? 𝗜 𝗵𝗮𝘃𝗲 𝗽𝗿𝗲𝗽𝗮𝗿𝗲𝗱 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲 𝗜𝗻𝘁𝗲𝗿𝘃𝗶𝗲𝘄 𝗣𝗿𝗲𝗽𝗮𝗿𝗮𝘁𝗶𝗼𝗻 𝗚𝘂𝗶𝗱𝗲 𝗳𝗼𝗿 𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗻𝗲𝗿𝘀 & 𝗗𝗮𝘁𝗮 𝗔𝗻𝗮𝗹𝘆𝘀𝘁𝘀. 👉 𝗚𝗿𝗮𝗯 𝗶𝘁 𝗵𝗲𝗿𝗲(𝟭𝟬𝟬% 𝗥𝗲𝗳𝘂𝗻𝗱): https://lnkd.in/giHUMNx9

🔠 Indentation & Comments in Python 🧱 Indentation In Python, indentation (spaces at the beginning of a line) defines a code block — instead of using {} like other languages. It helps make the code clean, structured, and readable. ✅ Example: if 10 > 5: print("A is bigger") 👉 Here, the print() statement is indented — showing that it belongs to the if block. 💬 Comments Comments make your code easy to understand and maintain. Python supports two types: 📝 Single-line comment: # This is for single-line comment 🗒️ Multi-line comment: ''' This is for multiple lines ''' 🔢 Python Data Types (Quick Overview) Python has several built-in data types used to store different kinds of data: 🔹 Numeric: int, float, complex 🔹 Boolean: True, False 🔹 Sequential: String, List, Tuple 🔹 Container: Dictionary, Set ✅ Example: name = "John" # String marks = [80, 90, 85] # List data = {"a": 1, "b": 2} # Dictionary 🔣 Operators in Python (Simplified) Operators are used to perform operations on values and variables. ⚙️ Types of Operators: ➕ Arithmetic: +, -, *, /, //, %, ** ⚖️ Relational: <, >, <=, >=, ==, != 🧠 Logical: and, or, not 🧮 Assignment: =, +=, -=, *=, /=, etc. 🔍 Membership: in, not in 🆔 Identity: is, is not ⚡ Bitwise: &, |, ^, ~, <<, >> ✅ Example: x, y = 10, 5 print(x + y) # Arithmetic print(x > y) # Relational print(x and y) # Logical ✨ Quick Summary Understanding indentation, comments, data types, and operators is the foundation of Python programming. Once you master these, everything else becomes easier — from writing clean code to building advanced projects! #Python #Programming #CodingTips #LearnToCode #PythonForBeginners #Developers #CodeClean #SoftwareDevelopment #DataTypes #Operators #✅✅