MD Ashikur Rahman’s Post

UDF = custom logic on a column. Works well, but Spark cannot optimize it. Each row goes to Python and comes back. This makes it slow on large data. Built-in functions run inside Spark. They are faster and optimized. Built-in functions first. when().otherwise() next. UDF only when there is no other way. Swipe 👉 #PySpark #DataEngineering #BigData #sql

Didn't know you could extract tables from a Word doc using Python until today. python-docx lets you loop through tables, pull cell data, and load it straight into a DataFrame. Spent some time cleaning it up — splitting on ':', transposing, fixing headers — but it worked. Also practiced groupby() and lambda functions inline. Small things but they make the code so much cleaner. Notebook here 👉 https://lnkd.in/dfTwrvqT #Python #Pandas #DataAnalysis #LearningInPublic

Just practiced Pandas and data cleaning hits different when you're working with real messy data. Covered data types, type conversion, handling missing values, replacing inconsistent entries, and using category dtype to save memory — FuelType column went from 11488 bytes to 1460 bytes just by changing the dtype. Notebook here 👉 https://lnkd.in/d3djYPvp #Python #Pandas #DataAnalysis #LearningInPublic

⚡ Stop being forced to write API scripts in a language you don’t use. From this latest release, Voiden lets you write pre- and post-request scripts in #Python, #JavaScript, ( + more languages to follow soon). What we added: - JavaScript + Python (first-class): use the language you already know and trust - Real runtimes & package imports: run actual code, import libraries, and reuse existing logic - Stateful workflows: share variables, store data, and chain requests dynamically - Orchestration-ready: automate multi-step flows, token rotations, and dependent API calls Not helper scripts. Real programmable infrastructure inside your API client. Which other language would you want to see? GitHub: https://lnkd.in/d4rG6PcU Download: https://voiden.md/download

Topic 7/100 🚀 🧠 Topic 7 — Lambda Functions Want to write a quick function in just one line? ⚡ 👉 What is it? Lambda functions are small anonymous functions defined using the lambda keyword. 👉 Use Case: Used in real-world applications for: Quick operations inside map(), filter() Sorting with custom logic Short, throwaway functions 👉 Why it’s Helpful: Reduces boilerplate code Makes code concise Useful for functional programming 💻 Example: # Normal function def square(x): return x * x # Lambda version square = lambda x: x * x print(square(5)) 🧠 What’s happening here? We replaced a full function definition with a single-line lambda expression. ⚡ Pro Tip: Use lambdas for small logic only — avoid them for complex functions. 💬 Follow this series for more Topics #Python #BackendDevelopment #100TopicOfCode #SoftwareEngineering #LearnInPublic

【🐍-Python-Update】‐059‐【Render】Process-Specific Script Collection for Recording -Management- Export Media Information to Excel Following up from last time, here's the Python version of scripts useful for recording work💁♂️ https://lnkd.in/gRwBJU87 This script exports information about exported files to a management Excel sheet. You can view a list of created waveform files, and later use Excel's formatting features to create more readable tables ✨ ◆Required Plans ・RIGDOCKS -BRONZE- ・RIGDOCKS -SILVER- ・RIGDOCKS -GOLD- #AZSTOKE #RIGDOCKS #Reaper #Reascript

🚀 Day 51 of #100DaysOfCode ✅ Solved: 1689. Partitioning Into Minimum Number of Deci-Binary Numbers Today’s problem looked tricky at first, but the solution turned out to be beautifully simple once the pattern was understood. 🔎 Problem Insight: A deci-binary number contains only digits 0 or 1. To form a number like "82734", think about each digit: If a digit is 8, we need at least 8 deci-binary numbers contributing 1 at that position. If a digit is 3, we need at least 3 deci-binary numbers at that position. 👉 So the minimum number of deci-binary numbers required is simply: 📌 The maximum digit in the given number 💡 Example: Input: "82734" Output: 8 🧠 Python Code: Python Copy code class Solution: def minPartitions(self, n: str) -> int: return int(max(n)) ⏱ Time Complexity: O(N) 💾 Space Complexity: O(1) This problem is a great example of how understanding the pattern simplifies the solution dramatically. #LeetCode #ProblemSolving #Python #DataStructures #CodingJourney #100DaysOfCode

𝗣𝘆𝘁𝗵𝗼𝗻 𝗜𝗻𝘁𝗲𝗿𝘃𝗶𝗲𝘄 𝗣𝗮𝘁𝘁𝗲𝗿𝗻𝘀 🐍 | 𝗕𝘂𝗶𝗹𝘁-𝗶𝗻𝘀 – 𝗔𝗻𝘆() & 𝗔𝗹𝗹() ⚡ | 📅 𝗗𝗮𝘆 𝟱𝟴 🚀 Today’s task: ✅ 𝗧𝗮𝗸𝗲 𝗮 𝗹𝗶𝘀𝘁 𝗼𝗳 𝗶𝗻𝘁𝗲𝗴𝗲𝗿𝘀. ✅ 𝗖𝗵𝗲𝗰𝗸 𝗶𝗳 𝗮𝗹𝗹 𝗻𝘂𝗺𝗯𝗲𝗿𝘀 𝗮𝗿𝗲 𝗽𝗼𝘀𝗶𝘁𝗶𝘃𝗲. ✅ 𝗧𝗵𝗲𝗻 𝗰𝗵𝗲𝗰𝗸 𝗶𝗳 𝗮𝗻𝘆 𝗻𝘂𝗺𝗯𝗲𝗿 𝗶𝘀 𝗮 𝗽𝗮𝗹𝗶𝗻𝗱𝗿𝗼𝗺𝗲. Only if you understand Python’s logical helpers: all() and any() Core idea from the code: 𝙖𝙡𝙡(𝙞𝙣𝙩(𝙞) > 0 𝙛𝙤𝙧 𝙞 𝙞𝙣 𝙣_𝙡𝙞𝙨𝙩) Checks whether every number is positive. 𝙖𝙣𝙮(𝙞 == 𝙞[::-1] 𝙛𝙤𝙧 𝙞 𝙞𝙣 𝙣_𝙡𝙞𝙨𝙩) Checks whether any number is a palindrome. Final condition: Both must be True. 💡 𝗜𝗻𝘁𝗲𝗿𝘃𝗶𝗲𝘄 𝗧𝗮𝗸𝗲𝗮𝘄𝗮𝘆: all() → True if all conditions pass any() → True if at least one condition passes Strong candidates understand: • Generator expressions • Logical evaluation of iterables • Writing compact Pythonic conditions Because Python isn’t about long loops. It’s about expressing logic clearly. Cleaner logic. Smarter code. #Python #PythonBuiltins #InterviewPrep #HackerRank #ProblemSolving #DailyCoding #Consistency

90% of Python devs only know context managers as "with open()". That's like buying a Swiss Army knife and only using the toothpick. Context managers can handle: → Database connections (auto commit/rollback) → Execution timing (profile any code block) → Temp file cleanup (zero manual deletion) → Lock management → API sessions Slide through for real code examples ↗️ Which one do you use most? Drop your favorite use case below 👇 #Python #SoftwareEngineering #CodingTips #PythonDev #CleanCode

It’s “just text”… until you realize it powers almost everything. Usernames. Passwords. Logs. Messages. APIs. Reports. The Python String datatype is simple on the surface — but incredibly powerful when you understand how to Create, Read, Update, and Delete data efficiently. Strong fundamentals = strong developer. 🔥 What’s your favorite string method? 👇 #PythonDeveloper #CodingLife #DataAnalyst #TechLearning #LinkedInTech