Data Engineer

Job Title: Data Engineer

Location: Virtual (Global)

Company: Foundever

About Us: At Foundever, we are dedicated to harnessing the power of data to drive business transformation and deliver exceptional results for our clients. We are seeking a detail-oriented and analytical Data Engineer to join our team. The ideal candidate will have strong ETL skills and experience in data management within a BPO environment.

Job Overview: As a Data Engineer, you will design, build, and maintain scalable data pipelines and systems to ensure the efficient collection, processing, and storage of large datasets. You will collaborate with cross-functional teams, analysts, and other stakeholders to ensure data flows seamlessly throughout the organization. You will also be responsible to integrate various data sources from unstructured resources, create optimized data schemas for serving billions of data records.

Your work will enable data-driven decision-making and provide critical insights to drive business growth.

Key Responsibilities:

·       Data Pipeline Development: Design, implement, and maintain scalable and efficient data pipelines to move data from various sources to centralized data repositories (e.g., data lakes, data warehouses).

·       Data Integration: Integrate data from multiple unstructured sources, ensuring data quality, consistency, and accessibility for downstream analytics and reporting tools.

·       Data Modeling: Build and maintain data models that allow for efficient querying, reporting, and analysis, using technologies such as SQL, NoSQL, or cloud-based solutions.

·       Performance Optimization: Monitor and optimize the performance of data systems and processes, ensuring fast and reliable access to data.

·       Collaboration: Work closely with cross functional teams, analysts, and other technical teams to understand data requirements and provide technical solutions that meet business needs.

·       Automation: Automate data workflows and ETL (Extract, Transform, Load) processes to reduce manual intervention and improve data accuracy and reliability.

·       Data Security and Compliance: Ensure data privacy and compliance with relevant data protection regulations (e.g., GDPR, CCPA) by implementing security best practices.

·       Documentation: Maintain thorough documentation of data architectures, pipelines, and processes to ensure transparency and knowledge sharing across teams.

·       Troubleshooting and Support: Identify, troubleshoot, and resolve data-related issues and provide ongoing support for the data infrastructure.

Required Qualifications:

·       Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field (or equivalent practical experience).

·       Proven experience as a Data Engineer, Data Architect, or similar role in a data-driven environment.

·       Proficiency in programming languages such as NodeJS, Python or Springboot.

·       Strong SQL skills, with experience in database management (e.g., MS SQL Server, PostgreSQL, Redshift, BigQuery, etc.).

·       Experience with Azure cloud platforms particularly in data storage and processing services.

·       Hands-on experience with ETL tools and frameworks (e.g., Apache Kafka, Apache Airflow, Talend, etc.).

·       Familiarity with data warehousing solutions and data modeling techniques.

·       Knowledge of big data technologies (e.g., Hadoop, Spark, etc.) and Machine Learning is a plus.

·       Strong understanding of data security principles and best practices.

·       Ability to optimize query performance for Millions of rows of data.

Tech Stack

·       Programming Languages: Python, Java (Spring Boot), Node.js

·       Front End Stack: Next JS / React.

·       Data Processing & Frameworks: Apache Spark, Apache Flink, Apache Kafka, Pandas, Numpy, Scikit-learn

·       Middleware Creation:  NodeJS (ExpressJs), Python or Java Spring Boot (Strong experience in developing and managing middleware solutions for data integration, APIs, and event-driven architectures)

·       Data Storage & Warehousing: MS SQL Server, MongoDB, Google BigQuery

·       Containerization & Orchestration: Docker, Kubernetes

·       Version Control & Collaboration: Git, GitLab

·       Data Visualization: Tableau, Power BI

·       Monitoring & Logging: Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana), Datadog.

·       Automation Frameworks: Power Automate (Cloud Flow & Desktop), UiPath, BluePrism.

·       Cloud Platforms: Microsoft Azure, Google Cloud Platform, AWS.

Why Join Foundever:

• Opportunity to work on innovative and impactful automation projects.
• Collaborative and inclusive work environment.
• Professional growth and development opportunities.
• Competitive salary and benefits package.