Senior Big Data Engineer - Remote (Ciudad de México)

Apex Systems is a leading Data and Digital Transformation professional services organization focused on providing solutions with real business value. We provide a customer-focused approach to building authentic partnerships with our clients with objective counsel from concept to deployment for a consistent voice through the dynamic IT environment. Apex Systems Mexico is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines and replication frameworks within modern lakehouse architectures. This role will focus on implementing scalable ingestion and transformation pipelines using Databricks, Delta Lake, and Spark , supporting large-scale data platform modernization initiatives. The idóneo candidate has strong hands-on experience building production-grade pipelines, implementing Change Data Capture (CDC) and replication frameworks, and optimizing distributed data workloads. This role requires strong collaboration with cross-functional engineering, analytics, and governance teams to ensure high-quality, reliable, and scalable data solutions. Data Engineering & Pipeline Development Build and configure table-level replication pipelines using Airbyte or similar data replication tools. Implement incremental load strategies and CDC-based ingestion frameworks for enterprise data pipelines. Develop and maintain data pipelines aligned with Medallion architecture standards (raw, source, core, mart layers).

Implement data transformations and validation frameworks using SQL and Python . Data Platform Optimization Optimize Delta Lake table design, partitioning strategies, and storage layout for performance and scalability. Tune Spark workloads and cluster performance to improve pipeline efficiency and resource utilization.

Enhance batch scheduling, workload parallelization, and pipeline orchestration to support large-scale data processing. Data Quality, Security & Governance Develop automated data validation scripts to ensure source-to-target data accuracy and completeness. Implement data masking transformations and security controls aligned with enterprise data governance standards.

Implement logging, monitoring, failure handling, and retry logic to ensure resilient and reliable pipelines . Support Power BI validation queries and migration testing during data platform transitions. Collaborate with engineering, analytics, and governance teams to deliver high-quality data solutions.

Provide guidance and mentoring to junior engineers, supporting their technical and professional development. Proactively identify opportunities to improve data processes, architectures, and operational efficiency.

Deliver high-quality solutions while meeting project timelines and ensuring engagement success 5+ years of experience in Data Engineering building production data pipelines. ~3+ years of hands-on experience with Databricks and Apache Spark. ~ Experience implementing data replication frameworks using Airbyte or similar tools. ~ Strong expertise in SQL and Python for data transformation and validation scripting. ~ Experience implementing Medallion architecture and modern lakehouse data platforms. ~ Experience optimizing Spark workloads and cluster performance.

~ English proficiency level C1 or higher is a requirement. At Apex systems it is important to us that our employees feel comfortable and feel an important part of the organization. Variable performance bonus Private medical insurance for you, spouse and children

Home office bonus Postúlate en Kit Empleo: kitempleo.com.mx/empleo/5vdgm2