Lead Databricks Developer (PySpark / Azure)
Job Description
Job#: 3028138
Job Description:
Lead Databricks Developer (PySpark / Azure)Location: Mexico (Remote)
Company: Apex Systems Mexico (Mexico Delivery Center)
About the RoleWe are seeking a Lead Databricks Developer (PySpark / Azure) to join our Mexico Delivery Center. This role is responsible for leading the development of scalable data solutions within a Databricks Lakehouse architecture, enabling high-performance data processing and analytics.
This is a hands-on leadership role, combining strong technical expertise in Databricks and Azure with the ability to guide engineering teams and drive best practices across data pipelines and platform design.
Key Responsibilities- Lead the design and development of data pipelines using Databricks (PySpark, Spark SQL)
- Build and optimize ETL/ELT workflows for large-scale data processing
- Architect and implement Lakehouse solutions on Azure
- Collaborate with data engineers, analysts, and stakeholders to deliver data-driven solutions
- Drive best practices in data modeling, performance optimization, and scalability
- Mentor and guide mid-level and senior data engineers
- Ensure data quality, reliability, and governance across pipelines
- Integrate Databricks solutions with the Azure ecosystem (Data Lake, storage, networking)
- Support CI/CD processes and deployment of data pipelines
- Participate in architectural decisions and long-term platform strategy
- Ensure proper documentation and knowledge sharing
- 7+ years of experience in Data Engineering or Big Data development
- Strong hands-on experience with Databricks
- Advanced experience with PySpark and Spark SQL
- Strong experience with Azure ecosystem (Data Lake, storage, networking)
- Proven experience designing and building large-scale data pipelines (ETL/ELT)
- Experience with data modeling and performance optimization
- Experience in technical leadership or mentoring engineers
- Strong SQL skills
- Experience working in agile environments
- Strong communication and collaboration skills
- Advanced English proficiency
- Experience with Delta Lake, Delta Live Tables, or Databricks Workflows
- Experience with Unity Catalog and data governance practices
- Exposure to CI/CD for data pipelines
- Experience working with analytics or ML teams
- Experience in cloud-based data platforms
- Competitive salary aligned with market standards in Mexico
- Performance-based bonus
- Private medical insurance (family coverage)
- Food vouchers
- Home office allowance
- Christmas bonus (30 days)
- Vacation + vacation bonus
- Career growth opportunities within Apex Systems
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including Great Place to Work® and Great Place for Women to Work® in Mexico.
VEVRAA Federal Contractor.
We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.
Job#: 3028138
Job Description:
Lead Databricks Developer (PySpark / Azure)Location: Mexico (Remote)
Company: Apex Systems Mexico (Mexico Delivery Center)
About the RoleWe are seeking a Lead Databricks Developer (PySpark / Azure) to join our Mexico Delivery Center. This role is responsible for leading the development of scalable data solutions within a Databricks Lakehouse architecture, enabling high-performance data processing and analytics.
This is a hands-on leadership role, combining strong technical expertise in Databricks and Azure with the ability to guide engineering teams and drive best practices across data pipelines and platform design.
Key Responsibilities- Lead the design and development of data pipelines using Databricks (PySpark, Spark SQL)
- Build and optimize ETL/ELT workflows for large-scale data processing
- Architect and implement Lakehouse solutions on Azure
- Collaborate with data engineers, analysts, and stakeholders to deliver data-driven solutions
- Drive best practices in data modeling, performance optimization, and scalability
- Mentor and guide mid-level and senior data engineers
- Ensure data quality, reliability, and governance across pipelines
- Integrate Databricks solutions with the Azure ecosystem (Data Lake, storage, networking)
- Support CI/CD processes and deployment of data pipelines
- Participate in architectural decisions and long-term platform strategy
- Ensure proper documentation and knowledge sharing
- 7+ years of experience in Data Engineering or Big Data development
- Strong hands-on experience with Databricks
- Advanced experience with PySpark and Spark SQL
- Strong experience with Azure ecosystem (Data Lake, storage, networking)
- Proven experience designing and building large-scale data pipelines (ETL/ELT)
- Experience with data modeling and performance optimization
- Experience in technical leadership or mentoring engineers
- Strong SQL skills
- Experience working in agile environments
- Strong communication and collaboration skills
- Advanced English proficiency
- Experience with Delta Lake, Delta Live Tables, or Databricks Workflows
- Experience with Unity Catalog and data governance practices
- Exposure to CI/CD for data pipelines
- Experience working with analytics or ML teams
- Experience in cloud-based data platforms
- Competitive salary aligned with market standards in Mexico
- Performance-based bonus
- Private medical insurance (family coverage)
- Food vouchers
- Home office allowance
- Christmas bonus (30 days)
- Vacation + vacation bonus
- Career growth opportunities within Apex Systems
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including Great Place to Work® and Great Place for Women to Work® in Mexico.
VEVRAA Federal Contractor.
We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state.
About Apex Systems, Inc.
Apex Systems is a world class technology services business that incorporates industry insights and experience to deliver solutions that fulfill our clients’ digital visions. We provide a continuum of service from workforce mobilization and modern enterprise solutions to digital innovation to drive better results and bring more value to our clients. Apex transforms our customers with modern enterprise solutions tailored to the industries we serve. Apex has a presence in over 70 markets across the US, Canada, and Mexico.
Apex is a segment of ASGN Inc. (NYSE: ASGN). To learn more, visit www.apexsystems.com.
Related Jobs
City : Omaha, NE or Chesterfield, MO State : Nebraska (US-NE) Country : United States (US) Requisition Number : 45084 A Day In The Life:We are seeking an experienced Associate General Counsel with 10-...
City : Omaha State : Nebraska (US-NE) Country : United States (US) Requisition Number: 45204 A Day in the Life:The Trades Payables will play a crucial role in classifying, examining, and analyzing acc...
Berlin Packaging
Berlin Packaging is the premier supplier of rigid packaging. With over $3 billion in revenue, we grow 5x faster than the overall packaging industry. Chances are you enjoy products supplied by B...
WIN Waste Innovations
WIN Waste Innovations is looking for a Shift Supervisor. They will be responsible for directing and supervising Operations Department and other plant personnel to ensure the facility is operated and m...
WIN Waste Innovations
WIN Waste Innovations is looking for a Heavy Equipment Operator. The Heavy Equipment Operator is responsible for the safe operation of heavy equipment at a recycling facility, landfill or transfer sta...
WIN Waste Innovations
WIN Waste Innovations is looking for a Heavy Equipment Operator. The Heavy Equipment Operator is responsible for the safe operation of heavy equipment at a recycling facility, landfill or transfer sta...
