M3 - DataOps & Framework Engineering Lead
M3 - DataOps & Framework Engineering Lead
2 days ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
DataOps & Framework Engineering Lead
Data Engineering
Sr Data Engineer & Data Platform Manager
Objective of the Role
The
DataOps & Framework Engineering Lead
Job Family : Decision Sciences >
Sub-family : Data Engineering
Reports to (role) : Sr Data Engineer & Data Platform Manager
Objective of the Role
The DataOps & Framework Engineering Lead is responsible for leading the DataOps Engineering Lead and Framework Team . This role aims to set the technical and operational standards that ensure data pipelines, and the data framework are reliable, automated, observable, and scalable, thereby improving time to market. Working primarily with Databricks on AWS , and optionally integrating with GCP and Azure environments , you'll help build a platform that powers analytics, business intelligence, and AI use cases across the company.
Main Responsibilities
- Lead and mentor Framework Engineering Team, fostering a culture of accountability, continuous improvement, and technical excellence.
- Define and share the best practices for implement CI / CD pipelines and automation using tools such as GitHub Actions, and Terraform
- Define and share Framework Architecture, and Data Contract especifications.
- Design and implementing oversee observability standards : logging, monitoring, alerting, and retries across the entire pipeline lifecycle.
- Ensure alignment between DataOps - Framework Teams and other technical chapters (Engineering, Platform, Architecture, Security) to support cross-domain pipelines.
- Collaborate with business stakeholders and tech leads to proactively manage delivery plans, risks, and dependencies.
- Act as the technical authority for incident response, root cause analysis, and resilience strategies in production environments.
- Promote infrastructure as code (IaC) practices and drive automation across cloud environments.
- Monitor resource usage and optimize cloud costs (Databricks clusters, compute, storage).
- Facilitate team rituals (1 : 1s, planning, retros) and create career development opportunities for team members.
- Promote an autonomous work culture by encouraging self-management, accountability, and proactive problem-solving among team members.
- Serve as a Spin Culture Ambassador to foster and maintain a positive, inclusive, and dynamic work environment that aligns with the company's values and culture.
Required Knowledge and Experience
Minimum 10+ years leading DataOps and Framework developers, or DevOps, with at least 5 years in a technical leadership role overseeing and mentoring, DevOps, DataOps, Data Engineers. Demonstrates experience in managing complex projects, coordinating team efforts, and ensuring alignment with organizational goals.Advanced hands-on experience withDatabricks, including Unity Catalog, Delta Live Tables, Job orchestration, and monitoring.Solid experience incloud platforms, especiallyAWS(S3, EC2, IAM, Glue).Experience withCI / CD pipelines(GitHub Actions, GitLab CI), and orchestration frameworks (Airflow or similar).Proficient inPython,SQL, and scripting for automation and data operations.Strong understanding of data pipeline architectures across batch, streaming, and real-time use cases.Technical Skills : Proficiency in DevOps tools and technologies such as Jenkins, Docker, Kubernetes, Terraform, Ansible, and cloud platforms (e.g. Databricks, AWS, Azure, GCP).Soft Skills : Strong leadership, communication, and collaboration skills. Excellent problem-solving abilities and a proactive approach to learning and innovation.Experience implementing monitoring and data quality checks.Effective communicator who can bridge technical and business needs.Preferred Qualifications :Experience with microservices architecture and containerization technologies.Familiarity with ITIL or other IT service management frameworks.Certification in cloud platforms or DevOps practices.Experience working withGoogle Cloud Platform (GCP)services such as BigQuery, Cloud Functions, Pub / Sub, or Composer.Fluent EnglishSpin está comprometida con un lugar de trabajo diverso e inclusivo.
Somos un empleador que ofrece igualdad de oportunidades y no discrimina por motivos de raza, origen nacional, género, identidad de género, orientación sexual, discapacidad, edad u otra condición legalmente protegida.
Si desea solicitar una adaptación, notifique a su Reclutador.
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Engineering and Information Technology
Referrals increase your chances of interviewing at Spin by 2x
Sign in to set job alerts for “Lead Engineer” roles.
Senior Full Stack Product Engineer - ActiveCampaign / Hilos
Mexico City Metropolitan Area 2 weeks ago
Mexico City Metropolitan Area $2,700.00-$4,000.00 1 week ago
Senior Pre-Sales Engineer – Data-Focused Enterprise Support
Mexico City Metropolitan Area $2,700.00-$4,000.00 1 week ago
Senior QA Engineer - Desktop and Distributed Systems
Principal Full Stack Engineer (Node,TypeScript)
LATAM Senior Software Engineer (Angular & .NET)
Senior Solutions Sales Engineer- Enterprise, Mexico City- LATAM
Tlalpan, Mexico City, Mexico $32,000.00-$39,000.00 1 month ago
Mexico City Metropolitan Area 4 months ago
Principal Full Stack Software Development Engineer - Mexico
Senior Software Development Engineer, Platform
Senior Front-End Engineer - Mobile & Web (m / f / d)
Mexico City Metropolitan Area $63,000.00-$114,000.00 3 weeks ago
Mexico City Metropolitan Area $63,000.00-$114,000.00 3 weeks ago
Senior Software Development Engineer, Android
Senior Software Development Engineer, Delivery Engineering
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr