Lead Data Engineer (Azure)
North Eastern ServicesCiudad de México, Ciudad de México, MexicoHace 6 días
Tipo de contrato
- Teletrabajo
Descripción del trabajoMicrosoft Certified : Azure Fundamentals Microsoft Certified : Azure Data Engineer Associate Microsoft Certified : Azure Solutions Architect Expert : nice to have Databricks Certified Associate Developer for Apache Spark Databricks Certified Data Engineer Associate, nice to have Strong programming Skills in one or more languages such as Python (must have), Scala, and proficiency in writing efficient and optimized code for data integration, storage, processing and manipulation. Strong experience using Markdown to document code or automated documentation tools (e.g PyDoc). Strong experience with scalable and distributed Data Processing Technologies such as Spark / PySpark (must have, experience with Azure Databricks is a plus), DBT and Kafka, to be able to handle large volumes of data. Expert in designing and implementing efficient ELT / ETL processes in Azure (experience with Azure Data Factory is a plus) and using open source solutions being able to develop custom integration solutions as needed. Skilled in Data Integration from different sources such as APIs, databases, flat files, event streaming, with technologies such as Azure Data Factory. Expertise in data cleansing, transformation, and validation. Hands-on experience with Jupyter Notebooks and python packaging and dependency management : Poetry, PipEnv. Proficiency with Relational Databases (Oracle, SQL Server, MySQL, Postgres, or similar) and NonSQL Databases (MongoDB or Table). Good understanding of Data Modeling and Database Design Principles. Being able to design and implement efficient database schemas that meet the requirements of the data architecture to support data solutions. Strong understanding and experience with SQL and writing advanced SQL queries. Strong experience in designing and implementing Data Warehousing solutions in Azure with Azure Synapse Analytics and / or Snowflake. Familiarity with migration of code from one or more of SAS , R, Julia, SPSS to Python. Proven technical leadership on prior Big Data projects. Strong understanding of the software development lifecycle (SDLC), especially Agile methodologies. Strong knowledge of SDLC tools and technologies Azure DevOps, including project management software (Jira, Azure Boards or similar), source code management (GitHub, Azure Repos, Bitbucket or similar), CI / CD system (GitHub actions, Azure Pipelines, Jenkins or similar) and binary repository manager (Azure Artifacts or similar). Strong understanding of DevOps principles, including continuous integration, continuous delivery (CI / CD), infrastructure as code (IaC), configuration management, automated testing and cost management. Strong knowledge in cloud computing specifically in Microsoft Azure services related to data and analytics, such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics (formerly SQL Data Warehouse), Azure Stream Analytics, SQL Server, Azure Blob Storage, Azure Data Lake Storage, Azure SQL Database, etc. Experience in Orchestration using technologies like Apache Airflow. Strong analytical skills to identify and address technical issues, performance bottlenecks, and system failures. Proficiency in debugging and troubleshooting issues in complex data and analytics environments and pipelines. Good understanding of Data Quality and Governance, including implementation of data quality checks and monitoring processes to ensure that data is accurate, complete, and consistent. Good understanding of BI solutions including PowerBI and Tableau. Knowledge in containers and their environments (Docker, Podman, Docker-Compose, Kubernetes, Minikube, Kind) is a plus. Effective and strong written and verbal communication skills to collaborate with cross-functional teams, including data architects, DevOps engineers, data analysts, data scientists, developers, and operations teams, and ability to think strategically and work cross-functionally with multiple stakeholders and audiences. Ability to document processes, procedures, and deployment configurations. Possesses strong leadership skills with a willingness to lead, create Ideas, and be assertive. Understanding of Azure security practices, including network security groups, Azure Active Directory, encryption, and compliance standards. Ability to implement security controls and best practices within data and analytics solutions, including proficient knowledge and working experience on various cloud security vulnerabilities and ways to mitigate them. A willingness to stay updated with the latest Azure services, Data Engineering trends, and best practices in the field. Must be well organized, comfortable working in a fast-paced environment, and able to prioritize effectively. Team player and self-motivated. Ability to work and learn independently to answer questions, while maintaining attention to detail and quality. Commitment to agility, continuous learning, and ability to adapt to changing business needs. Lead engineers on the team to meet product deliverables. Architect, design, develop, test, optimize and maintain high-performance, large-scale data architectures prioritizing best practices, for data intake, validation, mining, and engineering for delivering data products. Support data integration (batch and real-time), storage, processing, and infrastructure and ensure scalability, reliability, and performance of data systems. Provide mentorship, coaching and guidance to junior data engineers and foster their professional growth and development. Collaborate with cross-functional teams (Product, Engineering, Data Scientists, Analysts, Cloud Architects, DevOps engineers) to drive discovery and requirements gathering for data management and business analytics efforts to meet product deliverables, supporting the implementation of code and procedures for data products. Work with the product management team to understand the roadmap commitments and communicate design and implementation milestones effectively. Understanding data requirements, Interacting with a multi-disciplined team, and translating them into effective solutions. Identify and solve code / design optimization. Learn and integrate with a variety of systems, APIs, and platforms. Establish a full-proof QA process for data validations and overall quality control on the Product. Continuously evaluate and implement new technologies and tools. Promote the development of reusable components. Design, implement, and maintain data governance solutions. Manage cataloging, lineage, data quality (enhancing data accuracy), and governance frameworks. Implement data validation and quality assurance processes. Lead data security and privacy efforts. Work independently and collaboratively on a multi-disciplined project team in an Agile development environment, actively participating in Agile ceremonies. Work on a Scrum team to deliver on projects and initiatives that impact business development, client support, business management, investment management, and all functional areas of the organization. Contribute to continuous improvement activities. Stay updated on market trends and emerging technologies.
About Fusemachines
Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Ne-pal, United States, Canada, and Dominican Republic and more than 400 full-time employees). Fusemachines seeks to bring its global expertise in AI to transform companies around the world.
About the role
Location : Remote (Contract)
This is a full-time position responsible for leading, designing, building, and maintaining the infrastructure required for data integration, storage, processing, and analytics (BI, visualization and Advanced Analytics) using Microsoft Azure in the Media domain.
We are seeking a Lead Data Engineer with hands-on Python, Spark experience and proven abilities to lead software development on Data and Analytics products using Agile methodology. We are seeking a well-rounded senior data engineer to lead a cloud based Big Data product team using a variety of technologies. The ideal candidate will possess strong technical, analytical, and interpersonal skills. In addition, the candidate will lead data engineers, data scientists on the team to achieve architecture and design objectives as agreed with stakeholders.
Qualification & Experience
- Must have a full-time Bachelor's degree in Computer Science or similar from a top tier school.
- 4+ years of experience with Azure DevOps, Azure Cloud Platform, or other hyperscalers.
- At least 4 years of experience as a data engineer with strong expertise in Azure, working on generation of big datasets using different data sources, in the Media industry.
- Proven experience delivering projects and products for Data and Analytics as a data engineer.
Following certifications :
Required skills / Competencies
Responsibilities
Equal Opportunity Employer : Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
#J-18808-Ljbffr
Crear una alerta de empleo para esta búsqueda
Data Engineer • Ciudad de México, Ciudad de México, Mexico
Ofertas relacionadas
Talent Acquisition IT | Selección estratégica de talento | Buscando talento para mover la tecnología del futuro | Supply Chain.
Te apasiona transformar datos en soluciones que generen impacto? En Ne...Mostrar másÚltima actualización: hace 17 días
Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Mostrar másÚltima actualización: hace 23 días
Get AI‑powered advice on this job and more exclusive features.Direct message the job poster from CodeRoad Inc.Talent Acquisition Specialist | Experienced in LATAM markets.At Coderoad, we’re more th...Mostrar másÚltima actualización: hace 8 días
Senior Lead Azure Data Engineer – Data Factory / Synapse / Databricks.Senior Lead Azure Data Engineer – Data Factory / Synapse / Databricks.
Senior Lead Azure Data Engineer.The focus of this positio...Mostrar másÚltima actualización: hace 7 días Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI.With a presenc...Mostrar másÚltima actualización: hace 23 días 
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.
Job CategorySoftware EngineeringJob Details • • • •Abo...Mostrar másÚltima actualización: hace 4 días
)
Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI.With a presenc...Mostrar másÚltima actualización: hace 5 días
Oceans Code Experts is looking for talented individuals that are ready for the next step in their career, we offer a collaborative professional environment as full of rewarding experiences as it is...Mostrar másÚltima actualización: hace 13 días
Rol : Líder Técnico / Arquitecto de Datos (AWS) Experiencia +4 años en tecnologías Cloud (AWS) Experiencia en Diseño y Desarrollo de arquitectura de Datos Experiencia como Líder Técnico de Datos ...Mostrar másÚltima actualización: hace 1 día
Right Balance® is a Los Angeles‑based technology talent firm seeking a Data Engineer – Databricks to build a lakehouse for a gaming client.
Right Balance® serves innovative companies in the US, rece...Mostrar másÚltima actualización: hace 3 días
- Oferta promocionada
AWS Lead Data Engineer
LogiceaCiudad de México, Ciudad de México, Mexico Direct message the job poster from Logicea.At Logicea, we empower some of the biggest names in business with beautiful, intuitive software that unlocks potential for employees, builds loyalty with ...Mostrar másÚltima actualización: hace 17 días
- Oferta promocionada
Azure Data Engineer
NetlogistikCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Team Lead, Data Analytics
StripeCiudad de México, Mexico Stripe is a financial infrastructure platform for businesses.Millions of companies - from the world’s largest enterprises to the most ambitious startups - use Stripe to accept payments, grow their ...Mostrar másÚltima actualización: hace 29 días
- Oferta promocionada
Data Engineer (Lead) ID41785
AgileEngineCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Tech Lead Data Engineer
IDS ComercialCiudad de México, Mexico Ids Comercial es una empresa 100% mexicana dedicada a TI con más de 40 años de experiencia y presencia en México, Latinoamérica y EEUU.
Más de 1500 consultores trabajan con un gran número de proyect...Mostrar másÚltima actualización: hace 29 días
- Oferta promocionada
Azure Data Engineer
PIXIECiudad de México, Ciudad de México, Mexico We are looking for an experienced.Oil & Gas client on a 12-month engagement.This role will focus on building and optimizing Azure-based data solutions that enable analytics, reporting, and business...Mostrar másÚltima actualización: hace 28 días
- Oferta promocionada
Lead Data Engineer
CodeRoad IncCiudad de México, Ciudad de México, MexicoTeletrabajo
- Oferta promocionada
Senior Lead Azure Data Engineer – Data Factory / Synapse / Databricks
Publicis SapientCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Lead Data Engineer
North Eastern ServicesCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Lead Software Engineer | Data Engineering & Data Solutions
Salesforce, Inc.Ciudad de México, MexicoTeletrabajo
- Oferta promocionada
Databricks Platform Cloud Engineer
Greymatter InnovationzCiudad de México, Ciudad de México, Mexico Talent Advisor | Tech Recruitment | Pharma.Join our team and play a key role in the.Databricks platform, ensuring that data and analytics teams can work efficiently, securely, and at scale.Databric...Mostrar másÚltima actualización: hace 12 días
- Oferta promocionada
Data Engineer Senior - Azure
Bluetab, an IBM Company (América)Mexico City Metropolitan Area, Mexico En Bluetab, seguimos en crecimiento y estamos en busca de personas como tú, que comparten nuestra pasión por la tecnología.
Nos destacamos por ser diferentes a la consultoría tradicional.Aquí, creem...Mostrar másÚltima actualización: hace más de 30 días
- Oferta promocionada
Site Reliability Engineer - AWS / SQL
S&P GlobalMexico City Metropolitan Area, Mexico Site Reliability Engineer - Data Support | S&P Dow Jones Indices.We are seeking an Site Reliability Engineer - Data Support to be a key player in the implementation and support of our Global Index ...Mostrar másÚltima actualización: hace más de 30 días
- Oferta promocionada
Lead Data Engineer (Azure)
FusemachinesCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Azure Data Engineer PH-14
Oceans Code ExpertsCiudad de México, Ciudad de México, MexicoTeletrabajo
- Oferta promocionada
Lead Data Engineer (Ciudad de México)
Link-WorldwideCiudad de México, MexicoTeletrabajo
- Oferta promocionada
Data Engineer — Databricks
Right Balance ®Ciudad de México, Ciudad de México, MexicoTeletrabajo
- Oferta promocionada
Databricks Data Engineer
Accenture MéxicoCiudad de México, Mexico You’ll collaborate with cross-functional teams to design and build scalable data solutions that support strategic decision-making.
Design, develop, and maintain ETL / ELT pipelines using Azure Data Fa...Mostrar másÚltima actualización: hace 17 días