Data Engineer

Overview

The Ksquare Group was established over 10 years ago in Dallas TX, we are a multinational company with a presence in different countries such as Mexico, US, Dominican Republic, India and Guatemala currently being more than 250 Ksquarians and growing. We offer technological solutions through multidisciplinary Pods specifically designed to meet our customer’s needs. Depending on the skills required by every project, the best professionals are selected to bring all their talent together to achieve mutual goals. We authentically care about the comfort, well-being, and career path of all our employees making sure integrity, innovation, leadership, ownership, and team spirit continuously stand by one and each one of us. We believe and trust all our outstanding professionals and realize how special they are but what makes us even special is the family we have become throughout the years.

We are looking for a skilled Data Engineer to build and optimize scalable data pipelines and infrastructure. You will work with cross-functional teams to design, implement, and maintain efficient data processing systems that support analytics, machine learning, and business intelligence. This role is critical in ensuring the availability, reliability, and quality of data across the organization.

Responsibilities

• Pipeline Management: Design, build, and maintain ETL/ELT pipelines to ingest, transform, and store data from multiple sources.
• Optimization: Optimize data processing workflows for performance, reliability, and scalability, including query performance, cost efficiency, and storage utilization.
• Processing: Implement real-time and batch data processing using technologies like Apache Spark, Kafka, and Databricks.
• Infrastructure: Develop and manage data lakes, warehouses, and lakehouses (specifically Azure Databricks).
• Database Management: Ensure efficient data partitioning, indexing, and schema design. Work with structured and unstructured data across SQL and NoSQL databases.
• Quality & Governance: Implement data validation, cleansing, and monitoring. Implement data governance, security, and compliance policies (e.g., GDPR, CCPA).
• Documentation: Maintain metadata management, data lineage, and documentation for data assets.
• Cloud Deployment: Deploy and manage data solutions on cloud platforms (Azure, Databricks), utilizing serverless and distributed computing.
• Collaboration: Partner with data analysts and software engineers to support analytics initiatives.

Qualifications

• Education: Bachelor’s Degree in Computer Science, Information Systems, or a related field.
• Experience: 8+ years in Data Architecture or a related field, with a strong understanding of cloud-based data solutions (or equivalent combination of education and experience).

Required Knowledge, Skills, and Abilities

• Core Tech: Extensive experience with data ingestion pathways including Azure Data Factory (ADF).
• Languages: Proficiency in Python, SQL, or Scala for data processing.
• Cloud & Big Data: Experience with cloud data services (Azure Data Factory, Databricks) and big data frameworks (Apache Spark, Hadoop, Databricks).
• Architecture: Strong knowledge of data modeling, database optimization, API-based data integration, and proficiency in designing and implementing Medallion Architecture.
• Soft Skills:
  • Communication: Speaks clearly and persuasively; listens and gets clarification; demonstrates group presentation skills.
  • Professionalism: Approaches others in a tactful manner; reacts well under pressure.
  • Project Management: Coordinates projects, communicates progress, and completes projects on time/budget.
  • Reasoning: Ability to analyze facts and exercise sound judgment in arriving at conclusions.

Preferred Qualifications

• Experience with streaming data processing (Kafka, Event Hubs, Kinesis).
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation).
• Certifications in Azure, AWS, or GCP data engineering.
• Ability to work effectively with global teams.

The Ksquare Group does not and shall not discriminate based on race, color, religion, gender, gender expression, age, national origin, disability, marital status, sexual orientation, or military status, in any of its activities or operations. These activities include, but are not limited to, hiring, and firing of staff, selection of volunteers and vendors, and provision of services. We are committed to providing an inclusive and welcoming environment for all members of our staff, clients, volunteers, subcontractors, vendors, and clients. As an equal opportunity employer. We will not discriminate and will take affirmative action measures to ensure against discrimination in employment, recruitment, advertisements for employment, compensation, termination, upgrading, promotions, and other conditions of employment against any employee or job applicant on the basis of the conditions previously mentioned.