Data Architect

SUMMARY

As a hands-on Data Architect, you will be crucial in designing, building, and optimizing the data architecture for our next-generation SaaS platform. This position requires expertise in event-driven data architectures (e.g., Apache Kafka) and emerging technologies such as vector databases to support Generative AI applications. You will be deeply involved in implementing scalable, high-performance data systems that drive real-time analytics, AI applications, and dynamic data processing. Experience in the Utility industry and knowledge of AWS is preferred as we seek to optimize data systems that cater to the unique demands of this sector.

The development organization leverages Java, Spring Boot, AWS RDS (Postgres, SQL Server), Oracle, AWS Serverless technologies (Lambda, SQS), REST, JavaScript, and Mobile development with React Native hosted in AWS using Atlassian tools (Jira, BitBucket, andConfluence).

Dealbreakers :

Hands-on experience with Python and / or Java is required. Must have practical experience with data streaming use cases. Strong verbal and written communication skills are essential for engaging with stakeholders in technical roles.

Highlight Responsibilities :

This person is directly responsible for maintaining a consistent focus on the aspects of data and collaborating with business, technical stakeholders to implement a robust set of data capabilities consistent with our non-functional and functional requirements.

JOB FUNCTIONS

Duties and Responsibilities

• Design & Build Data Infrastructure : Architect and implement scalable, high-performance data infrastructure focusing on event-driven architectures, real-time data streaming, and advanced AI-driven applications.
• Event-Driven Data Solutions : Develop event-driven systems leveraging tools like Apache Kafka or similar technologies to support real-time data processing and low-latency pipelines.
• Hands-on Development : Actively develop and maintain data pipelines, ETL / ELT processes, and event-streaming solutions using Apache Kafka, Apache Flink, Apache Spark, or similar tools, as well as AI-specific data systems.
• Database Management : Manage and optimize SQL, NoSQL, OLAP and vector databases to ensure high availability, scalability, and performance, leveraging deep knowledge of database internals, mastery of concepts such as partitioning, sharding, embeddings, distributed database systems, and change data capture (CDC) techniques to drive efficiency and reliability across complex, large-scale environments.
• Data Integration : Build real-time and batch data pipelines that integrate structured and unstructured data from various sources, including AI models and third-party data sources.
• Performance Tuning : Continuously monitor and optimize data systems for performance, ensuring that AI workloads are supported by highly efficient data pipelines and storage solutions.
• Collaboration : Work closely with product managers, software engineers, and data scientists to align event-driven architectures, vector databases, and data pipelines with the needs of AI and machine learning models.
• Cloud Architecture : Architect and manage cloud-based data solutions AWS preferred, that support distributed data processing, AI workloads, and real-time data streaming.
• Vector Databases : Design and implement vector-based databases (e.g., Pinecone, pg_vector, Milvus) to support machine learning models, including Generative AI applications, efficiently handling high-dimensional data such as embeddings and unstructured data.

Requirements :

Preferred Qualifications :

Production Support / On-Call Duties :

As a key member of our engineering team, you will address escalated production issues from customer support. Your responsibilities will include :

Compensatory Time for On-Call Work :

We value work-life balance and recognize the extra effort required during on-call rotations. For hours spent actively working on-call, compensatory time off is provided, unless the law requires otherwise. This ensures your commitment is appropriately acknowledged. Please coordinate with your manager regarding the approval and scheduling of compensatory time, to align with team needs and workload.

Your contribution is essential in maintaining the smooth operation of our systems and in upholding high standards of customer satisfaction.