Data Engineering, ML Engineering, or Platform Engineering, with experience leading high-performing engineering teams. Sexpertise in Python, SQL, PySpark, distributed computing, and modern Big Data ecosystems. Expertise in distributed processing frameworks such as Spark, Databricks, Kafka, and orchestration tools including Airflow, Dagster, Oozie, or equivalent.
Lead the design, development, and optimization of large-scale batch and real-time data platforms using distributed technologies such as Spark, Databricks, Kafka, and cloud-native data services.
Provide technical leadership across Data Engineering and ML Engineering by defining the what, why, and how of scalable data architectures, feature engineering pipelines, ETL/ELT frameworks, and ML platforms.
Own the end-to-end data platform strategy, ensuring high standards for data quality, observability, lineage, governance, reliability, scalability, and performance.
Lead the engineering of production-grade ML solutions, including feature engineering, model training, deployment, monitoring, and continuous improvement.
Partner closely with Data Science, Product Management, Engineering, and Business stakeholders to translate business problems into scalable data and AI products.
Establish engineering best practices for CI/CD, Infrastructure as Code (IaC), model versioning, automated testing, monitoring, and MLOps.
Drive platform modernization initiatives across Data Lakes, Lakehouses, Warehouses, streaming platforms, and cloud-native analytics ecosystems.
Define engineering standards, reusable frameworks, and reference architectures that improve developer productivity and platform reliability.
Lead technical design reviews, architecture discussions, and engineering governance while ensuring alignment with enterprise architecture and security standards.
Build and manage high-performing engineering teams through coaching, mentoring, hiring, career development, and performance management.
Drive execution across multiple concurrent initiatives by balancing technical priorities, delivery commitments, operational excellence, and stakeholder expectations.
Foster a product mindset by enabling data-driven decision making through scalable platforms, analytics, AI, and self-service data capabilities.
Champion innovation by evaluating and adopting emerging technologies, GenAI capabilities, modern data architectures, and engineering best practices.
12+ years of experience in Data Engineering, ML Engineering, or Platform Engineering, with experience leading high-performing engineering teams.
Strong hands-on expertise in Python, SQL, PySpark, distributed computing, and modern Big Data ecosystems.
Expertise in distributed processing frameworks such as Spark, Databricks, Kafka, and orchestration tools including Airflow, Dagster, Oozie, or equivalent.
Strong experience designing enterprise-scale Data Lake, Lakehouse, and Data Warehouse architectures supporting analytics and AI workloads.
Deep understanding of ML Engineering and MLOps, including MLflow, Feature Stores, model deployment, monitoring, evaluation, and lifecycle management.
Strong knowledge of distributed data formats and storage technologies, including Parquet, ORC, Delta Lake, Apache Iceberg, and Apache Hudi.
Good understanding of distributed transaction management, workload optimization, partitioning strategies, and performance tuning.
Experience with cloud platforms (AWS, Azure, or GCP) and modern cloud-native data services.
Hands-on experience with Docker, Kubernetes, containerized workloads, and infrastructure automation.
Strong understanding of Unix/Linux environments, Hadoop ecosystem, object storage, and distributed file systems.
Excellent analytical, architectural, debugging, and problem-solving skills with experience solving large-scale data challenges.
Experience implementing engineering best practices including CI/CD, DevOps, Infrastructure as Code, automated testing, observability, and production monitoring.
Leadership Expectations
Lead, mentor, and inspire engineering teams by fostering a culture of ownership, continuous learning, innovation, and operational excellence.
Drive technical strategy and influence engineering roadmaps across multiple products and platforms.
Build strong partnerships with Product, Architecture, Data Science, and Business leaders to deliver measurable business outcomes.
Balance strategic planning with execution, ensuring predictable delivery, engineering quality, and platform reliability.
Champion engineering excellence through architecture reviews, coding standards, design governance, and technical mentoring.
Develop future technical leaders by coaching engineers, enabling career growth, and creating a high-performance engineering culture.
Communicate effectively with senior leadership, providing clear updates on technology strategy, delivery risks, investment priorities, and business impact.