Operational skills relevant for this job: | ||
Strong communication skills, both written and verbal to effectively engage with team and individuals involved in the project. Strong analytical abilities and attention to detail. Experience with collaborative development methods such as mob or ensemble programming. | ||
Experience relevant for this job: | ||
Proficiency in SQL and programming languages like Python, PySpark Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbt Experience working with cloud data platforms e.g. Azure Databricks, Snowflake or BigQuery Knowledge of data lakes and data warehouses concepts and distributed systems like Kafka, Spark etc., Familiarity of Docker, Kubernetes, CI/CD, Terraform Knowledge of cybersecurity principles and practices |
Data Architecture: Support the design, build and management of realtime, near realtime and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.
Data Integration and Transformation: Implement and manage the automated frameworks for integrating the data from various security sources into the security data lake. Also, the data transformation frameworks to move data between the raw, trusted, and curated data layers.
Coding and Documentations: Contribute to raising the quality bar of the team's codebase by producing high-quality code and documentation of data platform architecture, process and best practices.
Automation and DevOps: Implement various automations and DevOps practices to streamline the deployment, configuration, and management of data platform components.
Collaboration and Communication: Collaborate and communicate effectively with members of the team and actively participate in resolving issues related to data platform operations, providing support as needed.
Proficiency in SQL and programming languages like Python, PySpark
Working knowledge of ETL and ELT frameworks and orchestration tools like Airflow and dbt
Experience working with cloud data platforms e.g. Azure Databricks, Snowflake or BigQuery
Knowledge of data lakes and data warehouses concepts and distributed systems like Kafka, Spark etc.,
Familiarity of Docker, Kubernetes, CI/CD, Terraform
Knowledge of cybersecurity principles and practices