Lead Data Engineering - Bengaluru, India - Apex Systems

    Apex Systems
    Apex Systems Bengaluru, India

    3 weeks ago

    Default job background
    Technology / Internet
    Description

    Over 8 years of experience in Data Engineering leading the design, development and implementation of data pipelines, ETL processes and data models

    Lead and mentor a team of data engineers, fostering continuous learning and professional development in data technologies.

    Proficiency in Data Engineering, Data Warehousing, Data Modeling, ETL, Database & Analytics.

    Expertise in programming languages such as Scala, SQL, Python is essential.

    Experience with big data technologies such as Spark, Kafka or Hadoop

    Familiarity with Agile methodologies, DevOps practices, and CI/CD pipelines.

    Comprehensive understanding of data security, privacy, and compliance regulations. Experience with cloud platforms such as AWS, Azure, or Google Cloud, including services like S3, ADF, BigQuery. Experience working on CI/CD pipelines. Demonstrated experience in leading a technical team. Experience in creating system design, High-Level Design (HLD), and Low-Level Design (LLD), understanding and consideration of non-functional aspects of any requirement. Willingness to engage in coding tasks. Analytical and problem-solving mindset. Ability to adapt to the latest technologies and implement them in projects. Ability to collaborate with internal and external stakeholders for effective delivery. Stay up to date with emerging data trends, services, and industry best practices, and advocate for their adoption when appropriate.