Lead Data Engineer - Bangalore, India - Antal International

    Antal International
    Antal International Bangalore, India

    2 weeks ago

    Default job background
    permanent Technology / Internet
    Description

    THE ROLE :
    You will be tasked with building and maintaining our data infrastructure.

    You'll also play a key role in acquiring, organising and analysing data to provide insights that enable the company in making sound business decisions.


    This includes, but is not limited to :

    • Maintaining our database and building on the existing database infrastructure
    • Establishing the needs of different users and monitoring user access and security
    • Capacity planning and refining the physical design of the database to meet system storage requirements
    • Creating efficient queries and tools to obtain data for different business needs
    • Building data models to identify, analyze and interpret trends or patterns in data sets that inform business decisions and strategy
    • Working with various internal and external stakeholders to maintain and develop enhanced data collection systems
    • Performing periodic data analyses, creating and presenting findings and insights
    • Performing scheduled data audits in order to locate and correct code errors and maintain data integrity
    • Collaborating with our global tech team to build data collection and data analysis tools

    THE QUALIFICATIONS :

    • Undergraduate degree in computer science; advanced degree preferred
    • 7+ years of experience in database programming, database administration and data analysis
    • Must have prior experience in building high quality databases in accordance with end users information needs and views
    • Proficiency in Python, Database design, Apache Airflow, Data pipeline
    • CI/CD is a must.
    • Prior experience with AWS Glue or Databricks and Redshift or Snowflake is a must
    • Deep familiarity with database design and documentation
    • Handson expertise and exposure to at least one database technology (MySQL, PostgreSQL)
    • Advanced knowledge of R/Python, PySpark, or Scala is a plus
    • Prior experience building data pipelines and data orchestration is a plus.
    • Experience in Big Data and Hadoop ecosystems is a plus
    • Superior analytical and problem solving skills
    • Proven ability to create and present comprehensive reports
    • Ability to multitask and own several key responsibilities at a given time
    • Passion for excellence: constantly striving to improve professional skills and business operations
    )