Data Engineering Specialist - Bengaluru, India - BT Group

    BT Group
    BT Group Bengaluru, India

    3 weeks ago

    Default job background
    Description

    What you'll be doing


    • Work closely with our internal teams of Solutions Architects, Data Designers, Source System Experts and other stakeholders to understand requirements and translate them into a technical implementation and design documentation and write code to build our Data pipelines.

    • Monitor and maintain our data pipelines focusing on improving their performance.

    • Recommending the correct technologies to be used and in the most cost effective manner.

    • Leave code better than you found it (and fully commented) and participate in Code Reviews.

    • Maintain and enforce a good standard of coding and adhere to the same conventions as the rest of the team

    • Work in an SecDevOps environment

    The skills & experience you need

    Key skills identified as:

    • Experience with analytic warehouse solutions, data movement from data stores into analytic warehouses, and with performance/scalability improvements.

    • Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Cloud Data Fusion, Dataprep, etc.).

    • Experience with SQL and NoSQL modern data stores.

    • Solid Python programming skills in Python

    • Streaming experience ( e.g. Kafka)

    • LLM/Experience in creating ML models, worked on MLOps

    Other skills beneficial for the role are:

    • Ab Initio/ETL tools

    • Degree in Computer Science or equivalent work experience.

    • Experience with Big Data, PaaS, and IaaS technologies.

    • Worked as a team lead

    • Experience using version control and CD/CI tools (e.g GITLAB, Jenkins, et al.)

    • Official Google Data Engineer Certification

    • Experience writing and deploying Terraform scripts

    • Communicate complex ideas effectively to stakeholders at all levels.

    • Knowledge and experience of using Agile.

    Our leadership standards

    Looking in:
    Leading inclusively and Safely
    I inspire and build trust through self-awareness, honesty and integrity.
    Owning outcomes
    I take the right decisions that benefit the broader organisation.

    Looking out:
    Delivering for the customer
    I execute brilliantly on clear priorities that add value to our customers and the wider business.
    Commercially savvy
    I demonstrate strong commercial focus, bringing an external perspective to decision-making.

    Looking to the future:
    Growth mindset
    I experiment and identify opportunities for growth for both myself and the organisation.
    Building for the future
    I build diverse future-ready teams where all individuals can be at their best.