Lead Data Engineer - Bangalore/Anywhere in India/Multiple Locations - Live Connections

    Live Connections
    Live Connections Bangalore/Anywhere in India/Multiple Locations

    2 weeks ago

    Default job background
    permanent Technology / Internet
    Description

    Role : Lead Data Engineer

    Job Description :

    Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS .

    Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be crucial in enabling data-driven decision-making processes.

    You should have been responsible for the end-to-end execution of at least 1-2 projects, demonstrating a profound ability to navigate through challenges and deliver solutions that drive our business objectives.

    Key Responsibilities :

    - Design and implement robust, scalable data engineering pipelines within GCP, tailored for web analytics.

    - Integrate a variety of marketing & enterprise data sources, including AWS Aurora , SAP and Salesforce ensuring seamless data flow and accessibility.

    - Execute at least 1-2 end-to-end data engineering projects, from conceptualization to deployment, demonstrating project management and technical prowess.

    - Employ advanced SQL, Python, and Bash scripting to optimize data processing, analysis, and automation tasks.

    - Collaborate with cross-functional teams to identify data needs, design solutions, and enhance data-driven decision-making capabilities.

    - Maintain and ensure the integrity and reliability of data pipelines, implementing best practices in data security and compliance.

    Qualifications :

    - Bachelors/ Masters in computer/allied stem engineering fields with relevant 4-6 years of proven experience as a Data Engineer, with a focus on web analytics data engineering pipelines.

    - Hands-on experience with GCP & AWS , including its data processing and analytics services (Pubsub , Dataflow, Bigquery , Cloud functions , Cloud run , Bigtable , Glue , Redshift , S3 , SQS etc)

    - Strong proficiency in integrating data from diverse sources using API's.

    - Advanced knowledge of SQL, Python, and Bash scripting is essential.

    - Demonstrated ability to execute end-to-end projects, showcasing effective project management and technical skills.

    - Excellent problem-solving abilities, with a keen eye for detail and a commitment to high-quality outcomes.

    - Strong communication skills, with the ability to convey complex technical concepts in a clear, concise manner.

    )