Senior Data Engineer - Hyderabad, India - Anblicks

    Anblicks
    Anblicks Hyderabad, India

    Found in: Appcast Linkedin IN C2 - 1 week ago

    Default job background
    Description

    Job Description:

    Job Designation / Role: Senior Data Engineer (Snowflake)

    Job Location: Ahmedabad/ Hyderabad

    Role Objective:

    We are seeking a skilled and driven Senior Data Engineer with a strong focus on Snowflake, Python, and data engineering concepts to join our team. The ideal candidate will possess deep expertise in designing, building, and optimizing data pipelines, leveraging Snowflake and PySpark to drive efficient data processing and analytics. As a key member of our team, you will collaborate closely with stakeholders to architect and implement scalable data solutions that meet the organization's needs.

    Roles & Responsibilities :


    • Design, develop, and optimize end-to-end data pipelines using Snowflake, PySpark, and Python.


    • Collaborate with stakeholders to understand data requirements and translate them into technical solutions.


    • Implement best practices for data ingestion, transformation, and storage within the Snowflake environment.


    • Develop and maintain ETL processes to ensure data quality, consistency, and reliability.


    • Utilize PySpark for data processing tasks, including data cleansing, enrichment, and aggregation.


    • Implement data validation and testing frameworks to ensure the accuracy and integrity of data pipelines.


    • Optimize performance and scalability of data pipelines to meet SLAs and business requirements.


    • Work closely with data scientists and analysts to support advanced analytics initiatives.


    • Troubleshoot and debug issues with data pipelines, ensuring timely resolution.


    • Stay updated on emerging technologies and trends in data engineering and cloud computing.

    Skills & Experience Required:


    • Bachelor's degree in Computer Science, Engineering, or a related field.


    • Minimum of 5 years of experience in data engineering, with a focus on Snowflake, Python, and PySpark.


    • Strong proficiency in SQL and experience working with Snowflake for data warehousing.


    • Experience in working with Snowflake concepts like Snowpipe, Streams, Tasks, Cloning, TimeTravel, Data Sharing, Data Replication e.t.c.


    • Expertise in Python programming, including experience with data manipulation, scripting, and automation.


    • Hands-on experience with PySpark for distributed data processing and analytics.


    • Solid understanding of data engineering concepts, including data modeling, ETL/ELT, and data integration.


    • Experience with cloud platforms such as AWS or Azure, with a focus on Snowflake implementation.


    • Familiarity with data visualization tools and techniques is a plus.


    • Strong problem-solving skills and attention to detail.


    • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.


    • Proven ability to manage multiple tasks and priorities in a fast-paced environment.


    • Experience working in an Agile development environment is preferred.

    Education: BE/B.Tech, MCA, MSC, M.Tech