Manager, Data Engineering - Chennai - confidential

    confidential
    confidential Chennai

    5 days ago

    Full time
    Description

    infrastructure meets business needs and is scalable, reliable, and efficient.

    Key Responsibilities:

    1. Team Leadership:

    • Manage, mentor, and guide a team of data engineers, ensuring their professional development and optimizing team performance.
    • Foster a culture of collaboration, accountability, and continuous learning within the team.
    • Lead performance reviews, provide career guidance, and handle resource planning.

    2. Data Engineering Analytics:

    • Design and implement data pipelines, data models, and architectures that are robust, scalable, and efficient.
    • Develop and enforce data quality frameworks to ensure accuracy, consistency, and reliability of data assets.
    • Establish and maintain data lineage processes to track the flow and transformation of data across systems.
    • Ensure the design and maintenance of robust data warehousing solutions to support analytics and reporting needs.

    3. Collaboration and Stakeholder Management:

    • Collaborate with stakeholders, including data scientists, analysts, product managers, engineering managers, and business leaders, to understand business needs and translate them into technical requirements.
    • Work closely with these stakeholders to ensure the data infrastructure supports organizational goals and provides reliable data for business decisions.

    4. Project Management:

    • Drive end-to-end delivery of analytics projects, ensuring quality and timeliness.
    • Manage project roadmaps, prioritize tasks, and allocate resources effectively.
    • Manage project timelines and mitigate risks to ensure the timely delivery of high-quality data engineering projects.

    5. Technology and Infrastructure:

    • Evaluate and implement new tools, technologies, and best practices to improve the efficiency of data engineering processes.
    • Oversee the design, development, and maintenance of data pipelines, ensuring that data is collected, cleaned, and stored efficiently.
    • Ensure there are no data pipeline leaks and monitor production pipelines to maintain their integrity.
    • Familiarity with reporting tools such as Superset and Tableau is beneficial for creating intuitive data visualizations and reports.

    6. Machine Learning and GenAI Integration:

    • Machine Learning: Knowledge of machine learning concepts and integration with data pipelines is a plus. This includes understanding how machine learning models can be used to enhance data quality, predict data trends, and automate decision-making processes.
    • GenAI: Familiarity with Generative AI (GenAI) concepts and exposure is advantageous, particularly in enabling GenAI features on new datasets. Leveraging GenAI with data pipelines to automate tasks, streamline workflows, and uncover deeper insights is beneficial.

    Qualifications and Skills:

    Experience:

    • 10+ years of experience in data engineering, with at least 2 years in a managerial role.
    • Experience in any SaaS company is highly beneficial, as is an understanding of common SaaS business processes, including familiarity with metrics such as customer acquisition costs, retention rates, and revenue growth.
    • Technical Expertise: Strong knowledge of data engineering concepts, including data warehousing, ETL processes, and data pipeline design. Proficiency in SQL, Python, and other data engineering tools.
    • Data Modeling: Expertise in data modeling is essential, with the ability to design and implement robust, scalable data models that support complex analytics and reporting needs. Experience with data modeling frameworks and tools is highly valued.
    • Leadership Skills: Proven ability to lead and motivate a team of engineers while managing cross-functional collaborations.
    • Problem-Solving: Strong analytical and troubleshooting skills to address complex data-related challenge.
    • Communication: Excellent verbal and written communication skills to effectively interact with technical and non-technical stakeholders. This includes the ability to motivate team members, provide regular constructive feedback, and facilitate open communication channels to ensure team alignment and success.
    • Data Architecture: Experience with designing scalable, high-performance data systems and understanding cloud platforms such as AWS, Google Cloud, Data Bricks, Click house, Snowflake, or Azure.
    • Machine Learning and GenAI: Knowledge of machine learning concepts and integration with data pipelines, as well as familiarity with GenAI, is a plus.
    • Data Governance: Experience with data governance best practices is desirable.
    • Open Mindset: An open mindset with a willingness to learn new technologies, processes, and methodologies is essential. The ability to adapt quickly to evolving data engineering landscapes and embrace innovative solutions is highly valued.
  • Work in company

    Data Engineer/Lead Data Engineer

    Only for registered members

    Job summary · Lead the technical design and delivery of scalable data solutions on the Microsoft Azure platform. · Experience : 6 years of hands-on Data Engineering experience · ...

    Chennai

    1 month ago

  • Work in company

    Senior Data Engineer Data Engineering

    Only for registered members

    The Senior Data Engineer will design and build scalable ETL/ELT pipelines across cloud and big data platforms. They will contribute to architectural discussions and lead squads of engineers to deliver quality solutions. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    This role involves working across diverse data sources and modern big data technologies to support high-performance, · data-driven systems. Design efficient scalable data pipelines for ingestion transformation integration. · Work with relational databases NoSQL databases manage o ...

    Chennai, Tamil Nadu, India

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    Design and develop data pipelines and ETL processes using AWS and Snowflake. · Collaborate with data scientists and analysts to understand data requirements.Implement data transformation workflows using DBT (Data Build Tool). · Write efficient code in Python. · Optimize and tune ...

    IN-TN-Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. · Build and maintain ETL pipelines using Fivetran, dbt, and Azure Data Factory · Monitor and support production ETL jobs · ...

    Chennai, Hyderabad, Mumbai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    The Data Engineer is a role focusing on designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, machine learning, and business intelligence initiatives. · Work on Azure data platform to deliver scalable data solutions. · Design, devel ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer responsible for data stewardship of mobile banking platform, · designing data collection, storage & retrieval systems, · guiding team on data management best practices, · & providing data-driven insights about mobile platform.Mandatory skills: Data Engineering (6-10 ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    This is a contract-based Data Engineer role in Chennai responsible for designing scalable data pipelines and collaborating with cross-functional teams. · Designing and maintaining scalable data pipelinesCreate and optimize ETL processesDeveloping and implementing data architectur ...

    Chennai, Tamil Nadu

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    +We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · +- Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, · - Im ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer AWS ETL Cognos EDW Assist in building and maintaining data pipelines using AWS Glue Lambda and Snowflake Write SQL queries and Python scripts for data extraction transformation and loading Support ETL/ELT development to ingest and transform data into Snowflake and A ...

    Chennai

    1 week ago

  • Work in company Remote job

    Data Engineer

    Only for registered members

    Data Engineer position required for building and maintaining data pipelines using Python programming and modern data engineering practices. · Design and develop ETL pipelines for structured and unstructured data. · Implement efficient data ingestion transformation processes using ...

    Chennai, Tamil Nadu

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database, Knowledge Graphs like Neo4j and StarDog. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    +We re seeking a talented Data Engineer with hands on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database Knowledge Graphs like Neo4j and StarDog. · ...

    Chennai, Tamil Nadu

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a Data Engineer with strong expertise in Microsoft Fabric and Microsoft Purview to design, build and govern scalable data platforms for enterprise clients. · ...

    Greater Chennai Area

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    NPCI is hiring Data Engineers who are well-versed with Big data technologies. · ...

    Chennai, Hyderabad, Mumbai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    The Data Engineer is responsible for designing and building scalable data pipelines and infrastructure to support analytics initiatives. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    The Data Engineer is a role focusing on designing, building and maintaining scalable data pipelines and infrastructure to support analytics, machine learning and business intelligence initiatives. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We're seeking a talented data engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database, Knowledge Graphs like Neo4j and StarDog. · ...

    Chennai, Tamil Nadu

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We're looking for a Data Engineer who's eager to build reliable, secure, and scalable data pipelines. · Data Pipelines & ETL/ELT · Develop, schedule, and monitor ELT/ETL pipelines in Python to ingest data from APIs, files, and databases into Snowflake. · Implement transformations ...

    Chennai

    5 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a Senior Lead Data Engineer to join NPCIs Data Solutioning and Architecture team. · ...

    Chennai, Hyderabad

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer for dynamic team responsible for technical design and implementation of data engineering solutions on Azure. · ...

    Chennai, Tamil Nadu

    1 month ago

Jobs
>
Manager data engineering
>
Jobs for Manager data engineering in Chennai