Mid-Level Data Engineer - Chennai - Bmw Techworks India

    Bmw Techworks India
    Bmw Techworks India Chennai

    3 days ago

    Full time
    Description
    • Provide estimates for requirements, analyze and develop as per the requirement.
    • Developing and maintaining data pipelines and ETL (Extract, Transform, Load) processes to extract data efficiently and reliably from various sources, transform it into a usable format, and load it into the appropriate data repositories.
    • Creating and maintaining logical and physical data models that align with the organizations data architecture and business needs. This includes defining data schemas, tables, relationships, and indexing strategies for optimal data retrieval and analysis.
    • Collaborating with cross-functional teams and stakeholders to ensure data security, privacy, and compliance with regulations.
    • Collaborate with downstream application to understand their needs and build the data storage and optimize as per their need.
    • Working closely with other stakeholders and Business to understand data requirements and translate them into technical solutions.
    • Identify risks and provide relevant solutions to complex problems and on-time delivery
    • Familiar with Agile methodologies and have prior experience working with Agile teams using Scrum/Kanban
    • Proficiency in Software Development best practices - Secure coding standards, Unit testing, Code coverage, Quality gates.
    • Ability to lead and deliver change in a very productive way.
    • Lead Technical discussions with customers to find the best possible solutions.
    • Working closely with the Project Manager, Solution Architect and managing client communication (as and when required)
    • Proactively identify and implement opportunities to automate tasks and develop reusable frameworks.
    • Collaborate with the other team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms.
    • Provide technical write-ups and drawings to promote the proposed solutions.

    What should you bring along

    Must Have

    • Must have knowledge of Data analytics
    • Must have knowledge of Building an application using AWS Services.
    • Hand on Expertise of 10+ years in AWS services like S3, Lambda, Glue, Athena, RDS, Step functions, Amazon Q, SNS, SQS, API Gateway, Security, Access and Role permissions, Logging and monitoring Services.
    • Good hand on knowledge on Python, Spark, Hive and Unix, AWS CLI
    • Hand on experience in the Terraform, GIT, GIT Actions. CICD pipeline
    • Excellent knowledge in Data modeling and Designing ETL pipeline.
    • Must have strong knowledge in using different databases such as MySQL, Oracle and Writing complex queries.
    • Strong experience working in a continuous integration and Deployment process
    • Ability to learn quickly, be organized and detail oriented.

    Nice to Have:

    • AI Project implementation and AI methods.

    Must have technical skill

    • Pyspark , AWS, SQL

    Good to have Technical skills

    • Terraform, GIT, GIT Actions. CICD pipeline, AI
  • Work in company

    Data Engineer

    Only for registered members

    We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record. · Nous recherchons un ingénieur des données talentueux avec une expérience pratique dans l'écosystème de données Google Cloud et un bilan probant.Data Pip ...

    Chennai

    2 weeks ago

  • Work in company

    Azure Data Engineer

    Only for registered members

    Python/ Pyspark · Azure, Synapse, Data factory, data bricks · SQL · ...

    Chennai

    3 days ago

  • Work in company

    Data Scientist/ML Engineer

    Only for registered members

    Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. · Liderar el diseño y el desarrollo de modelos de aprendizaje automático y soluciones AI para resolver problemas empresariales. · Seleccionar modelos ...

    Chennai, Tamil Nadu

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record of working with Vector Database, Knowledge Graphs like Neo4j and StarDog. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for experienced Data Engineers who are passionate about innovation and eager to work on large-scale, cutting-edge data engineering projects in a collaborative and inclusive environment. · ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Job Overview · We are seeking a highly skilled and experienced Senior Data Engineer to join our team at Chiselon Technologies Pvt Ltd. This is a full-time position with hybrid and remote working options available. The successful candidate will have between 5 to 15 years of work e ...

    Chennai ₹10,000,000 - ₹30,000,000 (INR) per year

    3 days ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer responsible for data stewardship of mobile banking platform, · designing data collection, storage & retrieval systems, · guiding team on data management best practices, · & providing data-driven insights about mobile platform.Mandatory skills: Data Engineering (6-10 ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer AWS ETL Cognos EDW Assist in building and maintaining data pipelines using AWS Glue Lambda and Snowflake Write SQL queries and Python scripts for data extraction transformation and loading Support ETL/ELT development to ingest and transform data into Snowflake and A ...

    Chennai

    3 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a highly skilled Data Engineer (Cloud, AI & Analytics) with strong hands-on experience across cloud data engineering, advanced analytics, · and artificial intelligence.- Architect, design and maintain scalable data pipelines · and enterprise data models to supp ...

    Chennai

    3 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    We believe that DevOps has transformed from an aspiration to now a practical science. We built our platform to help organizations accelerate their DevOps adoption and reach peak innovation velocity. · ...

    Chennai, Tamil Nadu

    4 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Senior Data Engineer with strong architectural experience and deep hands-on expertise in Databricks. The ideal candidate will design, build and optimize scalable data solutions while solving complex data engineering problems. · Design and implement data engin ...

    Chennai

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    NPCI is hiring Data Engineers who are well-versed with Big data technologies. · ...

    Chennai, Hyderabad, Mumbai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    +Join us as a Data Engineer to build effortless, digital first customer experiences. · +Carrying out data engineering tasks to build, maintain, test and optimise a scalable data architecture, · Carrying out data extractions, transforming data to make it usable to data analysts an ...

    Chennai, Tamil Nadu

    1 week ago

  • Work in company

    Data Engineer

    Only for registered members

    Hiring – Data Engineer in Chennai for 3–5 years of experience with Python, SQL, PySpark and strong data engineering fundamentals. · ...

    Chennai, Tamil Nadu

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    We are looking for a Senior Data Engineer – Transformations & dbt to join a Snowflake-centric enterprise data platform team. · ...

    Chennai, Tamil Nadu

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    Data Engineer · Chiselon Technologies Pvt Ltd is seeking an experienced Senior Data Engineer to join our team in Chennai. · We require proficiency in Python for scripting and automating data workflows. · Expertise in Data Architecture to design scalable and efficient data storage ...

    Chennai ₹900,000 - ₹2,500,000 (INR) per year

    4 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a Senior Lead Data Engineer to join NPCIs Data Solutioning and Architecture team. · ...

    Chennai, Hyderabad

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    +We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. · +- Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, · - Im ...

    Chennai

    1 month ago

  • Work in company

    Data Engineer

    Only for registered members

    Greetings from Colan Infotech · Designation - DATA Engineer / Analytics Engineer · Experience - 5+ Years · Job Location - Chennai · Notice Period - Immediate to 15 Days · Required Skills · ● Strong proficiency in SQL and experience with data modeling and schema design such as s ...

    Chennai ₹900,000 - ₹2,500,000 (INR) per year

    2 days ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team. · The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, · and programming expertise in Python (PySpark), Scala, and Java.Designing, developing, and ...

    Chennai, Tamil Nadu

    2 weeks ago

  • Work in company

    Data Engineer

    Only for registered members

    We are seeking a skilled Data Engineer with strong experience in Snowflake and SQL along with working knowledge of Azure Data Factory (ADF) and Python. · ...

    Chennai

    4 weeks ago

Jobs
>
Chennai