Jobs
>
Chennai

    Big Data Engineer - Bangalore/Chennai/Pune, India - ADVANSOFT

    Default job background
    permanent Technology / Internet
    Description
    We are hiring for Data engineer with top most MNC client;

    Exp : 5+years


    Np :
    immediate to 15days


    Location :
    & Responsibilities :


    5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.


    • Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.
    • Developing scalable streaming solutions based on Hadoop/ Big Data stack such as HDFS, Ozone, Hive/ Impala, Apache Spark, and Kafka.
    • Experience in Data Engineering and implementation. multiple e endtoend DW projects in a Big Data environment.
    • Experience in building data pipelines through Git, Shell, Spark with Java/ Python on Hadoop, or Object storage (S3/CEPH).
    • Strong analytical skills are required for debugging production issues, providing root causes, and implementing mitigation plans.
    • Strong communication skills, both verbal and written and strong relationship, collaboration skills, and organizational skills.
    • Flexible enough to stretch and work in India time to coordinate with the India team.

    Experiences :

    • Nice to have development experience in Pythonbased Al/ML workloads on Hadoop.
    • Experience working on Nifi, APLS, and Unix Environments will be an added advantage.
    • Experience of working in Agile teams.
    • Ability to multitask across multiple projects, interface with external and internal resources, and provide technical leadership to junior team members.
    • Ability to be highenergy, detailoriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and selfmotivation to drive results.
    • Ability to quickly learn and implement new technologies and perform POC to explore the best solution for the problem statement.
    • Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
    • Perform assigned tasks and production incidents independently.
    )

  • OptiSol Business Solutions

    Data Engineer

    1 day ago


    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • HTC Global Services

    Data Engineer

    4 days ago


    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • Ashley Global Capability Center

    Data Engineer

    1 day ago


    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • Mindsprint

    Data Engineer

    1 day ago


    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • InfoCepts

    Data Engineering

    3 days ago


    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • HTC Global Services

    Data Engineer

    1 day ago


    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • System Soft Technologies

    Data Engineer

    21 hours ago


    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Movate

    Data Engineer

    1 week ago


    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • iTechMinds Consulting LLP

    Data Engineer

    1 day ago


    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • Blackstraw

    Data Engineer

    13 hours ago


    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...

  • Movate

    Data Engineer

    2 days ago


    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    3 days ago


    TIGI HR Solution Pvt. Ltd. Chennai, India permanent

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • Randstad

    Data Engineer

    3 days ago


    Randstad Chennai, India permanent

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • Mobile Programming LLC

    Data Engineer

    1 day ago


    Mobile Programming LLC Chennai, India

    Job Role : · Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data ...

  • iMind Your Business Solutions Private Limited

    Data Engineer

    1 day ago


    iMind Your Business Solutions Private Limited Chennai/Mumbai/Pune, India permanent

    Company Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...

  • Coders Brain Pvt Ltd

    Data Engineer

    4 days ago


    Coders Brain Pvt Ltd Chennai, India permanent

    JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all aspects of the soft ...

  • CliqHR

    Data Engineer

    3 days ago


    CliqHR Chennai, India permanent

    Job Description : · Mandatory Skills : GCP, Python, SQL, Snap logic, Airflow, Data flow · - 6-8 years of experience in to GCP Data engineer. · - GCP Components (Composer, BQ, Data flow, Pub/Sub, Cloud functions, GCS storage) Intermediate · - SQL Advanced level · - ETL Processing ...

  • System Soft Technologies

    Data Engineer

    4 days ago


    System Soft Technologies Chennai, India

    Job Summary:We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ena ...

  • Change leaders

    Data Engineer

    1 day ago


    Change leaders Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, India permanent

    Primary Skill : · GCP + Python + SQL · OR · - GCP + Java + SQL · NP : Immediate to 35 Days max · Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineer ...

  • Vysystems

    Data Engineer

    1 day ago


    Vysystems Chennai, India

    Top job opening for MNC Company · We have an immediate opening for "Data Engineer" with MNC Company for permanent Position - Chennai Location · Job Description : · Roles and Responsibilities: · Critical Skills to Possess: · Essential: · - Strong experience with Postgres and SQL a ...