Jobs
>
Data Engineer
>
Chennai

    Data Engineer - chennai, India - ADVANSOFT

    ADVANSOFT
    Default job background
    Technology / Internet
    Description

    Skills :

    • Hadoop
    • Python
    • Spark
    • PySpark
    • ETL (Extract, Transform, Load)

    Roles & Responsibilities :

    • Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.
    • Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and performance.
    • Data Modeling: Design and implement data models that facilitate efficient querying and analysis of structured and unstructured data.
    • ETL Development: Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and integrate data from different sources into data warehouses or data lakes.
    • Performance Tuning: Optimize data processing workflows and queries to improve performance and reduce processing times.
    • Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data.
    • Data Governance: Enforce data governance policies and standards to ensure compliance with regulatory requirements and industry best practices.

    Documentation:
    Maintain documentation for data pipelines, data models, and ETL processes to facilitate knowledge sharing and troubleshooting.

    • Collaboration: Collaborate with crossfunctional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
    • Continuous Improvement: Stay updated with emerging technologies and best practices in data engineering, and proactively identify opportunities for process optimization and automation.
    )


  • Seven Consultancy chennai, India

    SALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...


  • Seven Consultancy Chennai, India

    SALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...

  • BU Soft Tech

    Data Engineer

    1 day ago


    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • OptiSol Business Solutions

    Data Engineer

    1 day ago


    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible ...

  • InfoCepts

    Data Engineering

    1 day ago


    InfoCepts Chennai, India

    Position: · Data Engineering - Project Manager · Location: · Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, ...

  • Aspire Systems

    Data Engineer

    1 day ago


    Aspire Systems Chennai, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Movate

    Data Engineer

    1 week ago


    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • Ashley Global Capability Center

    Data Engineer

    1 week ago


    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • HTC Global Services

    Data Engineer

    1 day ago


    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • Mindsprint

    Data Engineer

    3 days ago


    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • Blackstraw

    Data Engineer

    1 day ago


    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: · We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exam ...

  • Cynosure Corporate Solutions

    Data Engineer

    1 day ago


    Cynosure Corporate Solutions Chennai, India

    Lead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data wareh ...

  • HTC Global Services

    Data Engineer

    1 week ago


    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • System Soft Technologies

    Data Engineer

    1 day ago


    System Soft Technologies Chennai, India

    · Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, ...

  • Makonis

    Data Engineer

    1 day ago


    Makonis Chennai, India

    Work Location: Chennai & Coimbatore Required Exp: 3 to 6yrs (Fulltime Position) Client: Leading Investment Bank Mandatory skills: We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. If that matches your profile, please share a copy of your res ...

  • culture highway

    Data Engineer

    1 day ago


    culture highway chennai, India

    Job Description : · Tech Anchor- Data Engineering Role Overview : · Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. You will be responsible for designing, implementing and optimizing data pipelines, ensuring data ...

  • Notus

    Data Engineer

    1 day ago


    Notus chennai, India

    AWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintai ...

  • Movate

    Data Engineer

    1 day ago


    Movate Chennai, India

    Role · - Data Engineer · Years of Exp- · : 5 Years – 8Years · Location · - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analy ...

  • ResourceTree Global Services

    Data Engineer

    1 day ago


    ResourceTree Global Services chennai, India

    Job Description : · ResourceTree Global Services is hiring Senior Data Engineer Role for one of its Data Analytics Client. Below are the details · Role : Senior Data Engineer - Azure · Primary Skills : ADF (Azure Data Factory), SQL · Experience : 4 - 6 Years · Location : Ch ...

  • ResourceTree Global Services

    Data Engineer

    1 day ago


    ResourceTree Global Services chennai, India

    ResourceTree Global Services is hiring Senior Data Engineer(Snowflake & DBT) for one of its Data Analytics Client. Below are the details. · Role: Senior Data Engineer(Snowflake & DBT) · Primary Skills: DBT,Snowflake · Secondary Skills: 4 to 6 Years · Location: Chennai · Role f ...