Jobs
>
Chennai

    Data Engineer - Chennai, India - SGS Technical Services Pvt. Ltd

    SGS Technical Services Pvt. Ltd
    SGS Technical Services Pvt. Ltd Chennai, India

    1 day ago

    Default job background
    Description

    Job Title : Data : Chennai, India


    Immediate Joiners Preferred: Notice period of up to 15 Keywords : Python Py spark ,SQL, with azure, data pipeline, Data warehouse (like snowflake) ETL control

    Job Description :

    We are seeking a highly skilled Data Engineer to join our team in Chennai. The ideal candidate should have strong expertise in Python, PySpark, SQL, Azure services, data pipelines, and data warehouse technologies like Snowflake. If you're passionate about building robust ETL processes and ensuring data quality and reliability, we want to hear from you.

    Responsibilities :

    • Design, develop, and maintain scalable data pipelines using Python and PySpark.
    • Collaborate with cross-functional teams to understand data requirements and design appropriate solutions.
    • Implement ETL processes to extract, transform, and load data from various sources into our data warehouse (e.g., Snowflake).
    • Optimize data pipelines for performance, reliability, and scalability.
    • Ensure data quality and integrity throughout the ETL process.
    • Monitor and troubleshoot production data pipelines to ensure smooth operation.
    • Work closely with stakeholders to understand business needs and translate them into technical requirements.
    • Provide technical guidance and support to junior team members.

    Requirements :

    • Bachelor's degree in computer science, Engineering, or a related field.
    • Proven experience as a Data Engineer or similar role.
    • Strong programming skills in Python and proficiency in SQL.
    • Hands-on experience with PySpark for big data processing.
    • Familiarity with cloud platforms, particularly Azure.
    • Experience building and maintaining data pipelines.
    • Knowledge of data warehouse concepts and experience working with platforms like Snowflake.
    • Strong understanding of ETL principles and best practices.
    • Excellent problem-solving and communication skills.
    • Ability to work independently and as part of a team in a fast-paced environment.
    • Expert knowledge in any of the following ETL processes ETL control tables, Error logging, Auditing.
    • Solid working experience on writing ETL jobs using standard components.
    • Ability to spin new ETL jobs or modify the existing job based on requirements.
    • Ability to support & troubleshoot any existing ETL jobs for failures and suggest fix to avoid failures.
    • Build and maintain complex ETL and data pipelines to load and maintain data.
    Preferred Qualifications :
    • Experience with other big data technologies such as Apache Spark, Hadoop, or Kafka.
    • Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
    • Knowledge of data governance and compliance standards.
    • If you meet the above qualifications and are ready to take on this exciting challenge, we encourage you to apply and become part of our dynamic team
    )
  • InfoCepts

    Data Engineering

    1 day ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • BU Soft Tech

    Data Engineer

    2 days ago

    BU Soft Tech Chennai, India

    Experience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...

  • Aspire Systems

    Data Engineer

    19 hours ago

    Aspire Systems Chennai, India

    Data Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...

  • Movate

    Data Engineer

    5 days ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • OptiSol Business Solutions

    Data Engineer

    1 week ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • Blackstraw

    Data Engineer

    6 days ago

    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...

  • HTC Global Services

    Data Engineer

    2 days ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • Mindsprint

    Data Engineer

    1 week ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • culture highway

    Data Engineer

    1 day ago

    culture highway Chennai, India

    Job Description : · Tech Anchor- Data Engineering Role Overview : · Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. You will be responsible for designing, implementing and optimizing data pipelines, ensuring data qu ...

  • iTechMinds Consulting LLP

    Data Engineer

    1 week ago

    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • Ashley Global Capability Center

    Data Engineer

    1 week ago

    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • Randstad

    Data Engineer

    1 day ago

    Randstad Chennai, India

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • HTC Global Services

    Data Engineer

    1 week ago

    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • Makonis

    Data Engineer

    19 hours ago

    Makonis Chennai, India

    Work Location: Chennai & Coimbatore · Required Exp: 3 to 6yrs (Fulltime Position) · Client: Leading Investment Bank · Mandatory skills: · We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. · If that matches your profile, please share a copy o ...

  • Movate

    Data Engineer

    23 hours ago

    Movate Chennai, India

    Role - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    1 day ago

    TIGI HR Solution Pvt. Ltd. Chennai, India

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • CliqHR

    Data Engineer

    1 day ago

    CliqHR Chennai, India

    Job Description : · Mandatory Skills : GCP, Python, SQL, Snap logic, Airflow, Data flow · - 6-8 years of experience in to GCP Data engineer. · - GCP Components (Composer, BQ, Data flow, Pub/Sub, Cloud functions, GCS storage) Intermediate · - SQL Advanced level · - ETL Processing ...

  • Optisol Business Solutions

    Data Engineer

    1 day ago

    Optisol Business Solutions Chennai, India

    Position : Data Engineer( Senior/Lead) · Experience : 4-10 yrs. · Locations : : Immediate -15 Days (Preferred) · Required Candidate Profile : · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pi ...

  • System Soft Technologies

    Data Engineer

    1 week ago

    System Soft Technologies Chennai, India

    Job Summary:We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ena ...