Jobs
>
Data Engineer

    Data Engineer - Coimbatore, India - XANDER CONSULTING AND ADVISORY PRIVATE LIMITED

    XANDER CONSULTING AND ADVISORY PRIVATE LIMITED
    XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Coimbatore, India

    5 days ago

    Default job background
    permanent Technology / Internet
    Description

    Job Description :
    Design, Develop and maintain ETL pipelines using Pyspark in Azure Databricks using delta tables.

    • Create build from Github and release pipeline for Ingestion and Databricks using Azure Devops / Harness
    • Monitor Performance of ETL Jobs, resolve any issue that arose and improve the performance metrics as needed.
    • Diagnose system performance issue related to data processing and implement solution to address them.
    • Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
    • Maintain integrity and quality across all pipelines and environments.
    • Understand and follow secure coding practice to make sure code is not vulnerable

    Skills :

    • Should have Strong background in Software development with experience in ingest, transform and store data from large datasets using Pyspark in Azure Databricks with strong knowledge on distributed computing concepts.
    • Must have hands on experience in designing and developing ETL Pipelines in Pyspark in Azure Databricks with strong python scripting exposure like list comprehensions, Dictionary variables etc.
    • Must have minimum 5 years of exposure and good proficiency in data warehousing concepts.
    • Proficient in SQl and database Design concepts.
    • Hands on experience with good proficiency in Delta table and delta file operations like merge, Insert override, Partition overrides etc.
    • Hands on Experience in CICD in Azure DevOps/Harness and ADF/Stone branch for orchestration.
    • Knowledge of Azure cloud computing platform with Azure Synapse, ADLS.
    • Knowledge on GitHub and build management.
    • Passion for data and experience working within a data driven organization
    • Excellent presentation, communication (oral & written), and relationship building skills, across all levels of management
    )
  • XANDER CONSULTING AND ADVISORY PRIVATE LIMITED

    Data Engineer

    5 days ago

    XANDER CONSULTING AND ADVISORY PRIVATE LIMITED Coimbatore, India permanent

    Job Description · Primary Skills : Databricks with Pyspark, Python · Secondary skills; ADF · - 6+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools. · - 4+ years of work experience with very large data war ...

  • DataWeave

    Senior Data Engineer

    5 days ago

    DataWeave Coimbatore, India

    ABOUT US · Data Weave provides Retailers and Brands with "Competitive Intelligence as a Service" that enables them to take key decisions that impact their revenue. Powered by AI, we provide easily consumable and actionable competitive intelligence by aggregating and analyzing bi ...

  • Spectrum Talent Management Private Limited

    Azure Data Engineer

    5 days ago

    Spectrum Talent Management Private Limited Coimbatore, India permanent

    Job Description : · Design, develop, and maintain data pipelines using Azure Data Factory (ADF). · - Work closely with customers to understand their business requirements and translate them into scalable, performant, and secure data integration solutions. · - Develop and maintain ...

  • BlueByte Technologies

    Senior Data Engineer

    5 days ago

    BlueByte Technologies Coimbatore, India permanent

    Job Title : Sr. DATA Engineer · Location : Coimbatore · Position Type : Full-Time / 6 months contract to hire · Key Responsibilities : · Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable forma ...

  • BlueByte Technologies

    Data Engineering Lead

    5 days ago

    BlueByte Technologies Coimbatore, India permanent

    Job Title : Data Engineering Lead (With Architecture Experience) · Location : Coimbatore · Position Type : Full-Time · Key Responsibilities : · Architect and Design Data Solutions : · - Collaborate with cross-functional teams to understand business requirements and design scalab ...

  • mindcurv group

    Senior Data Engineer

    2 days ago

    mindcurv group Coimbatore, India

    About MindcurvWe help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the market's need ...

  • mindcurv group

    Senior Data Engineer

    4 days ago

    mindcurv group Greater Coimbatore Area, India

    About Mindcurv · We help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the market's ne ...

  • QBrainX

    Data Modeler/Engineer

    18 hours ago

    QBrainX Coimbatore, India permanent

    Job Title : Data Modeler / Data Engineer - Data modeling · Exp level : 12 years · Job Location : Coimbatore (Work from Office from Day 1) · Salary is not a constraint for the right candidate. · Immediate joiners preferred or Someone who can join us within 15 to 30 days of time. · ...

  • Dotflick Solutions

    Data Governance Engineer

    5 days ago

    Dotflick Solutions Bangalore/Bhubaneshwar/Tamil Nadu/Chennai/Madurai/Coimbatore, India permanent

    Role : Data Governance Engineer · Job Description : · - Participate in establishing data/database standards, defining best practices for data management, defining requirements for governance frameworks/policies such as Retention, PII handling, RBAC etc. · - Conduct regular audits ...

  • timesjobs

    DataWeave - Support Engineer Data Operations - Coimbatore

    2 hours ago

    timesjobs Coimbatore, India Full time

    · Support Engineer Data Operations - Coimbatore · About DataWeave Digital Commerce capabilities are fundamental to winning todays shoppers. The pandemic has accelerated eCommerce adoption across the globe with multiple options for consumers to research, compare and buy products. ...

  • SWATSYS

    DevOps Engineer

    6 days ago

    SWATSYS Coimbatore, India

    Company Description · SWATSYS is a IT technology consulting startup and training firm based in Coimbatore. With a strong focus on Information Technology Services and Consulting, SWATSYS provides cutting-edge solutions to clients worldwide. To learn more about our company, visit o ...

  • CIRCOR International, Inc.

    Application Engineer

    3 days ago

    CIRCOR International, Inc. Coimbatore, India

    POSITION DETAILS · Position Summary · The Applications Engineer is responsible for supporting and working with customers which include distributors, agents and end user accounts. Will be part of a team providing high performance engineered solutions to the market. Under direction ...

  • Turbostart

    Python Developer

    5 days ago

    Turbostart Coimbatore, India

    Who are we: · The world of startups is changing. More importantly, startups are changing the world. At Turbostart Technology Centre (T2C), you have the opportunity to be part of the evolution of cutting edge technology solution development across multiple domains including EdTech ...

  • Objectways

    Product Manager

    6 days ago

    Objectways Coimbatore, India

    Company Description · Objectways is a boutique shop that specializes in solving complex problems in Big data analytics, Machine Learning, Artificial intelligence, and lOT analytics. We believe in working closely with our customers to provide customized solutions and architecture. ...

  • Aventra Group

    Senior Software Engineer C++, C#, Fortran

    3 days ago

    Aventra Group Coimbatore, India

    Job descriptionCompany Description · Aventra Group is a boutique IT consultancy that provides Enterprise Digital Solutions, Application Development, and Managed Services. They specialize in cloud infrastructure, cybersecurity, data management, advanced analytics, artificial intel ...

  • Maxbyte Technologies

    Quality Analyst

    4 days ago

    Maxbyte Technologies Coimbatore, India

    Company Description · Maxbyte Technologies is a leading industrial digitalization, robotization, and decarbonization solutions provider based in Coimbatore. Our mission is to enable smart and sustainable industrial enterprises by offering innovative solutions for productivity, fl ...

  • Kumaraguru College of Technology

    Assistant Professor

    5 days ago

    Kumaraguru College of Technology Coimbatore, India

    KCT is a premier Educational Institution in Tamil Nadu offering Engineering and Management education for the past three decades. Spread over a campus area of 150 acres, the college has 6,000 top rank students. It offers 13 undergraduate and 14 post graduate programs including MBA ...

  • The Career Works

    Full Stack Engineer

    9 hours ago

    The Career Works Coimbatore, India

    Our client a IT services company is looking to hire Full Stack Engineer. This team of experienced digital enthusiasts that strive to deliver innovative concepts and quality results to their clients. Their focus is on creating effective solutions that not only result in an eye-cat ...

  • Tatmeem Private Limited

    Quality Control Engineer

    4 days ago

    Tatmeem Private Limited Coimbatore, India

    Ideal candidate should meet the following criteria · BE Mechanical · should have 3 - 5 years work experience as quality control engineer with industrial valves manufacturing sector. · Developing and implementing quality control procedures to identify defects or deviations in th ...

  • EQI Ltd.

    Product Engineer

    5 days ago

    EQI Ltd. Coimbatore, India

    About EQI · EQI sources metal castings, forgings, and fabrications from carefully selected suppliers around the globe. EQI manages every aspect of the product life-cycle -- from Product Development to Production Qualification to Logistics and Vendor Managed Inventory Services. Th ...