Jobs
>
Chennai

    Senior Data Engineer - Chennai, India - hubwork

    hubwork
    hubwork Chennai, India

    1 day ago

    Default job background
    permanent Technology / Internet
    Description

    Summary :
    We are looking for a data engineer who has experience in building data pipelines for large data platforms.

    This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs.

    This role will be augmented with a customer of Intellect and other third parties in delivering streaming and batch processes.


    This role will collaborate with product managers, scrum masters / project managers, data analysts, data engineers, and test engineers to understand the product roadmap, product requirements and translate them into performant and reusable data pipelines.

    Proficiency in cloud infrastructure, data warehousing, data security, modeling, and metadata management is must.


    This role is expected to drive discussions and able to influence different personas to arrive at a solution that is right for our client.

    This role is to lead experienced data engineers in architecting, desiging, developing, and maintaining large scale data platform.

    Key Skills and Experience Required :

    • 10+ years experience in architecting, designing, and developing large scale data solutions.
    • 10+ years experience in building and maintaining ETL/ELT pipelines
    • 5 years experience in developing streaming processes / systems
    • Proficiency in various data management concepts such as :
    • Master Data Management
    • Data Architecture
    • Data Modeling
    • Data Quality
    • Excellent design and development experience with SQL and NoSQL database, OLTP and OLAP databases
    • Expertise in Python and Scripting (Shell / JavaScript)
    • Expertise in Apache Kafka and ETL/ELT Job schedulers
    • 3+ years experience in building data platforms on Snowflake
    • 3+ years experience in using Matillion ETL
    • Experience working with AWS cloud
    • Strong experience in SQL
    • Working experience with Jenkins
    • Ability to visualize data in Excel / Power BI / Tableau / Qlik or other BI tools
    • Experience in developing and maintaining CI/CD for cloud data technologies
    )
  • KloudPortal ™ - SaaS | Product Marketing

    Data Engineer

    6 days ago

    KloudPortal ™ - SaaS | Product Marketing Chennai, India

    Job Description for Data Engineer: · KloudPortal Technology Solutions Private limited offers a range of software solutions to clients worldwide. We take pride in creating solutions that are scalable, optimal and effective. Our team of 60+ engineers is diverse and welcoming. · Abo ...

  • HTC Global Services

    Data Engineer

    4 days ago

    HTC Global Services Chennai, India

    Position Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...

  • OptiSol Business Solutions

    Data Engineer

    1 day ago

    OptiSol Business Solutions Chennai, India

    Position: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...

  • Mindsprint

    Data Engineer

    1 day ago

    Mindsprint Chennai, India

    Job Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...

  • Mobile Programming LLC

    Data Engineer

    1 day ago

    Mobile Programming LLC Chennai, India

    Job Role : · Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data ...

  • Movate

    Data Engineer

    6 days ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • InfoCepts

    Data Engineering

    3 days ago

    InfoCepts Chennai, India

    Position: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...

  • System Soft Technologies

    Data Engineer

    13 hours ago

    System Soft Technologies Chennai, India

    Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...

  • Movate

    Data Engineer

    1 week ago

    Movate Chennai, India

    Role: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...

  • iTechMinds Consulting LLP

    Data Engineer

    1 day ago

    iTechMinds Consulting LLP Chennai, India

    Position : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...

  • Ashley Global Capability Center

    Data Engineer

    1 day ago

    Ashley Global Capability Center Chennai, India

    Primary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...

  • OptiSol Business Solutions

    Data Engineer

    6 days ago

    OptiSol Business Solutions Chennai, India

    Position: Data EngineerExperience: 5-10 yrs.Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for a ...

  • Blackstraw

    Data Engineer

    5 hours ago

    Blackstraw Chennai, India

    Data Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...

  • HTC Global Services

    Data Engineer

    1 day ago

    HTC Global Services Chennai, India

    Data Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...

  • Randstad

    Data Engineer

    3 days ago

    Randstad Chennai, India permanent

    Role : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...

  • IDP Education

    Data Engineer

    6 days ago

    IDP Education Chennai, India

    An ASX100 business part that is owned by Australian universities, IDP is a pioneer in international education services. Our · core business lines include student placement to Australia, US, UK, Canada and New Zealand institutions, English-language testing and training.We are on a ...

  • TIGI HR Solution Pvt. Ltd.

    Data Engineer

    3 days ago

    TIGI HR Solution Pvt. Ltd. Chennai, India permanent

    Job Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...

  • Change leaders

    Data Engineer

    1 day ago

    Change leaders Bangalore/Mumbai/Pune/Chennai/Kolkata/Noida, India permanent

    Primary Skill : · GCP + Python + SQL · OR · - GCP + Java + SQL · NP : Immediate to 35 Days max · Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineer ...

  • Gainwell Technologies LLC

    Data Engineer

    7 hours ago

    Gainwell Technologies LLC Chennai, India

    Summary · We're looking for a dynamic data engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell Technologies. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, ...

  • Coders Brain Pvt Ltd

    Data Engineer

    3 days ago

    Coders Brain Pvt Ltd Chennai, India permanent

    JD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all aspects of the soft ...