Jobs
>
Mumbai

    Lead Data Engineer - Mumbai, India - Sampoorna Consultants Pvt. Ltd

    Default job background
    permanent Technology / Internet
    Description


    Client is looking out for a technical delivery leader on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.


    The role will drive the development of data processing frameworks and architectural approaches that scale to handle the business's growing demands.


    This hands-on role requires technical expertise to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.


    The key accountabilities:

    • Design data solutions to meet business, technical and user requirements. This includes building modern data pipelines that meet functional/nonfunctional business requirements and provide endtoend data solutions
    • Participate in proofsofconcept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialisation
    • Contribute to ongoing management of the platform, including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues
    • Identify, design, and implement process improvements: automating manual processes, optimising data delivery, redesigning infrastructure for greater scalability
    • Technical ownership for data and data pipelines to ensure compliance with data standards, architectural standards, and achievement of business requirements
    • Build a strong understanding of platform architecture and the best way to leverage it to achieve effective outcomes for a given project
    • Support compliance with data, information and security management requirements

    Technical qualifications & skills:

    • Experience in building and maintaining realtime data pipelines.
    • Expected experience using the following tech stack:
    1. dbt


    • SQL
    • SQL
    Spark


    • Python
    • Dagster/Airflow

    Preferred but not mandatory:

    • Kubernetes and Terraform


    • CI/CD

    • Github actions, CircleCI


    • Datadog / Cloudwatch

    • Logging
    • Prior work with streamprocessing systems (e.g., Kafka, Kinesis).
    • Exposure to Trino, Dagster, Cubejs, metabase/looker will be advantageo
    )

  • Versor

    Data Engineer

    1 day ago


    Versor Mumbai, India permanent

    Job Description : · The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate closely with senior researchers to design and develop a large-scale data lake. We are seeking candidates who have excelled in engineering ...

  • NeerInfo Solutions

    Data Engineer

    12 hours ago


    NeerInfo Solutions Mumbai, India

    The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. You will test your code, identify errors, and iterate to ensure quality code. You will also support our customers and partners by troubleshooting any of the ...

  • HR PLACEMENT CONSULTANTS (HRPC)

    Data Engineer

    5 days ago


    HR PLACEMENT CONSULTANTS (HRPC) Mumbai, India

    Position- Data Engineer · Location-Mumbai · Total Experience 4+ years · Domain/Vertical Insurance and / or Finance (preferred) · Qualifications Educational  MSc/MCS/BE/B.Sc : Computer Science / Maths / IT · Certifications  Data Engineering / Analytics / Databases etc. · Experie ...

  • Virtusa

    Data Engineer

    14 hours ago


    Virtusa Mumbai, India

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...

  • 2coms

    Data Engineer

    4 days ago


    2coms Mumbai, India

    Job Description · Looking For Data Engineer Professionals For Global IT MNC @Mumbai · Greetings From 2COMS · Job Title: Data EngineerJob Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools · from Mic ...

  • OIL FIELD INSTRUMENTATION

    data engineer

    14 hours ago


    OIL FIELD INSTRUMENTATION Mumbai, India

    Experience : 4+ years of Mud Logging experience as Data Engineer in India and abroad, both onshore and offshore rig operations. Deep Water experience will be an advantage. Proficient with real-time data monitoring and data management, WITSML transmission, gas detection and analy ...

  • Visionyle Solutions

    Data Engineer

    1 day ago


    Visionyle Solutions Mumbai/Kolkata, India permanent

    Key Responsibilities : · - Develop and maintain scalable data pipelines and ETL processes using Python, SQL, and other relevant technologies. · - Design and optimize data models for efficient storage and retrieval in data warehousing environments. · - Collaborate with cross-funct ...

  • Procter & Gamble

    Data Engineer

    4 days ago


    Procter & Gamble Mumbai, India

    · This role reports to Director, Platform Engineering Lead, P&G ( · AMA · ) · A · PAC, · M · iddle East, and · A · frica markets.Your teamAbout the AMA Data Solutions & Engineering Team:We take pride in managing the most-valuable asset of company in Digital World, called Data. O ...

  • Newfold Digital

    Data Engineer

    18 hours ago


    Newfold Digital Mumbai, India Full time

    Data Engineer JOB DESCRIPTION · Newfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive ex ...

  • 2coms

    Data Engineer

    4 days ago


    2coms Mumbai, India

    Data Engineer- · Not less than 7 years with Excellent Comm skill / Must have experience is Azure Synapse or DatabricksFor this rolewe basically are looking for someone who has worked on Pyspark extensively, or hands on in Synapse or databricks ( The Pyspark side of Syapse or Data ...

  • LTIMindtree

    Data Engineer

    4 days ago


    LTIMindtree Mumbai, India

    Role: Data Engineer-OACSExperience: 3 to 8 YearsLocation: Mumbai · Job Description: · 3-8 years of IT experience as in development and implementation of Business Intelligence and Data warehousing solutions using OBIEE/OAC/OAS.Knowledge of Analysis Design, Development, Customizati ...

  • Noventiq

    Data Engineer

    14 hours ago


    Noventiq Mumbai, India

    Description · Why Noventiq? Do you want to contribute directly to successful business outcomes by driving digital transformation for its customers' businesses, connecting 75k organizations forward in a secure way? Are you motivated to evolve the global best practices within all ...

  • 2coms

    Data Engineer

    14 hours ago


    2coms Mumbai, India

    · Looking For Data Engineer Professionals For Global IT MNC @Mumbai · Greetings From 2COMS · Job Title: Data Engineer · Job Loc: Mumbai - Thane (WFO – 5 days) · Job Description : · Worked within data and data tools for the last 7 years. · Worked with tools from Microsoft like Az ...

  • timesjobs

    Data Engineer

    1 week ago


    timesjobs Mumbai, India Full time

    Please share your resume at ruchita.- · Experience: 4 Years · Location : Mumbai · Job Description: · 4 years (must) relavent experience in Bigdata and cloud technologies with can do attitude · Big data tools: Spark etc. · Relational SQL and NoSQL databases. · Data pipeline and wo ...

  • Skyleaf Consultants LLP

    GCP Data Engineer

    4 days ago


    Skyleaf Consultants LLP Mumbai, India

    Position: GCP Data Engineer · About Company: a well-known conglomerate · Location: Mumbai or Pune, India · Experience: 3-5 years · Qualifications: · Bachelor's degree in information technology, data engineering, or related field. · 3-4 years experience with Google BigQuery; SAP B ...

  • Quantiphi

    GCP Data Engineer

    1 day ago


    Quantiphi Mumbai, India

    Designation: Data Engineer · Experience Level: 4-15 Years · Location: Mumbai/Bangalore/Trivandrum · Role & Responsibilities: · In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTable · Must have proficient experi ...


  • Ventura Mumbai Metropolitan Region, India

    Ventura is an omnichannel trading and investment platform with a network of branches, sub-brokers and Digital Channels. Founded in 1994, the company is now entering the next phase of growth by pivoting to a digital-first approach and strengthening its direct-to-consumer franchise ...


  • RapidBrains Mumbai, India

    Job Description: · Responsibilities: · Design, develop, and maintain data pipelines and infrastructure. · Collaborate with the data engineering team to devise and deploy innovative data-driven solutions. · Liaise with stakeholders to gather requirements and translate them into te ...


  • Blenheim Chalcot India Mumbai, India

    1-2 years of extensive experience in a Data Engineer role · Solid experience with Python and SQL databases · Experience with AWS (if not, then other cloud platforms) · Demonstrated expertise in building and optimizing ETL data pipelines to and from data warehouses · Proven exper ...

  • LTIMindtree

    GCP Data Engineer

    16 hours ago


    LTIMindtree Mumbai, India

    · • 5+ years of applicable engineering experience · • Experience in GCP, Big Query · • Strong proficiency in Python with an emphasis in building data pipelines · • Ability to write complex SQL to perform common types of analysis and aggregations · • Experience with Apache Airflo ...