Jobs
>
Data Engineer
>
Mumbai

    Data Engineer - Mumbai, India - Careernet Technologies Pvt Ltd

    Default job background
    Description

    Purpose :


    As a Data Engineer, your role is to own the data pipeline and the data governance of our Data Strategy.

    Our Data Strategy underpins our suite of Client-facing Applications, Data Science activities, Operational Tools and Business Analytics.


    Responsibilities :

    • Architect and build scalable, resilient and costeffective software to support complex data pipelines.
    • The architecture has two facets : Storage and Compute.


    The Data Engineer is responsible for designing and maintaining the different tiers of the data storage, including (but not limited to) archival, long-term persistent storage, transactional and reporting storage.


    • The Data Engineer is responsible for designing, implementing and maintaining various data pipelines such as selfservice ingestion tools, exports to applicationspecific warehouses and indexing activities.
    • The Data Engineer is responsible for data modeling, as well as designing, implementing and maintaining various data catalogs, to support data transformation and product requirements.
    • Collaborate with Data Science to understand, translate, and integrate methodologies into engineering build pipelines.
    • Partner with product owners to translate complex business requirements into technical solutions, imparting design and architecture guidance.
    • Provide expert mentorship to project teams on technology strategy, cultivating advanced skill sets in software engineering and modern SDLC.
    • Stay informed about the latest technologies and methodologies by participating in industry forums, having an active peer network, and engaging actively with customers.
    • Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through teamwork.

    Qualifications :

    • A degree in Computer Science or related technical field.
    • Strong Computer Science fundamentals
    • 3+ years of professional Database Development, with languages such as ANSI SQL, TSQL, PL/pgSQL, PLSQL, plus database design, normalization, server tuning, and query plan optimization
    • 3+ years Software Engineering experience with programming languages such as Java, Scala, Python and Unix Shell
    • 3+ years of professional DBA experience with large datastores including HA and DR planning and support.
    • Understanding of File Systems
    • Demonstrated understanding and experience with big data tools such as Kafka, Spark and Trino/Presto
    • Experience configuring database replication (physical and/or logical)
    • ETL experience (3rd party and proprietary)
    • Experience with orchestration tools such as Airflow
    • Comfortable with version control systems such as git
    • A thirst for learning new Tech and keeping up with industry advances.
    • Excellent communication and knowledgesharing skills.
    • Comfortable working with technical and nontechnical teams.
    • Strong debugging skills.
    • Comfortable providing and receiving code review feedback.
    • A positive attitude, adaptability, enthusiasm, and a growth mindset.

    Nice to have :

    • A personal technical blog
    • A personal (Git) repository of side projects
    • Participation in an opensource community

    Preferred skills :

    • Comfortable using Docker and Kubernetes for container management.
    • DevOps experience deploying and tuning the applications you've built.
    • Monitoring tools such as Datadog, Prometheus, Grafana, Cloudwatch.
    )


  • Axis Bank mumbai, India

    BIU:Data Engineer-ETB Database Lending · 0 - 1 Years · 1 Opening · Mumbai · Role description · To update · Skills · Excel · ...

  • Trafigura

    Data Engineer-1

    3 weeks ago


    Trafigura Mumbai, India

    **Knowledge Skills and Abilities, Key Responsibilities**: · Data ingestion / integration, ETL/ELT data pipeline design, data modelling, data provisioning · - Python, SQL · - AWS data stack (E.g. S3, Redshift, EMR, Glue, Athena) · - Experience with data related to commodities, fin ...

  • Perfict

    Data Engineer

    2 weeks ago


    Perfict Maharashtra, India

    Title: Data Engineer · Job Location: 100% Remote (PAN India) · Role: Contract Role · Timing: IST · Looking candidate who can join in days after job offer · Data Engineer - Financial Domain · Job Description: · Based on the requirements of the project, need a strong resource who ...


  • consultant Mumbai, India

    Openings for the role of data Engineer/ Sr Data Engineer · Must Have : · - 5-7+ years of extensive experience in a Data Engineer role · - Solid experience with Python, PySpark, and SQL databases · - Experience with Azure, Databricks, and GCP · - Extensive knowledge of the full so ...

  • Teksands

    Data Engineer

    2 weeks ago


    Teksands Mumbai/Kolkata, India permanent

    Job Description : · 8+ years of analysis and reporting business intelligence-related needs. · - Must have : Excellent Data warehousing, data modeling, and data transformation · - Advanced SQL ,Tableau Reporting ,Design stable, reliable, and effective databases. · - Interface wit ...

  • ImpactGuru

    Data Engineer

    2 weeks ago


    ImpactGuru Mumbai, India

    Job Description: · We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. You will work closely w ...

  • Quilytics

    Data Engineer

    1 day ago


    Quilytics Mumbai, India

    Company Description · Quilytics is committed to help enterprises grow their business value through a powerful combination of quality and analytics. We provide end-to-end custom data analytics solutions to businesses in various areas including Marketing analytics, Business Analyti ...

  • Searce Technologies Inc

    Data Engineer

    3 weeks ago


    Searce Technologies Inc mumbai, India

    about the role · Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questio ...

  • Asterion

    Data Engineer

    1 week ago


    Asterion Mumbai, India

    Job Summary : · We are seeking a skilled and motivated Data Engineer to design, develop, and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering, a passion for working with large datasets, and the ability to transform data into ...

  • Huquo

    Data Engineer

    3 weeks ago


    Huquo Mumbai, India

    Position : Data Engineer · Location : Mumbai · Experience : 4-6 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data ...

  • Aunalytics

    Data Engineer

    3 weeks ago


    Aunalytics mumbai, India

    Position Overview · Data Engineers are data experts who dive right into new client projects and make it their job to understand how a client's data fits into our Industry Intelligent data models. Utilizing this knowledge and the industry's newest technologies, they create high ...

  • Virtusa

    Data Engineer

    4 days ago


    Virtusa Mumbai, India

    Data Engineer - CREQ191185 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...

  • Neer Info

    Data Engineer

    3 weeks ago


    Neer Info mumbai, India

    About the job : · - The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. · - You will test your code, identify errors, and iterate to ensure quality code. · - You will also support our customers and partners ...

  • iMind Your Business Solutions Private Limited

    Data Engineer

    3 weeks ago


    iMind Your Business Solutions Private Limited mumbai, India

    Company Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...

  • OIL FIELD INSTRUMENTATION

    data engineer

    3 weeks ago


    OIL FIELD INSTRUMENTATION Mumbai, India

    Experience : · 4+ years of Mud Logging experience as Data Engineer in India and abroad, both onshore and offshore rig operations. Deep Water experience will be an advantage. Proficient with real-time data monitoring and data management, WITSML transmission, gas detection and anal ...

  • The Nielsen Company

    Data Engineer

    3 weeks ago


    The Nielsen Company mumbai, India

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embar ...

  • Puma Energy

    Data Engineer

    3 weeks ago


    Puma Energy mumbai, India

    Main Purpose: · Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. · Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists ...

  • RIA Advisory

    Data Engineer

    1 day ago


    RIA Advisory Mumbai, India

    Job Summary · Seeking a Data Engineer who will be working closely with data scientists and developers to architect data transformations, analyze, develop, maintain, and test data infrastructures. This role requires deep hands-on production expertise in Apache Spark and data engin ...

  • Virtusa

    Data Engineer

    1 week ago


    Virtusa Mumbai, India

    Data Engineer - CREQ191174 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...

  • Argus Media

    Data Engineer

    3 weeks ago


    Argus Media mumbai, India

    Data Engineer – Pricing · (FTC 18 Months) · About Argus Media Argus is the leading independent provider of market intelligence to the global energy and commodity markets. We offer essential price assessments, news, analytics, consulting services, data science tools and industr ...