Jobs
>
Senior Data Engineer
>
Pune

    Senior Data Engineer - Bangalore/Kolkata/Pune, India - Nilasu consulting

    Nilasu consulting
    Nilasu consulting Bangalore/Kolkata/Pune, India

    Found in: Talent IN 2A C2 - 2 days ago

    Default job background
    permanent Technology / Internet
    Description

    Summary :

    • We are seeking a highly skilled and experienced Senior Data Engineer to join our team.
    • You will play a key role in designing, developing, and maintaining largescale data processing pipelines using Python and Spark/PySpark.
    • Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.

    Responsibilities :

    • Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.
    • Optimize Spark jobs for performance and scalability to handle large datasets.
    • Utilize working knowledge of Scala or Java with objectoriented principles and design patterns to contribute to complex data processing tasks (if applicable).
    • Manage and maintain data pipelines on Hadoop infrastructure.
    • Develop and integrate RESTful APIs for data access and consumption.
    • Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
    • Apply Agile development methodologies and collaborate effectively with crossfunctional teams (data scientists, analysts, developers).
    • Troubleshoot and fix performance issues across the codebase and database queries.
    • Document data pipelines and processes for maintainability and knowledge sharing.
    • Stay uptodate with the latest advancements in big data technologies and tools.

    Qualifications :

    • At least 6 years of experience as a Data Engineer or a related role.
    • Strong expertise in Python programming and proficiency in Spark/PySpark for largescale data processing.
    • Working knowledge of Scala or Java with objectoriented principles and design patterns (a plus).
    • Experience with Linux environments and Hadoop infrastructure.
    • Experience working with RESTful APIs for data exchange.
    • Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.
    • Understanding of Agile development methodologies and practices.
    • Excellent problemsolving and analytical skills.
    • Strong written and verbal communication skills to collaborate effectively with stakeholders.
    • Passion for learning and implementing new technologies.
    • Ability to thrive in a fastpaced and dynamic environment.
    )
  • ACS International India Pvt. Ltd. (ACSII)

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    ACS International India Pvt. Ltd. (ACSII) Pune, India

    ACS-I India is looking for a 5+ years experienced Data Engineer who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insights. The data engineer will work ...

  • Sigmaways Inc

    Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago

    Sigmaways Inc Pune, India

    Our client Master card is looking for 6-10 years of experienced Data Engineer with hands on strong in programming language. this is a for Data warehouse group. · 12+ months CONTRACT ROLE with possible Extension · Experience in ETL- Data warehouse experience in past is a Plus. · ...

  • PeopleLogic

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    PeopleLogic Pune, India

    Company Profile · We are hiring for a multi-national company providing IT services. It provides software and consultancy services in different industries like Finance, Education, Insurance, Retail, Energy, Life Science, and Healthcare. · Experience Range : 10-15 · Desired Compet ...

  • Coditas

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Coditas Pune, India

    We are looking for data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space. A passion for shipping high-quality data products, interest in the data products space; curiosity about the b ...

  • Tech Mahindra

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 hours ago

    Tech Mahindra Pune, India

    Title: Reltio GCP Data Engineer · Location: Pune · Experience: 6+years · NP: Immediate to 15days · Company Profile: · Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable ...

  • ACS International India Pvt. Ltd. (ACSII)

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    ACS International India Pvt. Ltd. (ACSII) Pune, India

    ACS-I India is looking for an 8+ years experienced Data Engineer with data modeling experience who will support a rapidly growing Business Data & Analytic Platform focused on providing data product solutions that empower our core business users to turn data into actionable insigh ...

  • Perficient

    Data Engineer

    Found in: Talent IN 2A C2 - 4 days ago

    Perficient Pune, India

    Job Description: Data Engineer · Experience Total: 4- 7 · Location: Pune · Qualification: · Advanced working SQL knowledge and performance tuning · Good knowledge of Relational Model, Dimensional Data Modelling, Data Warehouse · Experience working with relational databases, fo ...

  • Sigmaways Inc

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 days ago

    Sigmaways Inc Pune, India

    This position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates). · Position : Data Engineer · Type : Long Term Contract Role · Location : Pune / Hybrid · Job Description: · This position is for Data warehouse group . · This position is a ...

  • Atyeti Inc

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 2 days ago

    Atyeti Inc Pune, India

    Designation: Data Engineer · Experience: 5+Years · Location: Pune · Skills: GCP / AWS, Python, Spark, Hive, Hadoop and Big Data · Bachelor's degree in computer science, information systems, or other related field or equivalent work experience. · 5+ years of high-tech industry int ...

  • PURVIEW

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    PURVIEW Pune, India

    Role: Sr Data Engineer/Technical lead · Location Pune(1st preference) and Hyderabad · Look for candidate min 8+years experience. · Job description: · Mandatory Google Cloud Big Query Scripting Skills or Snowflake AWS or Cloud SQL · Mandatory to have knowledge on any ETL Tool ONLY ...

  • Tech Mahindra

    Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 hours ago

    Tech Mahindra Pune, India

    GCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pipeli ...

  • Nilasu consulting

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Nilasu consulting Bangalore/Hyderabad/Chennai/Pune, India permanent

    Responsibilities: · - Design, develop, and deploy production-ready data pipelines using Databricks, Kafka, and Snowflake. · - Collaborate with data analysts, software engineers, and stakeholders to understand data requirements and develop effective data migration strategies, API ...

  • TMF Group

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    TMF Group Pune, India

    About TMF Group · TMF Group is a leading provider of critical administrative services, helping clients invest and operate safely around the world. Our 10,000 experts and 120 offices in 85 jurisdictions worldwide serve corporates, financial institutions, asset managers, private cl ...

  • vipsa solutions

    Data Engineer

    Found in: Talent IN 2A C2 - 2 days ago

    vipsa solutions Bangalore/Pune, India permanent

    SALARY : 15LPA - Engineer: · Location: Pune, Bangalore · Experience: 6-9 years · NP: Immediate- 15 days · Key accountabilities: · As a Data Engineer you will be accountable for: · - Understanding operational needs by collaborating with specialized teams · - Supporting key, involv ...

  • Talentoj

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Talentoj Hyderabad/Pune/Ahmedabad, India permanent

    Azure Data Engineer : · We are seeking a highly skilled Azure Data Engineer to join the data engineering team and play a crucial role in an optimization initiative. The current problem is that read speed is compromised and faster responses from delta are required. · The ideal can ...

  • ADVANSOFT

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    ADVANSOFT Pune/Bangalore/Chennai, India permanent

    Skills : · - Hadoop · - Python · - Spark · - PySpark · - ETL (Extract, Transform, Load) · Roles & Responsibilities : · - Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem. · - Data Processing: Utilize Python ...

  • Nanotech Soft-App IT Solution

    Data Engineer

    Found in: Adzuna IN C2 - 2 days ago

    Nanotech Soft-App IT Solution Pune/Hyderabad, India permanent

    In this role, you will: · - Technical leadership for a team of engineers that focus on development, deployment and operations. · - Lead and contribute to multiple pods with moderate resource requirements, risk, and/or complexity. · - Interface technically with a range of stakehol ...

  • Huquo

    Data Engineer

    Found in: Talent IN 2A C2 - 3 days ago

    Huquo Pune/Hyderabad, India permanent

    Must-Have : · - 4+ years of experience in Data Engineering experience on Azure and Databricks · - Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required · - Experience Developing and tuning Spark Application and SparkSQL queries- · - Expertise t ...

  • Promaynaov Advisory Services Pvt Ltd

    Data Engineer

    Found in: Talent IN 2A C2 - 1 day ago

    Promaynaov Advisory Services Pvt Ltd Pune, India

    Role : Data Engineer · Location : Pune/Hyderabad · In this role, you will : · Principal Responsibilities : · As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects o ...

  • Virtusa

    Data Engineer

    Found in: ATTB IN C2 - 17 hours ago

    Virtusa Pune, India

    Data Engineer - CREQ184791 Description 8-10years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...