Jobs
>
Data Engineer
>
Pune

    Data Engineer - Pune, India - Worldline

    Worldline
    Worldline Pune, India

    3 weeks ago

    Default job background
    Description

    Data Engineer M2C

    Pune

    This is Worldline

    We are the trailblazers in the payments technology industry, influencing how the world conducts transactions. The solutions our team develops today drive the growth of countless businesses tomorrow. From your favorite local cafe to global giants and financial institutions. From bustling cities like San Francisco to serene settings like Auckland. We have a presence in every corner of the world, in every aspect of commerce. By aiding our customers in advancing their businesses, we are dedicated to propelling our employees' careers forward. Together, we shape the future.

    The Opportunity

    At Worldline, our technology tackles the longstanding challenges of the payment sector. We create and manage cutting-edge digital payment and transaction solutions that foster sustainable economic development and reinforce trust and security within our communities. If you are a skilled Product Owner with a knack for innovation and a love for delivering top-notch code, then prepare to join our team. We are on the lookout for a Developer/Engineer to develop scalable software solutions in the Payments Domain. You will be part of a versatile team responsible for the entire software development life cycle, from inception to deployment.

    Day-to-Day Responsibilities

    • Develop and maintain robust data pipelines using PySpark and SQL to facilitate the transition from Oracle's on-premises data warehouse and unstructured data sources to BigQuery.
    • Design and implement reliable data ingestion and integration processes to ensure data quality and consistency.
    • Utilize the dbt tool to create and oversee ETL processes that efficiently transform and load data to/from BigQuery.
    • Ensure the durability and effectiveness of data transformation jobs capable of handling substantial data volumes in a cloud-based framework.
    • Collaborate closely with Data Engineers to gather requirements for ongoing data pipeline development. Offer expertise on GCP services like DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and Bigquery, promoting best practices in cloud-based data management.
    • Work alongside data architects and stakeholders to optimize data models and warehouse design for the cloud environment.
    • Establish and execute monitoring, quality assurance, and validation processes to safeguard the integrity of data pipelines and data.
    • Document all data engineering processes and create explicit specifications for future reference and compliance.

    Who Are We Looking For

    We seek visionaries. Individuals who can steer positive transformations, take charge, and envision what lies ahead – individuals with passion, a proactive mindset, and a thirst for knowledge and development. In practical terms, this entails:

    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
    • Minimum of 5 years of experience as a Data Engineer emphasizing Google cloud-based solutions.
    • Thorough understanding of versioning and CI/CD.
    • Proficiency in GCP services, emphasizing data-centric products like DataProc, DataFlow, Cloud Functions, Workflows, Cloud Composer, and Bigquery. Extensive background in ETL tools, particularly dbt Labs, and a clear grasp of ETL best practices.
    • Experience in constructing and enhancing data pipelines, architectures, and datasets from structured/unstructured data sources.
    • Strong analytical skills with the capacity to comprehend complex requirements and translate them into technical solutions. Excellent problem-solving skills and a dedication to excellence.
    • Effective communication skills, capable of collaborative work in a team setting.
    • Relevant certifications in Google Cloud Platform or other data engineering credentials are advantageous. Proficiency in SQL and Python with a grasp of Spark.
    • Proficiency in English, with strong oral and written communication abilities.
  • Provision People

    Data Engineer

    2 days ago

    Provision People Pune, India

    Summary: · Our award-winning client is seeking a Data Engineer to join their team.We are looking for Data Engineers to join our growing Data Infrastructure team. In this role, you will play a key role in designing, developing, and maintaining the data pipelines that power our org ...

  • Xcelyst

    Data Engineer

    2 weeks ago

    Xcelyst Pune, India

    Role : Data Engineer - Nifi · Experience : 5 Years - 8 Years · Notice period : Immediate - 30 days · Skills : Experience in Nifi and Data Engineering (Pyspark, SQL, ETL). · Secondary : Big Data/Hadoop, Hive, Spark · 4+ Years in Data Engineer/1-2 yrs exp in Nifi · We are seekin ...

  • Persistent Systems

    Data Engineer

    3 weeks ago

    Persistent Systems pune, India

    About Position · As a Data Engineer, you will be responsible for design and implementation of data pipelines, deploy models, build applications and integrations to Healthcare Domain & Data Standards. Good knowledge of public cloud such as AWS, System Engineering and Azure is pr ...

  • Global Pharma Tek

    Data Engineer

    3 weeks ago

    Global Pharma Tek Pune, India

    Mandatory Skills · - AWS Services,Data Engineer Python,SQL,Redshift.Description: We are seeking a versatile Data Engineer with a strong background in data analysis, proficient in Python and SQL, and adept at performance optimization. The ideal candidate will have hands-on experie ...

  • Virtusa

    Data Engineer

    2 weeks ago

    Virtusa Pune, India

    Data Engineer - CREQ184790 Description 8-10years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...

  • Tata Technologies

    Data Engineer

    3 weeks ago

    Tata Technologies Pune, India

    Position :- Data Engineer (Snowflake) Location :- Pune Exp. Rane :- 4-6 years Must Have: 4-6 Years Overall experience 4+ years of experience with sound knowledge on database concepts like Entity-relationship, Data modeling, DDL and DML statements etc. 3+ years of proven experienc ...

  • YASH Technologies

    Data Engineer

    1 week ago

    YASH Technologies Pune, India

    · Job Description · Masters / Bachelors Degree in Computer Science, Information Technology or other relevant fields. · • Minimum 2 + Years of Mandatory experience in Advance Data & Analytics Architecture, ETL, Data Engineering solution using the following Skills, tools and techn ...

  • Russell Tobin

    Data Engineer

    3 weeks ago

    Russell Tobin pune, India

    The Data Engineer is part of a Corporate Analytics SWAT team responsible for supporting data and analytics solutions for MMC Corporate Functions. This individual will collaborate with analytics team to design and implement MMC corporate data strategy, ensuring reliable data infra ...

  • Virtusa

    Data Engineer

    3 weeks ago

    Virtusa Pune, India

    Data Engineer - CREQ190094 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...

  • PURVIEW

    Data Engineer

    4 days ago

    PURVIEW Pune, India

    Purview is hiring Data Engineer with one of our valued clients. If you're interested, please reply for more details. · Job Details: · Role: Data Engineer · Location: Pune/Hyderabad · Duration: Permanent with Purview · We are looking for 5+ years with Python/PySpark · Job Descript ...

  • Evolent Health

    Data Engineer

    3 weeks ago

    Evolent Health pune, India Full time

    Your Future Evolves Here · Evolent Health has a bold mission to change the health of the nation by changing the way health care is delivered. Our pursuit of this mission is the driving force that brings us to work each day. We believe in embracing new ideas, challenging ourselv ...

  • Rockwell Automation

    Data Engineer

    1 week ago

    Rockwell Automation Pune, India Full time

    Rockwell Automation is a global technology leader focused on helping the world's manufacturers be more productive, sustainable, and agile. With more than 28,000 employees who make the world better every day, we know we have something special. Behind our customers - amazing compan ...

  • Volante Technologies

    Data Engineer

    4 days ago

    Volante Technologies Pune, India

    ****Immediate joiners only*** · Company Description: Volante is on the Leading Edge of Financial Services technology, if you are interested to be on an Innovative fast-moving team that leverages the very best in Cloud technology our team may be right for you. · By joining the pro ...

  • ADVANSOFT

    Data Engineer

    3 weeks ago

    ADVANSOFT pune, India

    Skills : · - Hadoop · - Python · - Spark · - PySpark · - ETL (Extract, Transform, Load) · Roles & Responsibilities : · - Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem. · - Data Processing: Utilize Python ...

  • YASH Technologies

    Data Engineer

    3 weeks ago

    YASH Technologies Pune, India

    We are looking for Data Professionals with 7 years of minimum experience who can Explore and learn the latest Data & Analytics and Databricks Platform features /technologies to provide new capabilities and increase efficiency. · Build and operationalize large scale enterprise da ...

  • Unison Consulting

    Data Engineer

    3 weeks ago

    Unison Consulting Pune, India Full time

    Proven experience as a Data Engineer with a focus on Spark and Scala Strong programming skills in Scala and experience with Apache Spark for large-scale data processing Knowledge of distributed computing concepts and experience optimizing Spark jobs for performance Experience wit ...

  • closeloop Technologies private Limited

    Data Engineer

    3 weeks ago

    closeloop Technologies private Limited Pune, India

    Requirements: · - Snowflake : Proven experience in using Snowflake for data warehousing solutions. · - Databricks: Strong hands-on experience with Databricks for big data processing and analytics using Machine Learning. · - Redshift: Expertise in managing and optimizing Amazon Re ...

  • Tech Mahindra

    Data Engineer

    3 weeks ago

    Tech Mahindra Pune, India

    GCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage, · Strong python programming experience in using Google Cloud python client libraries, · Strong SQL and data analysis skills, · Proficient ETL/ELT experience in workflows, data modelling and data pip ...

  • Atyeti Inc

    Data Engineer

    2 weeks ago

    Atyeti Inc Pune, India

    Atyeti is a Global Managed Service provider, winner of the Inc 500 Award for fastest growing IT companies, with offices in US, UK, Switzerland, Singapore, Hong Kong, Malaysia, and India. We own and execute end to end projects in the Investment Banking world with clients such as C ...

  • F337 Deutsche India Private Limited, Pune Branch

    Data Engineer

    3 weeks ago

    F337 Deutsche India Private Limited, Pune Branch Pune, India Full time

    Description · – Senior Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause analysis skills, developed through addressing enhanc ...