Data Pipeline Engineer - Bangalore Area

Only for registered members Bangalore Area, India

1 month ago

Default job background

Job summary

Develop and maintain data pipelines for efficient data extraction transformation and loading ETL ELT processes utilizing PySpark for distributed big data processing and Polars Rust for maximal performance and memory safety in single-node bottlenecks Design implement and own internal process improvements automating manual processes optimizing data delivery latency using high-speed language components and redesigning infrastructure for greater scalability and cost efficiency Work on the data pipeline operations to operate maintain evolve our decoding pipelines proposing improvements to automatize industrialize all processes ways of working with a focus on data quality platform stability Support the ramp up installations of data pipeline for future airline aircraft deployment Integrate high-performance Rust compiled routines e.g UDFs into Python PySpark workflows resolve critical performance issues.


Lorem ipsum dolor sit amet
, consectetur adipiscing elit. Nullam tempor vestibulum ex, eget consequat quam pellentesque vel. Etiam congue sed elit nec elementum. Morbi diam metus, rutrum id eleifend ac, porta in lectus. Sed scelerisque a augue et ornare.

Donec lacinia nisi nec odio ultricies imperdiet.
Morbi a dolor dignissim, tristique enim et, semper lacus. Morbi laoreet sollicitudin justo eget eleifend. Donec felis augue, accumsan in dapibus a, mattis sed ligula.

Vestibulum at aliquet erat. Curabitur rhoncus urna vitae quam suscipit
, at pulvinar turpis lacinia. Mauris magna sem, dignissim finibus fermentum ac, placerat at ex. Pellentesque aliquet, lorem pulvinar mollis ornare, orci turpis fermentum urna, non ullamcorper ligula enim a ante. Duis dolor est, consectetur ut sapien lacinia, tempor condimentum purus.
Get full access

Access all high-level positions and get the job of your dreams.



Similar jobs

  • Work in company

    Full Stack Developer

    Only for registered members

    Are you passionate about IT, experienced in software development techniques and convinced by the business added value of digitalization? · Airbus started its Digital journey. The objective being to transform the company and to prepare it for the future. · This transformation incl ...

    Bangalore Area

    1 month ago

  • Work in company

    Lead DevSecOps Engineer

    Only for registered members

    Airbus is looking for a DevSecOps Engineer to join its Information Management team based in Bangalore, India. · ...

    Bangalore Area

    2 weeks ago

  • Work in company

    Data Engineering Intern

    Only for registered members

    We are looking for an intern to join in Bangalore and will be responsible to help build and maintain data processing pipelines. · You will also have the chance to assist with developing basic web APIs. · ...

    Bangalore Area

    1 week ago

  • Work in company

    Engineer

    Only for registered members

    The team plays an enabling role in digitization initiatives across Airbus utilizing the latest technologies and domain knowledge. · ...

    Bangalore Area

    1 month ago

  • Work in company

    Lead Cloud Software Engineer

    Only for registered members

    We are seeking to enhance our team with a Cloud Engineer with the main focus on Cloud and hybrid platforms in order to support the sizing and setting-up of future digital services. · Design scalable cloud solutions for HPC workloads. · Omitize compute resources by selecting appro ...

    Bangalore Area

    1 month ago

  • Work in company

    Avionics Software Engineer

    Only for registered members

    This is a job for an Avionics Software Engineer to develop software and provide in-service support for cabin management and connectivity solutions on Airbus aircraft. · ...

    Bangalore Area

    1 month ago

  • Work in company

    Skywise Foundry Software Developer

    Only for registered members

    Airbus is looking for Python Developers/Typescript developers to join in Bangalore, India. · ...

    Bangalore Area

    2 weeks ago

  • Work in company

    Lead Skywise Data Engineer

    Only for registered members

    The Lead Skywise Data Engineer would develop quick win solutions on the Skywise platform to provide immediate value to end customers. The engineer must understand customer pain points and leverage domain knowledge of airline operations to capture requirements. · Analyze and organ ...

    Bangalore Area

    1 month ago

  • Work in company

    Associate DevOps Engineer

    Only for registered members

    Airbus is looking for a DevSecOps Support Intern to join in Bangalore, India. The successful candidate will assess and understand business needs and translate such into IT solutions. · ...

    Bangalore Area

    22 hours ago

  • Work in company

    Data Automation Engineer

    Only for registered members

    We are looking for a skilled and motivated Data Analyst to join our dynamic team. This role offers a unique opportunity to work at the intersection of data extraction knowledge representation and machine learning. Youll deep dive into complex technical data including AMM data to ...

    Bangalore Area

    1 month ago

  • Work in company

    Skywise Data Engineer

    Only for registered members

    The Skywise Engineer would develop quick win solutions on the Skywise platform to provide immediate value to end customers. They would work collaboratively with product teams and leverage domain knowledge of airline operations to capture requirements. · Analyze and organize raw d ...

    Bangalore Area

    1 month ago

  • Work in company

    Software Engineer

    Only for registered members

    To design develop and maintain technology solutions that align with business goals requirements particularly to implement software applications for aircraft domains. · Design develop maintain software application. · ...

    Bangalore Area

    2 weeks ago

  • Work in company

    Test Automation Engineer

    Only for registered members

    A Test Automation Engineer at Airbus India will perform test automation on Skywise suite of products and work closely with the product owner and development team to define program increment and iteration scope. · ...

    Bangalore Area

    1 week ago

  • Work in company

    Site Reliability Engineer

    Only for registered members

    We are seeking a highly skilled and motivated Site Reliability Engineer (SRE) to join our innovative Airline Sciences (DMA) team. · Design, implement, and maintain robust and scalable infrastructure on AWS to support our microservices-based applications and REST APIs. · Work coll ...

    Bangalore Area

    4 weeks ago

  • Work in company

    Application Security Engineer

    Only for registered members

    Airbus is on its Digital journey and the objective is to transform the company and prepare it for the future. This transformation includes new global governance, new ways of working, and the implementation of digital business services and platforms. · Contribute towards developme ...

    Bangalore Area

    1 day ago

  • Work in company

    Data Analyst Intern

    Only for registered members

    Engage in research and implementation of Retrieval-Augmented Generation (RAG) and other advanced techniques to enhance Language model capabilities. · Participate in data preparation for fine-tuning processes. · ...

    Bangalore Area

    22 hours ago

  • Work in company

    Technical Lead

    Only for registered members

    Airbus India Private Limited seeks a highly skilled Technical Lead for full-stack applications. This role involves leading a team in designing robust web solutions using modern technologies such as Angular and NodeJS. · ...

    Bangalore Area

    1 month ago

  • Work in company

    Technology Analyst

    Only for registered members

    To be responsible for designing, developing and maintaining technology solutions that align with our business goals and requirements, particularly to lead, design and implement software applications for aircraft domain. · ...

    Bangalore Area

    1 month ago

  • Work in company

    Architect/Tech Lead

    Only for registered members

    Airbus is looking for an Architect/Tech Lead to join in Bengaluru, India. The individual will act as a visionary to proactively assist in defining the direction for future IT Products & Services and validate product designs. This role is responsible for designing, implementing, a ...

    Bangalore Area

    1 month ago