Lead Data Pipeline Developer - Bengaluru - beBeeDataInfrastructure

Required experience in Java software development for Windows/Linux platforms with strong CI/CD skills and test automation tools. · ...

Kubernetes Application Developer · Cloud Computing (AWS & Azure) · Python scripting · Infrastructure as Code (Terraform/CloudFormation) · EKS, Fargate, ECS, ECR, Lambda, Helm · CI/CD Pipeline design (AWS Code pipeline, Code Deploy) CKA · Expertise in API integration and developme ...

Our Pipeline teams combine a solid understanding of technology with the workflows and processes used by our artists daily. They have a passion for supporting the creative process and for ensuring our global pipeline is as optimal as possible. · ...

We are seeking an experienced Senior DevSecOps & Observability Engineer to join our team. · Drive adoption of DevSecOps culture, embedding security into CI/CD pipelines and development workflows. · ...

We are seeking experienced professionals with strong expertise in GCP Cloud Data Fusion and Wrangler to design, develop, and support ETL pipelines. · ...

We are seeking a talented Pipeline Technical Director to join our team at DNEG. As a key member of our Production Technology department, you will be responsible for ensuring the smooth running of our tools and software used on award-winning VFX and Feature Animation shows. · ...

You will ensure smooth running of tools software workflows used on award-winning VFX Feature Animation shows providing face-to-face technical support assistance developing new tools scripts predominantly in Python meet specific show requirements. · ...

Setting data pipelines using Azure Synapse Pipelines (or Azure Data Factory) · Developing ETL jobs using stored procedures and Data Flow · Developing Data Validation and Reconciliation Jobs using Synapse Pipeline · Skills: · Azure Data Factory · Azure Synapse · SQL · Good to have ...

We are looking for an experienced Azure Data Factory Developer to design develop and maintain data integration pipelines on Azure The role involves working with large-scale data ingestion transformation and orchestration workflows ensuring data quality security and performance · ...

Job Description: · Design, develop, and maintain data pipelines using Python for processing large datasets. · Manage data pipelines in a continuous integration environment (e.g., Jenkins) to ensure automated testing. · Collaborate with development teams deploying web applications ...

Key Responsibilities: · Develop, maintain, and optimize data pipelines using SQL, Spark, and Python. · Integrate and process data using AWS services such as Glue, Athena, and Redshift. · Perform functional and automated testing of data pipelines to ensure accuracy and reliability ...

Etl development leveraging gcp cloud data fusion for data pipelines. · ...

Responsibilities: · Build and manage end-to-end ML pipelines using Vertex AI Pipelines, Airflow, or similar orchestrators. · Implement ML models using TensorFlow, PyTorch, or other frameworks; monitor model performance in production. · Manage Python environments using venv, pip, ...

The Data Engineer will support the development execution and monitoring of data pipelines ensuring reliable and secure data delivery for analytics reporting and decision-making across the bank. · Develop enhance ETL pipelines under guidance from senior engineers. · Perform data i ...

We are seeking a skilled Blue Yonder One Network (BY/1N) Developer with strong expertise in Java, React JS, and BY frameworks. · Develop and maintain applications using Blue Yonder One Network SDK built on Java. · Design and implement front-end components using React JS for intui ...

Senior Lead Data Engineer responsible for designing and developing new ETL pipelines and data processing workflows as per business requirements. Provides ongoing operational support and maintenance for data pipelines and related systems. · ...

Experience in ADF pipeline creation and testing from Different source to AWS S3 · Installation and Configuration new ADF NonProd and Prod environments · Experience in SSIS And Synapse · Maintaining the health and stability of all ADF environments · Creating and managing ADF Pipel ...

A Data Engineer specializing in Google's data platforms will design, build, and maintain data engineering solutions on Google's Cloud ecosystem. · ...

We are looking for a skilled Data Engineer with expertise in Snowflake and ETL processes to build, maintain, and troubleshoot data pipelines that support research data services. · 5+ years of experience in data engineering or ETL development. · Strong experience in developing and ...

We are looking for a skilled Azure DevOps Engineer with strong hands-on experience in YAML-based CI/CD pipelines and automation scripting. · ...

The job involves providing key technical input and implementing integrity programs for subsea and onshore pipelines systems. · ...