Data Engineer - Bengaluru / Bangalore, Chennai - Natwest Digitalx

Description · We are seeking a skilled Data Engineer to join our team in India. The ideal candidate will be responsible for building and maintaining robust data pipelines and architectures that support our data-driven initiatives. · Responsibilities · Design, construct, install, ...

Roles and Responsibilities : · Design, build, and optimize scalable ETL pipelines using Apache Airflow or similar frameworks to process and transform large datasets efficiently. · Utilize Spark (PySpark), Kafka, Flink, or similar tools to enable distributed data processing and re ...

Build data systems and pipelines · Standardize the data assets which maximize data reusability · Evaluate business needs and objectives · Implementing data pipeline to ingest and cleanse raw data from various source systems including SaaS, Cloud based and On-prep databases · Cond ...

Roles and Responsibilities · Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data bricks. · Develop complex ETL processes using Python scripts and SQL queries to process l ...

Responsibilities: · Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines using Databricks for data ingestion, transformation, and processing. · Programming & Scripting: Develop robust data solutions and automation scripts primarily using Py ...

Roles and Responsibilities · Required Professional degree in a technical discipline with a minimum of 4 years professional experience in software development · Design, develop, and maintain large-scale data pipelines using Hadoop, Spark, and SQL. · Collaborate with cross-function ...

Key Responsibilities: · Design and implement scalable data architectures to support data integration, transformation, and storage. · Build and maintain ETL pipelines to extract, transform, and load data from diverse sources into data warehouses or data lakes. · Work with big data ...

As a Big Data Engineer (Azure) , you will build and learn about a variety of analytics solutions platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might ...

We re hiring a Fullstack Software Engineer to help develop the Cloud Data Hub our AWS-based data platform for managing petabytes of enterprise data. · You ll focus on building end-to-end platform features that empower customers to design, deploy, and monitor their own data pipeli ...

Must-Have Qualifications: · AWS Expertise: Strong hands-on experience with AWS data services including Glue, Redshift, Athena, S3, Lake Formation, Kinesis, Lambda, Step Functions, EMR, and CloudWatch. · ETL/ELT Engineering: Deep proficiency in designing robust ETL/ELT pipelines w ...

Responsibilities : · Design, develop, and maintain backend services and APIs in Python to enable self-service pipeline creation, orchestration, and monitoring. · Build frontend features (e.g., dashboards, forms, monitoring views) that help customers easily design and manage data ...

Responsibilities : · Design, develop, and maintain Python backend services and APIs. · Integrate and manage AWS services such as S3, Glue, Lambda, IAM, and others. · Develop and maintain data connectors for Snowflake, Azure, and SAP. · Write clean, maintainable, and well-tested c ...

We are seeking a Senior Distributed Systems & ML Engineer to design and build scalable distributed systems, Big Data pipelines, and ML/Generative AI services. This role will contribute to architecture decisions, integrate AI solutions into production, and mentor engineering teams ...

Build and optimize scalable data pipelines using Python and Spark in Azure Databricks · Leverage Databricks workflows and Asset Bundles for efficient data orchestration · Implement and manage CI/CD pipelines using GitHub for automated deployments · Apply expertise in Data Warehou ...

Key Responsibilities: · System Design & Development: Design, develop, and implement efficient software and engineering solutions using Python, MATLAB, C, and C++. · Database Engineering: Develop and maintain scalable data storage and retrieval systems using SQL, Hive, and related ...

Position Description · We are seeking a talented and experienced Data Scientist / MLOps Engineer to join our team. In this role, you will be responsible for · developing and operationalizing machine learning models, with a focus on NLP sentiment analysis, scoring, app recommendat ...

Description · Design, develop, and maintain advanced Looker dashboards on GCP, ensuring they are intuitive, user-friendly, and provide actionable insights. · Develop custom visualizations(ex. using Java Script) · Collaborate with stakeholders to gather requirements and translate ...

Key Responsibilities: · Architect and implement scalable MLOps pipelines for model development, deployment, and monitoring · Lead end-to-end operationalization of ML models using AWS SageMaker and AWS ecosystem · Build and manage CI/CD pipelines for ML workflows using tools like ...

Key Responsibilities · Design, develop, and implement AI and Machine Learning solutions using Python · Build, train, evaluate, and optimize ML models (classification, regression, clustering, NLP, predictive analytics) · Perform data preprocessing, feature engineering, and model v ...

The team is responsible for analytics and delivery strategy across Pricing, Promotion Competitive Intelligence (PPCI) product portfolio. . We work closely with business stakeholders to deliver analytical solutions to Data Intelligent products. · Job Summary: · The Lead Analyst is ...