Snowflake, Python, Airflow, SQL - Hyderabad / Secunderabad, Telangana - confidential

Skill · Snowflake, SQL, Airflow, Python & UNIX (ALL ARE MANDATORY SKILLS) · Role · Senior ETL Developer · At least 7 years of hands-on experience in Python, Snowflake, AWS, Unix, Airflow & Tidal. · Experience in Hive and Hadoop is an added advantage. · At least 2 years of experie ...

Python Proficiency: Strong understanding of Python, with practical coding experience · AWS: Comprehensive knowledge of AWS services and their applications · Airflow: creating and managing Airflow DAG scheduling. · Unix & SQL: Solid command of Unix commands, shell scripting, and w ...

Python Proficiency: Strong understanding of Python, with practical coding experience · AWS: Comprehensive knowledge of AWS services and their applications · Airflow: creating and managing Airflow DAG scheduling. · Unix & SQL: Solid command of Unix commands, shell scripting, and w ...

We are seeking an experienced AWS Data Engineer to manage and optimize cloud-based data solutions. The ideal candidate will have strong experience with AWS services, Python scripting, and SQL, along with excellent communication and documentation skills. · Key Responsibilities: · ...

Key Responsibilities: · Design, build, and maintain data pipelines (ETL/ELT) using BigQuery, Python, and SQL · Optimize data flow, automate processes, and scale infrastructure · Develop and manage workflows in Airflow/Cloud Composer and Ascend (or similar ETL tools) · Implement d ...

Develop and optimize data processing jobs using PySpark for complex transformations and aggregations · Design and implement robust data pipelines on AWS, ensuring scalability and performance · Utilize AWS services like EC2 and S3 for data processing and storage solutions · Manage ...

Job Responsibilities: · Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory (ADF) and Azure Databricks. · Write proficient SQL queries to perform data mining and analysis, specifically focusing on Teradata as a primary RDBMS. · Develop c ...

Language - UNIX shell scripting, Python, Oracle PLSQL. · Data base - Strong DB SQL experience - Oracle/MYSQL. · Scheduler - Airflow or other schedulers will be of added advantage. · CI CD - GITLAB/Jenkin. · Integration & logging tools - Kakfa, Splunk - Good to have but not mandat ...

We are seeking a skilled Data Engineer with expertise in Python, Apache Airflow, and Snowflake to join our team in India. The ideal candidate will be responsible for building and maintaining robust data pipelines, optimizing data workflows, and ensuring the reliability and accura ...

Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. · Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency. · Leverage AWS services such as EC2, S3 for comprehe ...

Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. · Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency (Databricks exposure will be an advantage) · Leverage ...

Understanding of core Business Intelligence BI data warehousing technology ETL, RDBMS etc. · Work with the application development teams throughout the development life cycle. · Create Airflow DAG pipelines for data ingestion. · Hands on knowledge of Scripting languages like Pyth ...

We are seeking an experienced Data Quality Engineer to join our team in Hyderabad. · Strong SQL and Python experience required. · ...

Key Responsibilities: · Work with AWS services including S3, Lambda, Glue, API Gateway, and SQS to build and maintain data pipelines · Develop and manage scalable data workflows using Python, PySpark, and SQL · Handle batch job scheduling and manage data dependencies effectively ...

Roles and Responsibilities · Data Engineer/Developer with Cloud (GCP) (Experience - 0 to 2 Years) · Expert in Python, Data Flow, Pubsub, Big Query · Hadoop knowledge, NiFi/Kafka experience · Must have good Experience/knowledge on GCP components like GCS, BigQuery, AirFlow, Cloud ...

Key Responsibilities: · Design, develop, and maintain data pipelines using Python and SQL. · Write efficient, optimized SQL queries for data extraction, transformation, and reporting. · Automate data workflows and integrate APIs or third-party services. · Collaborate with cross-f ...

Role & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. · Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. · Build streaming and near-real-tim ...

Roles and Responsibilities · Must Have Skills: · Proficient in Data Engineering · Hands-on experience in Python, Azure Data Factory, Azure Data bricks (PySpark )and ETL · Knowledge of Data Lake storage (storage container) and MSSQL · A quick and enthusiastic learner (must) and wh ...

Hands-on Experience with programming languages such as Python mandatorily. · Thorough understanding of AWS from a data engineering and tools standpoint. Experience in another cloud is also beneficial. · Experience in AWS Glue, Spark, and Python with Airflow for designing and deve ...

Roles & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow (Apache Beam), Dataproc/Spark, and Cloud Composer (Airflow). · Model and optimize datasets in BigQuery, including partitioning, clustering, materialized views, and UDFs. · Build stre ...