cloud-based big data engineer - Hyderabad / Secunderabad, Telangana - beBeeBigData

We are seeking a skilled Data Engineer to join our team in India. The ideal candidate will be responsible for designing, building, and maintaining data pipelines that support our data-driven decision-making processes. You will work closely with cross-functional teams to ensure th ...

We are seeking a skilled Data Engineer with expertise in Python, Apache Airflow, and Snowflake to join our team in India. The ideal candidate will be responsible for building and maintaining robust data pipelines, optimizing data workflows, and ensuring the reliability and accura ...

Data Engineer Advanced Hyderabad, India Objectives of the role · • Design, build and maintain complex ELT jobs that deliver business value · • Translate high-level business requirements into technical specs · • Ingest data from disparate sources into the data lake and data war ...

Roles & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow (Apache Beam), Dataproc/Spark, and Cloud Composer (Airflow). · Model and optimize datasets in BigQuery, including partitioning, clustering, materialized views, and UDFs. · Build stre ...

Key Responsibilities: · Design, build, and maintain data pipelines (ETL/ELT) using BigQuery, Python, and SQL · Optimize data flow, automate processes, and scale infrastructure · Develop and manage workflows in Airflow/Cloud Composer and Ascend (or similar ETL tools) · Implement d ...

Roles and Responsibilities · Data Engineer/Developer with Cloud (GCP) (Experience - 0 to 2 Years) · Expert in Python, Data Flow, Pubsub, Big Query · Hadoop knowledge, NiFi/Kafka experience · Must have good Experience/knowledge on GCP components like GCS, BigQuery, AirFlow, Cloud ...

This team is responsible for designing and delivering data engineering, analytics, and generative AI solutions that drive meaningful business impact. We re looking for a pragmatic, results-driven problem solver who thrives in a fast-paced environment and is passionate about build ...

Essential Duties and Responsibilities · Develop and maintain data pipelines using Azure native services (e.g., ADLS Gen2, Azure Data Factory, Synapse, Spark, Python, Databricks) and AWS cloud services (e.g., Databurst). · Design and build datasets required for Business Analytics ...

Nisum is looking for a skilled Data Engineer to join our team. In this role, you'll be responsible for designing and building scalable data pipelines, developing robust data models, and ensuring data quality across our systems. If you're passionate about transforming raw data int ...

What youll do · Following are high level responsibilities that you will play but not limited to: · Analyse Business Requirements. · Analyse the Data Model and do GAP analysis with Business Requirements. · Design Data Warehouse/Business Intelligence schema. · Transformation of Dat ...

Requirements · What You Will Do · Analyze Business Requirements. · Analyze the Data Model and perform GAP analysis with Business Requirements and Power BI. · Design and model Power BI schema. · Transform data in Power BI, SQL, or Microsoft Fabric. · Create DAX formulas, reports, ...

Role & Responsibilities: · Design, develop, and maintain ELT/ETL pipelines on GCP using Dataflow/Beam, Dataproc/Spark, and Airflow/Composer. · Model and optimize datasets in BigQuery using partitioning, clustering, materialized views, and UDFs. · Build streaming and near-real-tim ...

Design and architect enterprise-scale data platforms, integrating diverse data sources and tools. · Develop real-time and batch data pipelines to support analytics and machine learning. · Define and enforce data governance strategies to ensure security, integrity, and compliance. ...

Key Responsibilities:Design and implement data models and pipelines using VaultSpeed to automate Data Vault architecture. · Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL/ELT). · Work closely with data architects, analysts, and busine ...

Role- Data Engineer · Job Description · Desired Competencies (Technical/Behavioral Competency) · Python with Pandas, Numpy · SQL · Responsibility of / Expectations from the Role · Python with Pandas, Numpy · Good SQL exp · Good Communication skills · Good stakeholder management e ...

We are looking for a skilled Data Engineer with strong experience in Python and AWS cloud technologies. The ideal candidate should have hands-on knowledge of building automation frameworks, managing test scripts, and working with various AWS services. This role requires good tech ...

As a Software Engineer (Associate II), you will take a leading role in designing, developing, and maintaining APIs that integrate advanced AI and ML capabilities. You will collaborate with cross-functional teams to implement Generative AI solutions, ensure secure and efficient de ...

Experience with Hadoop ecosystem, particularly with Hive for data querying and analysis · Experience with data modeling and ETL processes · Good knowledge of MySQL and ability to write complex queries, stored procedures, and perform query optimization · Capable of working with la ...

Have experience with Data Fusion or Equivalent, Big Query or Equivalent, SQL server, scripting in Java/Python that works well in GCP products, and their respective practices. Python experience is a plus. · Develop data ETL pipelines that meets both the functional and non-function ...

Key deliverables: · Enhance and maintain the MDM platform · Monitor and optimize system performance · Troubleshoot and resolve technical issues · Support production incident resolution · Role responsibilities: · Develop and refactor Python and SQL code · Integrate REST APIs withi ...

Python Proficiency: Strong understanding of Python, with practical coding experience · AWS: Comprehensive knowledge of AWS services and their applications · Airflow: creating and managing Airflow DAG scheduling. · Unix & SQL: Solid command of Unix commands, shell scripting, and w ...