Data Engineer - Pune - IOWeb3 Technologies

6 days ago

Description

Job Description:

We are seeking a highly skilled Data Engineer to join our team at ioweb3-technologies. As a Data Engineer, you will be responsible for designing, building, and maintaining highly scalable and efficient data pipelines on Google Cloud Platform (GCP).

Responsibilities:

Design, build, and maintain highly scalable and efficient data pipelines on GCP.
Develop and implement ETL/ELT processes to ingest, transform, and load large datasets.
Optimize data workflows for performance, reliability, and cost-effectiveness.
Leverage and optimize GCP services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Functions.
Utilize Dataflow for stream and batch data processing.
Implement Pub/Sub for real-time data ingestion and messaging.
Design and manage data warehouses within BigQuery.
Ensure data integrity, quality, and consistency across all data pipelines.
Implement and maintain data security measures, adhering to best practices and compliance requirements.
Monitor data pipelines for errors and anomalies, and implement proactive measures to prevent issues.

Requirements:

4+ years of hands-on experience as a Data Engineer, with a strong emphasis on GCP.
Extensive experience with core GCP services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Functions.
Proficiency in Python for data processing and automation.
Strong SQL skills for data querying and manipulation.
Knowledge of Infrastructure as Code (IaC) using Terraform (preferred).
Experience with CI/CD pipelines for automated deployments.

Qualifications:

5+ years of experience in GCP Data Engineering.
Experience in optimizing data workflows and implementing complex ETL/ELT processes.

Advanced Skills:

Experience with DataProc.
Experience with Airflow or Cloud Composer.
Experience with Data Catalog.

GCP Data Engineer @ Pune
2 days ago

Quess IT Staffing Pune

Ingénieur GCP · Lieu : Pune · Durée : Contrat à Durée Indéterminée · Description du Poste : · Expérience requise : 4 ans · Compétences attendues : PL/SQL, Python, GCP · Rôle et Responsabilités : · Le candidat choisi occupera le poste d'ingénieur GCP et sera chargé de la conceptio ...
Data Engineer
6 days ago

TekPillar Pune

Job Title: Data Engineer · Experience: 3 to 7 Years · We are seeking a skilled Data Engineer with expertise in Python, Snowflake, SQL, and AWS to join our dynamic team at Tekpillar. As a Data Engineer, you will be responsible for designing, developing, and maintaining data engine ...
Data Engineer
1 week ago

Oncorre Inc Pune

Company Description · Oncorre Inc. is a boutique digital transformation consultancy headquartered in Bridgewater, New Jersey. · Established in 2007, Oncorre provides cutting-edge engineering solutions for Fortune companies and Government Agencies across the USA. · Our mission is ...
Data Engineer
6 days ago

Ingeniumnext Pune

**Job Title : GCP Data Engineer** · We are seeking skilled professionals to drive digital transformation for Fortune 500 clients across industries. Our focus is on innovation and cutting-edge cloud technologies that empower businesses to harness the power of data. · As a GCP Data ...
Data Engineer
6 days ago

MWIDM Staffing Services Pune

Exciting Opportunity for a Data Engineer with Microsoft Fabric Expertise · With 5+ years of experience, you will be responsible for building and maintaining robust data pipelines and warehousing solutions. · Key Responsibilities: · Design and implement data solutions using Micros ...
Data Engineer
6 days ago

Coders Brain Technology Private Limited Pune

Job Description: · We are seeking an experienced Data Engineer to join our team at Coders Brain Technology Private Limited. The ideal candidate will have a strong background in data engineering, with a focus on building scalable data solutions. · The Data Engineer will be respons ...
Data Engineer
6 days ago

Live Connections Pune

ROLE SUMMARY · We are seeking an experienced Data Engineer/Big Data Engineer to join our Enterprise Architecture team. As a Data Engineer/Big Data Engineer, you will be responsible for designing, building, and maintaining small and large-scale data systems and architectures that ...
Data Engineer
1 week ago

Alp Consulting Ltd. Pune

Data Engineer · We are seeking a highly skilled Data Engineer to join our team at alp-consulting-ltd. · Domain: · The ideal candidate will have expertise in the pharma/pharmacy/pharmaceutical domain. · Cloud Platforms: · AWS (S3, EC2, Lambda) · Azure (Data Lake, Azure Functions) ...
Data Engineer
6 days ago

Impetus Career Consultants Private Limited Pune

Job Title: Data Engineer · We are looking for a skilled Data Engineer with expertise in SQL Server and AWS-based cloud data solutions. · About the Role: · Optimize SQL Server to improve performance, implement governance, and ensure data quality. · Set up a reporting database for ...
Data Engineer
6 days ago

Where U Elevate Pune

Job Description: · Talented Data Engineers Sought · We are looking for highly motivated data engineers with expertise in MS Azure or AWS engineering to join our Data analytics team. · Primary Responsibilities: · Architect data warehousing and BI solutions that solve problems acro ...
Data Engineer
6 days ago

Edgematics Pune

Job Description: · About the Role · We are seeking an experienced Data Engineer to lead the development of a cutting-edge data platform leveraging distributed computing frameworks such as Apache Spark, Databricks, and Snowflake. The platform will enable near real-time supply chai ...
Data Engineer
2 days ago

Suzlon Group Pune

Data Engineer/Power BI Developer · Job Overview · We are seeking a Power BI Developer with 3-4 years of experience in data engineering, who can design, build and manage scalable data solutions and intuitive analytics tools. The ideal candidate will have expert-level Power BI skil ...
Data Engineer
6 days ago

TekIT Software Solutions Pvt. Ltd. Pune

Data Engineer (AWS & PySpark) Position · We are seeking an experienced Data Engineer to join our team at Tekit Software Solutions Pvt. Ltd. · Key Responsibilities: · Develop and optimize ETL pipelines using AWS Glue and PySpark · Implement AWS Step Functions for workflow automati ...
Data Engineer
6 days ago

Tekpillar Service Pvt. Ltd. Pune

Job Title: Data Engineer · We are seeking a talented and experienced data engineer to join our growing team. In this role, you will work on a variety of projects involving data engineering, extract, transform, load (ETL) processes, and data visualization to help our business make ...
Data Engineer
2 days ago

157 Careers Pune

We are seeking a highly skilled Data Engineer to join our team at 157-careers. · Job Description · Data engineers play a crucial role in designing, implementing, and optimizing end-to-end data pipelines for ingesting, processing, and transforming large volumes of structured and u ...
Data Engineer
6 days ago

Talent Aura Pune

Job Overview: · The ideal candidate for this position will possess strong SQL skills, with a solid understanding of relational database concepts. Expertise in Business Intelligence tools, particularly Microsoft Power BI, is also required. Proficiency in DAX formula development an ...
Data Engineer
1 week ago

Stratacent Pune

Data Engineer · At Stratacent, we are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data warehousing, ETL tools, and cloud-based data platforms. · Key Responsibilities: · Design and implement data warehouses and ETL pr ...
Data Engineer
6 days ago

Bio Tribe Pune

Job Summary · We are seeking a highly skilled GCP Data Engineer to design, build, and maintain scalable data pipelines. The ideal candidate will work closely with data scientists, analysts, and business teams to ensure efficient data processing and integration within the Google C ...
Data Engineer
1 week ago

Innovalus Technologies Pune

Job Description : · The Data Engineer plays a pivotal role in leveraging data integration techniques to craft intricate data-centric solutions. This position focuses on the design, implementation, automation, and optimization of data pipelines and enterprise-wide data-centric app ...
Data Engineer
6 days ago

W Pune

Job Title: Senior Data Engineer · Overview: · We are seeking a highly experienced Senior Data Engineer to join our team. The successful candidate will be responsible for architecting data warehousing and BI solutions that address complex business problems across multiple function ...
Data Engineer
1 week ago

Synechron Pune

About Synechron · We believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. · Synechron's progressive technologies and optimization strategies ...