- As a senior/principal engineer, you will be responsible for ideation, architecture, design and development of new enterprise data platform. You will collaborate with other cloud and security architects to ensure seamless alignment within our overarching technology strategy.
- Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies.
- Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
- Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud.
- Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check.
- Architect and design the best security patterns and practices
- Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
- Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
- Design and develop advanced analytics and machine learning capabilities on the data platform.
- Design and develop observability and data governance frameworks and practices.
- Stay up to date with the latest data engineering trends, technologies, and best practices.
- Drive the deployment and release cycles, ensuring a robust and scalable platform.
- 10+ (for senior) 15+ (for principal) of proven experience in modern cloud data engineering, broader data landscape experience and exposure and solid software engineering experience.
- Prior experience architecting and building successful enterprise scale data platforms in a green field environment is a must.
- Proficiency in building end to end data platforms and data services in GCP is a must.
- Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub.
- Experience with Microservices architectures - Kubernetes, Docker and Cloud Run
- Experience building Symantec layers.
- Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure and workloads.
- Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows.
- Hands-on experience with GCP ecosystem and data lakehouse architectures.
- Strong understanding of data modeling, data architecture, and data governance principles.
- Excellent experience with DataOps principles and test automation.
- Excellent experience with observability tooling: Grafana, Datadog.
- Experience with Data Mesh architecture.
- Experience building Semantic layers for data platforms.
- Experience building scalable IoT architectures
- Must have worked with US/Europe based clients in onsite/offshore delivery model
- Should have very good verbal and written communication, technical articulation, listening and presentation skills
- Should have proven analytical and problem solving skills
- Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
- Should be a quick learner, self starter, go-getter and team player
- Should have experience of working under stringent deadlines in a Matrix organization structure
- Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations
-
Platform Cloud Architect
18 hours ago
Semarchy New Delhi, India**About Semarchy** · Semarchy was founded in 2011 in Lyon, France, by a group of former colleagues from Sunopsis before it was acquired by Oracle. This team came together to build a people-first company, to develop a more agile approach to master data management. And so Semarchy ...
-
SAP Cloud Platform Integration
6 days ago
Accurate Global Alliances Delhi, IndiaTotal 8+ years of SAP XI/PI/PO or Dell Boomi experience, In that 3+ years of SAP HCI/CPI, API Management experience Must (Hana Cloud Integration/Cloud Platform Integration). · In that 3-4 years of SAP HCI/CPI, API management experience Must (Hana Cloud Integration/Cloud Platform ...
-
Sme- Google Cloud Platform
1 week ago
NMS Consultant Gurgaon, IndiaFrom 6 to 11 year(s) of experience · ₹ Not Disclosed by Recruiter · - Gurgaon/Gurugram, Bangalore/Bengaluru, Mumbai (All Areas) · - Act as technical expert on Cloud IAAS & PAAS Services · - Perform analysis and diagnosis of complex Cloud implementation/Integration related issues/ ...
-
Lead Cloud Platform Engineer
1 day ago
UKG noida, IndiaUnited States (en-US) Lead Cloud Platform Engineer (Kubernetes, Terraform and (Python/Java/Golang/Ruby) · ...
-
Lead/Architect - Google Cloud Platform
1 day ago
Selsoft Bangalore/Noida, IndiaJob Description : · 1) Successfully executed at least couple of Production Migration projects on Google Cloud Platform · 2) Detailed understanding of Enterprise data architecture and management frameworks · 3) Must have hands on experience with various Google Platform Services li ...
-
Cloud and Platform Lead
3 hours ago
CRA GROUP LIMITED Delhi, IndiaJob Description1 month contract with A Local Authority · Job Summary: · Do you want to work as part of a dedicated team supporting Citrix XenDesktop and XenApp Servers for 4000+ colleagues across multiple organisations. · As a cloud and platform Lead you will be part of a multidi ...
-
Innovacer Bangalore/Noida, IndiaJob Description : · Manage databases in a multi-cloud environment with end-to-end automation including administration, observability, troubleshooting, configuration changes, upgrades, and migrations · - Responsible for Provisioning, availability 24X7, reliability, performance, S ...
-
Cloud Platform Lead
6 days ago
Virtusa Gurugram, IndiaCloud Platform Lead - CREQ186463 Description Platform Engineer · Job Responsibilities · Work with the platform team to architect solutions using modern management tools like MECM and Intune · Build, deploy and support Autopilot as the default device provisioning and imaging sol ...
-
Google Cloud Platform Architect
1 day ago
Vikisol Technologies Anywhere in India/Multiple Locations/Pune/Bangalore/Gurgaon/Gurugram/Mumbai permanentJob Title : GCP Architect · Location : Pune, Bangalore, Gurgaon, Mumbai · Experience : 7+ Years · Job Description : · We are seeking a skilled GCP Architect with over 7 years of experience to join our team. The ideal candidate will have a strong proficiency in Google Cloud Platfo ...
-
Azure Data Architect
1 week ago
Skillety Technologies Noida, India**Job Desciption**: · Total experience in data management area for 10 + years with Azure cloud data platform experience · Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & mandatory expertise on A ...
-
Architect(16-18 Years)
3 days ago
Infogain Noida, IndiaROLES & RESPONSIBILITIES · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · EXPERIENCE ...
-
Platform Security Architect Principal
1 week ago
Ceridian Noida, India**Location**: Work is what you do, not where you go. For this role, we are open to remote work and can hire anywhere in Bangalore, Chennai, Hyderabad and Noida · About the opportunity · The Ceridian Product Security team is responsible for the security of Ceridian products. We en ...
-
Azure Data Architect
1 week ago
Skillety Technologies Noida, IndiaRole: Azure Data Architect with streaming experience Job description Total experience in data management area · 10 + years with Azure cloud data platform experience Architect with Azure stack (ADLS, AALS, Azure Data Bricks, · Azure Streaming Analytics Azure Data Factory, cosmos D ...
-
Cloud Arcitect
5 days ago
CloudFirst Technology Private Limited Noida, India**Cloud Architect Job Description**: · A Cloud Architect is responsible for designing and implementing cloud-based solutions for organizations. · They must have expertise in cloud computing technologies and architectures, as well as a strong understanding of business needs and co ...
-
Azure Data Architect
1 week ago
Skillety Technologies Noida, India**Job Description**: · **Job Desciption**: · Total experience in data management area for 10 + years with Azure cloud data platform experience · Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & m ...
-
Oracle WMS Cloud Architect
4 days ago
BirlaSoft Noida, Uttar Pradesh, IndiaCountry/Region: IN- Requisition ID: Work Model: · - Position Type: · - Salary Range: · - Location: INDIA - NOIDA- BIRLASOFT OFFICE**Title**:Oracle WMS Cloud Architect**: · - Description: · - As an Oracle WMS Cloud Functional Architect, your role involves designing and implementin ...
-
Avp cloud Security
1 week ago
Skillety Technologies Noida, IndiaRoles & Responsibilities · - Serve as a SME on cloud cyber risk for leading cloud platforms AWS, Azure/ office 365. · - Design and develop cloud platform-specific security policies, standards, and procedures for management group and account/subscription management and configurati ...
-
Cia-chief Architect for Cloud Security
6 days ago
NR Consulting - India Noida, IndiaExperience required -8+ · Location Remote · **Requirements**: · At least 10+ years of IT implementation experience in Automotive or Financial Services Industry, or equivalent industries · At least 3+ years of experience delivering modern technology stacks using cloud, such as mic ...
-
Cloud Administration
4 days ago
Persystent Consultancy Services Noida, IndiaAs a Cloud Administrator, you will play a pivotal role in managing and optimizing our cloud infrastructure to ensure seamless operations and a secure environment. You'll work closely with our IT team, clients, and partners to design, implement, and maintain cloud solutions that a ...
-
Ea-infra oci Admin staff
1 week ago
EY Noida, IndiaAt EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...
Cloudsufi - Principal Data Engineer - Google Cloud Platform - noida, India - Cloudsufi India Private Limited
Description
About Us :
CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.
Our Values :
We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.
Diversity and Inclusivity :
CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation and national origin status. We are dedicated to providing equal opportunities in employment, advancement, and all other areas of our workplace.
Role Overview
We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience building enterprise-scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute significantly to platform development with a diverse skill set while also being very hands-on coding and actively shaping the future of our data ecosystem.
What We Are Looking For :
Responsibilities :