Jobs
>
Noida

    Cloudsufi - Principal Data Engineer - Google Cloud Platform - noida, India - Cloudsufi India Private Limited

    Default job background
    Technology / Internet
    Description

    About Us :

    CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.

    Our Values :

    We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners and the community.

    Diversity and Inclusivity :

    CLOUDSUFI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation and national origin status. We are dedicated to providing equal opportunities in employment, advancement, and all other areas of our workplace.

    Role Overview

    We are seeking a dynamic and highly skilled Principal Data Engineer who has extensive experience building enterprise-scale data platforms and lead these foundational efforts. This role demands someone who not only possesses a profound understanding of the data engineering landscape but is also at the forefront of their game. The ideal candidate will contribute significantly to platform development with a diverse skill set while also being very hands-on coding and actively shaping the future of our data ecosystem.

    What We Are Looking For :

    Responsibilities :

    • As a senior/principal engineer, you will be responsible for ideation, architecture, design and development of new enterprise data platform. You will collaborate with other cloud and security architects to ensure seamless alignment within our overarching technology strategy.
    • Architect and design core components with a microservices architecture, abstracting platform, and infrastructure intricacies.
    • Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
    • Design and develop connector frameworks and modern connectors to source data from disparate systems both on-prem and cloud.
    • Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices while keeping costs in check.
    • Architect and design the best security patterns and practices
    • Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
    • Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.
    • Design and develop advanced analytics and machine learning capabilities on the data platform.
    • Design and develop observability and data governance frameworks and practices.
    • Stay up to date with the latest data engineering trends, technologies, and best practices.
    • Drive the deployment and release cycles, ensuring a robust and scalable platform.
    Requirements :
    • 10+ (for senior) 15+ (for principal) of proven experience in modern cloud data engineering, broader data landscape experience and exposure and solid software engineering experience.
    • Prior experience architecting and building successful enterprise scale data platforms in a green field environment is a must.
    • Proficiency in building end to end data platforms and data services in GCP is a must.
    • Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub.
    • Experience with Microservices architectures - Kubernetes, Docker and Cloud Run
    • Experience building Symantec layers.
    • Proficiency in architecting and designing and development experience with batch and real time streaming infrastructure and workloads.
    • Solid experience with architecting and implementing metadata management including data catalogues, data lineage, data quality and data observability for big data workflows.
    • Hands-on experience with GCP ecosystem and data lakehouse architectures.
    • Strong understanding of data modeling, data architecture, and data governance principles.
    • Excellent experience with DataOps principles and test automation.
    • Excellent experience with observability tooling: Grafana, Datadog.
    Nice to have :
    • Experience with Data Mesh architecture.
    • Experience building Semantic layers for data platforms.
    • Experience building scalable IoT architectures
    Non-Technical/ Behavioral competencies required :
    • Must have worked with US/Europe based clients in onsite/offshore delivery model
    • Should have very good verbal and written communication, technical articulation, listening and presentation skills
    • Should have proven analytical and problem solving skills
    • Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
    • Should be a quick learner, self starter, go-getter and team player
    • Should have experience of working under stringent deadlines in a Matrix organization structure
    • Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations
    )


  • Semarchy New Delhi, India

    **About Semarchy** · Semarchy was founded in 2011 in Lyon, France, by a group of former colleagues from Sunopsis before it was acquired by Oracle. This team came together to build a people-first company, to develop a more agile approach to master data management. And so Semarchy ...


  • Accurate Global Alliances Delhi, India

    Total 8+ years of SAP XI/PI/PO or Dell Boomi experience, In that 3+ years of SAP HCI/CPI, API Management experience Must (Hana Cloud Integration/Cloud Platform Integration). · In that 3-4 years of SAP HCI/CPI, API management experience Must (Hana Cloud Integration/Cloud Platform ...


  • NMS Consultant Gurgaon, India

    From 6 to 11 year(s) of experience · ₹ Not Disclosed by Recruiter · - Gurgaon/Gurugram, Bangalore/Bengaluru, Mumbai (All Areas) · - Act as technical expert on Cloud IAAS & PAAS Services · - Perform analysis and diagnosis of complex Cloud implementation/Integration related issues/ ...


  • UKG noida, India

    United States (en-US) Lead Cloud Platform Engineer (Kubernetes, Terraform and (Python/Java/Golang/Ruby) · ...


  • Selsoft Bangalore/Noida, India

    Job Description : · 1) Successfully executed at least couple of Production Migration projects on Google Cloud Platform · 2) Detailed understanding of Enterprise data architecture and management frameworks · 3) Must have hands on experience with various Google Platform Services li ...


  • CRA GROUP LIMITED Delhi, India

    Job Description1 month contract with A Local Authority · Job Summary: · Do you want to work as part of a dedicated team supporting Citrix XenDesktop and XenApp Servers for 4000+ colleagues across multiple organisations. · As a cloud and platform Lead you will be part of a multidi ...


  • Innovacer Bangalore/Noida, India

    Job Description : · Manage databases in a multi-cloud environment with end-to-end automation including administration, observability, troubleshooting, configuration changes, upgrades, and migrations · - Responsible for Provisioning, availability 24X7, reliability, performance, S ...

  • Virtusa

    Cloud Platform Lead

    6 days ago


    Virtusa Gurugram, India

    Cloud Platform Lead - CREQ186463 Description Platform Engineer · Job Responsibilities · Work with the platform team to architect solutions using modern management tools like MECM and Intune · Build, deploy and support Autopilot as the default device provisioning and imaging sol ...


  • Vikisol Technologies Anywhere in India/Multiple Locations/Pune/Bangalore/Gurgaon/Gurugram/Mumbai permanent

    Job Title : GCP Architect · Location : Pune, Bangalore, Gurgaon, Mumbai · Experience : 7+ Years · Job Description : · We are seeking a skilled GCP Architect with over 7 years of experience to join our team. The ideal candidate will have a strong proficiency in Google Cloud Platfo ...


  • Skillety Technologies Noida, India

    **Job Desciption**: · Total experience in data management area for 10 + years with Azure cloud data platform experience · Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & mandatory expertise on A ...


  • Infogain Noida, India

    ROLES & RESPONSIBILITIES · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · - Azure Cloud Arch. · EXPERIENCE ...


  • Ceridian Noida, India

    **Location**: Work is what you do, not where you go. For this role, we are open to remote work and can hire anywhere in Bangalore, Chennai, Hyderabad and Noida · About the opportunity · The Ceridian Product Security team is responsible for the security of Ceridian products. We en ...


  • Skillety Technologies Noida, India

    Role: Azure Data Architect with streaming experience Job description Total experience in data management area · 10 + years with Azure cloud data platform experience Architect with Azure stack (ADLS, AALS, Azure Data Bricks, · Azure Streaming Analytics Azure Data Factory, cosmos D ...

  • CloudFirst Technology Private Limited

    Cloud Arcitect

    5 days ago


    CloudFirst Technology Private Limited Noida, India

    **Cloud Architect Job Description**: · A Cloud Architect is responsible for designing and implementing cloud-based solutions for organizations. · They must have expertise in cloud computing technologies and architectures, as well as a strong understanding of business needs and co ...


  • Skillety Technologies Noida, India

    **Job Description**: · **Job Desciption**: · Total experience in data management area for 10 + years with Azure cloud data platform experience · Architect with Azure stack (ADLS, AALS, Azure Data Bricks, Azure Streaming Analytics Azure Data Factory, cosmos DB & Azure synapse) & m ...


  • BirlaSoft Noida, Uttar Pradesh, India

    Country/Region: IN- Requisition ID: Work Model: · - Position Type: · - Salary Range: · - Location: INDIA - NOIDA- BIRLASOFT OFFICE**Title**:Oracle WMS Cloud Architect**: · - Description: · - As an Oracle WMS Cloud Functional Architect, your role involves designing and implementin ...

  • Skillety Technologies

    Avp cloud Security

    1 week ago


    Skillety Technologies Noida, India

    Roles & Responsibilities · - Serve as a SME on cloud cyber risk for leading cloud platforms AWS, Azure/ office 365. · - Design and develop cloud platform-specific security policies, standards, and procedures for management group and account/subscription management and configurati ...


  • NR Consulting - India Noida, India

    Experience required -8+ · Location Remote · **Requirements**: · At least 10+ years of IT implementation experience in Automotive or Financial Services Industry, or equivalent industries · At least 3+ years of experience delivering modern technology stacks using cloud, such as mic ...


  • Persystent Consultancy Services Noida, India

    As a Cloud Administrator, you will play a pivotal role in managing and optimizing our cloud infrastructure to ensure seamless operations and a secure environment. You'll work closely with our IT team, clients, and partners to design, implement, and maintain cloud solutions that a ...


  • EY Noida, India

    At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build ...