Data Engineering Architect - Bengaluru, Karnataka
22 hours ago
Job description
Data Engineering Architect
Experience: 8-12+ years
Location: Kolkata/Bangalore
Work Mode: Hybrid
Position Summary
:
Own enterprise data architecture across OLTP, analytics and Gen AI Agentic AI workloads cloud on-prem. Define lakehouse warehouse target state standards; enable secure, scalable, cost efficient RAG agentic solutions. Partner with data engineering AI teams to deliver governed, retrieve already datasets metadata. Preferred: Primary experience on Azure Databricks + Synapse Platform + Purview OR AWS Snow flake Redshift + Glue with exposure to the other; ServiceNow CMDB/ITSM/ITOM as a governed knowledge source is a plus.
Key Responsibilities
:
- Own roadmap for lakehouse, warehouse, MDM and streaming layers. Architect on Azure OR AWS Databricks Synapse or Snowflake Redshift with ADF Glue Airflow orchestration; design streaming with Kafka OR Kinesis and CDC.
- Model data dimensional, Data Vault 2.0, DDD; define canonical semantic layers. Build ELTETL SQL, Python, PySpark; batchstream pipelines Kafka, Kinesis, CDC, schema registry.
- Design vectorization pipelines chunking, embeddings operate vector stores Azure AI Search, Pinecone, FAISS.
- Data quality metadata lineage: Great Expectations Deequ; Purview AI Collaboration; Open Lineage.
- Security privacy FinOps: IAMRBACABAC, encryption, PIIGDPRISO; SLAs, cost performance monitoring.
- Integrate ServiceNow via Table REST APIs; align with CSDM; stream events to agents via Kafka.
Must-have Skills
- Expert SQL; strong Python PySpark;
- ELTETL orchestration Airflow ADF Glue.
- Lakehouse warehouse: Databricks Delta; Snowflake Redshift Big Query; modeling Kimball, Data Vault.
- Streaming integration: Kafka OR Kinesis; CDC; Avro Proto buf.
- Cloud Azure OR AWS, security IAMTLSKMS, DR performance; governance Purview CollibraAlation, Great Expectations Deequ, PII controls.
- Good to Have Agentic RAG architectures Lang Chain, Lang Graph with vector stores Azure AI Search Pinecone FAISS and unification of ServiceNow knowledge with lakehouse.
- Exposure to ServiceNow data integration Table REST APIs, CSDMCMDB is a plus.
- Cost performance for GenAI data flows: Delta Iceberg Hudi tuning; Databricks Snowflake FinOps; real-time features via Kafka.
- Education BE / BTech/ ME/ MTech in CSIT Data or related Preferred
- Certifications: Azure AWS Data Engineer Architect, Databricks, Snowflake.
Similar jobs
We're Hiring: Security Software Engineers & Enterprise Architect · Cred-O is building the next generation of AI-driven cybersecurity and intelligence platforms for enterprise and industrial environments. · We work with enterprise customers at production scale and are growing rapi ...
5 days ago
A strong experience in cloud-native platforms is preferred for this role which involves system architecture scalability and stakeholder collaboration. · ...
2 weeks ago
+ Prepare architectural designs drawings and 3D concepts coordinate with clients consultants and site teams ensure design compliance support approvals and assist in execution as per project requirements. · ...
2 weeks ago
Hiring for my IT services client - Bengaluru or Noida Location. · Architectural Leadership: · Strategy & Roadmap: · Execution & Delivery: · Mentorship: ...
1 month ago
Salesforce has Software Architect opportunities throughout the company These positions require technical skills outstanding analytical and influencing skills and extraordinary business insight. · Accountable for defining and driving software architecture and enterprise capabiliti ...
1 month ago
We are seeking an experienced and highly skilled Lead AI/ML Architect Engineer to design, build, and scale AI/ML solutions. The ideal candidate will lead end-to-end model development, architecture planning, deployment, and optimization while working closely with cross-functional ...
1 month ago
We are seeking a dynamic and highly skilled Cloud Architect who has extensive experience building enterprise scale data platforms and lead these foundational efforts.This role demands someone who not only possesses a profound understanding of the data engineering landscape but is ...
3 weeks ago
The Professional will be responsible to architect methods to improve data reliability and quality. · Analyze and organize raw data · Build data systems and pipelines · ...
1 week ago
We are looking for a Performance Engineering Architect with 9-12 years of experience to join our team. · ...
5 days ago
We are seeking a dynamic and highly skilled Cloud Architect who has extensive experience building enterprise scale data platforms and lead these foundational efforts. · This role demands someone who not only possesses a profound understanding of the data engineering landscape but ...
3 weeks ago
We are looking for a Performance Engineer Architect who will be responsible for designing and implementing performance testing strategies. · ...
6 days ago
Location Pan India · Level - SM Level (13 to 18 yrs) · Security Engineer /Architect (AWS Cloud Security Architect) · Understand the Client Security Standards and create Security Design Document · Implement Container Security Principles for Astronomer Platform hosted in AWS. · Des ...
22 hours ago
Data Engineering Architect · Experience: 8 to 12+ years · Location: Kolkata Bangalore · Work Mode: Hybrid · Position Summary: · Own enterprise data architecture across OLTP, analytics and GenAI or agentic AI workloads on cloud or on prem. Define lakehouse and warehouse target ...
16 hours ago
Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. · ,Accountable for defining and driving software architecture and enterprise capabilities (scalability, fault tolera ...
1 month ago
This position requires strong technical skills in .NET architecture and experience with Microsoft Visual Studio. The ideal candidate will have excellent problem-solving skills, knowledge of testing tools and frameworks. · ...
1 month ago
We're building the data engineering backbone of the next-generation industrial AI platform in our Bengaluru engineering hub. · This is a greenfield opportunity to architect and own large-scale distributed systems that process and contextualize industrial data at massive scale, · ...
1 month ago
Data Engineering Architect · Experience: 8-12+ years · Location: Kolkata/Bangalore · Work Mode: Hybrid · Position Summary : · Own enterprise data architecture across OLTP, analytics and Gen AI Agentic AI workloads cloud on-prem. Define lakehouse warehouse target state standard ...
1 day ago
As an Architect at Quest Global you will play a crucial role in managing complex building construction projects. Your expertise will be instrumental in developing solutions for various building typologies leading the project team and ensuring project success. · ...
2 weeks ago
We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you you would enjoy yo ...
1 month ago
Hiring for my IT services client Bengaluru or Noida Location. As a Data Engineering Architect you will be the technical guru responsible for designing building and scaling our enterprise data ecosystems. · ...
1 month ago