- Design, deploy, and manage Kafka clusters in a production environment, ensuring high availability, scalability, and reliability.
- Collaborate with engineering teams to understand data processing requirements and design Kafka solutions that meet their needs.
- Optimize Kafka configurations and performance to ensure efficient utilization of resources and low latency data processing.
- Develop and maintain Kafkarelated tools, utilities, and automation scripts to streamline deployment, monitoring, and management tasks.
- Provide guidance and best practices to engineering teams on Kafka usage, data modelling, and integration patterns.
- Work closely with operations teams to monitor Kafka clusters, troubleshoot issues, and perform capacity planning.
- Stay updated with the latest Kafka features, enhancements, and best practices, and evaluate their applicability to our environment.
- Indepth understanding of Kafka architecture, including brokers, topics, partitions, producers, consumers, and replication.
- Knowledge of Kafka distributed nature, fault tolerance, scalability and high availability.
- Experience with streaming data processing frameworks like Apache Flink, Apache Spark Streaming, or Kafka Streams.
- Knowledge of Kafka integration pattern and best practises for integration with various data source.
- Knowledge of containerization and orchestration technologies such as Docker and Kubernetes.
- Experience with cloud platforms like AWS, Azure, or Google Cloud Platform.
- Relevant certifications such as Confluent Certified Developer or Confluent Certified Administrator.
- Knowledge of containerization and orchestration technologies such as Docker and Kubernetes.
- Very good knowledge in database technology for both NoSQL DB and SQL DB.
- Working experience with inmemory DB such as Couchbase would be an advantage.
- Establish scalable implementation of data management framework, platform and tools stack.
- Good knowledge to develop, implement and managing BAU operational process for data quality functionality and capability such as Data Quality Statistics, Data Quality Scorecards, Data Quality Analysis and Workflows Design.
-
Kafka Architect
2 weeks ago
Brillio Bengaluru, India**Kafka Architect**: · **Work Location** : Bangalore · **Experience**: 10 to 15Years · **Roles and Responsibilities**: · - Provide consultative recommendations to clients to solve their Big Data challenges · - Work as an individual contributor and or team player based on the proj ...
-
Kafka Architect
1 week ago
vijiksha Technologies Bengaluru, IndiaLooking for 10+ years of experience · - Primary skills: * · Apache Kafka, · Confluent Kafka, · ELK Platform · **Responsibilities**: · Kafka infrastructure consulting · - Cluster sizing, capacity planning, infrastructure design, and implementation · - Bench-marking, throughput, la ...
-
Kafka Architect
5 days ago
Ultrabot Innovations Bangalore/pune/kolkata/chennai, India Full timeJob Description : As a Kafka Architect specializing in Spark and Apache Server, you will play a key role in designing, architecting, and implementing real-time data streaming solutions using Apache Kafka, Apache Spark, and related technologies. · You will work closely with our cl ...
-
Kafka Architect
2 weeks ago
Iriseidea Bengaluru / Bangalore, India Full timeRole & Responsibilities · Kafka infrastructure consulting · Cluster sizing, capacity planning, infrastructure design, and implementation · Bench-marking, throughput, latency and reliability tuning · Multi-data-center design and implementation · DR/fail-over, active/passive implem ...
-
Kafka architect
1 week ago
Rakuten India Bengaluru, IndiaAbout Rakuten:Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engineer ...
-
Kafka architect
1 week ago
Rakuten India Bengaluru, IndiaAbout Rakuten: · Rakuten India is the Development Centre and key technology hub of the Rakuten Group, Inc. We enable our businesses with our depth of knowledge in multiple streams of technology such as Mobile and Web Development, Web Analytics, Platform Development, Backend Engin ...
-
Mresult Services Private Limited Bangalore, India permanentWhat are we looking for · 10+ years of data engineering experience. · Strong experience with streaming platforms such as Kafka, Flink and big data platforms. · 5+ years of experience in building AWS data solutions using services such as storage, virtual machines, serverless te ...
-
Corp-cto Office-architect
2 weeks ago
Tata Elxsi Bengaluru, Karnataka, IndiaAutomotive and TELCO. Connected Vehicle and Smart Mobility Experience will be desirable. Strong Networking Skills and an understanding of 5G will be a big plus. · - Architecting Experience: · - End-to-end solutions on the cloud using microservices, cloud services, and tech stack ...
-
Technology Architect
3 weeks ago
Tata Elxsi Bengaluru, Karnataka, IndiaWe are a tight-knit, award-winning, customer-obsessed team, preparing to "Build Today for Tomorrow"- Creating solutions that take connectivity, electrification, digitalization, and sovereignty together to improve product sustainability, and touch lives, to make a difference to th ...
-
Big Data Architect
3 weeks ago
Cognizant Bengaluru, IndiaHadoop Solution Architect: Big Data Solution Architect | Hadoop Solution Architect: Big Data Solution Architect Hadoop Solution Architect: Big Data Solution Architect Job Information Required skills and experience · Minimum of 15 years; experience in diverse data environments. Ex ...
-
Solution Program Architect
3 weeks ago
DXC Technology Bengaluru, Karnataka, India**Solution Program Architect** · **Job Location**:Hyderabad / Bangalore / Chennai / Noida/ Gurgaon / Pune / Indore / Mumbai/ Kolkata** · **Skills & Technology**: · - Experience in ingestion and extracting information multi-terabyte-sized data sets · - Must have holistic approach ...
-
Aws Architect
1 week ago
Pinnacle Employment Bengaluru, IndiaAWS Architect · - WFH · Experience: 10-12 years · CTC Range: 35-40 LPA · Mandatory skills: Proven Exp as AWS Data Engineering Architect,AWS Architect certified, Exp in cloud Migration, Python, Spark · Required Experience and Skill · Should be hands-on technical lead in AWS with m ...
-
Aws Solution Architect
2 weeks ago
Synapseb systems Bengaluru, India**(IFFU)AWS Solution Architect** · 8Yrs+ · Location**:Bangalore(Onsite)** · **Must have Skills** · DEVELOPMENT BACKGROUND COMPULSORY · 1) Architect scalable, robust, and cost-effective solutions in AWS environment. · 4) SQL, no-SQL, big data, GraphDB, APIs, · 5) Languages : Java, ...
-
Data Platform Architect
2 weeks ago
growel softech Bengaluru, IndiaExperience in working on Scala, PySpark, Python · Experience in working with Airflow, AWS EMR, Google DataProc and Databricks · Experience in working with Amazon Redshift and Snowflake · Experience in working with Apache Hive, Google BigQuery, Google Data Studio, AWS Athena and P ...
-
Java Architect
1 week ago
Immersive Infotech Pvt. Ltd Bengaluru, India Full time**Job Title - Java Architect** · **Location: Bangalore (**Onsite**)** · **Experience: 15+ years** · Immediate joiners are preferred. · **Must-Have**: · - 7+ years of experience in an architect Role. · - Strong background in Systems/Application Architecture · **Skills**: · - Java, ...
-
Automation Architect C#
1 week ago
QA InfoTech Bengaluru, India· 8+ years of experience in programming and automation testing · Banking / Insurance domain knowledge · Knowledge and skills in Java and C#/Python/VBScript. · Strong knowledge and hands on experience in Web Services and Server technologies. · Strong Communication as the role is ...
-
Avp Backend Technology
2 weeks ago
Talentxo Bengaluru, India**Role & Responsibilities** · - Work in Agile development approach, and participate in the scoping the project and timelines · - Work closely with architects and other team members to formulate and execute project plans · - Drive from concept to delivery adhering to quality stand ...
-
Azure -big Data Architect - Scala/spark/hadoop
2 weeks ago
resourcetree Bengaluru, IndiaWe are looking for a Data Architect with good experience in MS Azure and Hadoop. · - 10+ years of technical experience with at-least 2 years on MS Azure and 2 years on Hadoop (CDH/HDP). · - With hands-on experience/exposure to NoSQL Database and Data Modelling · This role involve ...
-
Solution Architect-data
3 weeks ago
Kotak Mahindra Bengaluru, India**Role - Solution Architect · - Overall, 8-12 years of proven experience with building scalable, fault-tolerant and highly available distributed systems · - Experience building a product end to end, from a concept or early design to scale - preferably in a fast-moving tech startu ...
-
Java Solution Architect
1 week ago
Capco Bengaluru, Karnataka, India**Job Title: Java Solution Architect - Banking** · **About Us** · - "Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by ...
Kafka Architect - Bangalore, India - ConnectPro Management Consultants Pvt Ltd.
Description
Work Location:
Bangalore.
Hybrid model - Working in office 3 days in a week.
Experience : 8+ Years.
We are looking for a Kafka Architect who can Work alongside multiple Production Support, Development, System Admin, Project Managers and Engineering teams.
Key Responsibilities:
Technical Skill You Should Have: