- Design, develop, and maintain big data processing applications, workflows, and pipelines using Hadoop technologies.
- Utilize Java to build and enhance data processing components and services within the Hadoop ecosystem.
- Implement Kafkabased data ingestion and streaming solutions to efficiently manage realtime data flows.
- Leverage Hadoop technologies (HDFS, MapReduce, Spark, Hive, HBase) for batch and realtime data processing tasks.
- Develop and optimize data ingestion processes to ensure efficient data collection, transformation, and loading into the Hadoop cluster.
- Monitor and optimize the performance of Hadoop jobs and data pipelines for scalability and efficiency.
- Clean and transform data for analysis, ensuring data quality, integrity, and compatibility with downstream applications.
- Design and implement Kafkabased streaming solutions to handle large volumes of realtime data.
- Troubleshoot data processing and Kafkarelated issues promptly.
- Collaborate effectively with data engineers, data scientists, and other crossfunctional teams to understand data requirements and deliver successful solutions.
- Create and maintain comprehensive documentation of Hadoop configurations, Java code, Kafka setups, and data processing workflows.
- Implement and maintain security measures to safeguard sensitive data within the Hadoop ecosystem and Kafka Bachelor's or Master's degree in Computer Science, Information Technology, or a related field (preferred).
- Proven experience as a Hadoop Developer with strong Java and Kafka skills.
- Proficiency in Java programming for building data processing applications.
- Handson experience with core Hadoop ecosystem components (HDFS, MapReduce, Spark, Hive, HBase).
- Familiarity with Kafka for data streaming and ingestion.
- Strong understanding of data transformation and ETL processes.
- Excellent problemsolving skills and a keen eye for detail.
- Effective communication skills for collaboration with team members and stakeholders.
- Experience with data security and compliance is a plus.
- Ability to thrive in a fastpaced environment and adapt to evolving technologies and project requirements.
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bengaluru, IndiaAbout the Role : · We are seeking a highly skilled SAS and Python developer to join our team and play a key role in building, maintaining, and enhancing data-driven solutions. · You will leverage your expertise in both languages to create robust and scalable applications througho ...
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bengaluru, IndiaAbout the job · - Experience with supporting Java (J2EE/Spring Boot) based multi-tier applications with complex upstream downstream interactions having expertise in understanding the application request flow and analysing application logs for investigating and troubleshooting iss ...
-
Unison Consulting
3 days ago
Unison consulting pte ltd Bengaluru, IndiaAbout the Role: · We are seeking a highly skilled Senior Developer to join our growing team and play a key role in developing and maintaining critical applications used within the Financial Crimes Compliance (FCCM) or Anti-Money Laundering (AML) space. · You will leverage your ex ...
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bengaluru, IndiaSolution Architect · We are seeking a highly skilled and experienced Solution Architect to join our dynamic team. · As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements. · Your ...
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bengaluru, IndiaJOB DESCRIPTION: · - Understand the product roadmap and ensure that testing is conducted as per the QA process. · - Work closely with the test lead to devise test strategies for the applications/projects assigned. · - Ensure that the test strategy is implemented as per plan. · - ...
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bangalore, India permanentAbout the Role: · We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. · You will be responsible for translating business needs into scalable, reliable, and high-performance technology archi ...
-
Unison Consulting
4 days ago
Unison consulting pte ltd Bangalore, India permanentBusiness Analyst - Treasury Domain (FX/MM/SE) · About the Role: · We are seeking a highly motivated and analytical Business Analyst to join our team. · You will play a key role in the Software Development Life Cycle (SDLC) by bridging the gap between business stakeholders and th ...
-
Teradata Database Administrator
2 days ago
RiskInsight Consulting Pvt Ltd Bangalore, India permanentAbout the job : · RiskInsight Consulting Pvt Ltd, a subsidiary of Unison Consulting, is currently seeking a highly skilled SAP Teradata DBA to join our team. · As a leading provider of risk management consulting services, we assist clients in implementing and optimizing risk mana ...
-
SAP Fiori Developer
2 days ago
RiskInsight Consulting Pvt Ltd Bangalore, India permanentAbout the job : · RiskInsight Consulting Pvt Ltd, a subsidiary of Unison Consulting, is currently seeking a highly skilled SAP Fiori Developer to join our team. · As a leading provider of risk management consulting services, we assist clients in implementing and optimizing risk m ...
-
It Recruiter
1 week ago
Trijit Technologies Private Limited Bangalore, India Full timeResponsibilities: Manage the entire life cycle of the recruitment process for clients inthe UK. Work closely with the Recruiting leads and hiring managers. Work on strategic global hiring programs. Develop an action plan for recruiting the best fit for the organization. Procure p ...
-
SAP Application Security Specialist
1 day ago
RiskInsight Consulting Pvt Ltd Bengaluru, India Full timeRiskInsight Consulting Pvt Ltd, a subsidiary of Unison Consulting, is currently seeking a highly skilled SAP Application Security Specialist to join our team. As a leading provider of risk management consulting services, we assist clients in implementing and optimizing risk manag ...
Unison Consulting - Bengaluru, India - Unison consulting pte ltd
Description
We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure.
You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics needs.
Responsibilities :
