- Design, implement, and optimize Cloudera-based data platforms, including cluster sizing, configuration, and performance tuning.
- Install, configure, and administer Cloudera Manager and CDP/CDH clusters, managing the full cluster lifecycle.
- Monitor, troubleshoot, and resolve platform performance issues promptly.
- Maintain and optimize data ingestion and processing pipelines on the Cloudera platform.
- Collaborate with data engineers and data scientists to design efficient data models and ensure optimal data storage and retrieval.
- Implement and enforce security measures, including authentication, authorization, and encryption.
- Manage user access and permissions in compliance with data privacy regulations and internal policies.
- Create technology roadmaps for the Cloudera platform, recommending and implementing relevant updates and enhancements.
- Plan, test, and execute upgrades involving Cloudera components, ensuring platform stability and security.
- Document platform configurations, processes, and procedures, and provide training/support to team members.
- Expertise in Cloudera, Hadoop, Spark, Hive, Kafka, and CDH/CDP cluster management.
- Strong knowledge of big data concepts, data modeling, and data warehousing principles.
- Proficiency in Linux system administration and scripting (Shell, Python).
- Experience in monitoring, troubleshooting, and performance optimization of Cloudera platforms.
- Knowledge of data security and compliance requirements, with hands-on experience enforcing security measures.
- Familiarity with Azure Data Factory, Azure Databricks, and Azure Synapse is a plus.
- Excellent problem-solving, communication, and collaboration skills.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 10:00 am to 7:30 pm
- 2 days Work From Office (WFO), 3 days Work From Home (WFH)
Technical Consultant: Cloudera - Hyderabad / Secunderabad, Telangana - confidential
Description
Key Responsibilities:
Required Skills & Experience:
Education Qualification:
Work Timings: