Bigdata/hadoop (with Kafka) Support Expert - Bengaluru, India - CGI Group, Inc.

CGI Group, Inc.
CGI Group, Inc.
Verified Company
Bengaluru, India

1 month ago

Deepika Kaur

Posted by:

Deepika Kaur

beBee Recuiter
Description

Position Description:


  • 7 to 8 years working experience on Big Data Engineering and other open source technologies
  • Strong Knowledge of Python, Apache Spark (PySpark), Azure Data Lake (Gen 2), PySParkSQL, Spark Streaming
  • Strong knowledge of ETL/Data warehosuing concepts.
  • Working knowledge and experience with MapReduce, Spark Streaming, Spark Core, Spark SQL, HQL
  • Good knowledge in MySQL, PostgreSQL, Cassandra, Elastic Search and MongoDB
  • Excellent skills in DB Schema design and NoSQL development
  • Work experience in cloud services Azure, AWS
  • Strong knowledge of building Big Data Applications with highperformance.
  • Ability to think at a high level and see the big picture as well as the technical detail
  • Manage teams towards resolutions of technical issues during deployments/integrations with multiple stakeholders
  • Good experience in implementation of Design Concepts, Patterns and Principles
  • Solid knowledge of software development life cycle.
  • Ability to engage with the client in technology discussions.
  • Excellent leadership and communication skills.
  • Big Data Cloud migration with Confluent/Kafka with 7+yrs of experience
  • Proven Expertise on Confluent
  • Expertise on Kafka
  • Big Data Administration
  • Analyzes, designs, creates and implements Big Data infrastructures, including access methods, device allocations, validation checks, organization and security.
  • Designs data models, logical and physical infrastructure designs, etc.
  • Assists in system planning, scheduling, and implementation
  • Initiates corrective actions to stay on schedule
  • Install, configure, upgrades Hadoop Clusters including Spark, Impala, Hive, Scala, etc.
  • Experience in spark query tuning
  • Develops and implements recovery plans and procedures.
  • Extremely strong Unix/Linux skills
  • Solid administrative knowledge of Apache Hadoop a must (Cloudera distribution a plus)
  • BI Tool integrations with Hadoop
  • DBA experience HBASE
  • Experience with database replication and scaling
  • Design, install, and maintain highly available systems (including monitoring, security, backup, and performance tuning)
  • Scripting experience
  • Very good communication and work management
  • Must possess good analytics and problem solving skills
  • Must be willing to work flexible hours
  • Excellent technical leadership, teamwork and Work with crossfunctional teams to set up a production environment and enable solutions for business

Skills:


  • Hadoop Ecosystem (HDFS)
  • Big Data
  • Big Data
& Analytics Operation

  • Data Analysis
  • Data Architecture

What you can expect from us:

Insights you can act on


While technology is at the heart of our clients' digital transformation, we understand that people are at the heart of business success.


When you join CGI, you become a trusted advisor, collaborating with colleagues and clients to bring forward actionable insights that deliver meaningful and sustainable outcomes.

We call our employees "members" because they are CGI shareholders and owners, and, as owners, we enjoy working and growing together to build a company we are proud of.

This has been our Dream since 1976, and it has brought us to where we are today-one of the world's largest independent providers of IT and business consulting services.

At CGI, we recognize the richness that diversity brings.

We strive to create a work culture where everyone belongs, and we collaborate with clients in building more inclusive communities.

As an equal opportunity employer, we empower all our members to succeed and grow. If you require an accommodation at any point during the recruitment process, please let us know. We will be happy to assist.

Ready to become part of our success story? Join CGI-where your ideas and actions make a difference.
More jobs from CGI Group, Inc.
See all jobs of CGI Group, Inc.