Senior Staff Engineer - Hyderabad, India - Experian

Description

Job Description

Key Responsibilities:

Provide data sharing/storage/retrieval strategy for multiple clients.

Perform large-scale data processing.

Excellent knowledge EMR, Glue , Athena type of computation platform.

Utilize AWS services like S3, EMR, EC2 for data storage and processing.

Airflow management is big a plus.

Ensure the data quality, observability, and integrity across all our data infrastructure.

Oversee data versioning, backups, and restoration to ensure data resilience and availability.

Collaborate with cross-functional teams to implement best practices in data management.

Qualifications

Skills & Qualifications:

Proven experience in providing, managing and maintain Bigdata computational platform.

Minimum 10+ plus years of experience with master's in engineering and/or computer science graduation

Strong knowledge of Bigdata computation

Proficiency with AWS services, including S3, EMR, and EC2.

Hands-on experience with any programming

Good understanding on computation platforms like EMR or Data Bricks

Excellent understanding of AWS cloud

Experience in system management and monitoring the jobs.

Deep understanding monitoring and alerts and deployment.

Familiarity with Git or Bitbucket for version control.