Senior Data Engineer - Kalaburagi - Kani Solutions Inc

Description

Role:

We are seeking a highly motivated and experienced Senior Data Engineer to join our growing data team. In this role, you will be a key player in ensuring the accuracy, completeness, and consistency of our data assets. You will collaborate with various teams across the organization to identify, analyze, and resolve data quality issues, and implement proactive measures to prevent future problems. This position requires a strong understanding of data quality principles, excellent analytical and problem-solving skills, and the ability to communicate effectively with both technical and non-technical stakeholders.

Qualifications:

Bachelor's degree in Computer Science, Information Management, or a related field

12+ years of experience in data quality analysis, data management, or a related field

Strong understanding of data quality principles, methodologies, and tools

Proficiency in SQL and data analysis techniques

Experience with data warehousing and business intelligence concepts

Experience with AWS Glue Data Quality, DynamoDB, Athena, DataZone, SageMaker, Redshift, S3, Lambda, Step Functions, Spark SQL, PySpark etc.

Experience with data profiling, data cleansing, and data validation tools (e.g., Informatica, Collibra, Alation, Great Expectations)

Proven proficiency within a BI platform (e.g. Microsoft Power BI, Tableau) preferred

Experience with data governance frameworks and regulations (e.g., GDPR, CCPA) is a plus

Experience with cloud-based data platforms (e.g., Azure, GCP) is a plus

Experience with scripting languages (e.g., Python, R) is a plus

ETL and streaming data orchestration experience a plus

Detail and quality-oriented individual with the ability to rapidly learn and take advantage of new technical concepts and technologies

Ability to manage multiple concurrent projects while strong communication and interpersonal skills, with the ability to collaborate effectively with both technical and non-technical stakeholders

Excellent analytical and problem-solving skills

Organized, process driven, and enjoys the challenge of documentation

Team-oriented, collaborative worker while still being able to work independently

Demonstrated technical skills, knowledge and experience helping others to deliver products utilizing programming/systems environments and concepts

Experience with issue escalation, resolution and monitoring as well as communicating project risks

Experience with task prioritization and delegation

Effective verbal and written communication skills.