Senior Data Engineer - Noida, India - CloudAngles Inc

Description

Data Engineer

HealthComp is hiring an experienced Data Engineer who will design, develop, and maintain data pipelines for core data storage in our Analytics Engineering team. This person will support the success of the analytics engineering team by developing high quality, robust data pipelines and refining system architectures to support quality, performance, cost and availability initiatives. This role is responsible for improving the overall performance of the existing infrastructure while helping to maintain the high level of quality required for our data storage environments. If you have data pipeline and architecture experience in the self-funded health insurance industry, enjoy collaborating closely with your peers, and thrive in an environment with clear goals and measurable outcomes, then this may be the perfect role for you

Key Responsibilities

· Works collaboratively with a team of analytics engineers and data quality engineers, ensuring high quality delivery of features and bug fixes to maintain and support current production applications.

· Participate in scoping and estimating processes to support sprint planning.

· Establish and uphold data pipeline architecture best practices supporting high quality delivery of client requirements.

· Serve as a subject matter expert on HealthComp's products, services, and client-facing value.

· Stays informed of new and emerging data pipeline and architecture methodologies.

· Applies strong analytical and technical skills to understand, define, research, and resolve everyday data storage and performance issues.

· Design, develop and maintain custom scripts, software and infrastructure for our data pipeline and storage environment.

· Work with internal stakeholders providing feedback on product design and testability.

· Provides on-call support as needed.

· Create and maintain documentation and process guidance for all projects.

Requirements

Skills, Knowledge & Expertise

· Bachelor's degree in computer science or equivalent experience

· 5+ years' experience as a Data Engineer or equivalent, with experience delivering high quality data pipeline and data storage solutions from scratch and via enhancements to existing systems while utilizing best practices.

· Strong Proficiency with tabular and non-tabular databases technologies including full DDL/DML capability

· Previous experience working with big data analytic tools is strongly desired (Scala, Python, Spark, Databricks, etc.)

· Previous experience working with cloud-based data storage applications is strongly desired (Azure and/or AWS preferred).

· Experience with Scrum/Agile development methodologies to support Agile planning and work estimation

· Experience with distributed source code control (Git, GitHub, Bitbucket)

· Knowledge of agile software development suite of tools (Azure DevOps, Jira, etc.)

· Highly self-motivated and directed with the ability and dedication to meeting aggressive deadlines while ensuring quality delivery

· Strong written and verbal communication skills

· Preferred experience in health insurance industry

1. ETL Developers - ETL tool (SSIS) with Azure data factory (SSIS is mandatory)
   
2. Should be able to develop new Functionalities like data attributes, data pipelines and also need to support the existing production to keep the system up.
   
3. Should have deeper understanding of SQL server, transaction replication, SQL Server Triggers etc.
   
4. Should be Open to Work in 2 shifts (8AM-5PM IST) and (12PM-9PM IST) on rotational basis and along with that should be able to support on weekends on rotation basis(Once in a month).