Data Engineer - India - Ascendion

Description

Role: Senior Data Engineer

Job Description:

• The Senior Data Engineer will oversee the department's data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis. This role will work closely and collaboratively with members of the Data & Analytics and Development teams to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high-quality data pipelines in support of the analytics needs.

Responsibilities:

• Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications.
• Develop and implement processes to collect data from a variety of sources, and ensure these processes are reliable and scalable.
• Clean and process raw data so it's suitable for analysis and reporting.
• Create and deploy efficient data storage solutions and optimize these for performance and scalability.
• Develop data pipelines to automate data extraction, transformation, and loading.
• Collaborate to design and maintain data models.
• Transform raw data into scalable, performant data models that would be consumed by data analysts and data scientists.
• Design, build and update foundational analytics data models that simplify analyses across the products.
• Implement industry-standard data security methods, including encryption, and ensure compliance with data privacy regulations.
• Design and deploy data backup and recovery solutions.

Qualifications:

• Degree in a computer science, software engineering Minimum of 8+ years (5+ with advanced degree) experience working in an engineering role with Strong communication skills, both written and verbal.
• 5+ years of experience working with Python and SQL. (must have)
• 3+ years of experience with DBT, Fivetran (must have)
• Experience in developing orchestration/scheduling jobs using Airflow (must have)
• Experience with cloud platforms (preferably AWS) and Snowflake.
• A strong working knowledge of both relational and NoSQL database systems.
• Familiarity with the basic principles of distributed computing and data modeling.
• Working experience with Dimensional Modeling.
• Familiarity with extract, transform, and load (ETL) tools and frameworks.
• A strong understanding of data and database security and security best practices