Senior Data Engineer - Bangalore, India - One of the Consulting Firms

Description

Job Description :

Should have minimum 6 years of Operate/Managed Services/Production Support Experience

Should have extensive experience in developing scalable, repeatable, and secure data structures and pipelines to ingest, store, collect, standardize, and integrate data that for downstream consumption like Business Intelligence systems, Analytics modelling, Data scientists etc.

Designing and implementing data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems, such as data warehouses or data lakes.

Should have experience in building efficient, ETL/ELT processes using industry leading tools like Informatica, Talend, SSIS, SSRS, AWS, Azure, ADF, GCP, Snowflake, Spark, SQL, Python etc.

Should have Hands-on experience with Data analytics tools like Informatica, Collibra, Hadoop, Spark, Snowflake etc.

Monitoring and troubleshooting data pipelines and resolving issues related to data processing, transformation, or storage.

Implementing and maintaining data security and privacy measures, including access controls and encryption, to protect sensitive data.

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

Scaling and optimizing schema and performance tuning SQL and ETL pipelines in data lake and data warehouse environments.

Should have Experience of ITIL processes like Incident management, Problem Management, Knowledge management, Release management, Data DevOps etc.

Should have Strong communication, problem solving, quantitative and analytical abilities