- Use different data warehousing concepts to build a data warehouse for reporting purpose.
- Assist Data Science / Modeling teams in setting up data pipelines.
- Develop and test ETL components to high standards of data quality and act as hands-on development lead.
- and contribute to the creation and maintenance of relevant data artifacts (data lineages, source to target mappings, high level designs, interface agreements, etc.).
- that developer responsibilities are being met by mentoring, reviewing code and test plans, verifying that design best practices as well as coding and architectural guidelines, standards, and frameworks are adhered to by offering guidance, communicating risk, and addressing roadblocks as they arise.
- Strong business acumen & demonstrated aptitude for analytics that incite action.
Senior Data Engineer - Gurugram, India - EXL
Description
Job description (Lead Data Engineer)
Job Location: Bangalore/Gurgaon
Shift Timing: 1:00PM IST – 10:30 PM IST
Band : C2/D1
Experience: 5+ years
Job Responsibilities
Collaborate with project stakeholders (client) to identify product and technical requirements. Conduct analysis to determine integration needs.
Build data pipelines to ingest and transform the data into our Data platform
Apply best approaches for large scale data movement, capture data changes and apply incremental data load strategies
Team Leading Experience is required, minimum 2 years of experience in handling of 2 people team.
Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data
Must have:
Hands on coding experience in Oracle/ Teradata & SQL Server platform is a must have.
AWS Cloud experience is a must have.
Teradata to any cloud migration experience is a preference.
Worked on Spark Framework is a must have, Hadoop ecosystem, snowflake , AWS Redshift
Hands on experience on building data pipelines in Bigdata platforms.
Working knowledge of on one of the cloud platforms
Strong verbal and business communication skills.