No more applications are being accepted for this job
- 5 to 6 years of experience in ETL, Snowflake, Python, Pyspark
- 2+ years of experience in Airflow, AWS Glue is required.
- 6 to 8 years of strong data warehousing experience using RDBMS and Non-RDBMS databases.
- 5 years of recent hands-on experience (actively coding) working as a data engineer (back-end software engineer considered).
- Experience working in an agile, dynamic and customer facing environment is required.
- Understanding of distributed systems and cloud technologies (AWS) is highly preferred.
- Understanding of data streaming and scalable data processing is preferred to have.
- Experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
- 2+ years of experience in ETL (AWS Glue), Amazon S3, Amazon RDS, Amazon Kinesis, Amazon Lambda, Apache Airflows, Amazon Step Functions.
- Strong knowledge in scripting languages like Python, UNIX shell and Spark is required.
- Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc.
- Technical expertise with data models, data mining and segmentation techniques.
- Experience with full SDLC lifecycle and Lean or Agile development methodologies.
- Knowledge of CI/CD and GIT Deployments.
- Work in team in diverse/ multiple stakeholder environment.
- Communicate complex technology solutions to diverse teams namely, technical, business and management teams.
- Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.
- Develop tools to improve data flows between internal/external systems and the data lake/warehouse.
- Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.
- Understanding existing data applications and infrastructure architecture
- Build and support new data feeds for various Data Management layers and Data Lakes
- Evaluate business needs and requirements
- Support migration of existing data transformation jobs in Oracle, and MS-SQL to Snowflake.
- Write oracle Sql, PLSQL scripts and have demonstrated working experience in managing the oracle scripts.
- Good hands on with linux scriptings.
- Document the processes and steps.
- Develop and maintain datasets.
- Improve data quality and efficiency.
- Lead Business requirements and deliver accordingly.
- Collaborate with Data Scientists, Architect and Team on several Data Analytics projects.
- Collaborate with DevOps Engineer to improve system deployment and monitoring process.
Senior Data Engineer - Hyderabad, India - Helius Technologies
Description
Work Location : Hyderabad ( Onsite )
Job Type: 1 year renewable contract.
Senior Data Engineer
Job Requirement:
Responsibilities: