No more applications are being accepted for this job
- Design, develop, and maintain scalable data pipelines and ETL processes
- Work closely with data scientists and analysts to understand business requirements and translate them into technical solutions
- Optimize and tune data pipelines for performance and efficiency
- Implement data quality and validation processes to ensure data accuracy and integrity
- Collaborate with cross-functional teams to support data-driven decision-making
- Stay current with industry trends and best practices in data engineering and apply them to improve our data infrastructure
- Bachelor's degree in Computer Science, Engineering, or related field
- 5+ years of experience in data engineering or related roles
- Proficiency in Python for data processing and scripting
- Experience with AWS services such as S3, EC2, EMR, Glue, and Redshift
- Strong knowledge of Apache Spark for large-scale data processing
- Experience with SQL, relational databases, and data modeling
- Excellent problem-solving and analytical skills
- Strong communication and collaboration skills
- Ability to work independently and in a team environment
Data Engineer - Hyderabad, India - Anblicks
Description
Designation: Data Engineer
Skills: Python, Pyspark and AWS
Experience: 5+ years
Responsibilities:
Qualifications: