- Design, develop, and maintain scalable data processing systems using Apache Spark, Scala, Hadoop, Jenkins CI/CD, and Microservices
- Collaborate with crossfunctional teams to gather and analyze data requirements
- Write clean, efficient, and maintainable code to process and analyze largescale data sets
- Optimize and tune data processing pipelines for performance and scalability
- Troubleshoot and resolve issues related to data processing and pipeline failures
- Ensure proper security measures are implemented to protect sensitive data
- Keep up to date with emerging technologies and industry trends to continuously enhance data processing systems
- Bachelor's degree in Computer Science or related field
- Proven experience as a Full Stack Data Engineer or similar role
- Strong proficiency in Apache Spark and Scala
- Handson experience with Hadoop ecosystem (HDFS, Hive, HBase, etc.)
- Experience with Jenkins CI/CD for automated deployments and continuous integration
- Familiarity with Microservices architecture and implementation
- Excellent problemsolving and analytical skills
- Strong communication and collaboration abilities
- Ability to thrive in a fastpaced, dynamic environment
- Attention to detail and ability to deliver highquality work )
AppSierra Solutions - Pune/Hyderabad, India - AppSierra Solutions Pvt Ltd
Description
:We are currently seeking a highly skilled Full Stack Data Engineer to join our team. As a Full Stack Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems. You will work with large-scale data sets using technologies such as Apache Spark, Scala, Hadoop, Jenkins CI/CD, and Microservices.
This is an excellent opportunity to contribute to the development of cutting-edge data solutions and be part of a dynamic and innovative team.
Responsibilities:
: