Senior Engineer - Big Data (BB-F4F4D)
Found in: Talent IN
Description:
Description QBurst is looking for Senior Data Engineers who can help us build massive big data pipelines. As a Data Engineer at QBurst, you have to develop, construct, test and maintain architectures used for large-scale data processing. Responsibilities Develop data engineering pipelines for clients, that process thousands of records per secondAnalyze client requirements, come up with estimates and implementation plan within a short turn around timeDevelop complex ETL applications using Spark and perform continuous unit and integration testsRoutine code review and peer reviews for implementation approachEnsure code is efficient, well tested, documented and performs at scale Requirements Experience in Scala, SparkKnowledge in building production ready applications in the Hadoop ecosystem + Cassandra, KafkaConsiderable experience in designing databases, and familiarity with both RDBMS and NOSQL conceptsExperience in working with Akka is a plusAbility to work in a fast paced, Agile environmentcalendar_today3 days ago
report