Lead Data Engineer | US Consultation Service Company | 8-10 years (BB-69223)

Found in: Neuvoo Premium IN


US Consultation Service Company is hiring for one of its Fortune500 Clients
Design and build reusable components, frameworks and libraries at scale to support analytics data products
Design and implement product features in collaboration with business and Technology stakeholders
Anticipate, identify and solve issues concerning data management to improve data quality
Clean, prepare and optimize data at scale for ingestion and consumption
Drive the implementation of new data management projects and re-structure of the current data architecture
Implement complex automated workflows and routines using workflow scheduling tools
Build continuous integration, test-driven development and production deployment frameworks
Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
Analyze and profile data for the purpose of designing scalable solutions
Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
Mentor and develop other data engineers in adopting best practices
Work with product management to understand business requirements
Work with Engineering leadership and architecture teams to align on design, architecture and enterprise strategy
-8+ Years experience of building big data solutions
-Advanced experience building cloud scalable, real time and high-performance data lake solutions leveraging AWS, EMR, S3, Hive & Spark
-Experience working in an agile and iterative landscape
-Experience with relational SQL
-Experience with scripting languages such as Shell, Python
-Experience with source control tools such as GitHub and related dev process
-Experience with workflow scheduling toolslike Airflow
-In-depth understanding of micro service architecture
-Strong understanding of developing complex data solutions
-Experience working on end-to-end solution design
-Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions
-Willing to learn new skills and technologies
-Have a passion for data solutions
-Strong understanding of data structures and algorithms
-Strong understanding of solution and technical design
-Has a strong problem solving and analytical mindset
-Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
-Able to quickly pick up new programming languages, technologies, and frameworks

calendar_today5 days ago

Similar jobs

location_onNelamangala, India


I expressly authorise the Terms and Conditions