- Design, develop, and maintain end-to-end data solutions using DataBricks, Apache Spark, and other relevant technologies.
- Collaborate with stakeholders to gather, analyze, and translate business requirements into technical solutions and data-driven insights.
- Implement and optimize data pipelines, ETL processes, and data models to support business needs and analytical use cases.
- Perform data analysis, data profiling, and data cleansing to ensure data quality, integrity, and reliability.
- Design and develop data visualizations, dashboards, and reports to facilitate data-driven decision-making and business insights.
- Work closely with data scientists, analysts, and business users to understand data requirements and deliver actionable insights and recommendations.
- Stay up-to-date with the latest trends and advancements in data engineering, analytics, and visualization, and evaluate their potential impact on our data solutions and strategies.
- Provide technical leadership, mentorship, and guidance to junior team members, and promote best practices in data engineering and analytics.
- Bachelor's degree in Computer Science, Engineering, Statistics, or a related field.
- 6+ years of hands-on experience in data engineering, analytics, or a related role, with a focus on building and optimizing data solutions.
- Extensive experience with DataBricks, Apache Spark, and big data technologies for data processing, analytics, and machine learning.
- Proficiency in programming languages such as Python, Scala, or SQL for data manipulation, analysis, and visualization.
- Strong understanding of data modeling concepts and techniques, including dimensional modeling, data warehousing, and data lake architectures.
- Experience with data visualization tools and libraries such as Tableau, Power BI, or matplotlib.
- Excellent problem-solving, analytical, and communication skills, with the ability to effectively communicate complex technical concepts to non-technical stakeholders.
- Proven ability to work independently and collaboratively in a fast-paced and dynamic environment, and adapt quickly to changing priorities and requirements.
Senior DataBricks - Hyderabad, India - The TA Guy Inc.
Description
The TA Guy Inc. is an innovative HR startup in its early stages. Whether you're a business owner in search of top talent or a professional on the lookout for your next fulfilling career opportunity, The TA Guy Inc. is your trusted partner for all your staffing and recruiting requirements.
In addition to our stellar staffing services, we offer extensive support to our clients through an array of specialised HR products designed to cater to your unique needs.
Position: Senior DataBricks / Data Expert
Experience Level: 6+ Years
Location: Hyderabad (Work from office)
Compensation Range: 25L - 30L
About Client: A IT Services company who just started expanding their footprint in India. They are experts in software engineering, UI/UX design, and more, and are committed to collaborative partnerships for rapid growth. With a global presence and a focus on excellence.
Job Description:
As a Senior DataBricks / Data Engineer, you'll play a crucial role in designing, implementing, and optimizing data solutions using DataBricks and other cutting-edge technologies. Leveraging your extensive experience and expertise in data engineering, analytics, and visualization, you'll work closely with cross-functional teams to deliver scalable, high-performance, and actionable insights that drive business value and innovation.
Responsibilities:
Requirements:
We are committed to providing equal employment opportunities to all individuals without regard to race, colour, religion, sex, national origin, age, disability, genetic information, sexual orientation, gender identity, or any other characteristic protected by applicable laws. We celebrate diversity and are dedicated to fostering an inclusive workplace where everyone can thrive.