Data Engineer - Hyderabad, India - Highspot

Description

What You'll Do

Create optimal data pipeline architectureDevelop, and maintain end-to-end scalable data infrastructure and pipelines.
Identify, design, and implement process improvements, automating manual processes and optimizing data delivery.
Assist internal stakeholders with data-related technical issues and support their data infrastructure needs.
Develop data tools for analytics and data scientists, contributing to product innovation.
Collaborate with data and analytics experts to enhance functionality in data systems.
Design and implement data models, ensuring integrity and consistency.
Identify and resolve performance bottlenecks, optimizing queries and processing.
Implement data governance best practices for quality, security, and compliance.
Stay informed about emerging technologies, contribute to tool selection, and enhance data infrastructure.
Create and maintain comprehensive documentation for data engineering processes and workflows.
Drive the team's data strategy, technical roadmap, and data storage solutions.
Empower the team for self-servicing and efficient troubleshooting.

Your Background

Bachelor's degree or equivalent experience.5+ years experience in product engineering industry.2+ years of experience using SQL in an advanced capacity in query authoring, tuning, and identifying useful abstractions.3 years of hands-on experience in Python, demonstrating proficiency in data wrangling and object-oriented programmingExpertise in designing, creating, managing, and utilizing large datasets.

Ability to build efficient, flexible, extensible, and scalable ETL and reporting solutions.
Root cause analysis experience on internal and external data and processes.

Cloud-based database platforms experience, preferably Snowflake.2+ years of git experience for version control and collaboration.2+ years of experience working with AWS cloud technology.2+ years of experience working with workflow management platforms like airflow/dagster1+ years experience using Tableau to build impactful reports and dashboardsExperience working with dbt is a plusStrong analytical and problem-solving skills.

Cross-functional team collaboration experience in a dynamic environment.
Proven track record of navigating ambiguity, prioritizing needs, and solving impactful business problems.
Excellent written and verbal communication skills for technical and non-technical audiences.
Empathy-driven, supporting team success.
Remote work experience with a U.S.-based team is preferred.#LI-LM6