Data Engineer III - Bengaluru, India - ZoomInfo

Description

Data Engineer III

Position:

Data Engineer IIILocation: BangaloreExperience : 4-8 YearsAbout the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems.

In this dynamic position, you'll serve as both a developer and architect for various data monitoring and querying tools.

You'll collaborate with a dedicated team to design and implement data pipelines that not only measure metrics but also monitor the quality of our systems, ensuring an unparalleled experience for our customers and internal stakeholders.

Technological Stack:

Our technology stack includes but is not limited to Airflow, Python, BigQuery, Snowflake, Google DataProc, AWS Glue, Starburst/Apache Trino, Apache Iceberg, Apache Kafka, Kubernetes, AWS EMR Spark, Google BigTable, and more.

This role offers a tremendous opportunity to gain experience with a wide array of cloud-native technologies, develop sophisticated data pipelines using modern big data technologies, and lead significant initiatives on an enterprise scale with exposure to two of the top major cloud providers, AWS and GCP.

Key Responsibilities:
Design and implement data monitoring pipelines to proactively identify and resolve data quality issues, potentially impacting downstream products.

Collaborate with stakeholders to define requirements, develop metrics for data pipeline quality, negotiate data quality SLAs on behalf of downstream data product owners, and create monitoring solutions using Python, Spark, and Airflow.

Serve as a technical lead for our data observability and federated query systems, playing a key role in achieving true Data Democratization at scale with elevated Data Quality standards.

Innovate and develop new methodologies to enhance access to trustworthy data, accelerating the value provided by the product data team.

Requirements:

Bachelor's Degree in Computer Science, Engineering, or a related STEM field, with a focus on data processingA Master's Degree is equivalent to 2 years of experience.

A Ph.
D. counts as 5 years of experienceAt least 5 years of experience in Data Engineering or a similar role, with a proven track record of working with big data pipelines and analyticsMinimum of 3 years of hands-on experience with SQL in scalable data warehouses (e.g., Bigquery, Snowflake)

Experience in implementing best practices for data engineering and optimizing data pipeline performance/scalabilityProficiency in cloud technologies, preferably GCP and/or AWSExperience with Apache Airflow3+ years of experience with Apache SparkOver 5 years of coding experience in Python, Java, or equivalent programming language, beyond an undergraduate degreeDeep understanding of Distributed Systems and Effective Data ManagementProficiency in the Decoupled Compute and Storage ParadigmKnowledge of commonly utilized data structures in databases and data warehousesExperience in containerized applicationsDesirable Experience:

Proficiency in data visualization tools (e.g., Tableau)Familiarity with Agile methodologies and CI/CD practicesExperience with CI/CD tools (e.g., Jenkins)Knowledge of Infrastructure as Code (e.g., Terraform)Why Zoominfo?At Zoominfo Technologies, we are committed to fostering a culture of innovation, collaboration, and technological excellence.

As part of our team, you will have the unique opportunity to impact our products and services directly, ensuring we remain at the forefront of our industry.

If you are passionate about data engineering and looking to make a significant contribution to a leading tech company, we would love to hear from you.