WovV Technologies - Pune, India - Wovv Technology

Description

Job Description:
Big Data Pune (Hybrid Work module compulsory, WFH not 5-7 years.

Contract Duration:
Contract position for 6 months (can be Technology: Product development, Application development, Spark, Apache Airflow, Snowflake, BigQuery.

Role and is a mandatory skill here. Please ensure that the candidate has worked into Scala before sharing the profiles.

Also, while screening profiles please check if candidate was involved in "Product Development" or "application development".Design, develop, and deploy scalable and performant backend Spark jobs for data processing and integration.

Collaborate with cross-functional teams to understand data requirements and develop solutions that meet business needs.
Integrate Spark jobs with Key Management API to ensure secure handling of sensitive data.
Deploy and manage Spark jobs on Google Dataproc, ensuring optimal performance and resource utilization.
Orchestrate workflows using Apache Airflow to schedule and monitor Spark jobs.
Integrate Snowflake and BigQuery as data targets for Spark jobs, ensuring data consistency and accuracy.
Optimize Spark jobs for performance and scalability, identifying bottlenecks and implementing solutions to improve efficiency.
Write clean, maintainable, and efficient code, following best practices and coding standards.
Collaborate with data engineers, data scientists, and other stakeholders to drive continuous improvement and innovation in data processing workflows.
Stay updated on emerging technologies and industry trends in big data processing and analytics.
)