- 7+ years of experience with detailed knowledge of data warehouse technical architectures, ETL/ ELT and reporting/analytic tools.
- 4+ years of work experience with very large data warehousing environment
- 4+ years of work experience in Databricks, Pyspark and Python project development work
- Expertise in Bigdata Eco systems like HDFS and Spark
- Strong hands-on experience on Python or Scala.
- Hands on experience on Azure Data Factory.
- Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
- Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
- SQL SERVER development work experience with relational databases and knowledge is a must
- Development of Stored Procedures for transformations in ETL pipeline
- Should have work experience in Agile projects
- Write and maintain documentation of the ETL processes via process flow diagrams.
- Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
- Good experience on customer interaction is required.
- Possesses good interpersonal and communication skills.
Azure Databricks Engineer - Anywhere in India/Multiple Locations/Hyderabad/Bangalore/Pune/Mumbai/Chennai - BRISKWIN IT SOLUTIONS PRIVATE LIMITED
BRISKWIN IT SOLUTIONS PRIVATE LIMITED
Anywhere in India/Multiple Locations/Hyderabad/Bangalore/Pune/Mumbai/Chennai
1 day ago
Description
Position/Role : Azure data bricks with Pyspark/Spark/Python and SQL
Experience : 6-12 yrs
Location : Hyderabad/Bangalore/Pune/Mumbai/Chennai (Hybrid)
Job Overview :
Primary Skills : Databricks with Pyspark/Spark/ Python and SQL
Secondary skills : ADF
Job Description :