TR - Consultant L2 Databricks - Bengaluru, India - Xander Talent

    Xander Talent
    Xander Talent Bengaluru, India

    2 weeks ago

    Default job background
    Description

    Primary Roles andResponsibilities:

    Developing Modern DataWarehouse solutions using Databricks and AWS/ AzureStack Ability to provide solutions that areforwardthinking in data engineering and analyticsspace Collaborate with DW/BI leads tounderstand new ETL pipeline developmentrequirements.

    Triage issues to find gaps inexisting pipelines and fix the issues Workwith business to understand the need in reporting layer and developdata model to fulfill reporting needs Helpjoiner team members to resolve issues and technicalchallenges.

    Drive technical discussion withclient architect and team membersOrchestrate the data pipelines in scheduler viaAirflowSkills andQualifications:
    Bachelors and/or master sdegree in computer science or equivalentexperience. Must have total 6 yrs. of ITexperience and 3 years experience in Data warehouse/ETLprojects. Deep understanding of Star andSnowflake dimensional modelling.

    Strongknowledge of Data Management principles Goodunderstanding of Databricks Data & AI platform andDatabricks Delta Lake Architecture Shouldhave handson experience in SQL Python and Spark(PySpark) Candidate must have experience inAWS/ Azure stack Desirable to have ETL withbatch and streaming (Kinesis).

    Experience inbuilding ETL / data warehouse transformationprocesses Experience with Apache Kafka foruse with streaming data / eventbased dataExperience with other OpenSource big data products Hadoop (incl.
    Hive Pig Impala) Experience with Open Sourcenonrelational / NoSQL data repositories (incl. MongoDB CassandraNeo4J) Experience working with structuredand unstructured data including imaging & geospatialdata. Experience working in a Dev/Opsenvironment with tools such as Terraform CircleCIGIT. Proficiency in RDBMS complex SQL PL/SQLUnix Shell Scripting performance tuning andtroubleshoot Databricks Certified DataEngineer Associate/Professional Certification(Desirable).

    Comfortable working in adynamic fastpaced innovative environment with several ongoingconcurrent projects Should have experienceworking in Agile methodology Strong verbaland written communication skills.

    Stronganalytical and problemsolving skills with a high attention todetail.


    Mandatory Skills:
    Python/ PySpark /Spark with Azure/ AWSDatabricks
    bi,nosql,pyspark,azuredatabricks,databricks,etl,aws,azure,terraform,python,spark