Big Data Lead DeveloperNavya - Mumbai, India - Coders Brain Technology Pvt. Ltd.

    Default job background
    Description
    Primary Skills: Azure ADFDatabricks with PysparkPython
    • Data Engineerwith Pyspark Databricks skillset having 9 years of experience DataEngineering with min 5 years hands on experience in Pyspark fordata transformations.
    • Sound Knowledge on AzureData Bricks Azure Data Lake.
    • Sound knowledge inData Bricks & Logic Apps
    • Delta LakeAzure SQL and Azure blob storage Azure logic apps Azure Functionsand Azure Synapse Azure Purview.
    • Extensiveknowledge on big data concepts like Hive and sparkframework.
    • Should be able to write complex SQLqueries. Sound understanding of DWHconcepts.
    • Strong handson experience on Pythonor Scala.
    • Hands on experience on Azure DataFactory.
    • Should be able to coordinateindependently with business stake holders and understand thebusiness requirements.
    • Knowledge on DevOps andAgile methodologiesbased projects implement the requirements usingADF/Data Brick
    • Knowledge of version controltool such as Git/Bitbucket.
    • Should have basicunderstanding on Batch Account configuration various control andmonitoringoptions

    azure,python,spark,bigdata