Delta lake Developer - Bengaluru, India - Marlabs LLC

Description

Experience: 8-12 years

Location: Bangalore/Pune/Kochi or Mysore

Work Mode: Hybrid Mode.

Roles & Responsibility:

• Spearhead the development of conceptual, logical, and physical data models, while

• implementing data marts/data warehouse/data lake/data lakehouse on Spark-based platforms

• Analyse existing models to identify variances/gaps and devise strategies to achieve alignment.

• Establish and enforce best practices and standards for data models.

• Generate Data Flow diagrams and relevant artifacts to depict data integrations within

• targeted systems.

• Collaborate closely with Data Owners to understand business data requirements and

• clarify terms and business rules.

• Facilitate walkthrough sessions with Data Owners and stakeholders to review and

• validate data models for accuracy.

• Demonstrate strong communication skills and effective engagement with delivery

• colleagues to ensure successful project outcomes.

• Comply with Data Architecture standards and guardrails.

• Proactively manage issues, risks, actions, and dependencies, escalating when

• necessary.

Skills Required:

• Possess a minimum of 5+ years of Data Modelling experience in Data Lake/Delta
• Lakehouse/Data Warehouse on Spark based platforms on AWS

• Demonstrate a minimum of 1 year of experience working with/in Databricks.

• Mandatory experience of Data Modelling on Delta Lakehouse

• Knowledge in handling Spark streaming data over Delta Lakehouse.

• Hands-on experience with data modelling tools for performing reverse and forward

• engineering of as-is and to-be data models, in any of the industry leading data modelling

• tools such as Erwin/ ER/Studio etc.

• Utilize visual notations for expressing data logical and physical models, state transitions,

• transformations, and versioning. Familiarity with UML, DPMN, ERDs, etc. is ideal.