Collibra Integration Engg - Hyderabad, Telangana, India - ITI Data
Description
Requisition No
- VN358
Employment Type
- Permanent
Location Country
- India
Location Region
Location City
- Hyderabad
Job Details
Locations:
India
-
Type: Full-time
-
Experience: 8-10 years
-
Functions: Consulting, Finance, Information Technology, Data Governance
-
Industries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, Business Travel Healthcare
-
Job Duties
- Work with business and requirement teams to formulate
_Collibra integration design_ with
_external metadata repositories_ (such as Informatica Metadata Manager, Apache Atlas, AWS Glue etc.),
_authoritative data sources_ (Oracle, Teradata, AWS, Snowflake etc. and other
_ETL_ tools (Ab Initio, Informatica) and
_programming languages_ (Python, Java, SQL) - As per requirements (functional/nonfunctional/operational)
_design & build scalable, generic integration solution using Python_ with Collibra as centralized Data Governance platform for use cases such as
_technical metadata, lineage, Data Quality, reference data_ etc. - Design
_metamodel of assets and their characteristics_ on DGC as per workflow requirements - Configure JSON in order to customize
_Asset relationship/lineage diagrams_ on DGC - Design
_Collibra community and domains_ and modularize the asset residence hierarchy as per business requirements - Build integration solutions using
_Collibra Core, Import & Catalog APIs_ in Python or core Java - Design and build generic utilities to export/Import metadata to/from Collibra DGC using Python or core Java
Extensive Knowledge of _Python_
internals, deployment and execution methodologies:
- Build
_low-latency compute-intensive integrations_ leveraging several Python modules (requests, flask, pandas, subprocess, logging, os etc) - Build generic utilities to
_perform full CDC_ on incoming data and while importing assets into DGC - Perform Collibra
_DGC and Console integrations _with
_ Identity & Access Management_ systems (SSO/LDAP) - Onboard
_technical & business stewards on DGC_ as per the predefined roles and responsibilities - Build Collibra
_asset monitoring & lifecycle dashboards_ on DGC - Perform capacity planning and
_avoid scaling and performance issues_ of the designed solution - Develop source code,
_unit test, participate in code reviews, deploy code_ to multiple environments - Lead onsite and offshore teams and
_enable developers with clear and precise designs_ and planning to implement the design - Perform
_capacity planning and avoid scaling and performance_ issues of the designed solutions
_ Voice the opinions to multiple teams_ and thus driving the entire initiative with strong leadership
Key Responsibilities
- Bachelor's Degree or equivalent in computer science/related and minimum 8+ years experience
- Certified as Level 3 expert from Collibra
- Require Collibra DGC meta model design/customization experience with creation/configuration of DGC meta model assets and their relationships within and across domains/communities
- Require experience in building API based integration middleware for Collibra DGC, compatible with Collibra integration standards supporting Collibra assets onboarding, maturity lifecycle
- Require handson experience in operating on Collibra Core, Import & Catalog APIs
- Require handson experience in operating on Output Module of Collibra Core APIs
- Require handson expertise in payload manipulation, aggregation, data type conversion using Python or Java
- Require handson expertise in building scanners for parsing SQL constructs
- Require integration experience with other metadata tools such as Informatica, Ab Initio, Apache Atlas, Cloudera Navigator etc.
- Require expertise in load management using realtime or batchbased integration approach
- Require handson experience using RAML, REST API, SOAP, JSON, XML etc.
- Require handon experience on Collibra Marketplace connectors in integration architecture
- Preferred Mule 4.* runtime exposure.
- Preferred Collibra BPMN workflow development & Help Desk, Data Catalog exposure
- Require to be part of Production Rollouts of successful implementation of Collibra integrations
- Require expertise on Performance Analysis and perform code reviews and designs in order to improve performance
- Require expertise on capacity planning based on data volumes, processing complexity and SLAs
- Require Technical Coordination skills to drive requirements, design with multiple teams
- Financial services and Healthcare industry experience preferred
- Requires aptitude to help build skillset within organization
Education Level
- Bachelor's Degree
Experience Level
years
More jobs from ITI Data
-
Scrum Master
Chennai, Tamil Nadu, India - 3 weeks ago
-
Aws Redshift Admin
Chennai, Tamil Nadu, India - 2 weeks ago
-
Aws Redshift Admin
Pune, Maharashtra, India - 2 weeks ago
-
Sas Platform Authentication Engg
Pune, Maharashtra, India - 2 weeks ago
-
Sas Viya Platform Admin
Hyderabad, Telangana, India - 2 weeks ago
-
Scrum Master
Pune, Maharashtra, India - 3 weeks ago