Associate Architect - Bengaluru, India - Quantiphi

Quantiphi

Verified Company

Bengaluru, India

1 week ago

Posted by:

Deepika Kaur

beBee Recuiter

Description

While technology is the heart of our business, a global and diverse culture is the heart of our success.

We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you
- you would enjoy your career with Quantiphi

Job Role - Associate Architect - ETL

Location - Mumbai/Bangalore (Hybrid)

Experience - 6 to 9 Years

Brief:

As a Data Engineer at Quantiphi, you will solve big data challenges and will develop big data solutions for migration, storage and processing.

For building and assisting the production environment at large-scale the role of a data engineer is very vital and critical.

Role & Responsibilities:

Work with cloud engineers and customers to solve for big data problems by developing utilities for migration, storage and processing on AWS Cloud.
To migrate ETL jobs from the existing AB Initio to AWS Cloud
Design and build a cloud migration strategy.
Build tools to ingest and jobs to process several terabytes per day.
Design and develop nextgen storage and compute solutions for several large customers.
Communicate with a wide set of teams, including Infrastructure,DevOps, and cloud customers.
Build advanced tooling for automation, testing, monitoring, administration, and data operations across multiple cloud clusters.
Use Continuous Integration and Continuous deployment pipeline for deployment of code to higher environment in client's environment
Technical Point of contact between clients and offshore technical team

Required Skills:

6+ years' experience of Handson in data structures, AWS, spark, SQL and NoSQL Databases Experience with AWS EMR, Redshift, Lambda, DynamoDB, S3, RDS, SQS, Glue Experienced in using Airflow for orchestration Experience building and deploying cloudbased solutions at scale. Experience in developing Big Data solutions (migration, storage, processing) Experience in SQL and Query optimisation Ability to clearly communicate technical roadmap, challenges and mitigation Experience building and supporting largescale systems in a production environment

Technology Stack:

Cloud Platforms
AWS
Mandatory
High programming skill in Python and Pyspark, Handson experience with the AWS Redshift
Nice to have
Experience in Bigdata Technologies such as Spark, Lambda, AWS Cloud with focus on AWS Glue to create ETL pipelines
Design Dimensional Models for Data Warehouse and Data Marts
Knowledge of version control systems, build automation and CI/CD tools and frameworks
If you like wild growth and working with happy, enthusiastic overachievers, you'll enjoy your career with us_

- _