Data Platform Architect - Bengaluru, India - growel softech

growel softech

Verified Company

Bengaluru, India

2 weeks ago

Posted by:

Deepika Kaur

beBee Recuiter

Description

Experience in working on Scala, PySpark, Python

Experience in working with Airflow, AWS EMR, Google DataProc and Databricks

Experience in working with Amazon Redshift and Snowflake

Experience in working with Apache Hive, Google BigQuery, Google Data Studio, AWS Athena and Presto.

Experience in working with Kafka and Kinesis.

Expert knowledge on Data warehousing, Data modelling, Data Privacy, Data Security, Data Governance and Data Architecture

Expert Knowledge on Bucketing and Partitioning

Expert in troubleshooting and solving data processing and data quality issues.

Experience with processing a very high velocity / volume of data using Streaming and Batching mode.

Experience in architecting end to end data platform (data ingestion, data processing/transformation & data storage) using above tools and technologies

Experience in working with Agile/Scrum model

Ability to effectively communicate(both verbal and written) technical approaches with team members.

Ability to catch up on newer tools/technologies faster

Ability to lead and guide the team with design thought leadership.

Experience in defining technical best practices and guiding the team.

4+ years of experience in Scala / PySpark based end to end data platform implementation

1+ years of experience in architecting Scala / PySpark based data platforms.

Overall 10+ years of IT experience