GCP Data Engineer - Mumbai, India - Quantiphi

Description

Designation:

Data EngineerExperience Level:

4-15 YearsLocation:
Mumbai/Bangalore/Trivandrum

Role & Responsibilities:

In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of relational database concepts and technologies such as SQL, MySQL, PostgreSQL, or Oracle.

Hands-on experience with other cloud platforms and services such as AWS RDS, or Azure SQL Database.
Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.

Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plusStrong working experience on one or more of the Big Data/Hadoop distributions (or ecosystems) like, Cloudera/Hortonworks, MapR, Azure HDInsight, IBM Open platform, Kafka, Hive, Spark etc.

Good understanding of the following AWS Data services, Redshift, RDS, Athena or SQS/KinesisGood understanding of Native and external tables, with different file formats :
Avro, ORC, ParquetCI/CD pipelines for data workloads using Cloud Build, Artifact Registry, TerraformData governance solutioning using GCP governance tooling (Dataplex, Data Catalog)

Skills required:
GCP Dataflow, Pub/Sub, Cloud Composer, Cloud Workflow, BigQuery, Cloud Run, CloudBuildMust have: programming knowledge and willingness to be hands-on - Python, JavaSpecialization on streaming such as PubSub or Kafka or equivalent

Good to have:
Experience in BigQuery or Presto or EquivalentExperience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks and frameworks and tech such as SPARK, Oozie, Kafka, HBASEUnderstanding and experience with NoSQL databases such as HBASE, MongoDB, CassandraKnowledge of cloud databases such as Spanner, BigTable, Cloud SQL, DB migrationsGood to have GCP Data engineering Certification