Tx Data Ingestion - Chennai, India - Encora

Encora
Encora
Verified Company
Chennai, India

1 month ago

Deepika Kaur

Posted by:

Deepika Kaur

beBee Recuiter


Description

Our company:


Encora is a global Software and Digital Engineering company that helps business overcome the Software Engineering Talent shortage and provides next-gen services and such as Predictive Analysis, Artificial Intelligence & Machine Learning, IoT, Cloud, and Test Automation.

We count with 16 global offices and 25 innovation labs.

Our Software Engineering experts work with leading-edge technology companies to improve their speed to impact.


About the role:


Task Description:
Programming languages: Python (main), Scala (plus)


Batch Data Ingestion:
ADF and/or Spark, Delta IO (plus), Iceberg (plus plus)


Streaming Data Ingestion:
Kafka and Spark Streaming


Binary Formats:
Parquet and Avro (main), ORC (plus)


Warehousing:
Snowflake (main), Synapse or others (plus)


No-SQL:
Column store (plus) (e.g. Cassandara, HBase or equivalent), Document store (plus) (e.g. Mondo DB, Couchdb or equivalent), Key/Value store (plus) (e.g. Redis, RocksDB or equivalent)


Architectural patterns:

Data Vault Modelling (main), Lakehouse (main), Semantic Versioning and Schema Evolution (nice to have), Data Meshing (main), CAP theorem (plus), Semantic delivery reliability of distributed systems (plus, expected in streaming use case scenarios), Microservices (plus), Threading models (e.g.

Threads, Actors, Co-routines) (plus)


CI/CD:
Azure Devops (main), Jenkins, Git Actions, etc. (plus)


Bonus:
Docker and Kubernetes


Work Result:
Code submitted to repository


Skill Area:
Other


Technology:
Other


Proficiency - Technology: Expert


Other Skills:
Azure Data

More jobs from Encora