Tx Data Ingestion - Chennai, India - Encora
Description
Our company:
Encora is a global Software and Digital Engineering company that helps business overcome the Software Engineering Talent shortage and provides next-gen services and such as Predictive Analysis, Artificial Intelligence & Machine Learning, IoT, Cloud, and Test Automation.
Our Software Engineering experts work with leading-edge technology companies to improve their speed to impact.
About the role:
Task Description:
Programming languages: Python (main), Scala (plus)
Batch Data Ingestion:
ADF and/or Spark, Delta IO (plus), Iceberg (plus plus)
Streaming Data Ingestion:
Kafka and Spark Streaming
Binary Formats:
Parquet and Avro (main), ORC (plus)
Warehousing:
Snowflake (main), Synapse or others (plus)
No-SQL:
Column store (plus) (e.g. Cassandara, HBase or equivalent), Document store (plus) (e.g. Mondo DB, Couchdb or equivalent), Key/Value store (plus) (e.g. Redis, RocksDB or equivalent)
Architectural patterns:
Data Vault Modelling (main), Lakehouse (main), Semantic Versioning and Schema Evolution (nice to have), Data Meshing (main), CAP theorem (plus), Semantic delivery reliability of distributed systems (plus, expected in streaming use case scenarios), Microservices (plus), Threading models (e.g.
Threads, Actors, Co-routines) (plus)CI/CD:
Azure Devops (main), Jenkins, Git Actions, etc. (plus)
Bonus:
Docker and Kubernetes
Work Result:
Code submitted to repository
Skill Area:
Other
Technology:
Other
Proficiency - Technology: Expert
Other Skills:
Azure Data
More jobs from Encora
-
Senior Test Automation Engineer
Bangalore, India - 3 days ago
-
Gws Support
Chennai, Tamil Nadu, India - 4 weeks ago
-
NET 3ls Support
Chennai, Tamil Nadu, India - 2 weeks ago
-
Ruby on Rails Developer
bangalore, India - 3 weeks ago
-
Technical Lead
Anywhere in India/Multiple Locations - 3 weeks ago
-
Java Full Stack Developer
Bangalore, India - 3 weeks ago