Data Engineer PostGres and DataBricks - Kochi

Dbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways. · We are looking ...

Job description

Dbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways.

We are looking for an Experienced Data Engineer with a strong background in DataBricks or PostgreSQL, and proficiency in Python or Azure cloud data engineering. The ideal candidate will have at least 3 years of experience in a Data Engineering role and possess a deep understanding of data management and ETL processes Responsibilities:

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Collaborate with stakeholders including the Executive, Product, Data, and Design teams to address data-related technical issues and support their data infrastructure needs.
• Develop processes for data mining, data modeling, and data production.
• Work closely with data scientists and architects on multiple projects.
• Ensure systems meet business requirements and adhere to industry practices.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.

Requirements:

• Minimum of 3
• years of experience in a Data Engineering role.
• Proficiency in DataBricks or PostgreSQL.
• Proficiency in Python or experience with Azure cloud data engineering.
• Proven experience in building and optimizing big data pipelines, architectures, and data sets.
• Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong experience in data modeling, ETL development, and data warehousing, or similar skills.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Nice to Have:

• Experience with AWS or other cloud services.
• Experience with big data tools such as Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases.
• Familiarity with Salesforce.

Why Join Us:

• Be part of a dynamic team that is shaping the future of data engineering
• Engage with cutting-edge technologies and innovative projects.
• Opportunity to collaborate with a diverse group of professionals in a fast-paced environment.

Life at Dbiz

• Competitive salary and attractive benefits.
• Dynamic and innovative work environment.
• Opportunities for personal growth and development.
• Engaging and collaborative company culture.