Senior Big Data Engineer - Pune, India - Cognologix

Description

You will work on:

We help many of our clients make sense of their large investments in data – be it building analytics solutions or machine learning applications.

You will work on cutting edge cloud-native technologies to crunch terabytes of data into meaningful insights.


What you will do (Responsibilities):
Collaborate with product management & engineering to build highly efficient data pipelines for large datasets.

Perform Data quality analysis on disparate data sources and define, implement data quality rulesDesign and develop data models analyzing end to end data requirementsTroubleshooting data loss, data inconsistency, and other data-related issuesProduct development environment delivering stories in a scaled agile delivery methodologyCreate high quality project level technical artifacts such as requirement specs, high/detailed level design documents, test plans etcSupporting in technical POCs, Presales activities for newer opportunitiesContributing to maintaining frameworks, guidelines, standards for applicable project technologies and strengthening engineering practicesSupporting research, POCs in emerging technologiesMentoring associates, team membersWhat you bring (Skills):

5+ year of experience in hands-on data engineering & medium to large-scale distributed applicationsSound understanding of data warehousing conceptsExtensive experience in object-oriented programming languages such as Java or ScalaExtensive experience in RDBMS such as MySQL, Oracle, SQLServer, etc Cloud appliances as Snowflake, Redshift, BigQuery, Azure Synapse etc.

Experience in big data processing technologies such as Hadoop, Spark, Kafka, Databricks, etc.
Experience in Cloud-based services such as Amazon AWS, Microsoft Azure, or Google Cloud PlatformExperience in developing and deploying applications in Linux OSExperience with Scrum and/or other Agile development processesAbility to create WBS for project tasks and contribute to planningStrong analytical and problem-solving skillsTeam player with self-drive to work independentlyStrong communication and interpersonal skills


Great if you know (Skills):

Some exposure to containerization technologies such as Docker, Kubernetes, or Amazon ECS/EKSSome exposure to NoSQL data stores such as Couchbase, Solr, etc.

Some exposure to Perl, or shell scripting or orchestration tools like AirflowAbility to lead R&D and POC efforts


Advantage Cognologix:
A higher degree of autonomy, startup culture & small teamsOpportunities to become an expert in emerging technologiesRemote working options for the right maturity levelCompetitive salary & family benefitsPerformance based career advancement


About Cognologix:
Cognologix helps companies disrupt by reimagining their business models and innovate like a Startup.

We are at the forefront of digital disruption and take a business-first approach to help meet our client's strategic goals.

We are a Data focused organization helping our clients to deliver their next generation of products in the most efficient, modern, and cloud-native way.