- Architect and build scalable, resilient and costeffective software to support complex data pipelines.
- The architecture has two facets : Storage and Compute.
- The Data Engineer is responsible for designing, implementing and maintaining various data pipelines such as selfservice ingestion tools, exports to applicationspecific warehouses and indexing activities.
- The Data Engineer is responsible for data modeling, as well as designing, implementing and maintaining various data catalogs, to support data transformation and product requirements.
- Collaborate with Data Science to understand, translate, and integrate methodologies into engineering build pipelines.
- Partner with product owners to translate complex business requirements into technical solutions, imparting design and architecture guidance.
- Provide expert mentorship to project teams on technology strategy, cultivating advanced skill sets in software engineering and modern SDLC.
- Stay informed about the latest technologies and methodologies by participating in industry forums, having an active peer network, and engaging actively with customers.
- Cultivate a team environment focused on continuous learning, where innovative technologies are developed and refined through teamwork.
- A degree in Computer Science or related technical field.
- Strong Computer Science fundamentals
- 3+ years of professional Database Development, with languages such as ANSI SQL, TSQL, PL/pgSQL, PLSQL, plus database design, normalization, server tuning, and query plan optimization
- 3+ years Software Engineering experience with programming languages such as Java, Scala, Python and Unix Shell
- 3+ years of professional DBA experience with large datastores including HA and DR planning and support.
- Understanding of File Systems
- Demonstrated understanding and experience with big data tools such as Kafka, Spark and Trino/Presto
- Experience configuring database replication (physical and/or logical)
- ETL experience (3rd party and proprietary)
- Experience with orchestration tools such as Airflow
- Comfortable with version control systems such as git
- A thirst for learning new Tech and keeping up with industry advances.
- Excellent communication and knowledgesharing skills.
- Comfortable working with technical and nontechnical teams.
- Strong debugging skills.
- Comfortable providing and receiving code review feedback.
- A positive attitude, adaptability, enthusiasm, and a growth mindset.
- A personal technical blog
- A personal (Git) repository of side projects
- Participation in an opensource community
- Comfortable using Docker and Kubernetes for container management.
- DevOps experience deploying and tuning the applications you've built.
- Monitoring tools such as Datadog, Prometheus, Grafana, Cloudwatch.
-
BIU:Data Engineer-ETB Database Lending
3 weeks ago
Axis Bank mumbai, IndiaBIU:Data Engineer-ETB Database Lending · 0 - 1 Years · 1 Opening · Mumbai · Role description · To update · Skills · Excel · ...
-
Data Engineer-1
3 weeks ago
Trafigura Mumbai, India**Knowledge Skills and Abilities, Key Responsibilities**: · Data ingestion / integration, ETL/ELT data pipeline design, data modelling, data provisioning · - Python, SQL · - AWS data stack (E.g. S3, Redshift, EMR, Glue, Athena) · - Experience with data related to commodities, fin ...
-
Data Engineer
2 weeks ago
Perfict Maharashtra, IndiaTitle: Data Engineer · Job Location: 100% Remote (PAN India) · Role: Contract Role · Timing: IST · Looking candidate who can join in days after job offer · Data Engineer - Financial Domain · Job Description: · Based on the requirements of the project, need a strong resource who ...
-
Data Engineer/Senior Data Engineer
3 weeks ago
consultant Mumbai, IndiaOpenings for the role of data Engineer/ Sr Data Engineer · Must Have : · - 5-7+ years of extensive experience in a Data Engineer role · - Solid experience with Python, PySpark, and SQL databases · - Experience with Azure, Databricks, and GCP · - Extensive knowledge of the full so ...
-
Data Engineer
2 weeks ago
Teksands Mumbai/Kolkata, India permanentJob Description : · 8+ years of analysis and reporting business intelligence-related needs. · - Must have : Excellent Data warehousing, data modeling, and data transformation · - Advanced SQL ,Tableau Reporting ,Design stable, reliable, and effective databases. · - Interface wit ...
-
Data Engineer
2 weeks ago
ImpactGuru Mumbai, IndiaJob Description: · We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. You will work closely w ...
-
Data Engineer
1 day ago
Quilytics Mumbai, IndiaCompany Description · Quilytics is committed to help enterprises grow their business value through a powerful combination of quality and analytics. We provide end-to-end custom data analytics solutions to businesses in various areas including Marketing analytics, Business Analyti ...
-
Data Engineer
3 weeks ago
Searce Technologies Inc mumbai, Indiaabout the role · Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questio ...
-
Data Engineer
1 week ago
Asterion Mumbai, IndiaJob Summary : · We are seeking a skilled and motivated Data Engineer to design, develop, and maintain our data infrastructure. The ideal candidate will have a strong background in data engineering, a passion for working with large datasets, and the ability to transform data into ...
-
Data Engineer
3 weeks ago
Huquo Mumbai, IndiaPosition : Data Engineer · Location : Mumbai · Experience : 4-6 Years · Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data ...
-
Data Engineer
3 weeks ago
Aunalytics mumbai, IndiaPosition Overview · Data Engineers are data experts who dive right into new client projects and make it their job to understand how a client's data fits into our Industry Intelligent data models. Utilizing this knowledge and the industry's newest technologies, they create high ...
-
Data Engineer
4 days ago
Virtusa Mumbai, IndiaData Engineer - CREQ191185 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...
-
Data Engineer
3 weeks ago
Neer Info mumbai, IndiaAbout the job : · - The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software. · - You will test your code, identify errors, and iterate to ensure quality code. · - You will also support our customers and partners ...
-
Data Engineer
3 weeks ago
iMind Your Business Solutions Private Limited mumbai, IndiaCompany Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...
-
data engineer
3 weeks ago
OIL FIELD INSTRUMENTATION Mumbai, IndiaExperience : · 4+ years of Mud Logging experience as Data Engineer in India and abroad, both onshore and offshore rig operations. Deep Water experience will be an advantage. Proficient with real-time data monitoring and data management, WITSML transmission, gas detection and anal ...
-
Data Engineer
3 weeks ago
The Nielsen Company mumbai, IndiaAt Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embar ...
-
Data Engineer
3 weeks ago
Puma Energy mumbai, IndiaMain Purpose: · Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. · Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists ...
-
Data Engineer
1 day ago
RIA Advisory Mumbai, IndiaJob Summary · Seeking a Data Engineer who will be working closely with data scientists and developers to architect data transformations, analyze, develop, maintain, and test data infrastructures. This role requires deep hands-on production expertise in Apache Spark and data engin ...
-
Data Engineer
1 week ago
Virtusa Mumbai, IndiaData Engineer - CREQ191174 Description 6-8 years of relevant work experience showing growth as a Data Engineer. · Hands On programming experience · Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. · Experience of performance optimization in Batch a ...
-
Data Engineer
3 weeks ago
Argus Media mumbai, IndiaData Engineer – Pricing · (FTC 18 Months) · About Argus Media Argus is the leading independent provider of market intelligence to the global energy and commodity markets. We offer essential price assessments, news, analytics, consulting services, data science tools and industr ...
Data Engineer - Mumbai, India - Careernet Technologies Pvt Ltd
Description
Purpose :
As a Data Engineer, your role is to own the data pipeline and the data governance of our Data Strategy.
Responsibilities :
The Data Engineer is responsible for designing and maintaining the different tiers of the data storage, including (but not limited to) archival, long-term persistent storage, transactional and reporting storage.
Qualifications :
Nice to have :
Preferred skills :