- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
- Ability to provide solutions that are forwardthinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussion with client architect and team members
- Orchestrate the data pipelines in scheduler via Airflow
- Bachelor's and/or master's degree in computer science or equivalent experience.
- Must have total 5+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Deep understanding of Star and Snowflake dimensional modelling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have handson experience in SQL, Python and Spark (PySpark)
- Candidate must have experience in AWS/ Azure stack
- Desirable to have ETL with batch and streaming (Kinesis).
- Experience in building ETL / data warehouse transformation processes
- Experience with Apache Kafka for use with streaming data / eventbased data
- Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
- Experience with Open Source nonrelational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fastpaced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problemsolving skills with a high attention to detai
-
Data Engineer
5 days ago
Forward Eye Technology Anywhere in India/Multiple Locations permanentJob Description : · Overview : · As a Data Engineer specializing in Azure Data Platform, you will be responsible for designing, building, and maintaining data solutions on Microsoft Azure. Your expertise in data modeling, ETL/ELT processes, and tools such as Azure Data Factory (A ...
-
Data Engineer
5 days ago
Aricent Anywhere in India/Multiple Locations permanentJob Profile : Data Engineer · Location : WFO/WFH (Both Available) · Specialization : IT/Cloud/Data Management · Job Description : · - Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; ca ...
-
Data Engineer
3 days ago
Lancesoft India Pvt Ltd Anywhere in India/Multiple Locations permanentHiring for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with busin ...
-
Data Engineer
5 days ago
Arting Digital Anywhere in India/Multiple Locations permanentPosition Title : Data Engineer · Exp : 5+ years · Location : Remote · Primary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python · Qualification : Any · Roles and responsibilities : · - An offshore Data Engineer to work with the Investment Analytics team. · - This ...
-
Data Engineer
5 days ago
Liveconnections Anywhere in India/Multiple Locations permanentSkillset: · Data Engineering with strong SQL expertise. · Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources. · - Should be experienced in implementing DWH projects. · - Having Informatica experience will be value-add. · Relevant Ex ...
-
Data Engineer
5 days ago
Forward eye technologies Anywhere in India/Multiple Locations permanentRole : Data Engineer · Location : Remote · Shift timings : IST · Contract Period : 3 months · Experience : 5 - 8 years · Responsibilities : · - Review and understand business requirements ensuring that development tasks are completed within the timeline provided and that issues a ...
-
Data Engineer
2 days ago
AAR Consultancy Anywhere in India/Multiple Locations permanentTechnical Skills : · 1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage. · 2. Data Engineering : Strong understanding of data engineering principles, including ...
-
Data Engineer
5 days ago
Paralleldots Anywhere in India/Multiple Locations permanentJob Description : · As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets t ...
-
Data Engineer
3 days ago
Mobile Programming LLC Anywhere in India/Multiple Locations/Bangalore permanentJob Description : · Position : Data Engineer · Experience : 6+ years · Work Mode : Work from Office · Location : Bangalore · Experience in Nifi or Tibco is mandatory. · Mandatory Skills : ETL, DevOps platform, Nifi or Tibco · Please note : This position is focused on development ...
-
Data Engineer
5 days ago
Change leaders Anywhere in India/Multiple Locations permanentPrimary Skill - GCP + Python + SQL · OR · GCP + Java + SQL · NP - Immediate to 35 Days max · Job Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida · - Bachelor's degree in computer science or a related discipline · - 6+ years of applicable engineering e ...
-
Data Engineer
3 days ago
Ridgeant Techonologies Anywhere in India/Multiple Locations permanentResponsibilities : · - Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services. · - Design, develop, and maintain data pipelines using AWS serverless techno ...
-
Data Engineer
3 days ago
SKEP IT SYSTEMS Anywhere in India/Multiple Locations permanentJob Description : · We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datase ...
-
Data Engineer
5 days ago
Mobile Programming Anywhere in India/Multiple Locations/Bangalore permanentJob Summary: · We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning ...
-
Data Engineer
3 days ago
Egen Anywhere in India/Multiple Locations/Hyderabad permanentJob Description : · Egen is seeking a highly skilled Snowflake Data Engineer with expertise in data engineering, Snowflake, SQL, and strong experience in working with semi-structured data. The ideal candidate will have hands-on experience with various Snowflake data loading patt ...
-
Data Engineer
5 days ago
Huquo Anywhere in India/Multiple Locations permanentPosition : AWS Data Engineer · Location : Pune/ Gurgaon/ Hybrid · Experience : 5+ · Job Description : · - 5+ years of experience as a Data Engineer on the AWS Stack · - AWS Solutions Architect or AWS Developer Certification required · - Solid experience with AWS services such as ...
-
Data Engineer
3 days ago
TechFabric Anywhere in India/Multiple Locations permanentJob Description : · Candidate should have minimum 7Yrs working/hands-on experience in the below skills : · - With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage · - Hands on experience in data modelling, batch and real time pipelines using ...
-
Data Engineer
5 days ago
consultancy Anywhere in India/Multiple Locations permanentNote : It's a work-from-home opportunity. · Skills You must have experience with: · - Twilio Segment - Customer Data Platform · - Google Analytics (Inc. Firebase) · - Experience creating tailored dashboards using PowerBi · - Experience in data management, data warehousing, data q ...
-
Data Engineer
5 days ago
Teksands Anywhere in India/Multiple Locations permanentThe Data engineer is responsible for development & maintenance of the Data Lake within the Advice & Wealth Management technology team. You should be able to collaborate with technology cross-commits and business teams to code, test and deploy scalable solution and adhering to req ...
-
Azure Data Engineer
3 days ago
Live Connections Anywhere in India/Multiple Locations permanentAzure Data Engineer - Python/PySpark · We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python ...
-
Azure Data Engineer
5 days ago
DEVENIR SOFTWARE PRIVATE LIMITED Anywhere in India/Multiple Locations permanentPosition : Azure Data Engineer · Experience : 4 to 12+ years · Relevant 5+ Exp is must · Location : Pan India · Fulltime role · Immediate : · - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform · - Develop and implement data solutions using Azu ...
Data Engineer - Anywhere in India/Multiple Locations - XANDER CONSULTING AND ADVISORY PRIVATE LIMITED
5 days ago
Description
Primary Roles and Responsibilities:
Skills and Qualifications: