- At least 510 years of experience in development of data solutions using Azure cloud platform
- Good understanding Massively parallel processing (MPP) systems, experience building Datawarehouse/DataMart on Azure Synapse SQL pools (SQL DW)
- Strong SQL skills and experience writing complex yet efficient SPROCs/Functions/Views using T-SQL
- Experience building ADF pipelines for ingestion from Flat files, RDBMS systems, Cloud storage, SFTP etc. Building complex orchestrations using ADF
- Solid understand of spark architecture and experience with performance tuning big data workloads in spark
- Building complex data transformations on both structure and semistructured data (XML/JSON) using Pyspark & SQL, refactoring tradition ML model to run on spark framework
- Familiarity with Azure Databricks environment and deploying spark code in databricks cluster
- Good understanding of No SQL and its use case, Modelling No SQL schemas & containers, building integration to read/write to cosmos
- Familiarity with Cognitive Search/Elastic search and its use cases & building integrations to load data to Search services
- Experiences with other bigdata solutions like Kafka, Hive, Hadoop etc is preferred
- Good understanding of Azure cloud ecosystem; Azure data certification of DP200/201/203 will be an advantage
- Proficient with Visual Studio 19+, IntelliJ/eclipse and source control using GIT
- Experience using any one programming language like Python/C#
- Good understanding of Agile, DevOps and CI-CD automated deployment (e.g. Azure DevOps, Jenkins)
-
Data Engineer
1 week ago
HTC Global Services Chennai, IndiaPosition Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...
-
Data Engineering
6 days ago
InfoCepts Chennai, IndiaPosition: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...
-
Data Engineer
2 days ago
Movate Chennai, IndiaRole: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...
-
Data Engineer
3 days ago
Blackstraw Chennai, IndiaData Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...
-
Data Engineer
4 days ago
Ashley Global Capability Center Chennai, IndiaPrimary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...
-
Data Engineer
4 days ago
HTC Global Services Chennai, IndiaData Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...
-
Data Engineer
4 days ago
OptiSol Business Solutions Chennai, IndiaPosition: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...
-
Data Engineer
6 days ago
Coders Brain Pvt Ltd Chennai, India permanentJD - Python and Snowflake · - Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems. · - Responsible for Cloud migrations for data pipelines using AWS and Snowflake · - Participate in all aspects of the soft ...
-
Data Engineer
6 days ago
TIGI HR Solution Pvt. Ltd. Chennai, India permanentJob Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...
-
Data Engineer
5 days ago
Movate Chennai, IndiaRole - Data Engineer · Years of Exp- : 5 Years – 8Years · Location - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analyzing ...
-
Data Engineer
4 days ago
Mindsprint Chennai, IndiaJob Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...
-
Data Engineer
2 days ago
Hexaware Technologies Chennai, IndiaWalk -in drive for Azure Data Engineer on 27 Apr at Chennai · Exp: 4 to 15 years · Drive Location: Hexaware Technologies, EB2 Ground Floor, SIPCOT IT Park,Navalur Siruseri Chennai, Tamil Nadu, 601301 · Contact Person: Manoj Kumar.k -TAG · Primary Skills : Databricks with Pyspark ...
-
Data Engineer
4 days ago
iMind Your Business Solutions Private Limited Chennai/Mumbai/Pune, India permanentCompany Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...
-
Data Engineer
3 days ago
System Soft Technologies Chennai, IndiaJob Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...
-
Data Engineer
6 days ago
CliqHR Chennai, India permanentJob Description : · Mandatory Skills : GCP, Python, SQL, Snap logic, Airflow, Data flow · - 6-8 years of experience in to GCP Data engineer. · - GCP Components (Composer, BQ, Data flow, Pub/Sub, Cloud functions, GCS storage) Intermediate · - SQL Advanced level · - ETL Processing ...
-
Data Engineer
1 week ago
System Soft Technologies Chennai, IndiaJob Summary:We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ena ...
-
Data Engineer
4 days ago
iTechMinds Consulting LLP Chennai, IndiaPosition : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...
-
Data Engineer
4 days ago
Mobile Programming LLC Chennai, IndiaJob Role : · Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data ...
-
Data Engineer
6 days ago
Randstad Chennai, India permanentRole : Data Engineer - PySpark · Exp : 5-10 years · - 5+ years of experience in data engineering field. · - Good experience in Pyspark - Including Dataframe core functions and Spark SQL. · - Good experience in SQL DBs · Be able to write queries including fair complexity. · - Sho ...
-
Data Engineer
6 days ago
LOGIC PLANET IT SERVICES Chennai, India permanentAbout the job : · We are hiring for a global technology company, home to more than 224,000 people across 60 countries. · Role : Data Engineer · Exp : 5+ years · Mode of Work : Hybrid · Mode of Hire : FTE · Availability : Immediate joinee or serving maximum of 30 days notice peri ...
Azure Data Engineer - Chennai, India - Travash
Description
Azure Data EngineerJob Description :