- Craft and implement data pipelines utilizing Spark and Python
- Define and deliver reusable components for ETL/ELT framework.
- Define optimal data flow for system integration and data migration
- Integrate new data management technologies and software engineering tools into existing structures
- Design, build and maintain CI/CD pipelines in multiple integration and test environments
- Install, configure and manage automated testing tools in the Experienced in Design, Development, and Implementation of largescale projects in financial industries using Data Warehousing ETL tools(Spark)
- Experience in creating ETL transformations and jobs using PySpark and automating workflows using Orchestration tools like Airflow, Control-M
- Strong knowledge and experience of SQL, Python and Spark
- Experience with Big Data/distributed frameworks such as Spark, Kubernetes, Hadoop, and Hive
- Ability to design ETL/ELT solutions based on user reporting and archival requirements
- Strong sense of customer service to consistently and effectively address client needs
- Selfmotivated; comfortable working independently under general direction
- Handson experience in building and managing CI/CD pipelines
- Basic knowledge of Azure Cloud Components
-
Jobs For Data Engineer
6 days ago
Seven Consultancy chennai, IndiaSALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...
-
Jobs For Data Engineer
6 days ago
Seven Consultancy Chennai, IndiaSALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...
-
Data Engineer
6 days ago
Live Connections chennai, IndiaImmediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediat ...
-
Data Engineer
6 days ago
HTC Global Services chennai, IndiaPosition Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be ...
-
Data Engineer
1 week ago
BU Soft Tech Chennai, IndiaExperience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...
-
Data Engineer
6 days ago
Live Connections tamil nadu, IndiaImmediate Opening For Data Engineer with ODI, Big Data, Power BI and Spark. · Please connect on LinkedIn for a swift profile process. · Role: Data Engineer. · Mandate Skill: Data Engineer with ODI, Big Data, Power BI and Spark, · Experience: 7+ Yrs Only · Notice Period: Immediate ...
-
Data Engineer
6 days ago
OptiSol Business Solutions Chennai, IndiaPosition: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, res ...
-
Data Engineer
3 weeks ago
Ashley Global Capability Center Chennai, IndiaPrimary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...
-
Data Engineer
6 days ago
Cynosure Corporate Solutions chennai, IndiaLead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data ...
-
Data Engineering
6 days ago
InfoCepts chennai, IndiaPosition: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, ...
-
Data Engineer
1 week ago
Altimetrik Chennai, IndiaRole: Data Engineer · Years of experience: 4-10. · Job Location: Chennai · Job Description: · Position Overview: We are seeking a skilled Data Engineer with a solid understanding of Google Cloud Platform (GCP) technologies. The ideal candidate will have extensive experience with ...
-
Data Engineer
6 days ago
Aspire Systems tamil nadu, IndiaData Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...
-
Data Engineer
1 week ago
Makonis Chennai, IndiaWork Location: Chennai & Coimbatore Required Exp: 3 to 6yrs (Fulltime Position) Client: Leading Investment Bank Mandatory skills: We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. If that matches your profile, please share a copy of your res ...
-
Data Engineer
6 days ago
ResourceTree Global Services Chennai, IndiaJob Description : · ResourceTree Global Services is hiring Senior Data Engineer Role for one of its Data Analytics Client. Below are the details · Role : Senior Data Engineer - Azure · Primary Skills : ADF (Azure Data Factory), SQL · Experience : 4 - 6 Years · Location : Ch ...
-
Data Engineer
5 days ago
Agilisium Chennai, India Full timeJob Description :- Develop and automate large scale, high-performance, scalable platform (batch and/or streaming) to drive faster analytics - Ability to design large-scale, complex applications and frameworks with excellent run-time characteristics such as low-latency, fault-tole ...
-
Data Engineer
1 week ago
Insight Global Chennai, India12-16hr USD · Required Skills & Experience · *Bachelors degree in computer science · 6-8 years of data engineering experience · Writing SQL and schema buildout, including star schemas, constellations, and snowflake schemas · Experience with ETL tool, such as SSIS · Big data techn ...
-
Data Engineer
3 weeks ago
Movate Chennai, IndiaRole: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...
-
Data Engineer
2 weeks ago
Mindsprint Chennai, IndiaJob Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...
-
Data Engineer
6 days ago
Blackstraw tamil nadu, IndiaData Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exampl ...
-
Data Engineer
1 week ago
Hexaware Technologies Chennai, IndiaWalk -in drive for Azure Data Engineer on 27 Apr at Chennai · Exp: 4 to 15 years · Drive Location: · Hexaware Technologies, EB2 Ground Floor, SIPCOT IT Park, · Navalur Siruseri Chennai, Tamil Nadu, 601301 · Contact Person: Manoj Kumar.k -TAG · Primary Skills : Databricks with Pys ...
Data Engineer - Chennai, India - U-SET
Description
Data Engineer - ETL with Python, Spark & HadoopWomen's Drive - 2nd March -Chennai - Organize business needs into ETL/ELT logical models and ensure data structures are designed for flexibility to support scalability of business solutions