- Hadoop
- Python
- Spark
- PySpark
- ETL (Extract, Transform, Load)
- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.
- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and performance.
- Data Modeling: Design and implement data models that facilitate efficient querying and analysis of structured and unstructured data.
- ETL Development: Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and integrate data from different sources into data warehouses or data lakes.
- Performance Tuning: Optimize data processing workflows and queries to improve performance and reduce processing times.
- Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data.
- Data Governance: Enforce data governance policies and standards to ensure compliance with regulatory requirements and industry best practices.
- Collaboration: Collaborate with crossfunctional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Continuous Improvement: Stay updated with emerging technologies and best practices in data engineering, and proactively identify opportunities for process optimization and automation.
-
Jobs For Data Engineer
1 day ago
Seven Consultancy chennai, IndiaSALARY : 12 L · LOCATION : Chennai, Tamil Nadu, India · VACANCIES : 1 · QUALIFICATION : Certified Analytics Professional. · MALE/FEMALE : Both · EXPERIENCE : 4 yr - 5 yr ...
-
Jobs For Data Engineer
6 hours ago
Seven Consultancy Chennai, IndiaSALARY · : · 12 LLOCATION · : · Chennai, Tamil Nadu, IndiaVACANCIES · : · 1QUALIFICATION · : · Certified Analytics Professional.MALE/FEMALE · : · BothEXPERIENCE · : · 4 yr - 5 yr ...
-
Data Engineer
1 day ago
BU Soft Tech Chennai, IndiaExperience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...
-
Data Engineer
1 day ago
OptiSol Business Solutions Chennai, IndiaPosition: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible ...
-
Data Engineering
1 day ago
InfoCepts Chennai, IndiaPosition: · Data Engineering - Project Manager · Location: · Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, ...
-
Data Engineer
1 day ago
Aspire Systems Chennai, IndiaData Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...
-
Data Engineer
1 week ago
Movate Chennai, IndiaRole: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...
-
Data Engineer
1 week ago
Ashley Global Capability Center Chennai, IndiaPrimary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...
-
Data Engineer
1 day ago
HTC Global Services Chennai, IndiaPosition Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...
-
Data Engineer
3 days ago
Mindsprint Chennai, IndiaJob Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...
-
Data Engineer
1 day ago
Blackstraw Chennai, IndiaData Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: · We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For exam ...
-
Data Engineer
1 day ago
Cynosure Corporate Solutions Chennai, IndiaLead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data wareh ...
-
Data Engineer
1 week ago
HTC Global Services Chennai, IndiaData Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...
-
Data Engineer
1 day ago
System Soft Technologies Chennai, India· Job Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, ...
-
Data Engineer
1 day ago
Makonis Chennai, IndiaWork Location: Chennai & Coimbatore Required Exp: 3 to 6yrs (Fulltime Position) Client: Leading Investment Bank Mandatory skills: We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. If that matches your profile, please share a copy of your res ...
-
Data Engineer
1 day ago
culture highway chennai, IndiaJob Description : · Tech Anchor- Data Engineering Role Overview : · Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. You will be responsible for designing, implementing and optimizing data pipelines, ensuring data ...
-
Data Engineer
1 day ago
Notus chennai, IndiaAWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintai ...
-
Data Engineer
1 day ago
Movate Chennai, IndiaRole · - Data Engineer · Years of Exp- · : 5 Years – 8Years · Location · - Chennai · Technical skills: · • Very strong SQL skills · o Writing new queries, · o Modifying existing queries · o Analyzing the queries for better performance · • Performance tuning capabilities · o Analy ...
-
Data Engineer
1 day ago
ResourceTree Global Services chennai, IndiaJob Description : · ResourceTree Global Services is hiring Senior Data Engineer Role for one of its Data Analytics Client. Below are the details · Role : Senior Data Engineer - Azure · Primary Skills : ADF (Azure Data Factory), SQL · Experience : 4 - 6 Years · Location : Ch ...
-
Data Engineer
1 day ago
ResourceTree Global Services chennai, IndiaResourceTree Global Services is hiring Senior Data Engineer(Snowflake & DBT) for one of its Data Analytics Client. Below are the details. · Role: Senior Data Engineer(Snowflake & DBT) · Primary Skills: DBT,Snowflake · Secondary Skills: 4 to 6 Years · Location: Chennai · Role f ...
Data Engineer - chennai, India - ADVANSOFT
Description
Skills :
Roles & Responsibilities :
Documentation:
Maintain documentation for data pipelines, data models, and ETL processes to facilitate knowledge sharing and troubleshooting.