- Proficiency in Spark, Python, Databricks, and AWS services.
- 7-10 years of experience
- Lead the design, development, and implementation of Spark-based solutions for complex data processing tasks.
- Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
- Implement best practices in software engineering, DevOps, and MLOps methodologies.
- Design and maintain data pipelines for efficient data processing and analysis.
- Perform data modeling and schema design to support business requirements.
- Mentor junior team members and provide technical guidance as needed.
- Stay updated with the latest advancements in Spark, Python, and related technologies, and advocate for their adoption when appropriate.
- Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
- Strong understanding of software engineering principles and best practices.
- Hands-on experience with DevOps tools and practices including CI/CD pipelines, Kubernetes, and either Jenkins, Airflow, or SageMaker.
- Experience with MLOps practices is a plus.
- Solid understanding of data engineering concepts and data modeling techniques.
- Excellent problem-solving skills and attention to detail.
- Ability to work independently and lead tasks effectively.
- Strong communication and interpersonal skills.
-
Data Engineer
5 days ago
BU Soft Tech Chennai, IndiaExperience - 3 to 4 yrs as Data Engineer · Tech Stack - Python, Pyspark, SQL, AWS & · Bachelor's degree in Computer Science, Engineering, or related field. · Excellent written and verbal communication skills. · Location - Chennai · Role Description · This is a full-time on-site r ...
-
Data Engineering
4 days ago
InfoCepts Chennai, IndiaPosition: Data Engineering - Project Manager · Location: Chennai · Purpose of the Position: · As a Data Engineering Project Manager, this position requires candidate who are enthusiastic about specialized skills to provide leadership and expertise in the design, development, and ...
-
Data Engineer
2 days ago
OptiSol Business Solutions Chennai, IndiaPosition: Data Engineer · Experience: 5-10 yrs. · Locations: Chennai/Madurai/Coimbatore/Hybrid · Role Summary · As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsibl ...
-
Data Engineer
3 days ago
Aspire Systems Chennai, IndiaData Engineer (Google Cloud Platform) · Exp: 5 - 9 Years · Location: Chennai / Bengaluru · Notice Period: Immediate - 30 Days · Requirements · Fluency in SQL, Shell and Python · Knowledge of building and maintaining data pipelines (e.g. Airflow, Control-M, Autosys) · Experience i ...
-
Data Engineer
1 week ago
Movate Chennai, IndiaRole: Azure Data Engineer/Scientist · Location: India (Chennai, Bangalore, Hyderabad) · Years of Experience : 5 – 7 Years · Work Mode : Work From Office · Responsibilities: · and analyze data on Azure using services like Azure Data Lake and Azure Synapse Analytics. · insights and ...
-
Data Engineer
5 days ago
HTC Global Services Chennai, IndiaPosition Description: · • This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be u ...
-
Data Engineer
1 day ago
Integrate Chennai, IndiaRole: Data Engineer L2 · Experience: 4-6 yrs · Skills required: Snowflake, spark, SQL, python · Work Location: Global Infocity, Chennai · Model: Hybrid · About us: · Integrate is the leader in Demand Management, an emerging category to help B2B marketers develop and deliver an om ...
-
Data Engineer
1 week ago
Blackstraw Chennai, IndiaData Engineer · Company Name: · Office Location: Chennai (Work from Office) · Job Type: Full-time · Experience: 4+ Years · Job Description: We are looking for Data Engineers to join our team. You will use various methods to transform raw data into useful data systems. For examp ...
-
Data Engineer
2 days ago
Mindsprint Chennai, IndiaJob Description: · Work Location : Bangalore & Chennai · Experience : 4 to 9 yrs · Mandatory Skillset : Google Big Query, Python, Sql · We need a Google Big Query Consultant who can fulfill below roles · 1. Solid understanding of data modeling concepts and experience with schema ...
-
Data Engineer
4 days ago
culture highway Chennai, IndiaJob Description : · Tech Anchor- Data Engineering Role Overview : · Tech Anchor- Data Engineering, you will play a crucial role in leading and driving data Engineering initiatives. You will be responsible for designing, implementing and optimizing data pipelines, ensuring data qu ...
-
Data Engineer
1 week ago
System Soft Technologies Chennai, IndiaJob Summary: · We are looking for an energetic Data Engineer our team. In this role, you'll work cross-functionally with business operations and to create and optimize workflow processes. · Responsibilities: · If you are a Data Passionist, this is the place for you. Together, we ...
-
Data Engineer
1 week ago
Ashley Global Capability Center Chennai, IndiaPrimary Job Functions · Responsible for full development cycle of Data Engineering & Warehousing concepts, including requirements gathering, architecture, design, implementation, and maintenance. · Identify and resolve data issues to ensure the quality and consistency of data; ...
-
Data Engineer
2 days ago
Notus Chennai, IndiaAWS Data Engineer · Job Title: AWS Data Engineer · Location: Bangalore / Chennai · Experience: 8+ Years · Job Description: · We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintainin ...
-
Data Engineer
4 days ago
TIGI HR Solution Pvt. Ltd. Chennai, IndiaJob Title : Data Engineer. · Experience : 3+ Years. · Budget : Up to 14-15 LPA. · Skills Required : · - Expertise in at least one of the following: Snowflake, Talend, Databricks, Matillion, DBT. · - Proficient in developing ETL processes including ETL control tables, error loggin ...
-
Data Engineer
1 day ago
Astonishic LLC Chennai, IndiaTitle : Data Engineer - Databricks Specialist · Location : Chennai, Tamil Nadu · Experience : 2-6 years · Employment Type : Onsite · Number of Positions : 10 · Job Description : · - Design, build, and maintain scalable and robust data pipelines using Databricks. · - Develop an ...
-
Data Engineer
1 week ago
HTC Global Services Chennai, IndiaData Engineer with GCP · 3+ yrs Experience · Job location : Chennai · Technical Skills : GCP -Big Query, Python, Data Flow or Pub-sub · please share resume to · Kindly share below details · CCTC · ECTC · Experience · Current Location · Skills · ...
-
Data Engineer
1 day ago
Cynosure Corporate Solutions Chennai, IndiaLead Data Engineer · Chennai, Tamil Nadu · Work Type: Full Time · Responsibilities: · Designing and implementing data pipelines to collect, clean, and transform data from various sources · Building and maintaining data storage and processing systems, such as databases, data war ...
-
Data Engineer
3 days ago
Makonis Chennai, IndiaWork Location: Chennai & Coimbatore · Required Exp: 3 to 6yrs (Fulltime Position) · Client: Leading Investment Bank · Mandatory skills: · We are looking for data engineers with good hands-on experience in T-SQL, SSRS and SSIS. · If that matches your profile, please share a copy o ...
-
Data Engineer
1 week ago
iTechMinds Consulting LLP Chennai, IndiaPosition : Azure Data Engineer · Location : Chennai · Essential Duties And Responsibilities : · - Build and maintain real-time and batch data pipelines across the advanced analytics platform. · - Design, develop, and orchestrate highly robust and scalable ETL pipelines. · - Desig ...
-
Data Engineer
2 days ago
iMind Your Business Solutions Private Limited Chennai, IndiaCompany Description : · iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. · Role Description : · This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US ...
Senior Data Engineer - Chennai, India - MARICI Solutions INC
Description
This is a remote position.
We are seeking a highly skilled Senior Spark Engineer with expertise in Python, Spark, Databricks, and AWS to join our dynamic team. The ideal candidate will possess a deep understanding of Spark architecture and be proficient in fine-tuning Spark jobs for optimal performance. Additionally, strong knowledge of software engineering best practices, DevOps principles including CI/CD pipelines, Kubernetes, and either Jenkins, Airflow, or SageMaker, is essential for this role. Experience in MLOps is desirable but not mandatory.