- Develop and maintain data pipelines and workflows using PySpark on Databricks
- Write Python scripts for data processing, transformation, and integration with Spark
- Utilize PySpark and related libraries (e.g., pyspark-ai) to incorporate AI and machine learning functionalities into Spark workflows
- Perform data analysis, transformations, and aggregations on large datasets
- Deploy and optimize machine learning models within the Databricks environment
- Collaborate with data engineers, data scientists, and business teams to understand requirements and deliver solutions
- Use the Databricks platform to manage, monitor, and optimize Spark jobs and workflows
- Work with the English SDK for Apache Spark to facilitate natural language interactions with Spark DataFrames
- Ensure code quality, performance, and scalability of data pipelines and Spark jobs.
-
Design develop and deploy data processing solutions using Azure Databricks. · ...
Chennai1 month ago
-
Design develop and deploy data processing solutions using Azure Databricks collaborate with data engineers architects and business analysts to gather and analyze requirements develop optimize and manage complex data pipelines and workflows ensure data quality integrity and securi ...
Chennai, Tamil Nadu1 month ago
-
Teamware Solutions is seeking a skilled Databricks with Python Developer to build, optimize, and manage our big data processing and analytics solutions. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to ...
Chennai Full time5 days ago
-
Key Responsibilities · Administer and manage Databricks workspaces across Dev, QA, and Prod environments. · Configure clusters, manage auto-scaling, and optimize platform performance. · Implement and manage security including RBAC, IAM roles, and access controls. · Monitor system ...
Chennai ₹900,000 - ₹2,200,000 (INR) per year Full time1 day ago
-
We're seeking a hands-on Resident Solution Architect (Databricks)with deep technical expertise in building and optimizing Lakehouse-based data and AI solutions. · ...
Chennai1 week ago
-
Role Overview · We are seeking a Databricks QA/Tester with 24 years of experience to join our data engineering and analytics team. The ideal candidate will have hands-on expertise in Python, PySpark, and Databricks, with a strong focus on testing, validation, and quality assura ...
Chennai, Guindy16 hours ago
-
Must have minimum 7+ years of experience in Data Migration and Data Transformation projects on Azure cloud Proven expertise in building large-scale batch and real-time data pipelines with data processing frameworks in AWS and Azure cloud platforms Design and develop pipelines ETL ...
Chennai, Hyderabad3 weeks ago
-
Databricks Developer job in top companies in India with average salary of Rs.15-23 lakhs per annum. · ...
Chennai, Mumbai, Pune1 month ago
-
We are looking for an experienced Databricks Administrator to manage, optimize, and support our Databricks environment. · Manage, optimize, and support our Databricks environment. · ...
Chennai, Kolkata3 weeks ago
-
Join our dynamic team as a Demand Role Architect where you will leverage your extensive experience in Spark in Scala Delta Sharing and Databricks technologies. · ...
Chennai3 weeks ago
-
Bachelors degree or equivalent in Computer Engineering, Computer Science, or a related field. · 5+ years of experience in data / software engineering role. · 3+ years of experience with building AWS or Azure cloud-based data pipelines and AI solutions. · 3+ years of experience wi ...
Chennai Full time1 day ago
-
Preferred candidate profile · Databricks & Snowflake experience : Must to Have · Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD. · Must to Have · Solution, Design an ...
Chennai Full time5 days ago
-
Essential · Bachelors degree or equivalent in Computer Engineering Computer Science or a related field · 5 years of experience in data software engineering role · 3 years of strong hands on experience with Databricks with AWS as a cloud platform which including Spark based proces ...
IN - TN - Chennai $100,000 - $120,000 (USD) per year1 day ago
-
Role & responsibilities · 1.Databricks Platform Administration including environment setup, user and group management, access control configuration and · familiarity with networking and firewall rules. · 2.Expertise in handling AWS/Azure services w.r.t Databricks Platform Featur ...
Chennai, Kolkata ₹900,000 - ₹2,200,000 (INR) per year16 hours ago
-
ROLE OVERVIEW · We are looking for a specialized Databricks Architect to define and drive our next-generation data lakehouse strategy. This role focuses on designing high-performance distributed data systems that enable real-time analytics and advanced machine learning capabiliti ...
Chennai3 days ago
-
We are seeking a highly skilled Senior Data Engineer with strong experience in cloud-based data engineering and AI solutions. The ideal candidate will bring a combination of software engineering, big data processing, and cloud infrastructure expertise. This role requires hands-on ...
Chennai Full time1 day ago
-
+Databricks engineer role in Chennai/Mumbai. · +Acting as a data ninja: dive deep, flip, slip, and transform data · Discovering clients requirements · Working with application developers, DevOps, business, and data scientists in an agile setup · Taking excellent care of the ...
Chennai, Mumbai1 month ago
-
Job description · Position Description: · Your future duties and responsibilities: · We are seeking a skilled Azure Databricks Developer to design, develop, and optimize big data pipelines using Databricks on Azure. The ideal candidate will have strong expertise in PySpark, Azure ...
Chennai ₹800,000 - ₹2,400,000 (INR) per year Full time1 day ago
-
We are seeking ETL Developers with 3-6 years of experience to join our data engineering team.The ideal candidates will have strong expertise in PySpark, Python and Databricks. · ...
Chennai1 week ago
-
Databricks engineer position at Chennai Hyderabad. · ...
Chennai, Hyderabad2 weeks ago
Databricks - Chennai - Elfonze Technologies
Description
Roles & Responsibilities:
-
Databricks
Only for registered members Chennai
-
Databricks
Only for registered members Chennai, Tamil Nadu
-
Databricks with Python
Full time confidential- Chennai
-
Databricks Administrator
Full time Siro Clinpharm- Chennai
-
Databricks Architect
Only for registered members Chennai
-
Databricks QA
Only for registered members Chennai, Guindy
-
Databrick AWS
Only for registered members Chennai, Hyderabad
-
Databricks Developer
Only for registered members Chennai, Mumbai, Pune
-
Databricks Admin
Only for registered members Chennai, Kolkata
-
Databricks with Pyspark
Only for registered members Chennai
-
PySpark/Databricks
Full time Virtusa- Chennai
-
Databricks Architect
Full time confidential- Chennai
-
Databrick AWS
Only for registered members IN - TN - Chennai
-
Databricks Administrator
Only for registered members Chennai, Kolkata
-
Databricks Architect
Only for registered members Chennai
-
PySpark & Databricks
Full time Virtusa- Chennai
-
Databricks Engineer
Only for registered members Chennai, Mumbai
-
Azure Databricks
Full time CGI Information Systems and Management Consultants Private Limited- Chennai
-
Databricks Developer
Only for registered members Chennai
-
Databricks AWS
Only for registered members Chennai, Hyderabad