- Troubleshoot, resolve and suggest deep codelevel analysis of Spark to address complex customer issues related to Spark core internals, Spark SQL, Structured Streaming and Databricks Delta.
- Provide best practices guidance around Spark runtime performance and usage of Spark core libraries and APIs for custombuilt solutions developed by Databricks customers.
- Help the support team with detailed troubleshooting guides and runbooks.
- Contribute to automation and tooling programs to make daily troubleshooting efficient.
- Work with the Spark Engineering Team and spread awareness of upcoming features and releases.
- Identify Spark bugs and suggest possible workarounds.
- Demonstrate ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests
- Participate in weekend and weekday on call rotation.
- Minimum 5 years' experience developing, testing, and sustaining Python or Java or Scalabased applications.
- Comfortable with compiling, building and navigating the Apache Spark source code.
- Comfortable with identifying and applying patches/bug fixes to the Apache Spark source code.
- Experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
- Handson experience with SQLbased database systems.
- Experience in JVM, GC, Thread dumpbased troubleshooting is required.
- Experience with AWS or Azure related services.
- Bachelor's degree in Computer Science or a related field is required.
-
Technical Solutions Engineer- Apache Spark
1 week ago
Databricks Bengaluru, IndiaDiscoverCustomersPartners · Databricks PlatformIntegrations and DataPricingOpen Source · Databricks for IndustriesCross Industry SolutionsMigration & DeploymentSolution Accelerators · Training and CertificationEventsBlog and PodcastsGet HelpDive Deep · CompanyCareersPressSecurity ...
-
Evnek - Senior Data Engineer - Python/Spark
1 week ago
Evnek Technologies Bangalore, India permanentJob Description : · Experience working with distributed technology tools for- developing Batch and Streaming- pipelines using SQL, Spark, Python, PySpark [4+ years], Airflow [3+ years], Scala [2+ years]. · - Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. · - Experience ...
-
Target Corporation Bengaluru, IndiaJob Description : · As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You help develop and gain insight in the application architecture. You can distill an abstract architecture into concrete design and influenc ...
-
Pyspark Dsa 4 to 8 Years Pan India
1 day ago
Capgemini Bengaluru, Karnataka, India**Job Description**: · - Bachelor's or master's degree in computer science, Engineering, or related field · - 5-8 years of experience in data engineering and machine learning · - Extensive experience with Python programming, including Pandas, NumPy, and various libraries for data ...
-
Gcp 6 to 9 Years Pan India
4 days ago
Capgemini Bengaluru, IndiaMinimum 2 years' experience in GCP Data Engineering. · - Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. · - Should have worked on handling big data. · - Strong communication skills. · - experience in Agile methodologies ETL ...
-
Gen Ai
1 week ago
Wipro Limited Bengaluru, Karnataka, India**Overview**: · Sr.Data Engineers with minmum 6+ years experinece on Pyhton, SQL, Shell Scriptin, Hive and Spark · ? Expert-level skills in writing and optimizing complex SQL. · ? Knowledge of data warehousing concepts. · ? Experience in data mining, profiling, and analysis. · ? ...
-
Enterprise Solutions Architect
1 week ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate ...
-
Big Data Python
1 week ago
Harman International Bengaluru, IndiaHARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of ...
-
Principal Solutions Architect
1 week ago
Databricks Bengaluru, IndiaAs a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor** internally to the sales team, and work with the product team as an advocate ...
-
Principal - Data Scientist
1 week ago
Affine Bengaluru, IndiaJob Description · **Key Responsibilities**: · - Develop, maintain, and optimize forecasting Machine Learning (ML) models for better accuracy. · - Collaborate with other data scientists and data engineers to ensure that specifications are translated into flexible, scalable, and ma ...
-
Azure Data Bricks 4 to 9 Years Gurgaon
4 days ago
Capgemini Bengaluru, IndiaExperience working with various database/data warehouse technologies (Azure Data Bricks & Data Factory ) · - Experience working with Spark-Scala in Azure Synapse Spark pool · - Experience in building data pipelines/ingestion framework for DWH implementations in Azure · - Main Ski ...
-
Solutions Data Architect
1 week ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
Solutions Architect
1 day ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
Gen Ai
1 week ago
Wipro Limited Bengaluru, Karnataka, IndiaBengaluru, India · - Tech Hiring · **Job Description**: · Sr.Data Engineers with minmum 6+ years experinece on Pyhton, SQL, Shell Scriptin, Hive and Spark · ? Expert-level skills in writing and optimizing complex SQL. · ? Knowledge of data warehousing concepts. · ? Experience in ...
-
Databricks + Python
1 week ago
NR Consulting - India Bengaluru, IndiaJob Description · **Role**: Software Engineer · **Location**: Bangalore · Who are we looking for? · We are looking for a data bricks engineer (developer), having strong software development experience of 3 to 4 years on DataBricks Python, Spark, Redshift, SQL & AWS · **Technical ...
-
Architect : Big Data & Ai
3 days ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
CGI Group, Inc. Bengaluru, India**Position Description**: · - 7 to 8 years working experience on Big Data Engineering and other open source technologies · - Strong Knowledge of Python, Apache Spark (PySpark), Azure Data Lake (Gen 2), PySParkSQL, Spark Streaming · - Strong knowledge of ETL/Data warehosuing conce ...
-
Solutions Architect
1 day ago
Databricks Bengaluru, IndiaAs a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advoc ...
-
Scala
3 days ago
Capgemini Bengaluru, Karnataka, India**Job Description**: · - **Data Engineer with minimum 6-8 years of relevant IT experience**: · - **Experience with Scala object-oriented/object function**: · - **Strong SQL background, especially, with Spark SQL, Hive SQL**: · - **Experience with data pipelines & Data Lake**: · - ...
-
Gcp Architect
1 day ago
Change Leader Bengaluru, India**JOB DESCRIPTION** · **GCP Architect** · **Explerience: 8**: · - 15 years · **Locations**:Bangalore, Chennai, Pune, Gurgaon · **Primary Skills**: GCP, Big Query, Air Flow, Cloud Composer, Data Fusion, Data Flow, Data Proc, Data Warehousing, Data Modeling, Big Data · **Desired S ...
Spark Engineer - Bengaluru, India - Cyber Sphere LLC
Description
Job Description :
As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team.
Outcomes :