- Troubleshoot and resolve complex customer issues related to Spark core internals, Spark SQL, Structured Streaming, and Databricks Delta, and suggest deep code-level analysis when necessary.
- Offer best practices guidance on Spark runtime performance and the usage of Spark core libraries and APIs for custom-built solutions developed by Databricks customers.
- Assist the support team by providing detailed troubleshooting guides and runbooks.
- Contribute to automation and tooling programs to streamline daily troubleshooting processes.
- Collaborate with the Spark Engineering Team to disseminate information about upcoming features and releases.
- Identify Spark bugs and recommend possible workarounds.
- Demonstrate ownership of customer issues and coordinate with engineering and escalation teams to achieve timely resolution.
- Participate in weekend and weekday on-call rotation schedules.
- Minimum of 5 years of experience in developing, testing, and sustaining Python, Java, or Scala-based applications.
- Proficiency in compiling, building, and navigating the Apache Spark source code.
- Ability to identify and apply patches/bug fixes to the Apache Spark source code.
- Experience with Big Data technologies such as Hadoop, Spark, Kafka, Elasticsearch, and data pipelines.
- Hands-on experience with SQL-based database systems.
- Proficiency in JVM, GC, and Thread dump-based troubleshooting.
- Familiarity with AWS or Azure related services.
- Bachelor's degree in Computer Science or a related field.
Technical Solutions Engineer - India - SourceBae
Description
Technical Solutions Engineer - Spark
Contract Type: Contractual (Onsite)
Location: Remote
Experience: Minimum 5 years
Mission: As a Technical Solutions Engineer, you will play a crucial role in ensuring the success of our customers utilizing the Databricks Data Intelligence platform. Your primary responsibility will be to address and resolve significant technical escalations from customers and the support team. Serving as the technical liaison between support and engineering, you will act as the first line of defense for engineering issues. Your role includes vetting all issues before they reach the engineering team. Reporting to the Senior Backline Manager of the Backline Escalations Team, you will collaborate closely with both support and engineering teams to provide efficient and effective solutions.
Outcomes:
Competencies: