Databricks Logo

Databricks

Staff Technical Solutions Engineer - Spark

Job Posted 17 Days Ago Posted 17 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Dallas, TX
102K-180K Annually
Senior level
Remote
Hiring Remotely in Dallas, TX
102K-180K Annually
Senior level
The Staff Technical Solutions Engineer will work with customers to solve complex technical challenges related to Spark and data engineering. Responsibilities include troubleshooting Spark issues, optimizing performance, collaborating with teams, and providing live customer support while maintaining technical documentation and contributing to internal tools.
The summary above was generated by AI

CSQ126R235. This role is hybrid with 3 days in our Plano office.

Are you passionate about solving challenging technical problems, working with cutting-edge big data technologies, and growing your expertise in Apache Spark™, cloud platforms, and data engineering? Join our global team and make an impact by helping customers achieve their goals with Databricks!

We are looking for a Staff-level Spark Technical Solutions Engineer with a strong data engineering background and hands-on Spark experience. In this role, you’ll work closely with our customers to solve complex technical challenges related to Spark, machine learning, Delta Lake, streaming, and our Lakehouse platform. You’ll use your technical expertise and communication skills to guide customers in their Databricks journey, ensuring they maximize the value of our platform.

The Impact You Will Have

  • Analyze and troubleshoot Spark issues, such as job performance and slowness, using tools like Spark UI, DAG, and event logs.
  • Solve problems related to Spark core, Spark SQL, structured streaming, Delta, and other Databricks runtime features.
  • Help customers optimize Spark performance in areas like memory management, streaming, and data integration.
  • Work directly with strategic customers to resolve day-to-day Spark and cloud-related issues.
  • Collaborate with Account Executives, Customer Success Engineers, and Solution Architects to address customer needs.
  • Collaborate with the R&D team to identify and escalate complex technical challenges, driving in-house supportability solutions within the Lakehouse platform.
  • Provide live support via screen-sharing sessions, Slack, and meetings to resolve major Spark issues.
  • Create and maintain technical documentation, including knowledge base articles and manuals.
  • Coordinate with engineering teams to report and track product defects.
  • Participate in on-call rotations for handling escalations and incidents.
  • Offer best practices for Spark performance and custom-built solutions.
  • Advocate for customers and their success.
  • Contribute to the development of internal tools and automation.
  • Support integrations between Databricks and third-party platforms.
  • Track and manage support tickets to meet SLAs.
  • Continuously learn and improve your expertise in Databricks, AWS, and Azure.

What We’re Looking For

  • 8-12 years of experience developing Python, Java, or Scala applications in data engineering or consulting roles.
  • 3+ years of hands-on experience with Spark (required) and other big data technologies like Hadoop, Kafka, or machine learning at a production scale.
  • Proven experience troubleshooting and optimizing Hive and Spark applications.
  • Knowledge of JVM, memory management, and garbage collection is a plus.
  • Familiarity with SQL databases and ETL tools (e.g., Informatica, Oracle, Teradata) is preferred.
  • Hands-on experience with AWS, Azure, or GCP is a plus.
  • Excellent written and verbal communication skills.
  • Basic Linux/Unix skills are a bonus.
  • Knowledge of data lakes and slowly changing dimensions (SCD) is a plus.
  • Strong problem-solving and analytical skills, especially in distributed big data environments.

Pay Range Transparency

Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles.  Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks utilizes the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.


Zone 3 Pay Range

$102,000$180,400 USD

About Databricks

Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks. 

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Top Skills

Spark
AWS
Azure
GCP
Hadoop
Informatica
Java
Kafka
Linux/Unix
Oracle
Python
Scala
SQL
Teradata

Databricks Seattle, Washington, USA Office

2001 8th Ave, Suite #600, Seattle, Washington, United States, 98121

Similar Jobs

53 Minutes Ago
Remote
Hybrid
Austin, TX, USA
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Develop and maintain automation for observability and reliability, support Kubernetes infrastructure, and mentor engineers in AWS and operational practices.
Top Skills: AnsibleArgoAWSBashDatadogElasticsearchGitGrafanaGroovyIstioJavaJenkinsKubernetesPodmanPrometheusPythonRubySplunkTerraform
An Hour Ago
Remote
USA
Mid level
Mid level
Machine Learning • Payments • Security • Software • Financial Services
The Software Engineer Lead at PNC will design, develop, and lead software solutions, facilitate problem resolution, and provide technical guidance to colleagues.
Top Skills: Application DevelopmentSoftware Development ToolsTechnical DocumentationUser Experience Design
An Hour Ago
Remote
USA
Mid level
Mid level
Machine Learning • Payments • Security • Software • Financial Services
The Quality Assurance Lead at PNC will oversee testing strategy, manage defect resolution, and ensure quality standards during the product life-cycle.
Top Skills: Quality Assurance (Qa)Software TestingTest Case Development

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account