Responsible ML Data Science Engineer

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Data

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Team Overview

Salesforce's Office of Ethical and Humane Use is looking for an experienced ML data scientist with a focus on responsible AI. Working with the Einstein product and engineering teams, AI Frontier, and Salesforce AI Research teams, they support the development of foundation and predictive models by ensuring they are built and deployed in alignment with OEHU’s guidelines and policies.

The Role

The ideal candidate is well-versed in assessing a variety of machine learning techniques to provide actionable insights on how to bring them into production. They are enthusiastic about providing technical and scientific leadership to teams of scientists and engineers. They build tools to ensure fair, accountable, transparent, and explainable AI. This individual will support our culture of being proactive, thoughtful, and knowledgeable about Salesforce’s AI products. 

Job Responsibilities:

• Partner with the Salesforce AI Research Science team, as well as distributed Data Science and Engineering teams, to measure and remediate potential bias in data and models.

• Build datasets for testing models, both generative and predictive, in collaboration with partner teams

• Participate in technical discussions, and drive engineering investments in responsible AI to improve model fairness and safety prior to launch

• Create notebooks using SQL or Python, and other tools, to empower other members of OEHU with advanced analytics capabilities

• Compare between different tools and libraries options (both Salesforce-built and open-source) to identify the most appropriate one for the task at hand

• Develop quantitative metrics to help surface insights from structured datasets

• Plan and conduct end-to-end experiments and analyses, from gathering requirements through processing and modeling the data, to identifying emerging risks

• Monitor and analyze logs data for harms/ threats and insights

• Validate any synthetic data generation, crowdsource, or contractor jobs for labeling or data creation

• Participate in labeling test data in partnership with OEHU and partner teams

• Contribute to the creation and use of libraries and tools that perform testing, evaluation, and mitigation of content safety issues and algorithmic bias

• Collaborate with industry leaders in similar positions in peer organizations on ways to improve the state of responsible AI development

• Extract logs and data from various parts of the tech stack for analysis

Job Requirements/Required Skills:

• Practical experience in machine learning 

• MS in a quantitative discipline with 8+ years of experience

• Fluent in building/prototyping machine learning models and algorithms and wrangling large datasets.

• Knowledgeable about standard machine learning approaches (Regression, Cross-Validation, Boosting, Matrix-Factorization, Decision Trees, Clustering, CNNs, RNNs, Transformers, GANs).

• Proficient in using Python and common machine learning frameworks (e.g., TensorFlow, Pandas, PyTorch, SciPy, scikit-learn, JAX) to implement models and algorithms.

• Proficient in SQL, shell scripting, and Unix/Linux command-line tools.

• Experience with designing and building micro-services, familiar with Kubernetes/containerization/RESTful API/gRPC, etc.

• Grasp of the evolving understanding of fairness and ability to meet both state-of-the-art and global standards for fairness evaluation, particularly in generative AI

• Experience working across teams of engineers, data scientists, and researchers.

• Strong communication skills. Comfortable presenting ideas to diverse teams and individuals in multiple formats, from slide decks to informal chats.

• Earns trust in relationships both internally and externally, and at all levels of the organization. Challenges the status quo to improve the productivity, effectiveness, and culture of a team - without burning bridges.

• Ability to creatively prioritize, stage, and sequence solutions to challenging/complex problems.

Desired Skills

• Demonstrated experience with  bringing data science solutions from problem identification to production

• Experience building and training various deep learning algorithms from scratch

• Strong experience leading multi-disciplinary teams driving significant business results

• Passion for the idea that technology can be a force for social good and for ethics and fairness.

• Ability to stay abreast of the latest findings in the field, new technologies, and best practices 

• Knowledge of enterprise SaaS space

• Works well under pressure, and is comfortable working in a fast-paced, ever-changing environment.

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.

For New York-based roles, the base salary hiring range for this position is $172,000 to $236,500.For Washington-based roles, the base salary hiring range for this position is $157,600 to $216,700.

For California-based roles, the base salary hiring range for this position is $172,000 to $236,500.

Compensation offered will be determined by factors such as location, level, job-related knowledge, skills, and experience. Certain roles may be eligible for incentive compensation, equity, benefits. More details about our company benefits can be found at the following link: https://www.salesforcebenefits.com.