Arity Logo

Arity

Arity - Senior Data Engineer

Job Posted 5 Days Ago Posted 5 Days Ago
Remote
86K-153K Annually
Senior level
Remote
86K-153K Annually
Senior level
As a Senior Data Engineer at Allstate's Arity, you'll design and optimize data and machine learning workflows to enhance telematics solutions, collaborate with teams to support analytics and reporting, and ensure data quality while mentoring junior engineers.
The summary above was generated by AI

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.
Job Description
Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer, and more useful for everyone. At the heart of that mission are the people that work here-the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real-world problems and put your talents towards transforming transportation. That's because at Arity, we believe work and life shouldn't be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don't just want you to see yourself here. We want you to be yourself here. Arity is committed to supporting an inclusive and diverse environment where you can thrive and learn from others.
We are seeking a highly skilled and experienced Senior Data Engineer with extensive professional experience in full-stack data engineering, including hands-on expertise in the development of large-scale data platforms and machine learning pipelines. In this role, you'll design, develop, and optimize scalable data and ML workflows to support our growing telematics business needs. As a key member of the Data Analytics Engineering Team, you'll enable data-driven decision-making by building robust pipelines, efficient architectures, and impactful ML solutions.
Key Responsibilities:

  • Design, build, and maintain end-to-end data and machine learning pipelines to support analytics, reporting, and AI-driven applications.
  • Develop and optimize scalable ETL/ELT processes to extract, transform, and load data from diverse sources into a cloud-based platform.
  • Architect and manage data storage solutions within the data platform (e.g., data lakes, warehouses, and marts) to enable advanced analytics and machine learning.
  • Implement and manage ML pipelines, building feature pipelines and deploying models.
  • Collaborate with data scientists, analysts, and software engineering to integrate data products into business workflows.
  • Ensure data quality, consistency, and governance by implementing robust monitoring, validation, and alerting mechanisms.
  • Lead the adoption of new cloud-native technologies to streamline and enhance data and ML operations.
  • Mentor junior data engineers, fostering a culture of innovation and knowledge-sharing within the team.


Qualifications:

  • Bachelor's degree in Computer Science, Data Science, Software Engineering, Mathematics, Statistics, or a related field. A Master's degree is preferred.
  • 5+ years of professional experience in data engineering, including end-to-end pipeline development and cloud integration.
  • Proven experience with machine learning workflows, including data preparation, feature engineering, and model deployment.
  • Proficiency in programming languages such as Python, Scala, or Java, with an emphasis on ML libraries like TensorFlow, PyTorch, or Scikit-learn.
  • Strong knowledge of data processing frameworks (e.g., Apache Spark, Flink, Beam) and real-time data streaming (e.g., Kafka, Kinesis).
  • Hands-on expertise with AWS or GCP ecosystems, including tools like:
    • AWS: SageMaker, Redshift, Glue, Athena, EMR
    • GCP: BigQuery, Vertex AI, Dataflow, Dataproc
  • Solid understanding of relational and non-relational database systems (SQL, NoSQL).
  • Experience with data orchestration tools (e.g., Airflow, Prefect, dbt) and CI/CD practices.
  • Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.


Preferred Skills:

  • Experience with geospatial data like trajectories.
  • Experience deploying machine learning models into production environments with monitoring and optimization strategies.
  • Familiarity with cloud security and compliance best practices for data and ML workflows.
  • Proficiency in BI tools (e.g., Tableau, Looker, Power BI) and data visualization.
  • Strong understanding of MLOps practices and tools for automated ML lifecycle management.


Relevant certifications in cloud platforms (e.g., AWS Data Engineer, Machine Learning Engineer; Google Cloud Professional ML Engineer, Professional Data Engineer) are a plus.
#JB-2
Skills
Business Data Analytics, Computer Science, Data Analytics, Data Science, Machine Learning, Predictive Modeling, Python (Programming Language)
Compensation
Compensation offered for this role is $85,600.00 - 152,650.00 annually and is based on experience and qualifications.
The candidate(s) offered this position will be required to submit to a background investigation.
Joining our team isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.
You'll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we've proven that Allstate empowers everyone to lead, drive change and give back where they work and live.
Good Hands. Greater Together.
Allstate generally does not sponsor individuals for employment-based visas for this position.
Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.
For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.
To view the "EEO is the Law" poster click "here". This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs
To view the FMLA poster, click "here". This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.
It is the Company's policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee's ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.

Top Skills

Airflow
Spark
Athena
AWS
Beam
BigQuery
Dataflow
Dataproc
Dbt
Docker
Emr
Flink
GCP
Glue
Java
Kafka
Kinesis
Kubernetes
NoSQL
Prefect
Python
PyTorch
Redshift
Sagemaker
Scala
Scikit-Learn
SQL
TensorFlow
Vertex Ai

Similar Jobs at Arity

18 Days Ago
Remote
United States
86K-153K Annually
Senior level
86K-153K Annually
Senior level
Big Data • Transportation • Analytics • Big Data Analytics
As a Senior DataOps Engineer at Arity, you will design and enhance cloud-based data pipelines, manage CI/CD pipelines, collaborate with teams on data flow optimization, and ensure the security and scalability of cloud environments while mentoring junior engineers.
Top Skills: AnsibleAWSBashCircleCICloudFormationDatadogGitlabGoGCPGrafanaJenkinsPrometheusPythonTerraform
4 Days Ago
Remote
United States
122K-207K Annually
Senior level
122K-207K Annually
Senior level
Big Data • Transportation • Analytics • Big Data Analytics
Lead the development of machine learning algorithms for advertising at Arity, focusing on optimizing the marketing platform using large datasets. Responsibilities include analyzing data, building predictive models, collaborating with cross-functional teams, and implementing best practices in data science to drive business results.
Top Skills: Amazon RedshiftBigQueryPythonPyTorchSagemakerScikit-LearnSparkSpark Ml-LibTensorFlowVertex Ai
18 Days Ago
Remote
United States
86K-153K Annually
Senior level
86K-153K Annually
Senior level
Big Data • Transportation • Analytics • Big Data Analytics
As a Senior DataOps Engineer at Arity, you will design and enhance cloud-based data pipelines, manage CI/CD pipelines, collaborate with teams on data flow optimization, and ensure the security and scalability of cloud environments while mentoring junior engineers.
Top Skills: AnsibleAWSBashCircleCICloudFormationDatadogGitlabGoGCPGrafanaJenkinsPrometheusPythonTerraform

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account