Arity - Big Data Engineer - Arity

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection.

Job Description

The Role:

The Data Engineer role is responsible for processing data into and out of the Arity insurance platform. This will include taking over existing pipelines, converting them to a new platform, as well as taking on some processing that pulls data together and then store in data lakes.

Responsibilities:

• Collaborate with other Engineers, IT Architects, and business clients to ensure complete understanding of the platforms technical and business functionality.

• Participate in daily site, cross-site, and product team ceremonies associated with scrum principals

• Establish continuous integration, continuous delivery, and continuous deployment pipelines and practices

• Design, develop, and test components of the new attribute platform including data ingestion and delivery functions

• Test, debug, and analyze performance and document hardware and software technology components.

• Ensure that plans integrate effectively with other components accounting for compliance and security standards.

• Rotate into production support of applications which could include off-hours support.

• Participate in knowledge sharing and contribute to the overall growth of the collective knowledge of the team.

Qualifications:

• 3+ experience with building big data ETL pipelines

• Strong understanding of computer science concepts, big data design principles and implementing and managing large data sets.

• Experience in Test Driven Development; including knowledge and experience in testing frameworks (such as MSTest, NUnit, xUnit.net, junit, mockito, jasmine, protractor, cucumber, and other like technologies)

• Understanding of cloud services, deployment models, and distributed systems

• AWS services knowledge: S3, Lambda, Firehose, Dynamo DB, and Step Functions

• GCP services knowledge: Big Query, GCS

• Experience in Python and/or Scala

• Clear understanding of data management, process automation, system monitoring, and maintainability.

At Arity, great things happen when our people work together.

That's why when you join our team, we make sure it isn't just a job - it's an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.

You'll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we've proven that Allstate empowers everyone to lead, drive change and give back where they work and live.

Good Hands. Greater Together

Skills

Compensation

The candidate(s) offered this position will be required to submit to a background investigation.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click "here" for information regarding the San Francisco Fair Chance Ordinance.
For jobs in Los Angeles, please click "here" for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

To view the "EEO is the Law" poster click "here". This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs

To view the FMLA poster, click "here". This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.

It is the Company's policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee's ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.