How Arity refines its crash detection algorithms

As Arity continues to grow and expand our core capabilities, we are consistently fine-tuning our technology. Our philosophy of continuous improvement is exemplified by our technology team. They maintain and refine Arity’s mobile phone-based crash detection algorithm. Arity compiles customer labels for tens of thousands of detected collisions per year, and we actively use this information to tweak the collision algorithm to optimize performance.  It has been quite a journey to get to where we are today.

The ups and downs of optimizing algorithms

The collision detection team rapidly developed the roller coaster filter for the algorithm, which has achieved greater than 95% precision and recalls in separating real collisions from former detected collisions that were actually roller coaster rides.

With the Arity software development kit (SDK) integrated into our customer’s mobile apps and carefully designed customer feedback channels, we can identify common user activities that are harder to differentiate from real vehicle collisions.

Preventing false positives that arise from roller coaster activity

One activity that throws the algorithm for a loop is amusement park rides. Roller coasters and similar rides can produce trajectories and accelerations comparable to those generated during real collisions. In the summertime, the number of false positives from these activities was magnified. After we identified the problem our team immediately assembled to find a solution.

To increase the volume of our roller coaster data set and gain additional context about the physics of the problem, we decided it was best to develop some first-hand experience. Luckily, we had no problem finding willing Arity volunteers. We narrowed down the large pool of enthusiastic volunteers to a group of data scientists and data engineers who were willing to take on the twists and turns of this unique field assignment.

We laid out a detailed plan of tests to be conducted at Six Flags in Gurnee, Illinois (in fact, we used integer programming to optimize an NP-hard scheduling problem, but that’s another blog post). In parallel, Arity’s data science team worked very closely with our mobile engineering team to develop special builds for the Arity SDK for the testing team’s test phones. Ahead of the big day, we trained our team of volunteers to manually start their trip in data collection mode, verify successful data collection, among many other things.

After a very challenging day-long effort that featured several rides on several roller coasters and other amusement park rides, our volunteers transferred the data that they collected over to the crash detection team as trained by the mobile engineering team. Using this data set, along with the customer labeled data already captured in the field, the collision detection team rapidly developed the roller coaster filter for the algorithm, which has achieved greater than 95% precision and recall in separating real collisions from former detected collisions that were actually roller coaster rides.

Preventing false positives that arise from skiing activities

As summer quickly turned into winter, we started to observe false positives at ski resorts. Indeed, certain skiing/snowboarding/sledding behaviors produce trajectories and accelerations comparable to those generated during some minor, but real collisions. Given the cold-start nature of the problem, similar to our roller coaster challenge, our biggest issue was the lack of a high volume of real and reliable ski ride data. Specific to this case, Arity worked closely with our customers to collect a new set of ski-specific data.

During their winter activities, several employees from both Arity and our customers graciously volunteered to collect data during their ski vacations. Using this data, we created a ski filter for the algorithm that has performed with greater than 90% precision and recalls in separating real collisions from the former detected collision that were actually skiing.

The scope of Arity’s data and data sources

Arity’s massive telematics database includes data from nearly one million on-board diagnostics (OBD-II) devices and 12 million mobile daily active users. This data is combined with the claims information (i.e. collision labels) for millions of insurance customers and customer labels which we gather in collaboration with Arity’s application partners. Whether we are speeding down a mountain or dropping from the heavens on a roller coaster, these are just two of the many examples of how Arity will go to great lengths to use this data to reach our goal of making transportation smarter, safer, and more useful for everyone.

Contact us to learn more about our crash detection solution.