Let's get out there and wreck some planes
Moderators: Rick, Lance Murray
- Rich
- 5 Diamonds Member
- Posts: 4608
- Joined: Mon Aug 30, 2010 12:40 pm
- First Name: Rich
- Aircraft Type: DA40
- Aircraft Registration: N40XE
- Airports: S39 Prineville OR
- Has thanked: 145 times
- Been thanked: 1187 times
Let's get out there and wreck some planes
Just kidding. An attempt at humor. And my intent is not to induce more Cirrus-bashing. It's more like journalist-bashing.
Here's what sparked it. last month Aviation Consumer published an article regarding the Cirrus accident record. The conclusion was it has improved a lot over the years. But something in the fatal accident percentage comparing them to the DA40 (33% ???) didn't look right, so I got to looking into it myself. Using what I think was his (Paul Bertorelli) stated methodology, i.e., using NTSB data for US accidents, I found some things I expected but some I did not. Summarily, here's what I found with respect to the percentage of accidents in the US that have been fatal:
1. His overall statement about Cirrus improvement is true, qualitatively.
2. The SR22 fatal accident percentage he came up with of 35% for all time looks accurate to me (76/120).
3. He showed a 41% fatal accident percentage all time for SR20. I conclude about 31% (22/72).
4. He stated 33% fatal accident percentage for the DA40. I find 21-23% (depends on whether to include DA40NG's - 7/34 or 7/31).
Contrary to his conclusion I believe the SR20 and DA40 are doing substantially better in this particular metric than he states, and both far better than the 22.
I went a bit further and did rolling 3 and 5 year averages of this statistic for the 3 types. All 3 show a downward trend (albeit somewhat "noisy"), with the numbers as of the end of 2018 being:
1. SR22 3-year: 26%, 5-year: also 26%.
2. SR20: 3-year: 18%, 5-year: 19%.
3. DA40: 3-year: 13%/9%, 5-year: 9.1%/7.1%
The DA40 numbers are particularly quirky and noisy as there has been only 1 DA40 fatal accident in the US after 2012, in 2016. My conclusion is the SR20 (and its pilots) with respect to this particular metric are both doing substantially better than the SR22. The DA40/pilot population accident record in the US is almost totally off the radar to the point it could be considered statistically useless. 4 of the 7 US DA40 fatal accidents occurred in the period 2009-2012, with the remaining 3 scattered across the remaining 13 years I included (2002-2018). The SR20 has had 4 years of zero fatal accidents scattered across that period, while the SR22 has had no such years in that period.
Why the title of the thread? There is such a disparity between what I came up with vs. Mr. B's is that I conclude that he somehow under-counted non-fatal accidents for both the SR20 and DA40 and/or over-counted fatal accidents. I have identified some quirks in the NTSB data and its search criteria page that could induce this sort of problem. Why this also didn't seem to be true for the SR22 conclusion I'm unsure, but it might have to do with the much higher numbers for the 22 either cancelling stuff out or making it moot. <SARCASM ALERT> So if we could bend up some more DA40's without hurting anyone we'd get more love from A/C next time around
I did come across something else interesting in the data. I counted actual fatalities recorded for each fatal accident. FWIW SR20 fatal accidents have a statistically significant higher likelihood than either the SR22 or DA40 to involve more than 1 fatality in a fatal accident.
Here's what sparked it. last month Aviation Consumer published an article regarding the Cirrus accident record. The conclusion was it has improved a lot over the years. But something in the fatal accident percentage comparing them to the DA40 (33% ???) didn't look right, so I got to looking into it myself. Using what I think was his (Paul Bertorelli) stated methodology, i.e., using NTSB data for US accidents, I found some things I expected but some I did not. Summarily, here's what I found with respect to the percentage of accidents in the US that have been fatal:
1. His overall statement about Cirrus improvement is true, qualitatively.
2. The SR22 fatal accident percentage he came up with of 35% for all time looks accurate to me (76/120).
3. He showed a 41% fatal accident percentage all time for SR20. I conclude about 31% (22/72).
4. He stated 33% fatal accident percentage for the DA40. I find 21-23% (depends on whether to include DA40NG's - 7/34 or 7/31).
Contrary to his conclusion I believe the SR20 and DA40 are doing substantially better in this particular metric than he states, and both far better than the 22.
I went a bit further and did rolling 3 and 5 year averages of this statistic for the 3 types. All 3 show a downward trend (albeit somewhat "noisy"), with the numbers as of the end of 2018 being:
1. SR22 3-year: 26%, 5-year: also 26%.
2. SR20: 3-year: 18%, 5-year: 19%.
3. DA40: 3-year: 13%/9%, 5-year: 9.1%/7.1%
The DA40 numbers are particularly quirky and noisy as there has been only 1 DA40 fatal accident in the US after 2012, in 2016. My conclusion is the SR20 (and its pilots) with respect to this particular metric are both doing substantially better than the SR22. The DA40/pilot population accident record in the US is almost totally off the radar to the point it could be considered statistically useless. 4 of the 7 US DA40 fatal accidents occurred in the period 2009-2012, with the remaining 3 scattered across the remaining 13 years I included (2002-2018). The SR20 has had 4 years of zero fatal accidents scattered across that period, while the SR22 has had no such years in that period.
Why the title of the thread? There is such a disparity between what I came up with vs. Mr. B's is that I conclude that he somehow under-counted non-fatal accidents for both the SR20 and DA40 and/or over-counted fatal accidents. I have identified some quirks in the NTSB data and its search criteria page that could induce this sort of problem. Why this also didn't seem to be true for the SR22 conclusion I'm unsure, but it might have to do with the much higher numbers for the 22 either cancelling stuff out or making it moot. <SARCASM ALERT> So if we could bend up some more DA40's without hurting anyone we'd get more love from A/C next time around
I did come across something else interesting in the data. I counted actual fatalities recorded for each fatal accident. FWIW SR20 fatal accidents have a statistically significant higher likelihood than either the SR22 or DA40 to involve more than 1 fatality in a fatal accident.
2002 DA40-180: MT, PowerFlow, 530W/430W, KAP140, ext. baggage, 1090 ES out, 2646 MTOW, 40gal., Surefly, Flightstream 210, Orion 600 LED, XeVision, Aspen E5
- Steve
- 5 Diamonds Member
- Posts: 1973
- Joined: Thu Aug 12, 2010 1:23 am
- First Name: Steve
- Aircraft Type: DA40
- Aircraft Registration: N432SC
- Airports: 1T7
- Has thanked: 85 times
- Been thanked: 504 times
Re: Let's get out there and wreck some planes
Rich:
You should forward your data to Bertorelli, perhaps as a letter to the editor of AC. He will either print it with a response, or ignore it. Either way, it will provide information about the accuracy of his analysis.
Steve
You should forward your data to Bertorelli, perhaps as a letter to the editor of AC. He will either print it with a response, or ignore it. Either way, it will provide information about the accuracy of his analysis.
Steve
- Rich
- 5 Diamonds Member
- Posts: 4608
- Joined: Mon Aug 30, 2010 12:40 pm
- First Name: Rich
- Aircraft Type: DA40
- Aircraft Registration: N40XE
- Airports: S39 Prineville OR
- Has thanked: 145 times
- Been thanked: 1187 times
Re: Let's get out there and wreck some planes
I've gone back and forth whether to bother. It's not that his article is biased and overall seems like good information. This one metric just seemed way off and I now am sure that it is. FWIW, in the past, he has often understated the already low numbers in the DA40 accident record.
I haven't tried to assess the equivalent numbers for several other types he had in his comparison. They may or may not be accurate. But doing this for Cessna 172s and such widely common types with vast numbers of years of data is way more than I'm ambitious enough to tackle.
2002 DA40-180: MT, PowerFlow, 530W/430W, KAP140, ext. baggage, 1090 ES out, 2646 MTOW, 40gal., Surefly, Flightstream 210, Orion 600 LED, XeVision, Aspen E5
- Keith M
- 4 Diamonds Member
- Posts: 363
- Joined: Sun Jun 19, 2011 9:54 am
- First Name: Keith
- Aircraft Type: DA40D
- Airports: EGNH
- Has thanked: 29 times
- Been thanked: 46 times
Re: Let's get out there and wreck some planes
Statistics about the relative safety of SR22s are all very well, but you do get a better choice of colors compared with our DA40s!
- Don
- 4 Diamonds Member
- Posts: 377
- Joined: Tue Jul 06, 2010 9:15 pm
- First Name: Don
- Aircraft Type: DA40
- Aircraft Registration: N623DS
- Airports: KTOA
- Has thanked: 123 times
- Been thanked: 162 times
Re: Let's get out there and wreck some planes
Here was the safety record from Aviation Consumer, back in 2012 when all North American DA40's were gas powered.
Total accidents on the left. Fatal accidents on the right.
I once herd someone refer to the DA40 as, "The Volvo of the Sky".
Total accidents on the left. Fatal accidents on the right.
I once herd someone refer to the DA40 as, "The Volvo of the Sky".
Diamond Star XLS, N623DS, SN40.1076
- Rich
- 5 Diamonds Member
- Posts: 4608
- Joined: Mon Aug 30, 2010 12:40 pm
- First Name: Rich
- Aircraft Type: DA40
- Aircraft Registration: N40XE
- Airports: S39 Prineville OR
- Has thanked: 145 times
- Been thanked: 1187 times
Re: Let's get out there and wreck some planes
Don, which issue was this in?
2002 DA40-180: MT, PowerFlow, 530W/430W, KAP140, ext. baggage, 1090 ES out, 2646 MTOW, 40gal., Surefly, Flightstream 210, Orion 600 LED, XeVision, Aspen E5
- Don
- 4 Diamonds Member
- Posts: 377
- Joined: Tue Jul 06, 2010 9:15 pm
- First Name: Don
- Aircraft Type: DA40
- Aircraft Registration: N623DS
- Airports: KTOA
- Has thanked: 123 times
- Been thanked: 162 times
- Rich
- 5 Diamonds Member
- Posts: 4608
- Joined: Mon Aug 30, 2010 12:40 pm
- First Name: Rich
- Aircraft Type: DA40
- Aircraft Registration: N40XE
- Airports: S39 Prineville OR
- Has thanked: 145 times
- Been thanked: 1187 times
Re: Let's get out there and wreck some planes
Thanks, Don.
I'm trying to deduce methodology in the past and present. Digging into the long-ago article clarified some things, but is still befuddling. A January Issue was probably composed sometime in late 2011, so data would have been incomplete for 2011 in that issue. There's an implication that NTSB data was the basis for accident counts. But here are a few weird things:
1. If you include all available NTSB data for the DA40 through 2011 and do not filter to US accidents alone, you do get about 30% a fatal accident percentage at that point in time.
2. But conversely, the SRxx data, while clearly much higher than the DA40, do not produce percentages as high as the 2012 graph shows.
3. Where they get DA42 fatalities I have little clue. There is not a single fatal DA42 accident to this day in the NTSB data, though there have been quite a few appearing elsewhere (such as ASN WIKI) dating back as early as 2006.
4. The article alludes to being informed by Diamond about a fire in a DA20 crash where the plane hit power lines, but the author states none could be found in the NTSB database. But it's there, big as life - 9/21/2005, in Texas.
I'm trying to deduce methodology in the past and present. Digging into the long-ago article clarified some things, but is still befuddling. A January Issue was probably composed sometime in late 2011, so data would have been incomplete for 2011 in that issue. There's an implication that NTSB data was the basis for accident counts. But here are a few weird things:
1. If you include all available NTSB data for the DA40 through 2011 and do not filter to US accidents alone, you do get about 30% a fatal accident percentage at that point in time.
2. But conversely, the SRxx data, while clearly much higher than the DA40, do not produce percentages as high as the 2012 graph shows.
3. Where they get DA42 fatalities I have little clue. There is not a single fatal DA42 accident to this day in the NTSB data, though there have been quite a few appearing elsewhere (such as ASN WIKI) dating back as early as 2006.
4. The article alludes to being informed by Diamond about a fire in a DA20 crash where the plane hit power lines, but the author states none could be found in the NTSB database. But it's there, big as life - 9/21/2005, in Texas.
2002 DA40-180: MT, PowerFlow, 530W/430W, KAP140, ext. baggage, 1090 ES out, 2646 MTOW, 40gal., Surefly, Flightstream 210, Orion 600 LED, XeVision, Aspen E5
- CFIDave
- 5 Diamonds Member
- Posts: 2682
- Joined: Wed Nov 07, 2012 3:40 pm
- First Name: Dave
- Aircraft Type: OTHER
- Aircraft Registration: N333GX
- Airports: KJYO Leesburg VA
- Has thanked: 234 times
- Been thanked: 1480 times
Re: Let's get out there and wreck some planes
Yes, no fatalities among Diamond twins in North America, although there have been some unusual fatalities of DA42s in Europe including aircraft being shot down and a suicide. In North America, the only accident (non-fatal) that I can recall is a pair of CFIs who stalled a DA42 too high over the runway at KLNS and collapsed the gear. My understanding is that plane is flying again.
Epic Aircraft E1000 GX
Former DA40XLS, DA42-VI, and DA62 owner
ATP, CFI, CFI-I, MEI
Former DA40XLS, DA42-VI, and DA62 owner
ATP, CFI, CFI-I, MEI