Monday, April 22, 2019

Alberta 2019 Election Post-mortem

Well that was fun!

How did I do?

For more than a year now I've been tracking Alberta election polls with the hope of developing a reasonably accurate prediction model. Overall, I'm happy to report that the party I predicted in the lead won in 80 out of 87 races, and my riding qualifiers broke out as follow:

  • "Solid" lead: 65/65 (100%)
  • "Likely" lead: 12/15 (80%)
  • "Lean" lead: 2/5 (40%)
  • "Toss-up" edge: 1/2 (50%)
I think this is a decent proof of concept, small "lean" sample size notwithstanding, and I want to talk a bit about what went right and what went wrong, and how I can improve if I want to keep doing this sort of thing.

First of all, the polls leading up to election day didn't turn out to be too accurate. Take a look at the province and regional splits:







Edmonton was remarkably accurate, Calgary was close, but the rest of the province and the top line results were off significantly. This is possibly a cause for concern, as it could suggest that my model was taking inaccurate data as inputs but then claiming credit for an accurate output, which it wasn't designed to do.

The NDP ended up under-performing relative to their polling numbers, and likely the only reason this didn't mess up too many election prediction models is because they under performed mostly in areas like rural Alberta, where they were predicted to lose anyway. If the polls had been that wrong about the NDP in Edmonton, say, the predictions could have been far worse.

Similarly, my model and others like me likely wouldn't have fared too well if the NDP had overperformed their polling rather than underperformed. The same amount of polling error as actually occurred, applied the other direction, could have had the NDP win the popular vote across the province.

My takeaway from this is that I need to adjust my topline polling tracker. Right now it runs under the implicit assumption that errors in individual polls will cancel each other out. This seemed reasonable given that polls are produced by different companies with different methods. That led to my full Alberta tracker having a low confidence interval for the NDP in particular, though, as several polls in a row provided the same result. If I instead make the assumption that at least part of the polling error is correlated between polls, perhaps due to something beyond their control, then the final result from election night would have still been a surprise, but far less of one. Certainly something I'll take into account next time.

Other Metrics


Overall on a riding-by-riding level, I had an error of 6.4% vote share. That's not superb, but also not far from what my testing beforehand suggested, and was factored into my uncertainty. Comparing my final projection to actual results on election night doesn't look too bad:


If we ignore the Alberta Party and the Liberals, this leads to an overall R-squared value of 0.79, which I consider respectable. It's handy to ignore the low parties because they don't have much of a spread, and will skew the coefficient of determination calculation.

Very fortunately for me, if I input the final actual regional results as though they were a poll result, my model does improve. This is a good hint that my model is behaving decently, especially so since this hasn't been the case with all other forecasters.


With the correct Calgary, Edmonton, and Rural results input as large polls, my model improved to 83/87 seats correctly predicted and an R-squared for party support per seat of 0.91. Very encouraging - too bad the polls weren't more correct!

Finally, I also provided an expected odds of winning each seat for each party. It's one thing to count a prediction as a success if you give it 100% odds of winning and it comes true, but how does one properly score oneself in the case of Calgary-Mountain View, where I gave the Liberals (10.8%), UCP (16.2%) and NDP (73%) different odds of winning, and only one (NDP) did?

In this case I've scored each riding using a Brier score. A score of 0 means a perfect prediction (100% to the winner and 0% predicted for all losers), a score of 1.0 means a perfectly wrong prediction (100% to one of the losers), and because of the math, a score of 0.19 for a complete four-way coin toss (I only predicted the four parties represented in the debate).

Overall, I scored a 0.027, which is considerably better than just guessing. It's hard to get an intuitive sense of what that score really means, but it's mathematically the same as assigning an 83.5% chance of something happening and having it come true. Not a bad prediction, but there's room to be sharpened.

How did I stack up?

So like I said, there were a lot of us predicting the election this time around. I've tried to find as many as I can, and I apologize profoundly if I've missed anyone. I've only included forecasts that had either a vote breakdown per seat or anticipated odds of winning each seat for comparison purposes.

I've reported on three main measures (seat accuracy, R-squared per seat, and prediction Brier score), and I'll present as many of those for each forecaster as I was able to determine. Different forecasters win at different categories, so it's not necessarily a clear picture as to which one of us is the "best", so I'll mostly leave room here for interpretation:



I'm not claiming to be the second best, but it's important to note that being best in one measure doesn't necessarily mean best overall. There are also harder-to-evaluate measures in play here - for instance VisualizedPolitics and TooClosetoCall allow you to input poll values to see reactions for yourself, and both improved when given more accurate data (VisualizedPolitics also got to 83 seats accurately predicted, though still with a low R-squared value).

338Canada probably rightly can claim to have been the strongest this time around, but I given the polling errors we were faced with I think it'll take several more elections to determine if anyone is really getting a significant edge consistently. This isn't the first time we've compared ourselves to each other, and I think it's an important exercise in evaluating our own models and whether there's a need for more.

18 comments:

Boante Ray said...

I just want to say a big thanks to ( CHIEF DR LUCKY ) for what he has done for me and my family by helping me to win lottery. I won Five Hundred and Thirty Three Million Us Dollars. (($533,000,000.00)). His lottery spell is the best and so amazing. My life is now balance and i am Now Very Rich As i have always wanted and i am out of doubt. Are you looking for a real and genuine spell caster to help you win big in any kind of lottery you play? you can contact Chief Dr Lucky , today all your plan to ever win Big in Lottery will Come True and work out well for you. His spell very real and genuine i can not still believe it And His spell also work very fast. Thank you so much chief Dr Lucky for dedicating your time to cast the Lottery spell for me. I got my bills paid and my debt cleared and am still mega rich. If you need a real And Genuine spell aster to help you Win lottery, kindly contact him for fast and urgent Help via email : chiefdrlucky@gmail.com or Whatsapp or Call Via +2348132777335
Website : http://chiefdrluckysolutionhome.website2.me/

Sharon Wayne said...

I want to thank Dr Emu a very powerful spell caster who help me to bring my husband back to me, few month ago i have a serious problem with my husband, to the extend that he left the house, and he started dating another woman and he stayed with the woman, i tried all i can to bring him back, but all my effort was useless until the day my friend came to my house and i told her every thing that had happened between me and my husband, then she told me of a powerful spell caster who help her when she was in the same problem I then contact Dr Emu and told him every thing and he told me not to worry my self again that my husband will come back to me after he has cast a spell on him, i thought it was a joke, after he had finish casting the spell, he told me that he had just finish casting the spell, to my greatest surprise within 48 hours, my husband really came back begging me to forgive him, if you need his help you can contact him with via email: Emutemple@gmail.com or add him up on his whatsapp +2347012841542 is willing to help any body that need his help.
Website: http://emutemple.website2.me/

Dominick said...

Well, your blog is the best one and it is very informative there is no doubt about that. But if you want to use any time tracking software then I must say group calendar is the best one for that. But you don't need to think about the price because this software is free for use and that's why we should thankful to the orapex.

Sharon Wayne said...

I want to thank Dr Emu a very powerful spell caster who help me to bring my husband back to me, few month ago i have a serious problem with my husband, to the extend that he left the house, and he started dating another woman and he stayed with the woman, i tried all i can to bring him back, but all my effort was useless until the day my friend came to my house and i told her every thing that had happened between me and my husband, then she told me of a powerful spell caster who help her when she was in the same problem I then contact Dr Emu and told him every thing and he told me not to worry my self again that my husband will come back to me after he has cast a spell on him, i thought it was a joke, after he had finish casting the spell, he told me that he had just finish casting the spell, to my greatest surprise within 48 hours, my husband really came back begging me to forgive him, if you need his help you can contact him with via email: Emutemple@gmail.com or add him up on his whatsapp +2347012841542 is willing to help any body that need his help.

Barbra Robert said...

Thanks dr jumba you promised and you did it god almighty will continue to bless you as you help people reunite their broken relationship and broken marriages .  I never thought I will smile again, My husband left me with two kids for one year, All effort to bring him back failed I thought I'm not going to see him again not until I met a lady called rose who told me about a spell caster called DR jumba, She gave me his email address and mobile number and I contacted him and he assured me that within 48hours my husband will come back to me, In less than 48hours my husband came back started begging for forgiveness saying it is the devils work, so I'm still surprise till now about this miracle,i couldn't conceive but as soon as the spell was cast,i became pregnant and gave birth to my third child,if you need any assistance from him you can contact him via: email:  wiccalovespelltools@gmail.com  or Call/WhatsApp him:  +19085174108  BLOG : blog : https://wiccaspelltools.blogspot.com/  
WEBSITE:  drjumbaspellhome.wordpress.com 

best canadian online casinos said...

Thank you for the article!

liora russell brandy said...

I completely trusted Dr Jumba from the time I spoke with him during the period my husband Left me after 1year and 3months of our marriage, Dr Jumba helped me Cast the spell work on my Relationship and gave me so much assurance and guaranteed me that he was going to bring my husband back to Me in just 15hours of the spell casting. I was so confident in his work because I have read A Lot of Testimonies online & Also for the Fact he Helped a Friend of mine Some weeks Back to get her Man Back. My faith was so strong About everything and just as Dr Jumba said to me in the beginning, my husband came back to me Asking for my Forgiveness And Also wants us to have A Happy Home together, YES MY HUSBAND IS BACK with all his hearts, Love, care, emotions and flowers and things are better now. Thankyou So much Papa, you cleared my Doubts about magic or Spells and You Also Brought Life and Happiness to me .. I would have no hesitation to recommend this powerful spell caster to anybody who is in need of help.. You can contact him through his email address: wiccalovespelltools@gmail.com OR Call ️  / WhatsApp him on: +19085174108  blog : https://wiccaspelltools.blogspot.com/  WEBSITE:  drjumbaspellhome.wordpress.com

kate said...

What could i have done if not for Priest ALUYA who restore my marriage and bring peace to my home, i will forever be grateful to you Priest ALUYA, My husband left for anther woman, he left me with our three children, i was confused and heart broken i almost lost one of my son in the processes i discus with a friend of mine and she told me about Priest ALUYA, and how he helped her in the past, so i contact him for help, and he promised me that after two day that my husband is going to call me and Apologize me for forgiveness i really didn’t believe, he told me what to do and i did every thing he asked me to do, after two day my phone rang and to my greatest surprise it was my husband he started begging me to forgive him for every thing he made me pass through, so i forgave him and now we are living happily again i say all thanks to Priest ALUYA, here is his contacts if you are passing through any marital stress i will advice you to contact him for solution, and i promise you all your problem will be solved.
(draluyasolutions@gmail.com or whatsapp...https://wa.me/message/WZDQDI75V3ZZP1

nelson said...

Do You Need A Powerful Africa Native Doctor? I Mean A Spiritual Herbalist
With Great Spirit Connected To Ancestors. Call or WhatsApp +2349058774809 Dr Obodubu Monday Is A High Voodoo Priest Master. He is a Spell Caster, Native
Doctor, Spiritual Herbalist, Powerful Sickle cell Healer, Spiritual
Astrologer, Psychic Reader, Multi Guru, Witch Doctor, Priest Of Africa
Money Ritual.
Have You Been To Native Doctor to Native Doctor Without Any Solution To
Your Problems Or Rather Add To it? Have You Been To Place To Place In View
Of A Powerful Native Doctor That Can Solve All Your Predicament, You Must
Understand That There Is A Native Doctor That Supersede All Native Doctor
Among All Native Doctor, If You Are In Search Of A Powerful Native Doctor
With Great Spiritual Powers, Then You Must Be In Search Of A Native Doctor
That Derives Power From The Marine World. That Is The Spirituality Of The
Greatest Africa Native Doctor Obodubu.
Dr Obodubu Is Recognized All Over The World Of Marine Kingdom, As One
Of The Top Fortunate And Most Powerful Native Doctor Of Charms Casts From
The Beginning Of His Ancestors ship Until Now Dr who lives Strong
Among All Other Native Doctors, There Have Never Been Any Form Of
Impossibility Beyond The Control Of Dr Obodubu. It Doesn't Matter The
Distance Of The Person With The Problems Or Situation, All You Have To Do
Is Believe
In The Native Obodubu charms Casts That Works, He Always
Warns Never To Get His Charms Casts If You Do Not Believe Or Unable To
Follow His Instruction.
It Is The Assignment Of The Native Doctor Obodubu To Offer
Services To Those In Need Of Spiritual Assistance Not Minding The Gravity
Of Your Situations Or Distance As Long As Water, Sea, Ocean, Lake, River
Sand etc. Are Near You, Then Your Problems Of Life Would Be Controlled
Under Your Foot.
If You Need Any Spiritual Help On Any of These:
Get Your Lover Back
Fruit Of The Womb
Fibroid
Business Boom
Financial Breakthrough
Get Rich Without Ritual WhatsApp +2349058774809
Do As I Say
Bad Dream
Promise And Fail
Epilepsy
Spiritual Attack
Land/Court Case
Mental Disorder
Political Appointment
Visa Approval
Cancer
Examination Success
Spend And Get Back
Good Luck
Natural Health
Hypertension
Diabesity (Diabetic+Obesity
Stroke
Sickle Cell
Impotency
Win Court Case
Promotion At Work
Commanding Tone
Protection Ring
Marriage Success
Love Ring
Favour Ring
Recover Lost Glory
Spiritual Power For Men Of God
Travel Success Ring
Job Success
Lotto/Pool Win And Many More.
Make Haste To Call or WhatsApp Dr Obodubu Monday +2349058774809. Or Mail Him to
babadoctorobodubuspiritualhome@gmail.com For Spiritual Problem Today And
You Will Surely
Get Solution To All Your Predicament.
Email: babadoctorobodubuspiritualhome@gmail.com

Isabella Lucas said...

My ex-husband and I had always managed to stay friendly after our divorce in February 2017. But I always wanted to get back together with him, All it took was a visit to this spell casters website last December, because my dream was to start a new year with my husband, and live happily with him.. This spell caster requested a specific love spell for me and my husband, and I accepted it. And this powerful spell caster began to work his magic. And 48 hours after this spell caster worked for me, my husband called me back for us to be together again, and he was remorseful for all his wrong deeds. My spell is working because guess what: My “husband” is back and we are making preparations on how to go to court and withdraw our divorce papers ASAP. This is nothing short of a miracle. Thank you Dr Emu for your powerful spells. Words are not enough. here is his Email: emutemple@gmail.com or call/text him on his WhatsApp +2347012841542

He is also able to cast spell like 1: Lottery 2: Conceive 3: Breakup 4: Divorce 5: Cure for all kinds of diseases and viruses.

Unknown said...

MOST POWERFUL AND HONEST POWERFUL LOVE SPELL CASTER DR JUMBA +1(908) 517 4108 . WEBSITE :  https://drjumbaspellhome.wordpress.com    
I am here to share the wonderful work Dr. Jumba did for me. After 7 years in marriage with my husband with 2 kids, my husband started acting weird and going out with other ladies and showed me cold love, on several occasions he threatens to divorce me if I dare question him about his affair with other ladies, I was totally devastated and confused until a old friend of mine told me about a spell caster on the internet called Dr. Jumba who help people with relationship and marriage problem by the powers of love spells, at first I doubted if such thing ever exists but decided to give it a try, when I contact him, he helped me cast a love spell and within 48hours my husband came back to me and started apologizing, now he has stopped going out with other ladies and his with me for good and for real. Contact this great love spell caster for your relationship or marriage problem to be solved today via email: wiccalovespelltools@gmail.com or text him on WhatsApp messenger:  +19085174108

Cameron Ayala said...



I want the author of this site to authorize this post and make it available on this page.____________________________

I was cured from herpes virus 2 weeks ago with his effective herbal Medicine, to contact him, start by writing his name ((Robinson.buckler herbal)) on google..........

WhatsApp ( +1 253 336 1750 )


#Do you have problem in your marriage/relationship life?

((He has solution to all health issues))…

((He can solve any kind of problem below)).

#Do you have Cancer?

#Do you want to get pregnant?

#Do you have shingles/herpes 1&2?

#Do you have erectile issue?

#Do you have Prostate cancer?

#Do you have diabetes?

#Do you have Fibroid?

liora russell brandy said...

I am so happy today and appreciate the genuine work done by the love spell caster and give me the right direction so today I got my wish fulfilled under the guidance of a love caster Dr Jumba .  Love is an important part of our relationship. I can understand this when my boyfriend has cheated on me and engaged with other girl’s affairs. At that time I was Broken and realized the importance of love in my life or relationship. My boyfriend did not give me importance and he always embarrasses me in front of his friends. Then I searched on the Internet and I found a spell caster who i trusted and he cheated me “one day a friend of mine told me about a real spell caster who helped her with a love spell  so I got the contact number of Dr Jumba spell caster ” then I dropped a message on WhatsApp and explained all my problems to him . So he  showed me previous work done by himself and guided me on how the work will be done. Then I start work and get my boyfriend back within 24 hours as Dr Jumba promised me  in a positive way. I want to use this time to show appreciation. That's why I am so happy and thankful to Dr Jumba. he can also help you below are his contact information email : wiccalovespelltools@yahoo.com  text or call him +19085174108    . 
website :https://drjumbaspellhome.wordpress.com

Jason Bennett said...

Omg I Finally Got Helped !! I'm so excited right now, I just have to share my testimony on this Forum.. The feeling of being loved takes away so much burden from our shoulders. I had all this but I made a big mistake when I cheated on my wife with another woman and my wife left me for over 4 months after she found out.. I was lonely, sad and devastated. Luckily I was directed to a very powerful spell caster Dr Emu who helped me cast a spell of reconciliation on our Relationship and he brought back my wife and now she loves me far more than ever.. I'm so happy with life now. Thank you so much Dr Emu, kindly Contact Dr Emu Today and get any kind of help you want.. Via Email emutemple@gmail.com or Call/WhatsApp cell number +2347012841542 Website (https://emutemple.wordpress.com/)

Isiyku Abdulahi said...


Isiyku Abdulahi
My ex-boyfriend dumped me one week ago after I accused him of seeing someone else and insulting him. I want him back in my life but he refuse to have any contact with me. I was so confuse and don’t know what to do, so I reach to the Internet for help and I saw a testimony of how a spell caster help them to get their ex back so I contact the spell caster and explain my problem to him and he cast a spell for me and assure me of 2 days that my ex will return to me and to my greatest surprise the third day my ex came knocking on my door and beg for forgiveness. I am so happy that my love is back again and not only that, we are about to get married. Once again thank you Dr Believe. You are truly talented and gifted.He is the only answer. He can be of great help and I will not stop talking about him because he is a wonderful man. Contact this great love spell caster for your relationship or marriage problem to be solved today via email: believelovespelltemple@gmail.com or WhatsApp: +19713839183


SIMON PATCHIN said...

How To Get Your Ex Lover/Partner/Boyfriend/Girlfriend/Wife Or Husband Back

It breaks my heart to know that people are hurting so badly that they are desperate to get their love lives back. For anyone hurting right now, I want you to worry no more for your Ex lover/partner will come back to you so you can feel whole again and I truly mean that. When my wife left me, Lord Zakuza was the man I contacted that helped me to get my wife back with his powerful spell within 48 hours and I can never forget the day I meant Lord Zakuza for he's spells perform GREAT MIRACLES. Get in touch with Lord Zakuza now for he's like a God on earth that can get your EX lover back within 48 hours with his powerful spell. You can go get in touch with him through the below details.


WhatsApp/call/text: +1 740 573 9483
Website via: lordzakuzaspells.com
Email via: Lordzakuza7 @ gmail. com

Anonymous said...

DR EMU WHO HELP PEOPLE IN ANY TYPE OF LOTTERY NUMBERS

It is a very hard situation when playing the lottery and never won, or keep winning low fund not up to 100 bucks, i have been a victim of such a tough life, the biggest fund i have ever won was 100 bucks, and i have been playing lottery for almost 12 years now, things suddenly change the moment i came across a secret online, a testimony of a spell caster called DR EMU, who help people in any type of lottery numbers, i was not easily convinced, but i decided to give try, now i am a proud lottery winner with the help of DR EMU, i won $1,000.0000.00 and i am making this known to every one out there who have been trying all day to win the lottery, believe me this is the only way to win the lottery.

Contact him via email Emutemple@gmail.com
What's app +2347012841542
Https://emutemple.wordpress.com/

Emily Sarah said...

Genuine online love spell cater to get your ex back contact Dr.Unity


I'm a Canada woman who wants her husband back home, he treated me badly and now I miss him and want him back after separation. I wanted him back so badly because of the love I had for him, I begged him with everything, I made promises but he refused. I explained my problem to my friend and she suggested that I should rather contact a spell caster that could help me cast a spell to bring him back , I had no choice than to try it. I messaged the spell caster called dr unity, and he assured me there was no problem and that everything will be okay before 11 hours. He cast the spell and surprisingly 11 hours later my husband called me. I was so surprised, I answered the call and all he said was that he was so sorry for everything that had happened He wanted me to return to him. He also said he loved me so much. I was so happy and went to him that was how we started living together happily again.thanks to dr unity . if you are here and your Lover is turning you down, or your husband moved to another woman, do not cry anymore, contact Dr.Unity for help now..
Here his contact..WhatsApp him: +2348055361568 ,
Email him at: Unityspelltemple@gmail.com
,Watch this YouTube channel to know how grateful I am https://youtube.com/shorts/rBPtBktMmtA?feature=share