Jump to content

Anti-Harassment Tools/SecurePoll Improvements/Test Results

From mediawiki.org

Test Election Results

[edit]

Randomly generated elections

[edit]
Election Comments Latest version tested
20_6_5100_1090197746 SecurePoll and OpenSTV agree on elected candidates commit f06e679
20_4_5120_824772467 Discrepancies due to how many candidates we eliminate at once commit 5986646
20_6_5000_536228607 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5001_819859726 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_2_5200_1308507669 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_4_5120_1609394555 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
20_6_5000_1301235635 Infinite recursion commit dcbad8c
20_6_5001_1851698519 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
20_6_5000_2048723651 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_1048374110 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_751478367 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_39399868 SecurePoll and OpenSTV agree on elected candidates (might be a good candidate for performance testing) commit 58bf4c8
20_6_5000_698142105 SecurePoll and OpenSTV agree on elected candidates commit b7a4ccb
20_6_5000_899201474 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_6_5000_1329880128 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
7_6_566_1185838663 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
5_3_2065 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
5_3_2679 Results (almost) agree between SecurePoll and OpenSTV commit dcbad8c
7_5_1000 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit dcbad8c
20_9_5200_704404317 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
20_4_5000_8910242957 Discrepancies between SecurePoll and OpenSTV, probably due to how we eliminate candidates commit dcbad8c
20_6_5100_319413701 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
20_6_5000_2048397232 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
5_3_100 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit dcbad8c
20_4_5000_1685033555 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 624ef32
20_6_5100_106188776 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
20_6_5100_1116366364 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
20_9_5200_2038025507 Potential example election to show our method for dealing with ties commit 58bf4c8
20_9_5000_1730013084 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing. commit 624ef32
20_9_5000_439818328 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties. Use-case for precision testing. commit 624ef32
20_9_5000_1236153056 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit c285563
20_9_5000_1355531191 SecurePoll and OpenSTV agree on elected candidates commit c285563
12_9_4828_204236991 SecurePoll and OpenSTV agree on elected candidates commit f06e679
20_9_5200_814099392 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit f06e679
20_9_5200_462089016 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit f06e679
12_9_4928_1803187550 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_9_5000_2083479695 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_9_5000_1420679070 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_9_5000_1886935514 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 3007c40
20_7_5000_292763510 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_7_5000_425367464 Infinite recursion commit 624ef32
20_9_496_604810680 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
20_9_496_604810680_reorder_reverse SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
12_9_5000_1830523430 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision. commit 624ef32
20_9_488_1934769146 SecurePoll and OpenSTV agree on elected candidates. Use-case for precision. commit 624ef32
12_9_5000_179685718 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties and precision. Use-case for precision. commit 624ef32
20_9_5000_468090402 SecurePoll and OpenSTV agree on elected candidates commit 624ef32
4_2_104_388762016 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_104_643122133 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_104_839775172 SecurePoll and OpenSTV agree on elected candidates commit 58bf4c8
4_2_2_394987273 Discrepancies between SecurePoll and OpenSTV, due to how we deal with ties commit 58bf4c8

Real elections

[edit]
Election Comments Latest version tested
stackoverflow-com-2011-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2011-election-results_2 SecurePoll and OpenSTV agree on elected candidates commit 3007c40
stackoverflow-com-2012-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2013-election-results Some discrepancies between our results and what SO report commit f06e679
stackoverflow-com-2014-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2015-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2015-election-results_2 SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2016-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
stackoverflow-com-2017-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
stackoverflow-com-2018-election-results Discrepancies between SecurePoll and OpaVote due to candidates being removed commit f06e679
stackoverflow-com-2019-election-results SecurePoll and OpaVote agree on elected candidates commit 3007c40
stackoverflow-com-2020-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
datascience-stackexchange-com-2019-election-results SecurePoll and OpaVote agree on elected candidates commit 3007c40
math-stackexchange-com-2010-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2011-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2012-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2013-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2014-election-results SecurePoll and OpenSTV agree on elected candidates commit f06e679
math-stackexchange-com-2017-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2018-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
math-stackexchange-com-2020-election-results SecurePoll and OpaVote agree on elected candidates commit f06e679
irish_2002_general_election_dublin_west SecurePoll, OpenSTV and real-life results agree on elected candidates commit 3007c40

High-volume testing

[edit]
Election Description Comments Latest version tested
100_uniform_elections 100 elections where each candidate is equally popular Discrepencies between SecurePoll and OpenSTV in 12 out of 100 of the elections commit 624ef32
100_binomial_elections 100 elections where candidate popularity was based on binomial distribution No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_normal_elections 100 elections where candidate popularity was based on normal distribution No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_so2011_2_elections 100 elections where candidate popularity was the same as SO 2011 (2nd) elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_so2020_elections 100 elections where candidate popularity was the same as SO 2020 elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8
100_m_so2010_elections 100 elections where candidate popularity was the same as the Math SO 2010 elections No discrepancies in elected candidates between SecurePoll and OpenSTV in 100 elections commit 58bf4c8

Analyses

[edit]
Name Description Comments
Precision Analysis of the precision of SecurePoll calculations So far, no evidence of large precision errors

Creating a new test result? Please use the Template.

All subpages

[edit]
Retrieved from "https://www.mediawiki.org/w/index.php?title=Anti-Harassment_Tools/SecurePoll_Improvements/Test_Results&oldid=5008684"