Loomio
Wed 21 Nov 2018 10:52PM

New feature: Score poll

GK Greg Kan Public Seen by 127

SCORE POLLING IS HERE!

We've been asked for it many times, and now we've happy to announce that Score Poll is available in Loomio.

Score Polling is a simple but expressive voting process which captures the level of preference voters have for each option in the poll.

In practice this means voters choose a "score" from 0 to 9 for each option in the poll.

The wikipedia page on Score voting details the properties of this voting system quite well, if you're interested.

As organisations move away from the traditional consensus vote, the score poll will complement the advice process when it comes to decision making. It can be used to survey the range of preferences without implying or determining an outcome.

Try out our live demo here

https://help.loomio.org/en/user_manual/getting_started/decision_tools/score_poll_form.png

GC

Greg Cassel Tue 4 Dec 2018 5:05PM

It's quite correct that you don't need to use numbers, and systems with finely-detailed 'sliders' are desirable. However, personal attitude can definitely be positive, negative or (practically) neutral on any specific concept. I think it's helpful to directly enable positive and negative reports on positive and negative feelings. In fact I also think it's highly desirable to enable ambivalent (both positive and negative) reports on specific concepts, although most persons and groups probably aren't going to want to analyze with that much level of detail.

C

Connor Tue 4 Dec 2018 6:56PM

No problem, Greg. It did take some time.
As I requested, I still hope you can find the time to read some of the material before responding. You reacted to the sources, and your skepticism thereof, but not the contents. I know this because you would not have made many of these comments otherwise, since the answers were provided:

rangevoting website, which presumably exists purely to promote range voting.

Nope - the purpose of the site is explicitly stated on their mission page, and they actually advocate other systems than range voting when appropriate. The main idea is to pick the best tool for the job in each case.

that website looks to me like lots of theory with thought experiment examples, but practically no use in real serious elections.

I'm not sure why it "looks like" that to you - it certainly has lots of theoretical examples (it's written by a mathematician after all), but that doesn't somehow mean there is a lack of practical examples. One need only look, to find plenty of real life examples! Actually, I'm not sure how you made it past the front page without knowing about one major example: the Olympics. That seems "real" and "serious" to me :)

If it's deeply sound theory

One way to find out - try to prove it wrong. You'll find plenty of provably valid criticisms against IRV, so be sure not to have double-standards.

which you want people to trust

No, this is exactly what you don't want to require. Any good, mathematically sound principle can be verified without requiring trust - just like the encryption schemes we use for security on the internet today. No need to trust the system - simply look at the theory (or the source code!) and you can see for yourself that it does what it says it does.

We don't use this encryption math in the wild so that we can prove it (in theory) - that would be circular logic. We use this math in the wild because it's proven theory.

then I'd like to see links to it in peer-reviewed professional journals-- probably mathematics journals

Again, just look - as far as mathematical papers, there are many, long, boring, papers, that I didn't link to, but exist nonetheless. math peers have written independently on the topic as well: here's Clay Shentrup confirming that Range voting "produces the highest voter satisfaction index".

or heck, on Quora, or at least edit the wikipedia page for Score Voting and see how well that holds up

Not sure what you mean. Did you read it? The wikipedia page is just fine. In fact, it highlights other advocacy groups besides rangevoting.org (since you want second opinions), and even has a paragraph that effectively answers your tactical voting objections from earlier:

"[The] validity of this problem is further called into question by a 2009 paper which found that "experimental results support the concept of bias toward unselfish outcomes in large elections."[34] The authors observed what they termed ethical considerations dominating voter behavior as pivot probability decreased. This would imply that larger elections, or those perceived as having a wider margin of victory, would result in fewer tactical voters."

Better yet, of course, get it used in small but serious elections, and build evidence of satisfied users.

Again, it's been used in serious elections already, so I'm not sure why this is a concern. (Side note: It's even preferred by evolution.) There is already plenty of evidence voters want it - especially voters who use IRV. This is nothing new.

I don't currently understand why you suggest to focus intensely on the strategic voting risk

Where is this coming from? Looking back on my post, I don't see any suggestions to focus intensely on anything...

in ranked voting

Huh? It was strategic voting in Range voting that I was responding to, not Ranked. I responded to it because you brought it up. It was the only tangible objection you provided, so it was the only one I could 'intensely focus' on.

without discussing how strategies influence range voting.

But that's precisely what we did! Okay I guess you misread something. Strategic Range voting was in fact the only strategic voting we did discuss. To recap:

  1. It's proven that all systems must allow some strategic voting
  2. Unlike other systems, the proven optimal strategy in range voting is dead simple (exaggerate your preferences), and never has you betraying your favorite
  3. Thus this is one of only systems where you can always be semi-honest, and never need to lie, like in IRV and Plurality
  4. Strategy has a relatively mild effect on Range Voting
  5. When strategic voting is at its worst in Range, the effect is, paradoxically, beneficial vs. lesser amounts.
  6. No matter how much tactical voting is employed, Range Voting produces less voter Regret (higher quality) than Plurality and IRV with no strategic voting. This can be seen visually in the bar chart!

That's a quick bullet list on that topic.

But hey I'm not here to argue against anyone trying ranged voting in any ways they desire! Loomio has it now (as Score Voting) and I hope you explore its performance in varied groups with varied goals.

Again, this isn't some new, unexplored, 'experimental' territory, these things are objectively true whether you try them out or not :)

If its effective use-cases exceed my expectations

Not sure where this keeps coming from - the effective use cases are "all of them", but if you don't believe so, it's not like you'll be able to "realize" that just by trying it...

Anyway, this conversation reminds me that my main problem with range voting-- and ratings systems in general-- is not the simple and deeply expressive method of rating subjects according to one or more finely graduated dimensions such as Approve/Disapprove. My problem is that ranged results-- and official decisions, when applicable-- are usually determined by (1) 'averaging' by arithmetic mean and (2) ranking the averages.

Yup, that's the right way to do it. What's the problem? you seem to have forgotten to include why you don't like this.

I'll try to make time to focus on alternatives to that procedure.

Woah there. You never stated the actual problem, so why work on solutions? I've never heard of this objection before, I'm looking forward to seeing the substance of it's argument :)

GC

Greg Cassel Tue 4 Dec 2018 7:23PM

I don't have nearly enough time to reply properly now, @adroit , but I will respond to a couple of bits.

I did indeed use a significant amount of my valuable time to read various parts of the source website. You publicly declared that I hadn't read it because you think I don't understand some things there. I think that's a pretty aggressive way to argue with a stranger who's trying to find common ground, but yes: I did skim over much of the content. I did however read many sentences on the website which gave me the decided opinion that it exists to promote range voting. Perhaps I shouldn't have stated that it exists purely to promote range voting; however, that's quite different than claiming that it exists to promote only range voting for all situations! But, whatever; I'm not here to argue.

one major example: the Olympics. That seems "real" and "serious" to me :)

Yes, the Olympics is very real and serious in its way. However, it's range voting done by professionally accountable judges who hold their scores up in front of the whole world. That's not nearly equivalent or transferable IMO to anonymous voting for public officials, or even for many community use-cases of Loomio Score Polling. Deeply different use-cases require different usage, and accumulating results.

You've spent a lot of time negatively criticizing parts of my comments above. I hope you don't miss the IMO key point that I'm actually encouraging you to use Score Polling and to build convincing evidence of its effectiveness in varied situations. I may reply to more of your critical commentary later if I find time, when I'm not building practical things or recovering from work.

C

Connor Tue 4 Dec 2018 7:48PM

I don't have nearly enough time to reply properly now, @adroit , but I will respond to a couple of bits.
No rush! It can always wait.

I did indeed use a significant amount of my valuable time to read various parts of the source website.

Okay. I'm sorry if I implied that you didn't read any of it, that's not what I meant.

but yes: I did skim over [..] the content.

That's what I meant.

You publicly declared that I hadn't read it because you think I don't understand some things there. I think that's a pretty aggressive way to argue with a stranger

Not quite - not understanding what you read is fine - but on the surface that looks very different from not reading it. Certain questions would not be asked, etc. I don't think there's anything aggressive about asking you to look through it - that's why I phrased it as a request instead of an accusation. I'm sorry it didn't come across to you as politely as I intended.

I did however read many sentences on the website which gave me the decided opinion that it exists to promote range voting.

Well, that is correct. It's run by the "Center for Range Voting", after all. That said, no need to figure out a site's purpose on your own when it has a mission statement :)

Perhaps I shouldn't have stated that it exists purely to promote range voting; however, that's quite different than claiming that it exists to promote only range voting

How? What else could "purely" mean in that context? There isn't a clear difference.

That's not nearly equivalent or transferable IMO to anonymous voting for public officials, or even for many community use-cases of Loomio Score Polling.

Nor does it mean it is not transferable to other scenarios, either. Let's not imply the converse. The statement was simply to show an example of a real and serious usage of Range, not to prove it's universally applicable.

You've spent a lot of time negatively criticizing parts of my comments above.

I'd stick with just "criticizing", since it's not clear what "positively criticizing" would mean in this case. However, I criticize ideas, not people, and I don't think there's anything wrong with that :)

I hope you don't miss the IMO key point that I'm actually encouraging you to use Score Polling and to build convincing evidence of its effectiveness in varied situations.

I definitely didn't miss that, but the scope is too small, and I think that's your point. It's not about me or my choice to use it, it's about waht's objectively better. You're implying that there isn't sufficient evidence already, and trying to pose it as a compromise. I think the topic deserves better than that, that's all.

RG

Robert Guthrie Tue 4 Dec 2018 10:14PM

Right, good call. Maybe we need an X or something next to the slider to remove the value entirely. Any UI suggestions?

To your second paragraph, how does that differ from ranked choice poll?

GC

Greg Cassel Thu 13 Dec 2018 7:24PM

FWIW this is what I found pretty aggressive @adroit , and mostly inaccurate: "You reacted to the sources, and your skepticism thereof, but not the contents." But hey that's fine; I appreciate you redirecting this discussion in a positive and substantial way.

Perhaps I shouldn't have stated that it exists purely to promote range voting; however, that's quite different than claiming that it exists to promote only range voting
How? What else could "purely" mean in that context? There isn't a clear difference.

You seem to have misunderstood my grammatically correct, but eccentric and vague, meaning. Here's another try: "This site exists only to promote range voting" is deeply different than "This site exists to promote range voting as the universally correct voting process." (And, I did not make or imply that second statement.)

Hope that makes sense now. (It's very tangential to me anyway.)

Let's not imply the converse.

No, I wouldn't waste my time arguing that the value of Olympic style voting is automatically and entirely inapplicable to anonymous voting etcetera. Burden of proof (or more accurately, persuasion) is IMO on the persons who promote specific activities in specific social contexts. This relates to me constructively suggesting that we build evidence of range voting successes, instead of debating theories.

You seem to believe there is already plenty of evidence that range voting is 'objectively better' in many or most contexts. Everyone is certainly welcome to believe you, and to practice range voting with you for any & all reasons.

JC

Jaimie Cosmia Thu 14 May 2020 12:22AM

Doesn’t the STAR implementation take what works so well about score voting and add automatic runoff to discourage dishonest voting? I’d love to see it as an option on Loomio.(https://en.m.wikipedia.org/wiki/STAR_voting)

Regardless, I agree with @Connor that the evidence is pretty clear that score voting is the superior method even when voters are tactical.

On a personal/anecdotal note, when I found out about Loomio recently, what really sent me running toward it was seeing that the platform supports score voting (er, polling).

JC

Jaimie Cosmia Thu 14 May 2020 12:31AM

I’m not as convinced as @Connor that ranked-choice shouldn’t even be an option available on the platform, but what I find much, much more problematic is that groups cannot set their own default decision-making method. Why is approval voting the immutable default? Why are the others mere “polls”? I understand that a group could informally agree on any of the polls as their decision-making standard, but I think there’s a lack of psychological weight/seriousness to not setting the default in the group’s code that could lead to a lack of clarity on what counts as a legitimate and final decision.

Furthermore, consider that as the platform expands, decisions might need to interact with smart contracts or some other form of machine code, in which it will be absolutely vital for a default method to be determined so that it can be acted on by the code.

JC

Jaimie Cosmia Thu 14 May 2020 12:43AM

And ime “no opinion” should be the default selection on every option until changed. This helps to ensure that voters aren’t overwhelmed by a long list of options/candidates if they are unfamiliar with many of them. They can simply skip to those they do have an opinion about and ignore the rest. Though, of course, we can hope that with sufficient time voters will research as many of the options as they are able, this isn’t always possible or desirable.

JC

Jaimie Cosmia Thu 14 May 2020 12:46AM

UI suggestion: a button that is selected by default. Having a button helps to prevent the misperception that this is mathematically calculated as “less than zero”, and having it selected by default allows voters to quickly skip through to options they do have an opinion about, without being overwhelmed by those they don’t. As soon as the user moves a slider the “no opinion” button is toggled off. In case of accident, it can be pressed again.

Load More