Tiers

Wondering how Criticker works, or have a question that doesn't seem to fit under requests or bugs?
paulofilmo
Posts: 2587
Your TCI: na
Joined: Mon Apr 07, 2008 3:40 pm

Tiers

Post by paulofilmo »

How are the Tiers dispersed?

If it were up to me, and according to my current ratings, I'd have:

Tier 10: 97-83 ---Experience/empathy/wisdom/profundity
Tier 9: 82 -77 ---Varying degrees of greatness
Tier 8: 76-74 ---Engaging+Interesting/emotive
Tier 7: 73-72 ---Thoughtful/entertaining/moving
Tier 6: 71-67 ---As one above, but with significant shortcomings
Tier 5: 66-61 ---A bit of fun/mild interest
Tier 4: 60-57 ---Not really worth the time
Tier 3: 56-41 ---A regretful watch
Tier 2: 40-26 ---Bearable when in a very tolerant mood
Tier 1: 25-0 ---Remove from society

But at the moment, my tiers currently stand thusly:
Tier 10: 97-77
Tier 9: 76-75
Tier 8: 74-72
Tier 7: 71-69
Tier 6: 68-67
Tier 5: 66-65
Tier 4: 64-61
Tier 3: 60-57
Tier 2: 56-41
Tier 1: 40-0

Is there a way to engineer them? I'd like to have a go moving them about, but I'm worried it wont work out and I'll lose my scores. I'm sure I'd get more accurate TCIs if the intervals were better associated with how I feel about the films (so long as everyone elses' is also accurate, which seems unlikely).

td888
Posts: 863
Your TCI: na
Joined: Thu Jul 12, 2007 10:44 am

Re: Tiers

Post by td888 »

You're preference to Tiers is exactly the same as for me. But I got this as Tiers:
T10: 100-80
T9: 79-78
T8: 78-77
T7: 76
T6: 75
T5: 74-73
T4: 72-71
T3: 70
T2: 69-65
T1: 64-0
Before some of my Tiers were completely missing (because I ranked a lot of movies the same score, 75). With the new functionality (your PSI's), I managed to differentiate between T8 en T4, and as a result I got much better TCI's. Before my closest TCI's were around 2. Now I got a least 10 with a TCI between 1.6 en 1.7. Now I got some better recommendations too. I did have to sacrifice some of my extreme scores (eg. I ranked some movies really bad or good opposite of the 'general' opninion. This caused havoc on my closest TCI's).

paulofilmo
Posts: 2587
Your TCI: na
Joined: Mon Apr 07, 2008 3:40 pm

Re: Tiers

Post by paulofilmo »

Crikey, three of your tiers have their own scores?! It seems strange how they're assigned (generally). Presumably it's to do with percentages, but I don't think the number of movies you watch should reflect the tiers, on a basic level. Primarily because there might be unintended variation between different users, even if they felt the same way about a film. And consequently, this will create differences and effect the TCIs.

I'm really not sure how it works, though, and would be interested to find out in the hope that my presumptions are wrong.

td888
Posts: 863
Your TCI: na
Joined: Thu Jul 12, 2007 10:44 am

Re: Tiers

Post by td888 »

Well, I'm glad I've got my Tiers back. Before I was missing some Tiers, it jumped from T5 to T2, T3 en 4 didnt' exist.... Anyway, there was some discussion about the Tier-calculation earlier, no need to repeat it again. Just hope that at some point in the future the folks behind Criticker''ll have a new look at this again. I'm still supporting a bell-curve-system... ;)

KGB
Posts: 746
Your TCI: na
Joined: Thu Jun 15, 2006 12:44 am

Re: Tiers

Post by KGB »

In my rankings, I wish it would look like this:

Tier 10: 100-89 - As good as it gets. These give you experience you can barely find at life itself, they intrigue, they move, they stay with you.
Tier 9: 88-84 - Excellent films, very well done, and achieve what they are trying to do.
Tier 8: 83-79 - Great films, pretty much tier 9 but in a little lower scale.
Tier 7: 78-72 - Very good films; sometimes it is refugee for tier 6 films that were more enjoyable than other, and tier 8 films that had one significant problem, but not necessarily.
Tier 6: 71-65 - Good films; most of the are not too memorable, but are enjoyable and pass the time.
Tier 5: 64-54 - Watchable; most probably films that were enjoyable but have one big problem (or a few) that makes me unable to consider them good enough.
Tier 4: 53-46 - Not as mediocre as tier 3 films, but still, films that aren't bad but are still pretty dull.
Tier 3: 45-39 Tedious. Not necessarily bad, but awfully mediocre.
Tier 2: 39-26 - Simply put, bad films.
Tier 1: 25-0 - Dreadful, abysmal, just plain awful.

Prince Sandy
Posts: 26
Your TCI: na
Joined: Sat Apr 26, 2008 5:36 pm

Re: Tiers

Post by Prince Sandy »

I don't know why people keep whining about the tiers. Do you think you are the only people who think the tiers should be specially adjusted for them? if you rate enough films, and not only your favourite, it balances out, and enables comparison between everybody, which is the whole point. You have to have a standardized system to allow comparison, the site would be redundant otherwise. Think about it a little. The colour system is there to allow you to categorize your rankings in a personal way.

paulofilmo
Posts: 2587
Your TCI: na
Joined: Mon Apr 07, 2008 3:40 pm

Re: Tiers

Post by paulofilmo »

Cheers, td888. I'll have a look at some earlier threads.
---
KGB, it's great to look at your rankings with relative meaning.
---

Another thing was quite esoteric film's PSIs being calculated by relatively different users (+higher TCIs). This means that the 'Average Tier' may have been calculated with the scores of relatively disparate TCIs. Perhaps TCIs could have another indirect influence on score, similar to how the 'Average Tier is then translated into a score, based on your rankings'.

Prince Sandy wrote:I don't know why people keep whining about the tiers. Do you think you are the only people who think the tiers should be specially adjusted for them? if you rate enough films, and not only your favourite, it balances out, and enables comparison between everybody, which is the whole point. You have to have a standardized system to allow comparison, the site would be redundant otherwise. Think about it a little. The colour system is there to allow you to categorize your rankings in a personal way.

I just want to learn about how the site works. And relieve my boredom by talking to people. And differentiate my tiers with descriptions (which I would have never otherwise had done).

I sincerely think it's a genuine concern when the tiers seem incorrect. I'd like to understand why they have a penchant for balance over rating.

KGB
Posts: 746
Your TCI: na
Joined: Thu Jun 15, 2006 12:44 am

Re: Tiers

Post by KGB »

Prince Sandy wrote:I don't know why people keep whining about the tiers. Do you think you are the only people who think the tiers should be specially adjusted for them? if you rate enough films, and not only your favourite, it balances out, and enables comparison between everybody, which is the whole point. You have to have a standardized system to allow comparison, the site would be redundant otherwise. Think about it a little. The colour system is there to allow you to categorize your rankings in a personal way.


Boy, you are noisy.

mpowell
Posts: 4194
Your TCI: na
Joined: Fri Sep 09, 2005 10:22 am

Re: Tiers

Post by mpowell »

Hi all -- this is excerpted from a longer email I wrote awhile ago, explaining our rationale behind an evenly-distributed 10-tier system for Criticker's recommendations. Hope it helps shed light on why we do what we do ;)

--------------------------------------------
Our equations depend on 10 evenly-distributed tiers. This is something we researched in depth as we were developing our algorithm, and the reasoning is this: Given the chance to freely choose from a 5-star scale, the huge majority of rankings end up being 3.5 or 4. On a 100-point scale, the huge majority of rankings end up over 75. This is why most recommendation engines end up providing terrible recommendations -- there's simply not enough breadth of variety in rankings. Criticker was designed to aggressively combat this.

At Criticker, if a film shows up in your bottom 20% of rankings, it is one of your Tier 2 movies -- we don't ever plan on changing that. You can change the color and quip, but not the fact of its position in the bottom 20% (unless you change your rating).

I think a lot of confusion arises from our decision to call them tiers, instead of percentiles... Perhaps that's something we'll change one day.
--------------------------------------------

I don't expect that to satisfy everyone, but I think it's a pretty decent explanation for our tier system.

KGB
Posts: 746
Your TCI: na
Joined: Thu Jun 15, 2006 12:44 am

Re: Tiers

Post by KGB »

I understood when you first explained it to me, and I'm not complaining or anything; just giving my point of view on my own tier.
And there's absolutely no need in changing 'tiers' to 'percentile'. I mean, it sounds so... Awful.

Post Reply