Should the Joomla Extensions user rating system be changed?
Moderators: tydust, LorenzoG, timothy.stiffler
Should the Joomla Extensions user rating system be changed?
OK, not wanting to sound pretentious or anything, but I honestly think that the current user rating system in no way reflects the quality of the extension....
There are extensions that are extremely complex, but extremely well written that have bad scores, because some users clearly can't configure the thing as it says in the manual and goes editing files left/right/center.
There are others labelled as beta which have 4 stars and on a totally fresh install is nothing but an alpha, because it's a poorly rewritten extension to support legacy Joomla upgrades, but not new installs.
There are some which are excellent extensions, but that don't even figure in the extensions directory.
As I see it, there is no real feedback discussion in the ratings - just a one-way client comment. Shouldn't the comments at least be a digest of user/developer feedback???
Your thoughts?
There are extensions that are extremely complex, but extremely well written that have bad scores, because some users clearly can't configure the thing as it says in the manual and goes editing files left/right/center.
There are others labelled as beta which have 4 stars and on a totally fresh install is nothing but an alpha, because it's a poorly rewritten extension to support legacy Joomla upgrades, but not new installs.
There are some which are excellent extensions, but that don't even figure in the extensions directory.
As I see it, there is no real feedback discussion in the ratings - just a one-way client comment. Shouldn't the comments at least be a digest of user/developer feedback???
Your thoughts?
- pe7er
- Joomla! Enthusiast
- Posts: 162
- Joined: Thu Aug 18, 2005 8:55 pm
- Location: Nijmegen, The Netherlands
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
I agree.
My opinion (posted at some other thread):
It's a pity that the review system at http://extensions.joomla.org/ is not linked to the user profiles at http://forum.joomla.org/
If it was, it would have given an indication about the users background (it's profile and postings at the forum), and would give an overall indication about the expertise of the user and of its comment.
Someone elses opinion in a thread called "Relevance of reviews": http://forum.joomla.org/index.php/topic,80095.0.html
My opinion (posted at some other thread):
It's a pity that the review system at http://extensions.joomla.org/ is not linked to the user profiles at http://forum.joomla.org/
If it was, it would have given an indication about the users background (it's profile and postings at the forum), and would give an overall indication about the expertise of the user and of its comment.
Someone elses opinion in a thread called "Relevance of reviews": http://forum.joomla.org/index.php/topic,80095.0.html
Kind Regards,
Peter Martin (aka pe7er)
db8.nl - Joomla! implementation, programming, template and component development [Dutch]
>> Questions? Get help more easily with JTS-post Assistant: viewtopic.php?f=428&t=272481
Peter Martin (aka pe7er)
db8.nl - Joomla! implementation, programming, template and component development [Dutch]
>> Questions? Get help more easily with JTS-post Assistant: viewtopic.php?f=428&t=272481
Re: Should the Joomla Extensions user rating system be changed?
i'm undecided about the value of keeping these comments at all. i've recently been evaluating several extensions and the first one I tried for each task was based on reviews. sadly in each case they were the worst of the extensions for that task. each had glaring errors.
this lead me to conclude that the reviews were either NOT for the currently available release or that the reviews were not genuine.
for now I will not be reading any of the reviews and will instead try each option alphabeticaly until I find the ideal one for the task. [at least that way its my fault if I chose the wrong one]
this lead me to conclude that the reviews were either NOT for the currently available release or that the reviews were not genuine.
for now I will not be reading any of the reviews and will instead try each option alphabeticaly until I find the ideal one for the task. [at least that way its my fault if I chose the wrong one]
- MMMedia
- Joomla! Enthusiast
- Posts: 233
- Joined: Sun Aug 21, 2005 2:25 pm
- Location: Somewhere Near Here
Re: Should the Joomla Extensions user rating system be changed?
I have mixed feelings on this. I think it is hard, because you may not know on which version the review was based. The enviroment can change rather rapidly, (or not change at all in the case of an extension that doesn't evolve to include necessary changes that make it work with an upgrade).
I am not sure how it could be addressed.
I am not sure how it could be addressed.
Be kinder than necessary, for everyone you meet is fighting some kind of battle.
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
Perhaps the review submission form could be reworked so that you MUST include the version number that you're writing the review for (and any other pertinant info).
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
Re: Should the Joomla Extensions user rating system be changed?
unixboymd wrote:Perhaps the review submission form could be reworked so that you MUST include the version number that you're writing the review for (and any other pertinant info).
I would say that this would be a great and useful idea. And when reading the reviews, maybe a pull-down menu: "Read reviews related to this version". May not work though, as there are not a tonne of reviews.
Certainly, the star rating should either reflect the current version or be a moving average of the all-time score, whichever is higher I guess. Then when you click on the extension to read more, it displays both: this version rating and all versions rating.
-
- Joomla! Enthusiast
- Posts: 112
- Joined: Thu Aug 18, 2005 12:37 am
- Location: Melbourne, Australia
Re: Should the Joomla Extensions user rating system be changed?
It should really move into the framework of a social networking app instead of just 'user-submitted' reviews.
That way you can stop people gaming the system..
That way you can stop people gaming the system..
Re: Should the Joomla Extensions user rating system be changed?
Whether or not this is anyone's fault, arguments about the review system mean that a number of major extensions are missing from the site.
Whatever the cause, that can't be good for Joomla and a solution would be great.
Whatever the cause, that can't be good for Joomla and a solution would be great.
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
What do you mean by "a number of major extensions are missing"?
ekaln wrote:Whether or not this is anyone's fault, arguments about the review system mean that a number of major extensions are missing from the site.
Whatever the cause, that can't be good for Joomla and a solution would be great.
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
Re: Should the Joomla Extensions user rating system be changed?
I'll PM you with a list.
The point of the post was just to say that way the reviews are done now can cause unhelpful trouble/arguments and it might be better to change the procedures.
The point of the post was just to say that way the reviews are done now can cause unhelpful trouble/arguments and it might be better to change the procedures.
- MMMedia
- Joomla! Enthusiast
- Posts: 233
- Joined: Sun Aug 21, 2005 2:25 pm
- Location: Somewhere Near Here
Re: Should the Joomla Extensions user rating system be changed?
It isn't up the the Extension Site Team to add extensions to the extension site. It is up to the developers to submit their extension to the site. That may be one of the reason why you think some major extensions are missing. Contact the developers of the extension to find out if they have submitted their extension for inclusion.
Also, be aware that any extension that is deemed to be a security risk or is no longer being actively developed or maintained by the developer, will not be listed on the extension site.
What do you mean by unhelpful trouble/arguments?
Also, be aware that any extension that is deemed to be a security risk or is no longer being actively developed or maintained by the developer, will not be listed on the extension site.
What do you mean by unhelpful trouble/arguments?
Be kinder than necessary, for everyone you meet is fighting some kind of battle.
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
Re: Should the Joomla Extensions user rating system be changed?
Pm sent.
Some developers have been annoyed at the handling of extension reviews in the past, lets that not bring those issues up again, but try and find a better way to handle reviews.
What I meant was...What do you mean by unhelpful trouble/arguments?
Some developers have been annoyed at the handling of extension reviews in the past, lets that not bring those issues up again, but try and find a better way to handle reviews.
- MMMedia
- Joomla! Enthusiast
- Posts: 233
- Joined: Sun Aug 21, 2005 2:25 pm
- Location: Somewhere Near Here
Re: Should the Joomla Extensions user rating system be changed?
I don't think anyone likes getting negative reviews. There actually isn't a way around that.
Be kinder than necessary, for everyone you meet is fighting some kind of battle.
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
http://www.oddsheepout.com http://www.jennifermarriott.com
JOOMLA ROCKS
Women JOOMLA! Too
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
I can agree with that... somewhat. No one likes getting a negative review. But there is a big difference between an objective constructive critisism and an outright bashing. Not to mention the many many reviews that I've seen that are asking for support (in the reviews area).
But you can't force people to leave a "good" negative review instead of bashing.
But you can't force people to leave a "good" negative review instead of bashing.
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
I think the reviews area is good, but there is always room for improvment. Perhaps modifying the way the approval process is done along with better / more clear instructions on what is / isn't an acceptable review and an improved review form.
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
- brad
- Joomla! Hero
- Posts: 2212
- Joined: Fri Aug 12, 2005 12:38 am
- Skype: tested
- Location: Sydney - Australia
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
Can I assure you all, the JED editors are working on and addressing this issue...
Now, lets move this to the Extensions Forum
Now, lets move this to the Extensions Forum
Brad Baker - Joomla! Core Team, Sites & Infrastructure.
http://www.rochen.com - Managed Dedicated, Reseller & Multiple Domain Hosting.
http://www.joomlatutorials.com <-- Joomla! 1.5 & 1.0.x
^New Joomla 1.5 Tutorials are out!
http://www.rochen.com - Managed Dedicated, Reseller & Multiple Domain Hosting.
http://www.joomlatutorials.com <-- Joomla! 1.5 & 1.0.x
^New Joomla 1.5 Tutorials are out!
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
Can you assure us Brad? Sure you can I'm all up for some assurance. j/k (yes I'm slowly going crazy today... anyone wanna come with me?)
brad wrote:Can I assure you all, the JED editors are working on and addressing this issue...
Now, lets move this to the Extensions Forum
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
- brad
- Joomla! Hero
- Posts: 2212
- Joined: Fri Aug 12, 2005 12:38 am
- Skype: tested
- Location: Sydney - Australia
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
1.5 Beta is so close, I'm going crazy as well... now, back to the the topic at hand.
Brad Baker - Joomla! Core Team, Sites & Infrastructure.
http://www.rochen.com - Managed Dedicated, Reseller & Multiple Domain Hosting.
http://www.joomlatutorials.com <-- Joomla! 1.5 & 1.0.x
^New Joomla 1.5 Tutorials are out!
http://www.rochen.com - Managed Dedicated, Reseller & Multiple Domain Hosting.
http://www.joomlatutorials.com <-- Joomla! 1.5 & 1.0.x
^New Joomla 1.5 Tutorials are out!
-
- Joomla! Enthusiast
- Posts: 112
- Joined: Thu Aug 18, 2005 12:37 am
- Location: Melbourne, Australia
Re: Should the Joomla Extensions user rating system be changed?
MMMedia wrote:I don't think anyone likes getting negative reviews. There actually isn't a way around that.
There is.
You make it into a social networking app where the forum id is displayed for the person who does the review (which likewise will gives it weighting). That way, people will think twice about how they do negative reviews (the risk is that the system can be gamed in the other direction - however this can be resolved by removing any potential status / weighting from the 'official' teams and moderators)
Cameron Adams did a similar thing with wd06 where the social networking app there allowed other people to tag you, and the best way to manage tags (or any other form of UGC) is to maintain a paper trail as to where it comes from.
http://www.themaninblue.com/writing/per ... 006/09/22/
By taking the power away from the JED admins and placing the responsibility at all times with the end user through social networking/karma, it provides a feedback loop in and on itself.
Last edited by absalom on Thu Oct 12, 2006 12:41 am, edited 1 time in total.
-
- Joomla! Enthusiast
- Posts: 113
- Joined: Thu Aug 18, 2005 5:53 pm
- Location: Washington D.C. & Baltimore, MD Metro
- Contact:
Re: Should the Joomla Extensions user rating system be changed?
Ok I just had an idea about this (after reading another thread in this category)...
Would it be possible to link a users forum "star rating" to any review that they leave? I for one would beleive a review from a person if they had a high star rating as opposed to someone who had a low or no star rating.
Would it be possible to link a users forum "star rating" to any review that they leave? I for one would beleive a review from a person if they had a high star rating as opposed to someone who had a low or no star rating.
Patience is something you admire in the driver behind you, but not in one ahead. -- Bill Mcglashen
Re: Should the Joomla Extensions user rating system be changed?
unixboymd wrote:Ok I just had an idea about this (after reading another thread in this category)...
Would it be possible to link a users forum "star rating" to any review that they leave? I for one would beleive a review from a person if they had a high star rating as opposed to someone who had a low or no star rating.
Well, that wouldn't entice 'lil 'ole me to bother leaving a review
I think the problem comes with negative reviews. A forum post count doesn't necessarily mean you can write a good review - just means you can write... alot!
Weighting negative comments is a bad idea as well, since that could wipe out a lot of valid positive reviews, and would be open to abuse. I like the tagging idea. Or even flagging.
-
- Joomla! Enthusiast
- Posts: 112
- Joined: Thu Aug 18, 2005 12:37 am
- Location: Melbourne, Australia
Re: Should the Joomla Extensions user rating system be changed?
- Accountability inside the community
- Validity outside the community
- Credibility inside the community - those who have the most posts here may not be the most valuable
- It then moves away from an arbitary figure judgement - star, post number, role (which usually forms most dating / social networking scripts / social moderation behaviour) to a representative mean. It does stop "positive" or "negative" gaming of the system by moderators in this respect to inflate or deflate credibility of a project listed
sprocket wrote:unixboymd wrote:Ok I just had an idea about this (after reading another thread in this category)...
Would it be possible to link a users forum "star rating" to any review that they leave? I for one would beleive a review from a person if they had a high star rating as opposed to someone who had a low or no star rating.
Well, that wouldn't entice 'lil 'ole me to bother leaving a review
I think the problem comes with negative reviews. A forum post count doesn't necessarily mean you can write a good review - just means you can write... alot!
Weighting negative comments is a bad idea as well, since that could wipe out a lot of valid positive reviews, and would be open to abuse. I like the tagging idea. Or even flagging.
Tagcloud it and deploy it based on XFN relationships to your forum profile, then link that forum profile to other instances of you across the Web (if you post anywhere else, does that provide a better measurement to whether or not you've written a good post ? maybe)
This then takes care of:
Last edited by absalom on Thu Oct 12, 2006 5:59 am, edited 1 time in total.