» Fri May 13, 2011 10:36 am
It would be nice to have a context for this discussion. For instance, perhaps you are exploring how things might be done differently over at Great House Fliggerty as opposed to merely a theoretical discussion of the topic.
However, since you solicited opinions about the 'ideal' mod rating system, I would scrap all of the numbers, and uninformed comments in favor of a single mod review created by a panel of (extensive) users of that mod - yes, a dream, I know. Such a review would clarify the mod's content and how well it achieves its goals, both in terms of quality of the work as well as the technical aspects (is it 'clean'; does it create conflicts with other mods). Of course any known issues (unresolved bugs and compatibility issues) should also be stated. This could be a sort of 'book club' for mods, where small groups of players agree to discuss and record their impressions. A brief summary (strongly recommended, recommended, etc.) including any 'conditions' should be included for those disinclined to read.
I do not think it is necessary or appropriate to make public a report about a (seriously) flawed mod if the author of the mod is still active in the community. Rather the group's findings should be shared and the modder given the opportunity to improve his or her work - vaguely reminiscent of the mod showcase over at Tamriel Rebuilt. This not only provides the constructive feedback most modders value, but it spares feelings and benefits the community as a whole by promoting revision leading to better quality mods.
If the creator of a mod is unreachable (or does not respond to the well-intentioned comments of the review panel) then the review should be posted. However any review should be as objective as possible and highlight the mod's strengths as well as its weaknesses.
There are a number of ways this might be managed, but it might need one person at the top to organize. A sub-forum (say at GHF) could post a thread of mods for review, and when a handful of players agree to write the review they would play and discuss the mod privately. Perhaps one member would draft the review and allow for the others to amend it as necessary. When there is reasonable agreement between the reviewers the report will be made public. If no consensus can be formed than the review panel disbands without 'publishing'. I can imagine modders requesting a review of their work by submitting mods. I would also include the requirement to contact active modders that a review of their work is being considered and allow them the option of declining the review after the process has been explained to them.