Posts

Showing posts from December, 2006

Scoring Changes Implementation Follow Up

It's been ten days since the implementation of the new voting system, so I thought I would keep everybody up-to-date with how things are shaping up. First thing to report is that voting is up. The number of basic votes cast per day added to the number of TPA votes cast per day is about 30% higher than the previous week's number of basic votes cast. So it seems that many people were not using the old system and were encouraged by the new one. So for those who were afraid that the new voting system will lead to people moving away from voting, rest assured, it didn't happen. Second, the voting form wording change is affecting scores mildly. The median of votes cast after the change is lower. It currently stands at 8.00 compared to 8.82 prior to the change. Of course, the Q Score is compensating for this difference and the Q Scores are more consistent. The number of TPA votes is about 30% of the basic votes number. So, it's quite high. I didn't expect it to be this high

Scoring System Changes Implemented

Well, it's done. Today, I implemented the display changes to show the new system in action. You can read the previous entries in this blog to see how these changes came about. First change is the voting forms. The old form has been redesigned with the new look and the wording has changed. It's very close to the temporary change that I implemented at the beginning of December, but with one major difference. The 10 is no labeled like before; the current version says 'Most Amazing Story', which makes it more attainable. Another change is the reversal of the order of the grades. It used to be that the 10 was the first item under the mouse, now it's the furthest one. This is a subtle change, but one I implemented to encourage readers to think before they cast their vote. The second change is the availability of the Expanded voting form. I designed the system to switch easily between the two forms and be able to set the default from within the form itself. This functional

Expanded Voting Form: Wording and Value distibution

I'm working on implementing the new optional expanded voting form referenced in my previous blog entry Final Decisions . I need some feedback about the wording of the voting form. The form will have three separate criteria for the reader to select values for and I want it to be clear enough about the meaning of each. So for each criteria, I need a short, concise sentence that goes under each option, to explain what the reader is selecting. It has to be as clear as possible as to not leave the reader confused about what they're selecting and short enough to be simple. So far I've come up with: Quality: 0 1 2 3 4 5 6 7 8 9 10 Spelling and Grammar Plot: 0 1 2 3 4 5 6 7 8 9 10 Thoroughness of the storyline Appeal: 0 1 2 3 4 5 6 7 8 9 10 Appeal to your personal taste. Also, I can't display all the numbers, so I must combine the three criterias into a single value to display. So far, the relative score is going to be in its own column and the expanded score would be in anoth

Weekly Download Counter Change

I've made an important change to the site today. Tonight will be the last night that weekly counters are all reset to zero. From now on the system will keep track of the last seven days individually for each story. So, the weekly counters will now reflect a story's downloads in the last seven days regardless of which day you view the listings. Previously, the site kept track of weekly downloads starting from the weekly reset time of Sunday night. So, if you view the download listings on Tuesday, you get the tally of two days' worth of downloads. With the new system, viewing the top downloads list on Tuesday will give you the cumulative downloads since last Wednesday. The current system had the effect that any story posted around midnight on Sunday, had the biggest chance of staying on top of the download list of the rest of the week. Some authors took advantage of this by posting their updates and new stories on Sunday after 9pm EST; which of course is completely understand

Final Decisions

I want to thank everybody that commented and contributed to the discussions in the three previous blog entries, and who made suggestions. It has been educational. I've made up my mind on how to proceed next with regards to the voting system. While I don't like to lose any authors or readers, the current state of the scoring system is pitiful, and if left as it currently is, then it will only get worse over time, which, to me, is unacceptable. The suggestions by many were interesting to say the least, but a lot of it, while could be useful and helpful, is not feasible to implement. Everybody has to remember that the site is a busy one and I don't have unlimited resources. The site serves millions of pages per day and any change in the page, in the processing, in the data stored can have a huge effect on the site's performance and its ability to cope. For example, keeping scores indefinitely, in order to allow for dropping a certain percentage of votes, or comparing previ

Derailed

Well, it has been an interesting experience to say the least. If you haven't read my two most recent entries about changes to the scoring system on the site, you should read them. The gist of this blog entry is to tell you that ALL changes to the scoring system have been canceled and reverted. A recap of what happened. For the last couple of years, story scores on the site have been edging up higher and higher due to various psychological reasons. The median for all scores of last year is about 8.87. Which means that half of the stories are scoring more than 8.87 and the other half below 8.87. The results of this median is that story scores are in general, extremely high. Over the last year, I kept hearing from many authors how ridiculous the scores are becoming, and from readers how they can't trust the system to guide them to the better stories. The phrase 'I don't read anything that is not scoring over 9.25' came up very frequently. So, because of these things, I

Scoring Changes Follow Up

I canceled the planned changes. Too many authors asked for the removal of their stories from the site. Sorry for all the trouble. This is a follow up to my previous blog entry about the changes to the scoring system. If you haven't read that one, please check it to see what this whole thing is about. This follow up is to address as many of the comments that have been received so far as possible. A simple clarification: the voting system itself is not really changing. It still works the same way. It's the results representation that's changing to allow for a clearer distinction between tiny variations in the scores. I'm just shifting the median for all scores from whatever it is now, to an artificial one of 6. For example, the current top scoring serials on the site contains eight stories with a score of 9.77. The new representation would simply magnify smaller variations within the .77 bit. As for suggestions offered, there were plenty, and that's good. Few things

Scoring System Changes

Since implementing the scoring system on the site in 1999, it has been the only controversial part of the whole site. Many users found it useful, some didn't trust it and some ignored it. To authors it's even more troublesome. Many authors expect the score to tell them how they did in their writing, they wanted it to reflect the effort that they put into the story regardless of the story's content and its subject's appeal to the readers. Those concerns and expectations are not something that I can really address. Authors need to simply realize that the score simply reflects how much a reader liked the story and whether they recommend that others read it too. It's like a thumbs up signal. However, there is a problem with the scoring system that I can address: Score compression. Score compression is when votes, like they are now on the site, tend to be mostly on one end of the scale. Last check revealed that the median for all scores on the site is 8.62! A median of 8