Posts

Showing posts from 2006

Scoring Changes Implementation Follow Up

It's been ten days since the implementation of the new voting system, so I thought I would keep everybody up-to-date with how things are shaping up. First thing to report is that voting is up. The number of basic votes cast per day added to the number of TPA votes cast per day is about 30% higher than the previous week's number of basic votes cast. So it seems that many people were not using the old system and were encouraged by the new one. So for those who were afraid that the new voting system will lead to people moving away from voting, rest assured, it didn't happen. Second, the voting form wording change is affecting scores mildly. The median of votes cast after the change is lower. It currently stands at 8.00 compared to 8.82 prior to the change. Of course, the Q Score is compensating for this difference and the Q Scores are more consistent. The number of TPA votes is about 30% of the basic votes number. So, it's quite high. I didn't expect it to be this high

Scoring System Changes Implemented

Well, it's done. Today, I implemented the display changes to show the new system in action. You can read the previous entries in this blog to see how these changes came about. First change is the voting forms. The old form has been redesigned with the new look and the wording has changed. It's very close to the temporary change that I implemented at the beginning of December, but with one major difference. The 10 is no labeled like before; the current version says 'Most Amazing Story', which makes it more attainable. Another change is the reversal of the order of the grades. It used to be that the 10 was the first item under the mouse, now it's the furthest one. This is a subtle change, but one I implemented to encourage readers to think before they cast their vote. The second change is the availability of the Expanded voting form. I designed the system to switch easily between the two forms and be able to set the default from within the form itself. This functional

Expanded Voting Form: Wording and Value distibution

I'm working on implementing the new optional expanded voting form referenced in my previous blog entry Final Decisions . I need some feedback about the wording of the voting form. The form will have three separate criteria for the reader to select values for and I want it to be clear enough about the meaning of each. So for each criteria, I need a short, concise sentence that goes under each option, to explain what the reader is selecting. It has to be as clear as possible as to not leave the reader confused about what they're selecting and short enough to be simple. So far I've come up with: Quality: 0 1 2 3 4 5 6 7 8 9 10 Spelling and Grammar Plot: 0 1 2 3 4 5 6 7 8 9 10 Thoroughness of the storyline Appeal: 0 1 2 3 4 5 6 7 8 9 10 Appeal to your personal taste. Also, I can't display all the numbers, so I must combine the three criterias into a single value to display. So far, the relative score is going to be in its own column and the expanded score would be in anoth

Weekly Download Counter Change

I've made an important change to the site today. Tonight will be the last night that weekly counters are all reset to zero. From now on the system will keep track of the last seven days individually for each story. So, the weekly counters will now reflect a story's downloads in the last seven days regardless of which day you view the listings. Previously, the site kept track of weekly downloads starting from the weekly reset time of Sunday night. So, if you view the download listings on Tuesday, you get the tally of two days' worth of downloads. With the new system, viewing the top downloads list on Tuesday will give you the cumulative downloads since last Wednesday. The current system had the effect that any story posted around midnight on Sunday, had the biggest chance of staying on top of the download list of the rest of the week. Some authors took advantage of this by posting their updates and new stories on Sunday after 9pm EST; which of course is completely understand

Final Decisions

I want to thank everybody that commented and contributed to the discussions in the three previous blog entries, and who made suggestions. It has been educational. I've made up my mind on how to proceed next with regards to the voting system. While I don't like to lose any authors or readers, the current state of the scoring system is pitiful, and if left as it currently is, then it will only get worse over time, which, to me, is unacceptable. The suggestions by many were interesting to say the least, but a lot of it, while could be useful and helpful, is not feasible to implement. Everybody has to remember that the site is a busy one and I don't have unlimited resources. The site serves millions of pages per day and any change in the page, in the processing, in the data stored can have a huge effect on the site's performance and its ability to cope. For example, keeping scores indefinitely, in order to allow for dropping a certain percentage of votes, or comparing previ

Derailed

Well, it has been an interesting experience to say the least. If you haven't read my two most recent entries about changes to the scoring system on the site, you should read them. The gist of this blog entry is to tell you that ALL changes to the scoring system have been canceled and reverted. A recap of what happened. For the last couple of years, story scores on the site have been edging up higher and higher due to various psychological reasons. The median for all scores of last year is about 8.87. Which means that half of the stories are scoring more than 8.87 and the other half below 8.87. The results of this median is that story scores are in general, extremely high. Over the last year, I kept hearing from many authors how ridiculous the scores are becoming, and from readers how they can't trust the system to guide them to the better stories. The phrase 'I don't read anything that is not scoring over 9.25' came up very frequently. So, because of these things, I

Scoring Changes Follow Up

I canceled the planned changes. Too many authors asked for the removal of their stories from the site. Sorry for all the trouble. This is a follow up to my previous blog entry about the changes to the scoring system. If you haven't read that one, please check it to see what this whole thing is about. This follow up is to address as many of the comments that have been received so far as possible. A simple clarification: the voting system itself is not really changing. It still works the same way. It's the results representation that's changing to allow for a clearer distinction between tiny variations in the scores. I'm just shifting the median for all scores from whatever it is now, to an artificial one of 6. For example, the current top scoring serials on the site contains eight stories with a score of 9.77. The new representation would simply magnify smaller variations within the .77 bit. As for suggestions offered, there were plenty, and that's good. Few things

Scoring System Changes

Since implementing the scoring system on the site in 1999, it has been the only controversial part of the whole site. Many users found it useful, some didn't trust it and some ignored it. To authors it's even more troublesome. Many authors expect the score to tell them how they did in their writing, they wanted it to reflect the effort that they put into the story regardless of the story's content and its subject's appeal to the readers. Those concerns and expectations are not something that I can really address. Authors need to simply realize that the score simply reflects how much a reader liked the story and whether they recommend that others read it too. It's like a thumbs up signal. However, there is a problem with the scoring system that I can address: Score compression. Score compression is when votes, like they are now on the site, tend to be mostly on one end of the scale. Last check revealed that the median for all scores on the site is 8.62! A median of 8

Recent Site Changes

I made few changes to the site in the past few days. I thought I'd talk about them a bit. The first two changes are in the way the voting mechanism and the feedback mechanism work at the end of stories. I've added some JavaScripts to make the forms submit to the site and return feedback without having to reload the whole page. The reason for the change is to make a better user interface. Previously (and currently if you don't have JavaScript active in your browser or doesn't have a supported browser), when a reader clicked the vote button in the voting form or send button in the mail form, the whole page would change, so to do both, one usually had to hit the back button once. With the change, the form simply goes away and the text changes to reflect the result. Overall, it works very well. Most people have recent browsers and most people have JavaScript active. The transition for the voting form was almost trouble free, but the one for the mail form was quite bumpy. Th

New Submission Wizard Features

Today, Saturday, August 19th, 2006, marks the deployment of a new version of the site's submission wizard. It's not a complete re-write but a significant one nonetheless. New features: Shortcuts: Designed for authors with multiple similar postings. For example if you need to post several chapters of a novel, separately, instead of clicking the wizard, then selecting a pen name (if applicable), then selecting 'New Chapter', then selecting the story - for each chapter, you can save the pen name, submission type, story, progress status, opt out of new categories, opt out of story's end-note, opt out of moderator notes. Also works for new stories, but of course with appropriate options (for example you can't opt out of categories because they're required). Basically, the version saves a lot of clicking. Delayed Posting: For authors that like to post something to appear later on the site. Other changes include some JavaScript enhancements to reduce the clicking r

Email Feedback System: A minor, but important change

This summary is not available. Please click here to view the post.

Library Usage Examples and Tips

Lately, I've been getting many requests for certain features for the library system, even though those features already exist in the Library, like update dates and a way to track serial stories. So in order to address those requests, I've created a page that shows a sample uses of the Library system on the site. I linked the new page from the various help pages on the site. The page can be found here . The new page shows how to use the library for tracking active serials, to remember stories for reading later and for managing bookmarks on the site, on other sites and on your own computer. Of course, other creative uses suggestions for the library are most welcome. A small request The last section of the new page details how to use the library to bookmark stories on other web sites and on your own computer. In that section I give a JavaScript snippet to use as a bookmarklet for adding stories from other sites and from your computer to the library easily. I created the code, but