New story reviewing system
Well, the new reviewing system is mostly finished.
I revamped the review display page completely and made it accessible to everybody. The old reviewing system has been integrated with the site. No more need for a separate log in page and different ID. Reviewing is easier than ever for those with reviewer accounts.
A new reviewers section has been added to the site and it's only
accessible for those with reviewer accounts.
The funny part about this change is that it came with no real planning. I know I had discussed a new reviewing system on this blog a long time ago, but it seemed that I could never really plan it and implement it properly within a reasonable amount of time. So I kept putting it off for later.
The way this started was with me thinking that the old reviews listing page is not particularly useful to either authors or reviewers if only premier members could access it. So I decided to give access to everybody and started by revamping the interface. Before this change, the reviews page was just a list by reviewer. It was static and listed all the reviews without any particular sorting, so new reviews could not be easily found by interested readers.
Bit by bit, the changes came and before I knew it, I had finished
reintegrating the old reviewing system, which had separate login and separate everything, into the site's current structure.
The old plans for a review system accessible automatically by everybody have been changed into a review system with set number of slots for reviewers.
I'll start with 10 new reviewers. If you're interested in becoming one of the reviewers contact me and let me know.
All reviews for now will be moderated by me. There are few rules to stick to. Basically, reviews have to be positive. Not necessarily glowing with praise. They have to be at least positive in that they aim to either guide the other members of the site to good stories, or at least help the author with constructive criticism. So it must help. If it doesn't help anybody, and is aimed to put down the author or drive them away from writing, then the review will be rejected. If it warns the reader to avoid the story without giving a valid reason why, then it will be rejected.
If I reject more than half of your reviews, your reviewer privileges will be revoked and the opening will be available for another that wants it and want to do good with it.
The system supports more than one review per story, so even if a story has already been reviewed and you have a differing opinion or more things that needs to be said about the story, you can still review it.
Be aware that a reviewer account needs a valid email address. And that email address will be visible to readers and authors. It could be different from your main email address for the site. Editors and authors will have the priority in becoming reviewers. And there is a limit to the time allowed without submitting a review. If you go 90 days without a single review, then your slot will be given to somebody else.
If the new system proves to be useful and helpful, I may expand it later and implement the missing part, which is review moderation by other users.
So if you're interested in becoming a reviewer, use the site's webmaster contact form to let me know.
I revamped the review display page completely and made it accessible to everybody. The old reviewing system has been integrated with the site. No more need for a separate log in page and different ID. Reviewing is easier than ever for those with reviewer accounts.
A new reviewers section has been added to the site and it's only
accessible for those with reviewer accounts.
The funny part about this change is that it came with no real planning. I know I had discussed a new reviewing system on this blog a long time ago, but it seemed that I could never really plan it and implement it properly within a reasonable amount of time. So I kept putting it off for later.
The way this started was with me thinking that the old reviews listing page is not particularly useful to either authors or reviewers if only premier members could access it. So I decided to give access to everybody and started by revamping the interface. Before this change, the reviews page was just a list by reviewer. It was static and listed all the reviews without any particular sorting, so new reviews could not be easily found by interested readers.
Bit by bit, the changes came and before I knew it, I had finished
reintegrating the old reviewing system, which had separate login and separate everything, into the site's current structure.
The old plans for a review system accessible automatically by everybody have been changed into a review system with set number of slots for reviewers.
I'll start with 10 new reviewers. If you're interested in becoming one of the reviewers contact me and let me know.
All reviews for now will be moderated by me. There are few rules to stick to. Basically, reviews have to be positive. Not necessarily glowing with praise. They have to be at least positive in that they aim to either guide the other members of the site to good stories, or at least help the author with constructive criticism. So it must help. If it doesn't help anybody, and is aimed to put down the author or drive them away from writing, then the review will be rejected. If it warns the reader to avoid the story without giving a valid reason why, then it will be rejected.
If I reject more than half of your reviews, your reviewer privileges will be revoked and the opening will be available for another that wants it and want to do good with it.
The system supports more than one review per story, so even if a story has already been reviewed and you have a differing opinion or more things that needs to be said about the story, you can still review it.
Be aware that a reviewer account needs a valid email address. And that email address will be visible to readers and authors. It could be different from your main email address for the site. Editors and authors will have the priority in becoming reviewers. And there is a limit to the time allowed without submitting a review. If you go 90 days without a single review, then your slot will be given to somebody else.
If the new system proves to be useful and helpful, I may expand it later and implement the missing part, which is review moderation by other users.
So if you're interested in becoming a reviewer, use the site's webmaster contact form to let me know.
Comments
Some comments and suggestions:
1) Why not allow space for a short "freehand" review, say a paragraph or two? That would give a much better sense of the story reviewed than just a numerical rating by set categories. And, maybe expand the number of categories, too, especially one for character development.
2) Why not allow "negative" reviews? As long as the reviewer provides a valid e-mail address, thus taking some measure of responsibility for the review, I should think that would be helpful to the readers and authors.
3) Permit reader/author comments on the reviews.
Something like slashdot, maybe, for rating the reviews themselves.
Shadowhawk
There is nothing more damaging to a site than to read a story that has glowing reviews, when it's 'utter shite'.
All that eventually happens, is that people stop reading the reviews because they can't be trusted (A bit like politicians!).
There-for making the whole idea pointless and a waste of everyones time.
(Sorry to be so negative, but you should never censor reviews, after all that is the whole point of reveiwing.)
Pixy
Read the article again. I never said that anything negative will be rejected. But any review, must have something redeeming to the review itself. If a story is terrible in the reviewer's opinion, then they could say that, but, they have to say why they think that and tell the author what they could do to fix it.
A review that goes like:
"I read this story and I found it terrible. The author is an idiot and should refrain from writing any further."
Will be rejected.
But a review that goes something like:
"I tried reading the story and I found it to be atrociously written. It is riddled with spelling errors and grammatical errors. The author needs to at least use their spell checker and have their work reviewed by an editor before submitting the story."
That kind of review could well be accepted.
A review of a story that rubs the reviewer major squicks, like somebody that hates incest reviewing an incest story would probably get rejected.
If the review goes something like:
I read this story and it contained incest. All authors that write incest should be hung with their balls.
or This story contains rape and scat the author is sick in the head for even thinking about writing such drivel.
that type of review will be rejected.
So, the reviews have to be helpful. To the reader or to the author, but they can't be outright insults with nothing constructive to say.
The idea is to not scare the authors from writing. To help them improve, not belittle them.
See for example some lower rated Celeste reviews on SOL.
Shadowhawk
Sincerely,
ElSol
Pixy
The OLD FART
So Shadowhawk, I did what you said and read some of Celeste’s lower rated reviews. ‘Free for all farm girl’ has a review better than the actual story. Which is a bit unsettling. Then there was ‘Irish Spring’ and then…. Before I knew it, the evening was ruined. Bugger.
Pixy
By constructively negative, I don't mean flames, or unsubstantiated negativity. If a reviewer is going to be negative, they need to support it with details as to why, just as (hopefully) they will support a positive review.
I'd like to point out to Lazeez that if a writer fails to use appropriate story coding, such as failing to mention that there *is* scat or incest in the story, then a reviewer should be allowed to give a negative review based on that fact. (Hopefully they will email the writer and tell them that they failed to warn of a "squick" type subject being in the story, and it can be corrected.) There's nothing worse than reading a story, getting into it, and then find out that {for example} beastiality is in it, and you hate stories like that. I'd also like to note that a coding of "Caution" for artistic purposes should not generate a negative review, I hope.
Writing a good review is hard, and can require a lot of thought. There are a lot of stories that I enjoyed, that I would write a good review for, but would also point out anything I felt was lacking.
I'd also like to see that no reviews are accepted for stories that are "In Progress". There's nothing worse than seeing a review written for something that isn't done, and the author could either drop the ball on the story, or pull a bad story into a really good one, and yet that review is sitting there.
Garylian
To ensure ensure it isn't spam? You did that, through moderation. To ensure it's not negative? Same thing. To ensure the reviewer will "stand by his words" or some such?
How come authors don't have to stand by -their- words, good or bad? Why is there such a(n increasing) double standard between readers/reviewers and writers? Even these hand picked special readers are getting the "bastard stepchild" treatment.
I also don't see a reason to limit this to 10 reviewers. Why only 10? Or is that just for the initial phase? You weren't clear on that.
I'd like to see author's not being given first crack at reviewing. Talk about having a "pat on the back society" potential. If you look at a.s.s.d, you can see that. Either the authors/editors are buddies, or they have stark animosity towards each other. I don't want to know only what other authors said. I want to see what a reader had to say.
The author's got what they wanted with the new email system, and it's fair. It's time to be fair to the reviewer. No public email address. Comments to them are handled the SAME way reader's comments to an author are done. Make it so a few reviewers are NOT authors/editors.
Having a reviewer account means having the power to affect a story's readership. With such power, there must be some measure of responsibility.
Who is going to really contact reviewers? Authors. Why would readers really contact a reviewer?
So if a reviewer has the power to affect an author's story, then the author must be able to contact the reviewer to discuss whatever issues were raised in the review.
Currently, the site's mailing system does not handle reviewer accounts, it may in the future, but for now, it doesn't.
As for spam, not to worry, the reviews and review listings are not accessible without logging in. So no bots.
And don't worry, more than half of the reviewers so far are neither authors nor editors.
When a review is posted, an automated message could be sent to the author with a copy of the review and the email addy of the reviewer.
"With such power, there must be some measure of responsibility." This comment makes NO sense in this context, since writers (who clearly have the most power) have no responsibility at all. Their anonymity is always protected no matter what they write. And that's fine - I have no problem with their being anonymous. But the current system is two-faced in every last regard, since there are solutions out there that can still favor writers -without- putting the security of readers at such an extreme disadvantage.
I still think a private messaging system would solve all these things, in this instance and with anonymous reviews.
"And don't worry, more than half of the reviewers so far are neither authors nor editors."
With only 10 reviewers, statistically that means almost half ARE.
1: At least get his name right.
2: “writers (who clearly have the most power)” No we don’t. We write but we don’t force you too read what we have written. On the other hand, reviewers are supposed to be impartial, and we should trust their judgement. To put it simply, would you trust the word of a plumber when he comes to fix a leak, or the word of his previous customers? Do you read reviews of an item before you buy it in the shops?
3: “This comment makes NO sense in this context” No, it makes perfect sense.
4: Your last paragraph is gibberish. Lazeez said “More than” not half. In simple English that is six and above, or four and below. Which any mathematician will tell you, is not half.
5: Who are you? Why are you not prepared too put a name to your half-baked accusations.
Personally (and this is as a writer) I prefer people to be able to comment on stories without having to supply an e-mail address. They are more likely to comment if they are not scared of recriminations (see above). Comments on my stories have dropped markedly at the loss of the ‘anonymous’ tag.
Pixy.
I'll start with 10 new reviewers. If you're interested in becoming one of the reviewers contact me and let me know.
If a reviewer feels like the story is missing a squirk code that should be added to the review.
When a story in progress is reviewed it would be nice for the reviewer to mention the last chapter his review references. For example, a few of the stories in progress I am currently following have more than 50 chapters. A review of only the first ten or so chapters in the above case is not as useful as one that includes most of the story.
The same idea also applies when the author does a rewrite of a reviewed story.
Knight Ranger
The review is dated, and the individual chapters are dated on the top of each one as to when it was originally posted AND last updated. While putting the chapter # that the reviewer made the review on would be helpful, there is nothing to prevent the author from going back and doing a complete re-write of that chapter, or of all the chapters prior to the review. In fact, they could re-write it 5 times, and all you see is the first and last date.
Which is why I don't look at reviews for stories that are in progress. Once that review is up, the author can do anything after it was written, and that review is stuck there. Some stories get worse, and some get better. And some get left unfinished, and a review of that would really be a mistake.
Garylian
1: My bad. As difficult as my name is to pronounce, I know how Lazeez must be tired of idiots like me spelling his name wrong. I apologize in advance, because I've now got that "s" in my head and will surely make the same mistake again.
2: In the context in which I referred, authors do have the power. What I meant was that with every new system being implemented, writers are getting more and more special privileges (or are allowed to retain more privileges), while readers are LOSING privileges left and right. Each new change in SOL is biased towards the writers and against readers. The point of my complaints is that a) it is RIGHT that authors should be favored, but b) that new changes don't have to be at the EXPENSE of readers.
That's why i suggested an internal messaging system. That way EVERYONE is allowed to be anonymous - comments, reviews and etc. can be tracked back to your SOL login id, not your email address. However, the SYSTEM would have your email address - it could allow you to be notified of reviews you receive, or of responses to reviews you've sent. Lazeez, as the owner of the system, would also have a way of linking email accounts to user ids, so trolls, author stalkers, flamers or whatever would not have free reign to wreak havoc.
3: "No, it makes perfect sense." No it doesn't. Authors bear no responsibility for the consequences of what they write. I'm not saying they SHOULD, either. But if they can write crap, or kill off a fan-favorite character in the 67th chapter, do they really have the right to complain that they're getting 2's and 4's for scores or are flooded with hate mail?
That is, of course, one of the primary reasons for the recent changes: To defend authors from the consequences of -their- actions. With such power, *should* there be some measure of responsibility? If an author goes out of the way to do something controversial in a story, knowing ahead of time that fans will react emotionally, how come it's the -readers- that are made to take responsibility for what -they- write in response?
The only situation in which this is not valid deals with story codes. If you're a moron and you read a scat story KNOWING you don't like scat, you'll vote it low whether the story deserves it or not.
Now, there are two ways to deal with that situation. First is to let Darwinism take its course. Let the scores and the hate mail stand, possibly driving those authors away. In one way, this is bad, but from another perspective, this is how the readers tell SOL and the authors what they want to see in the future. In effect, free market rules, and giving the readers what they want is what directs the site's future.
The second way to deal with is to treat it like a problem - and from past experience, Lazeez -will- treat it like a problem, as he did anonymous reviews. Here, one solution would be to link scores and feedback. If SOL used a private messaging system, you could be forced to give feedback on a story before being allowed to vote a score for it. Conversely, if you flame the author and vote a 2, your score could be deleted. Another way would be to let authors delete low scores. The effect of this is that you might have a higher score, but you'd have a lower number of VOTES, which is another way to tell tell how popular a story is. A third way would be to disallow anonymous votes. The end result of each "solution" to this problem will be a markedly large decrease in the total number of votes, as I'm sure many authors have seen a decrease in feedback since the new anonymous review "fix."
4: It's not gibberish. In simple English, 6 is almost half. Statistically, it's virtually indistinguishable from half. If the percentage holds as the number of "official reviewers" rises, a very significant number of them will be fellow authors, which will mean any given review is likely to be back-slapping from a fellow author or editor, rather than an honest reader's perspective.
5: I am me, and that is all anyone needs to know. That is, after all, the -point- of most of my comments on this blog. Are my comments somehow more valid if I turn out to be Nick Scipio or Catherine Zeta-Jones? Of course not. If in reality I'm just some nameless loser who enjoys reading stories on the internet, do my comments become somehow -less- valid?
My whole point is, they -shouldn't- be.
"Comments on my stories have dropped markedly at the loss of the ‘anonymous’ tag."
And that was exactly what I was fighting to prevent. El Sol doesn't care because he's got so many people sending him reviews, any small loss would be insignificant and probably not even noticeable. But you small guys, who are probably the vast majority of the writers (and of the number of stories posted) on SOL, all of you got bent over to take one for the team. So maybe I misspoke when I said that the authors have the power. Maybe its just a few of them mucking it it up for -everyone- else?
It is an authors choice if he/she allow anonymous feedback, or disallow it having less flames but possibly less feedback.
As to email address of authors: if they reply to feedback, then their email cease to be anonymous, at least to the reader the feedback they replied to. Without replies to reader's feedback there is much less chance for future feedback: see "Reader Feedback 101" entry.
Shadowhawk (the reader)
This reviewing system looks good. Allowing constructive feedback is very good.
Reviews feedback critism or whatever are an opinion. One person providing guidance to readers and perhaps in the ideal help for a writer.
It'll be most useful for me if it points to overlooked stories.
All in all another good idea
WarLord
Perhaps better (another) solution would be to implement the alphabetic table from SOL Authors table. That is just a thought.
Another idea would be to have some very coarse vote/grading system for reviews. Perhaps simply "I Agree"/"I Disagree" vote.
A good idea for reviewers would be to put in their reviewer page's "About:" section the separate paragraph explaining what kind of stories reviewer like, what searches in the stories and the like. It would hint if we would find the same stories interesting.
Shadowhawk
As for reviewing: authors--most of the ones I know of, anyhow--*are* readers. I get lots of 'fan mail' from fellow authors, so I know they're reading other authors. We're not isolated here, just typing away and ignoring the output of others.
There's an added bonus to looking for authors to review: Lazeez can quickly find out if we know how to *write*. Writing a review takes writing skill. A different type of writing than a story, to be sure, but all Lazeez has to do is look at one of my stories to see that I have a decent grasp of grammar and punctuation and all that stuff, and that I'm coherent.
And, yes, I did just send Lazeez an email telling him I'm interested. And, yes, I am well aware that some authors around here get way too much notice--and I'm one of them--and others get way too little. If Lazeez approves me, I plan on starting by highlighting some of my favorite stories that have gone sadly unnoticed.
--Frank Downey
Everybody can access the reviews and I've gotten emails thanking me for posting them, both from the author and people who've read the stories I've reviewed. As for telling the author, I always drop the author an email telling him/her I've submitted a review. And they write back, appreciative of it.
I could care less how many people are authors or what the policy is on anonymous readers. Stories are getting reviewed and people can choose to read them or not.
The OLD FART
Also, is there a way to access just the "Reviewers" reviews without looking through every new work to find them? I would like to selectively read stories based on better reviews.
Now *everyone* can be a reviewer just by making a Favorite Stories List and adding a blurb to each favorite story.
All I would ask for now is a list on my own Account Manager page to tell me who added any of my stories to their Favorite Stories List...
--Hungry Guy
Pixy
Bad writing doesn't need to be punished, just ignored. Does the reader rating system not go far enough to relegate weaker stories to the back of the pack?
If you feel a story doesn't deserve its high rating, you may have a point, but who is your proposed negative review designed to serve? The author? (Send them email.) Future readers? (As a whole will they differ so dramatically from past readers who gave it a high rating? And if they do, won't the rating fall?) Genre aficionados? (A positive descriptive review, or the absence of same next to other genre stories, can be just as informative.)
As few reviewers and reviews as there are and will be (relative to the number of stories and authors and ratings), better that they be used to elevate than denigrate.
If I want to read about how everything sucks, I'll go to CNN. I come to SOL to read what's good.