###Summary
This is a suggestion to create one, possibly two, indicators relating to Reopen Review Queue status. The purpose is to alert users to the requirement for intervention outside the normal process to get a question reopened.
###Detail
Purpose: to prevent questions becoming lost in the "Phantom Zone". The Phantom Zone is when a closed question becomes invisible for reopening and requires special intervention. This suggestion involves displaying one, potentially two, status indicators regarding the reopen review queue.
Site Applicability: This could potentially be useful on a number of sites, but I suspect it is most applicable to Super User because of the nature and size of the site.
A substantial portion of the technical questions SU receives are from non-technical users. The questions are answerable only with accurate, complete detail that non-technical users don't know to provide, or how to provide. For many posters, English is a second language, and technical descriptions are ambiguous. Getting a question into good, answerable form often requires repeated attempts at clarification and editing.
The way the reopen queue works causes a problem in this situation, which I'll describe below. Closed questions, that have been made good, fail to get reopened and fall through the cracks. Users may not even realize that the reason had nothing to do with the question quality. The functionality being suggested here is a way to alert users to the situation so they know that intervention is needed.
Problem to be addressed: (Simplified explanation of a complicated process.) Unanswerable as-is questions get closed. It takes multiple rounds of clarification and editing to turn it into a good question that can be reopened.
The first edit gets it into the reopen review queue. Then one of two things happens, whichever comes first. It collects five reopen votes, the review is ended and the question is reopened, or it collects three leave-closed votes, and the review is ended with the question still closed (but it retains any reopen votes received).
Often, that edit doesn't turn it into a good question, a later edit does. The early reviewers vote to leave the still-inadequate question closed. If the question is still in the review queue when it becomes good, reviewers start voting to reopen.
Editing continues independent of any reviewing, and at some point, it becomes a good question. Independent of the review queue, the editor may vote to reopen. A few people who are actively following the question may see the improved question and vote to reopen on the question, itself.
Behind the scenes, the question may already have collected three leave-closed votes, so it's no longer in the queue. Or it may have collected two before the final edit, started to collect reopen votes in the queue, and one reviewer, having a bad hair day, casts the third leave-closed vote that ends the review.
On the question, there's no indication of the review status, or even that it is in the queue. People make assumptions based on visible activity. What anyone with an interest in the question sees is easily misinterpreted: the question was turned into a good one, and then started receiving reopen votes. They assume the last edit bumped it into the queue, and those reopen votes are activity in the queue.
It looks like appropriate momentum, and reopening is expected. However, for no apparent reason, reopening just stalls; those initial reopen votes are the only ones that show up. People assume there's an active process underway to finish reopening the question, when there isn't.
Questions get only one shot at the reopen review queue. So when it fails in the queue, it becomes invisible. Nobody is aware that that they need to vote to reopen it. By this time, the question is no longer fresh, so there is only a trickle of people with voting privileges, who have not already voted, who might stumble across the question.
To make matters worse, if someone gets curious and checks the question timeline, it looks like it went through reopen review and it was the will of the community to leave it closed. The timeline information doesn't reliably indicate when the edit happened in relation to the individual votes. This perception may discourage even pursuing getting it reopened.
What the app or feature would do
There are two levels of functionality that could be useful.
The "simple" functionality would indicate on the question that reopen review was completed (only if the question is still closed; it would be just noise if the question has been reopened). That's the critical information needed to stop expecting that more reopen votes will be coming organically, and it is available long before someone might think to investigate.
This has a second value. If the review ended and failed to reopen the question even before the edit was made, the edit will not trigger review, as the editor would expect. Even manually voting to reopen in addition to the edit won't trigger review. The question is already in the Phantom Zone. So the editor would immediately need to take external steps to get the question reopened, and the review completion indicator would be the alert.
The logical place for an indicator of review completion would be at the bottom of the "Closed" message box. That would also solve the issue of displaying the message on a reopened question (if it is already open, there's no Close message in which to put the indicator; if it is currently closed and later reopens, the Close message disappears, taking this indicator with it).
Since many (most?) users aren't familiar with the implications, it could perhaps be a message like:
NOTE: Reopen review has been completed. This question will not appear in the Reopen Review queue again. If you believe it should be reopened, please use other means to have it reconsidered.
The above functionality serves multiple purposes, so the second part would be supplemental rather than an alternative. The above alert also doesn't really address the appearance of reopening failure being the will of the community.
The second part would depend on the granularity of the detail available through the API. If the detail was available, it could look for the characteristic pattern associated with this problem. The pattern is the following sequence:
- The question entered the reopen review queue.
- It received only votes to leave closed prior to step 3 (as a practical matter, this would be either 2 or 3 votes; 3 would end the review).
- The question was edited (regardless of whether the queue was still open).
- All, or all but one, subsequent votes were to reopen, regardless of where those votes occurred (review queue or on the question), and regardless of whether the question was still in the reopen review queue at the time.
Identifying this pattern would provide a direct alert that action is required, and provide a paradigm shift for people following the question who believe there is still an active reopen process.
The logical place for a Phantom Zone pattern alert might be under the line of buttons that contains the Reopen button; that's where people will be following the reopen vote count. It might be a message like:
Reopen votes for this question will no longer come from the Reopen Review queue.
See note in the Closed message.