[RQC-interest] Review Quality Collector funding proposal status

["Lutz Prechelt" <prechelt@inf.fu-berlin.de>]

Dear person interested in Review Quality Collector (RQC),

we were in contact about the Review Quality Collector initiative
in October 2012.
https://www.mi.fu-berlin.de/w/SE/ReviewQualityCollectorHome

I submitted a funding proposal for about EUR 600,000 to the
BMBF-funded program "Performance Evaluation in Research"
in November 2012 to get RQC implementation running.

That proposal was rejected.
The reviewers were interested in the weaknesses of the
proposal but thoroughly uninterested in its strengths.
See the details at the bottom if you are curious.

What will happen now?

I do not intend to bury the idea and will rather look for
alternative ways to make it real.
Most likely, I will put together a proposal for
community-based funding and approach some of you to
participate in that.

That will take a few months to prepare, though.
Any feedback in the meantime is highly welcome.

With kind regards,

  Lutz Prechelt

Prof. Dr. Lutz Prechelt; prechelt@inf.fu-berlin.de
Institut f. Informatik; Freie Universitaet Berlin
Takustr. 9, R.014; 14195 Berlin; Germany
+49 30 838 75115; http://www.inf.fu-berlin.de/w/SE/ 

DETAILS:

The reviewers' main criticisms were these:

- RQC does not address a fundamental issue.
  (This ignores a section of the funding program into
   which RQC fitted nicely.)

- The proposal lacks theoretical foundation.
  (Apparently the reviewers expected me to explicitly
   declare my epistemological stance. I haven't.
   There is very little actual literature on review quality
   in the RQC sense. The proposal was restricted to 10 pages.)

- The review quality criteria are insufficiently
  justified.
  (This is a valid criticism. The preliminary explanations
   in the proposal are acceptable from a pragmatic point of
   view, but likely insufficient from most others.)