From prechelt@inf.fu-berlin.de Thu Mar 24 16:41:06 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1aj7Ni-003feY-6v>; Thu, 24 Mar 2016 16:41:06 +0100 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1aj7Ni-003gZi-20>; Thu, 24 Mar 2016 16:41:06 +0100 Received: from kaduna.imp.fu-berlin.de ([160.45.118.73] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtpsa (TLSv1:AES256-SHA:256) (envelope-from ) id <1aj7Nh-002Sd0-Qy>; Thu, 24 Mar 2016 16:41:05 +0100 From: "Lutz Prechelt" To: Date: Thu, 24 Mar 2016 16:41:05 +0100 Message-ID: <0b0901d185e3$940a52f0$bc1ef8d0$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdGF4LGOezlPuSPYTpCpAMm8CF4nnQ== Content-Language: de X-Originating-IP: 160.45.118.73 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1458834066-00000D1A-7BA05FDD/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.029673, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-50.0 required=5.0 tests=ALL_TRUSTED, T_RP_MATCHES_RCVD X-Spam-Checker-Version: SpamAssassin 3.4.1 on Niue.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector (RQC) status update March 2016 X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Mar 2016 15:41:06 -0000 Dear all, In the previous update [1], I announced an article about RQC (and other initiatives) that would appear in Science Careers. It has appeared now [2]. What's new? You have not heard from me for several months, but things moved on nevertheless. I have built my skill set for developing the RQC software myself and am now becoming productive with just that. Since last week, I am on sabbatical until the end of September, so expect to hear from me more often in the coming months and expect the news to be fairly technical: I will be building the software for RQCconf [3] and am sure I will get it running before the end of the sabbatical. I have also transformed my code base to carry both RQCconf and RQC for journals, so there will be some progress on the latter as well. I will keep you posted. Please tell me if you know anybody else who may like to be on this mailing list [L]. Lutz [1] https://lists.fu-berlin.de/pipermail/rqc-interest/2015/date.html [2] http://www.sciencemag.org/careers/2016/02/getting-credit-peer-review [3] http://www.mi.fu-berlin.de/w/SE/RQCconf [L] https://lists.fu-berlin.de/listinfo/rqc-interest (you can subscribe here) From prechelt@inf.fu-berlin.de Mon Apr 18 19:45:39 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1asDEx-001sAM-C7>; Mon, 18 Apr 2016 19:45:39 +0200 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1asDEx-000ZPq-7E>; Mon, 18 Apr 2016 19:45:39 +0200 Received: from kaduna.imp.fu-berlin.de ([160.45.118.73] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtpsa (TLSv1:AES256-SHA:256) (envelope-from ) id <1asDEw-001Cuk-WC>; Mon, 18 Apr 2016 19:45:39 +0200 From: "Lutz Prechelt" To: Date: Mon, 18 Apr 2016 19:45:38 +0200 Message-ID: <080401d1999a$1ebe3410$5c3a9c30$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdGZmCqKFT2yacP+QHO0Qju31+Q3kw== Content-Language: de X-Originating-IP: 160.45.118.73 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1461001539-00000D1A-F90FB2A5/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.017078, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-51.0 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Checker-Version: SpamAssassin 3.4.1 on Vanuatu.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector (RQC) status update April 2016 X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Apr 2016 17:45:39 -0000 Dear all, In the previous update [1], I told you that I have now started working on the implementation of RQCconf [2] seriously. What's new? I am becoming more and more productive. Still many things I am doing for the first time and they take long, but the fraction of things I know and can do faster is climbing steadily. Today I achieved the first spike solution: The implementation of all of the core functions of the RQC software. Yeah! It can now: - Configure a conference-RQC - Read a review quality definition from an RTF file (a very nice solution) - Present and evaluate a review grading questionnaire according to the review quality definition - Compute a reviewer ranking - Produce PDF reviewing receipts If this sounds like "almost done": No, there are far more missing pieces than existing pieces, but still it feels good. I expect to put RQCconf to production in the first half of the year. If have updated the implementation status list and it now looks as shown in [3]. Please tell me if you know anybody else who may like to be on this mailing list [L]. Lutz [1] https://lists.fu-berlin.de/pipermail/rqc-interest/2015/date.html [2] http://www.mi.fu-berlin.de/w/SE/RQCconf [3] https://www.mi.fu-berlin.de/w/SE/RQCconf#Software_implementation_status [L] https://lists.fu-berlin.de/listinfo/rqc-interest (you can subscribe here) From prechelt@inf.fu-berlin.de Sun Jul 31 20:19:31 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bTvKk-0026dj-Pl>; Sun, 31 Jul 2016 20:19:30 +0200 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bTvKk-0031BL-MK>; Sun, 31 Jul 2016 20:19:30 +0200 Received: from x4d030fdf.dyn.telefonica.de ([77.3.15.223] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (envelope-from ) id <1bTvKk-000EEn-C5>; Sun, 31 Jul 2016 20:19:30 +0200 From: "Lutz Prechelt" To: Date: Sun, 31 Jul 2016 20:19:26 +0200 Message-ID: <02f801d1eb58$13b4f210$3b1ed630$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdHrV7zeZu5DN8jySeao+LhtJ2VErQ== Content-Language: de X-Originating-IP: 77.3.15.223 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1469989170-0000049F-1BC760FE/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.051815, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-51.3 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Checker-Version: SpamAssassin 3.4.1 on Kiribati.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector (RQC) status update July 2016 X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 31 Jul 2016 18:19:31 -0000 Dear all, In the previous update [1], I told you that that, despite the fact that all core functions were then implemented in the upcoming Review Quality Collector for conferences system, even more pieces were yet missing. What's new? If you interpreted the fact that you have not heard from me since April as "nothing much happening": The opposite is true. I have been working on so many things at once that there were no obvious milestones to report. That is changing now. The functions needed for an initial launch of the RQC portal are essentially all present now, as a quick look on the implementation status page will tell you [2]. Even the deployment mechanism is more than half complete. The number of other things that remain to be done is small. Expect to be notified of possible alpha testing usage (closed group, mailing list members only) within the next two weeks. I currently plan to launch RQC for conferences on September 1. Please tell me if you know anybody else who may like to be on this mailing list [L]. Lutz [1] https://lists.fu-berlin.de/pipermail/rqc-interest/2016/date.html [2] http://www.inf.fu-berlin.de/w/SE/RQCconf#Software_implementation_status [L] https://lists.fu-berlin.de/listinfo/rqc-interest (you can subscribe here) From prechelt@inf.fu-berlin.de Wed Aug 17 22:23:51 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1ba7NK-000gkW-Ku>; Wed, 17 Aug 2016 22:23:46 +0200 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1ba7NK-002o0w-Hb>; Wed, 17 Aug 2016 22:23:46 +0200 Received: from kaduna.imp.fu-berlin.de ([160.45.118.73] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (envelope-from ) id <1ba7NK-002tkH-BC>; Wed, 17 Aug 2016 22:23:46 +0200 From: "Lutz Prechelt" To: Date: Wed, 17 Aug 2016 22:23:46 +0200 Message-ID: <003d01d1f8c5$419e8a90$c4db9fb0$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdH4w5r55pvzQdB1TU2EvSkPB+QfAA== Content-Language: de X-Originating-IP: 160.45.118.73 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1471465426-0000049F-F43B8848/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.010389, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-50.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Checker-Version: SpamAssassin 3.4.1 on Vanuatu.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector Alpha Testing invitation X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Aug 2016 20:23:51 -0000 Dear all, finally, RQC is becoming real. There is now an implementation that provides the RQC service for conferences that use Easychair as their manuscript handling system (which most of them do). It has many small imperfections, but is otherwise ready to go I think. To find out more about this, I invite you, as members of the rqc-interest mailing list, to a closed-group alpha test (please do not tell any outsiders about the system yet): If you would like to see review quality collecting in action, use the sandbox mode to run an RQC process with artificial data. A trial will take you about 1 hour and can be done in pieces. Just read the text provided by the system and do the steps as explained there: http://www.reviewqualitycollector.org Some hints: - Cut down the RQdef template a bit to simplify the grading handling - Set a really short timeframe (such as 20 minutes) in the very near future - For your own thought clarity, use your default browser for the reviewer roles and a second browser for the organizer role with registration and login. (Reviewers need no account.) - Feel free to leave in the system any nonsense you like, sandbox conferences all get deleted eventually. I think RQCing has become a fairly smooth process but I'd be very happy to receive, within 8 days, feedback from you on anything you could not understand, did not like, or that does not appear to work correctly. RQC will go live on September 1st. Hooray! Lutz Prof. Dr. Lutz Prechelt; prechelt@inf.fu-berlin.de Institut f. Informatik; Freie Universitaet Berlin Takustr. 9, R.014; 14195 Berlin; Germany +49 30 838 75115; http://www.inf.fu-berlin.de/w/SE/ From prechelt@inf.fu-berlin.de Sun Aug 21 10:08:27 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bbNnv-000WWU-2w>; Sun, 21 Aug 2016 10:08:27 +0200 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bbNnu-003JAD-UD>; Sun, 21 Aug 2016 10:08:26 +0200 Received: from z6b82.pia.fu-berlin.de ([87.77.107.130] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (envelope-from ) id <1bbNnu-0049Vg-FT>; Sun, 21 Aug 2016 10:08:26 +0200 From: "Lutz Prechelt" To: Date: Sun, 21 Aug 2016 10:08:24 +0200 Message-ID: <01f501d1fb83$315078e0$93f16aa0$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdH7gjw7hlBxNW+HSSO5S7yP6uUtaA== Content-Language: de X-Originating-IP: 87.77.107.130 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1471766907-0000049F-9D033C84/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.024954, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-50.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Checker-Version: SpamAssassin 3.4.1 on Kiribati.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector Alpha Testing invitation (2) X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 08:08:27 -0000 Dear all, for all those of you who have tried to access RQC but could not: There was a firewall issue on my side. This is now resolved, please try again. And for everybody else: Try out the sandbox mode; creating your own little conference and seeing the resulting receipts is fun! One more hint: - Decide which reviewer has reviewed how well, so that the grading and the results really make (pseudo-)sense. Everything else as described below, except that the default entry URL is now https://reviewqualitycollector.org Eagerly awaiting your feedback until Thursday, Lutz -----Original Message----- From: Lutz Prechelt [mailto:prechelt@inf.fu-berlin.de] Sent: Mittwoch, 17. August 2016 22:24 To: rqc-interest@lists.fu-berlin.de Subject: [RQC-interest] Review Quality Collector Alpha Testing invitation Dear all, finally, RQC is becoming real. There is now an implementation that provides the RQC service for conferences that use Easychair as their manuscript handling system (which most of them do). It has many small imperfections, but is otherwise ready to go I think. To find out more about this, I invite you, as members of the rqc-interest mailing list, to a closed-group alpha test (please do not tell any outsiders about the system yet): If you would like to see review quality collecting in action, use the sandbox mode to run an RQC process with artificial data. A trial will take you about 1 hour and can be done in pieces. Just read the text provided by the system and do the steps as explained there: http://www.reviewqualitycollector.org Some hints: - Cut down the RQdef template a bit to simplify the grading handling - Set a really short timeframe (such as 20 minutes) in the very near future - For your own thought clarity, use your default browser for the reviewer roles and a second browser for the organizer role with registration and login. (Reviewers need no account.) - Feel free to leave in the system any nonsense you like, sandbox conferences all get deleted eventually. I think RQCing has become a fairly smooth process but I'd be very happy to receive, within 8 days, feedback from you on anything you could not understand, did not like, or that does not appear to work correctly. RQC will go live on September 1st. Hooray! Lutz Prof. Dr. Lutz Prechelt; prechelt@inf.fu-berlin.de Institut f. Informatik; Freie Universitaet Berlin Takustr. 9, R.014; 14195 Berlin; Germany +49 30 838 75115; http://www.inf.fu-berlin.de/w/SE/ From prechelt@inf.fu-berlin.de Thu Sep 01 13:51:17 2016 Received: from outpost1.zedat.fu-berlin.de ([130.133.4.66]) by list1.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bfQWa-0048Aa-RV>; Thu, 01 Sep 2016 13:51:16 +0200 Received: from inpost2.zedat.fu-berlin.de ([130.133.4.69]) by outpost.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (envelope-from ) id <1bfQWa-002204-Nr>; Thu, 01 Sep 2016 13:51:16 +0200 Received: from kaduna.imp.fu-berlin.de ([160.45.118.73] helo=KADUNA) by inpost2.zedat.fu-berlin.de (Exim 4.85) for rqc-interest@lists.fu-berlin.de with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (envelope-from ) id <1bfQWa-003WEK-He>; Thu, 01 Sep 2016 13:51:16 +0200 From: "Lutz Prechelt" To: Date: Thu, 1 Sep 2016 13:51:16 +0200 Message-ID: <00ac01d20447$2581fa30$7085ee90$@inf.fu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Outlook 15.0 Thread-Index: AdIERNt0DNOdFKDcTvGkdATs3OTe+g== Content-Language: de X-Originating-IP: 160.45.118.73 X-purgate: clean X-purgate-type: clean X-purgate-ID: 151147::1472730676-0000049F-9C1A5FA0/0/0 X-Bogosity: Ham, tests=bogofilter, spamicity=0.076263, version=1.2.4 X-Spam-Flag: NO X-Spam-Status: No, score=-51.5 required=5.0 tests=ALL_TRUSTED, RP_MATCHES_RCVD, URIBL_BLOCKED X-Spam-Checker-Version: SpamAssassin 3.4.1 on Tokelau.ZEDAT.FU-Berlin.DE X-Spam-Level: Subject: [RQC-interest] Review Quality Collector (RQC) is now online X-BeenThere: rqc-interest@lists.fu-berlin.de X-Mailman-Version: 2.1.16 Precedence: list List-Id: sporadic information on Review Quality Collector List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Sep 2016 11:51:17 -0000 Dear all, stage 1 of Review Quality Collector, the part for conferences, is now online. https://reviewqualitycollector.org Only one additional issue came up during the alpha testing phase and has been repaired. The software appears to be working nicely. All those of you who are concerned with conferences - are still invited to play around with RQC in sandbox mode if you have not already done so; - are invited to suggest RQC to the chairs of any conference you expect to review for or submit to (or point me to them so I can do it), in particular conferences that already have a best reviewer award or are (or should be) thinking about introducing one. I will start working on the "collector" functionality for research institutions shortly and on the journal functionality after that. Thanks for your support so far! Now comes the hard part: marketing. If you want to help a bit with that: - retweet my Tweet of today (@prechelt) https://twitter.com/prechelt - forward this email to people who might be interested - suggest such people to me for this mailing list - send me _any_ feedback that comes to your mind. At least one of these four? Thank you! Lutz Prechelt