← Back to topics
Topic

Faulty Graders

c
crusader
After noticing some quite strange solutions getting accepted on some problems, I decided to run some tests on the problemset. To not pollute my own account and to keep the test-solutions identifiable, I created a shadow account under the name of 'devils advocate'. Then I submitted 'solutions' that only returned with exit code 0, without reading or writing.

To my surprise, the following 14 problems got the full score:
Izbornik, Tamnica, Cvjetici, Kratica, Bijele, Vauvau, Veci, Kolone, Tomo, Skocimis, Tenis2, Grad, Pikado, Staza.

The following 10 problems got partial scores:
Regions 3/20, Plahte 4/10, Berba 1/10, Pitagora 6/10, Kontrola 2/10, Pisoar 1/10, Bazen 4/10, Oktalni 2/5, R2-coci 2/10, Maraton 1/10.

This may not sound like a big deal: if you're sincere, you will not cheat and submit a proper solution anyways; but the down-side is that you'll never know if your program is correct if you always get accepted for it.

Do with it what you think is wise. I only tested a subset of all problems (incidentally mostly problems added by one guy), so there may be more. You may consider deleting my shadow account or its submissions; I might use it to try out some more stuff in the future tho.

NOTE: I don't hold a grudge against the guy who added those problems, although I must say that I'm not impressed by what I've seen from him thus far.
d
dejandenib
THIS IS A BIG DEAL!!!
For the problems where you got partial score, it was probably because on those test cases, the answer is really a zero.
There is a problem that most people, who are adding tasks are not aware. The string compare checker doesn't work for numbers, eventhough it should, but i don't know why this happens.
The author of the tasks Dario should fix this.
What you did, creating a second account to test this, was the right thing to do. Thank you. That account will be probably removed because it is full of incorrect solutions.
k
karakondzula
He said that he didn't wrote anything, so task were he got partial score should be fixed too.
d
dario-dsa
I will fix that but 30% of this tasks other people published so people should note me on this.
d
dejandenib
I didn't publish them. Some other moderator did.