← Back to topics
Topic

Faulty Graders

crusader
After noticing some quite strange solutions getting accepted on some problems, I decided to run some tests on the problemset. To not pollute my own account and to keep the test-solutions identifiable, I created a shadow account under the name of 'devils advocate'. Then I submitted 'solutions' that only returned with exit code 0, without reading or writing.

To my surprise, the following 14 problems got the full score:
Izbornik, Tamnica, Cvjetici, Kratica, Bijele, Vauvau, Veci, Kolone, Tomo, Skocimis, Tenis2, Grad, Pikado, Staza.

The following 10 problems got partial scores:
Regions 3/20, Plahte 4/10, Berba 1/10, Pitagora 6/10, Kontrola 2/10, Pisoar 1/10, Bazen 4/10, Oktalni 2/5, R2-coci 2/10, Maraton 1/10.

This may not sound like a big deal: if you're sincere, you will not cheat and submit a proper solution anyways; but the down-side is that you'll never know if your program is correct if you always get accepted for it.

Do with it what you think is wise. I only tested a subset of all problems (incidentally mostly problems added by one guy), so there may be more. You may consider deleting my shadow account or its submissions; I might use it to try out some more stuff in the future tho.

NOTE: I don't hold a grudge against the guy who added those problems, although I must say that I'm not impressed by what I've seen from him thus far.
dejandenib
THIS IS A BIG DEAL!!!
For the problems where you got partial score, it was probably because on those test cases, the answer is really a zero.
There is a problem that most people, who are adding tasks are not aware. The string compare checker doesn't work for numbers, eventhough it should, but i don't know why this happens.
The author of the tasks Dario should fix this.
What you did, creating a second account to test this, was the right thing to do. Thank you. That account will be probably removed because it is full of incorrect solutions.
karakondzula
He said that he didn't wrote anything, so task were he got partial score should be fixed too.
dario-dsa
I will fix that but 30% of this tasks other people published so people should note me on this.
dejandenib
I didn't publish them. Some other moderator did.