Re: problems with the pre-qualification grader
Also, kudos for that. It will make our lives (and yours) easier. An IQ test with just one (super-hard) problem doesn't give much information about peoples' intelligence. Finer-grained feedback might make some problems tractable.
By the way, how sure are you that the "official" answers to problems are right? As you may remember, team Frink Rules! found errors in two of the "sample input/output" examples from problems last year. I'm not trying to be a dick in bringing that up, but is it possible to determine if a team originally submitted the right answer if an error in the "official" answers is found later? Will a judge be looking over outputs and sanity-checking them? Do you keep all submissions? There was a hint here that our submissions could be overwritten by later submissions. At least logging our outputs using append (>> vs. > in Perl) might help resolve this potential issue on later review, if necessary.
Now I can just set the auto-learning Frinkbot free to do a binary search of the problem space...
Also, kudos for that. It will make our lives (and yours) easier. An IQ test with just one (super-hard) problem doesn't give much information about peoples' intelligence. Finer-grained feedback might make some problems tractable.
By the way, how sure are you that the "official" answers to problems are right? As you may remember, team Frink Rules! found errors in two of the "sample input/output" examples from problems last year. I'm not trying to be a dick in bringing that up, but is it possible to determine if a team originally submitted the right answer if an error in the "official" answers is found later? Will a judge be looking over outputs and sanity-checking them? Do you keep all submissions? There was a hint here that our submissions could be overwritten by later submissions. At least logging our outputs using append (>> vs. > in Perl) might help resolve this potential issue on later review, if necessary.
Now I can just set the auto-learning Frinkbot free to do a binary search of the problem space...
Comment