We've been asked not to discuss any questions until noon PST on Saturday, so that's when the discussion thread will go up. In the meantime, of course, please refrain from posting anything even vaguely spoiler-ish.
In the meantime, get a good night's sleep. Best wishes from all of us at Goblin Artisans. Thank you for being such an awesome, thoughtful, and creative community.
If y'all didn't see the thread of tweets from him, there will be 75 questions.
ReplyDeleteWhere's the like/retweet button on this thing?
ReplyDeleteGood luck all. We're rooting for you.
Good luck, my friends!
ReplyDeleteI'm proud of you.
Don't commit to answers until you've written about each one.
Beware: When you refresh the form, the order of answers may have changed.
You may want to check Mark's twitter feed when you start working on the test. He's already noted a typo in one of the questions.
ReplyDeleteThank you for pointing this out. Anyone else feel like they really earned their dinner tonight?
DeleteI would, except that I didn't really get started until after dinner...
DeleteTwelve hours later... I'm exhausted. Can't wait to talk about these when we're allowed.
ReplyDeleteI'm exhausted too!
DeleteWe'll have a post for discussing the test at exactly 3:01 PM Eastern. Can't wait to hear everyone's thoughts.
"Get a good night's sleep"... I think you jinxed me, HavelockV. My work woke me up with an emergency customer issue at 3am PST.
ReplyDeleteIt's been an interesting twenty-four hours, but I did finish and I'm reasonably happy with how it went. Looking forward to discussing!
~65 questions took me a minute or so each.
ReplyDelete~5 took about 9 hours total.
And 2 of them were still agonizing coin tosses!
I'll be posting things.
Yeah, about that. Except I didn't spend anywhere near as long.
DeleteI'm in the same boat here, except I had more like 7 agonizing coin tosses.
DeleteDon't forget the trick questions... They said they weren't doing them, but I think at least one snuck in.
DeleteYeah, this definitely seemed to be testing things that extended outside design, like MARO said.
ReplyDeleteI have been following this blog and thanks everyone for the help.
ReplyDelete80/20 Rule to the effin EXTREME!!!! Pretty much did the same as Jay, finished most of it in an hour then had to chew the fat on the rest.
ReplyDeleteIf my power level is hitting Jay levels heres hope I make it to the Third Trial (And promptly get BTFO since I dont have a set proposal ready)
If even Jay is thinking he got at most a 73, it puts me a little at ease.
ReplyDeleteAdding up all my confidences, my score is 68.57.
DeleteI am feeling 68 is going to be the cutoff. I hope I get there.
DeleteThose are oddly specific numbers! I know I got at least 60 and probably 65+, but beyond that I wouldn't care to speculate.
DeleteWell will be easier speculate on Monday when we know how many out of 3000 entered.
DeleteI find it interesting they don't start with card design, seems an easy way to just get a lot of cards.
ReplyDeleteIt's more work to sift through cards from an unvetted source than to make them yourself.
DeleteIt would have been interesting to just be like, give us your best card. Pretty impossible thing to ask. but 3,000 cards is more than they'll end up looking through but I just feel the multiple choice does not show off what they end up looking for.
DeleteA bunch of the questions are trivial if you do (or have done and internalized) the work of reading his articles and checking gatherer and google. They're just there to weed out the folks who aren't committed enough to do that work. And then there are the really hard questions, to ensure they have a top 100 rather than a top 500. Some of those are a very good measure, and some are not. While this method could (and does) eliminate good candidates, they can be sure their 100 folks will be worth looking at. (So they'll get false-negatives but not false-positives.)
DeleteThe other thing is, it's prohibitively time consuming to grade 3000 of anything. Any sort of test on that scale really must be automated.
DeleteI'm salty about that typo, it made the question so much easier (and I actually think the typo was a good questiom given its reference to an obscure but important rules interaction)
DeleteI spent my entire time at the gym yesterday afternoon chewing over one of the questions. I'm sure I got way too many wrong, but the experience itself is very helpful.
ReplyDeleteThe one piece of advice I really wanted them to follow, they didn't: To give the second-best answer a non-zero value. By keeping each question's score completely binary, they're throwing away data, making the results of their test a less accurate measurement of Magic knowledge and design ability. And by making questions needlessly ambiguous, they reward the ability to take multiple choice tests, which is not a relevant skill for the position.
ReplyDelete(That's public information MaRo shared yesterday.)
Or worse, it’s actively getting them worse candidates, as designers who think “too much” and are aware of the complexities get it wrong while level-one thinkers don’t even realize there could be more to it.
DeleteYeah this one had some MURDUEROUS questions. Several "grey area" ones imho.
DeleteIf anything this means the curve grading will be smoother.
I also feel if we get into a situation like GDS 2 where 80% of the people answer one answer that is wrong the question should be thrown out.
ReplyDelete