Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re: TeckChek and other online assessments

by vladb (Vicar)
on Apr 29, 2003 at 06:08 UTC ( [id://253910]=note: print w/replies, xml ) Need Help??


in reply to TeckChek and other online assessments

Assessing competency of IT staff sounds like something every conscientious company might do; however, as far as the means of accomplishing this go, I doubt TeckCheck is anywhere close to the mark. After all, they even used invalid code in some of their own questions!

I glanced over their site and even took their sample assessment test. What surprised me is that the sample test contained questions loosely related to the IT field. For example, one question was on geography, while another touched on general history. In fact, none of the questions I was presented with were anywhere close to IT. I found this rather odd for a company claiming to be in the business they are in. Thereofre, I’m afraid that not having done an actual IT skill testing questionnaire myself, I'll have to base my critique squarely on your summary.

Concerning test scope, I believe that it takes completely different set of questions in order to objectively measure IT skills of a systems administrator as compared to a programmer analyst. Former would have to be tested on a shallow knowledge of Perl or any other systems scripting language. A programmer analyst, on the other hand, would be expected to have a more thorough knowledge of Perl, software design, etc.

Relating this back to the Perl/CGI test you took, scoring criteria might vary based on your position within the company. Therefore, questions on the proper use of the 'format' method may carry different weight for different kind of employee? Also, even amongst a group of adapt Perl programmers, you may expect varying level of expertise in any specific area. As you have rightly mentioned, having more than one legitimate way of accomplishing a task in Perl, it may be hard to come up with a yard stick that would provide an objective measure of an individual’s skill. If I was tasked to come up with a test, I’d lean towards questions of general nature that would encompass common Perl features and avoid those rarely used (such as the ‘format’ method :). I think that questions testing common problem solving skills would be more appropriate than those which concentrate on specific, and often obscure, areas of Perl.

_____________________
# Under Construction

Replies are listed 'Best First'.
Re: Re: TeckChek and other online assessments
by benn (Vicar) on Apr 29, 2003 at 13:51 UTC
    It does state quite clearly on the 'sample assessment' page that the sample is a subset of their 'general knowledge' test that only includes World History, Geography and Space Travel :) ...but I think the weakness here is the whole principle of trying to quantitively test what is basically a qualitative thing - how well somebody can program (in perl or otherwise).

    The best ('C') interview test I ever took consisted of the teamleader showing me some code and asking me to find the bug. When I found it, I also stated "but I wouldn't do it that way anyway - I'd use {whatever}". "Fine" he said, and gave me the job. Sum interview time - 10 minutes. He knew coding - he knew *I* knew coding - easy as that. The problem comes when it's HR drones that are trying to do the assessment. That's why people buy into stuff like this.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://253910]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (6)
As of 2024-03-28 07:52 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found