Yesterday I talked a little about why the concept of a Certified Information Professional is important to making Information Management a real profession and the gap that it is aiming to fill. Today I want to talk about the exam itself and whether or not it is a good measurement tool.
I’m not going to bore you with all the details on how the exam was prepared by outside experts or any of that. While important, that isn’t a true measure. I think the true measure is the opinions of the battle-scarred veterans of the Information wars. Being one, I offer my opinion here to start building a consensus.
I’m telling you right now, my approach should not be replicated by anyone who actually wants to pass the first time. I went in cold. No studying on the AIIM website, and there is plenty to study. All I did was sign-up, look at the topics covered, and take the exam.
The reason was that I wanted to see how it measured my experience as an information professional. I was pretty confident that if I studied that I would pass. What I wouldn’t learn is how much I know because of my experience and how much of the score was due to studying. I was trying to measure the exam, not just pass.
Looking at the topics was both a blessing and a curse. It was good to look at them and think on what I knew about each topic and how it was all inter-related. It was bad because I looked at some topics and knew that while familiar with the topic, I just knew high-level information.
Another thing I noticed is that the exam isn’t a percentage score. Like a section of the SATs, the top score is 800. Unlike the SATs, there is a minimum score to pass, 560 in this case. This leaves me with no way to even begin to gauge how I am doing on the exam.
Which is good and bad.
As I sat down for the exam, it was all very confortable. I’ve taken many certs (the Microsoft Solution Developer has consumed most of my exam money) in the past and the whole process was familiar. I then started the exam and was immediately concerned.
Some questions had one answer. Some had multiple. While it was very clear how many items I had to select, it made determining how I was doing impossible. I quickly guessed, maybe incorrectly, that you could get partial credit for the questions with multiple answers.
It also meant that selecting the correct answer as a whole was that much harder. There were many questions where one was obvious but the others seemed uncertain.
This basically ruined any possible enjoyment from the exam. I would hit a series of questions where I wouldn’t feel confident and then I would get a Content Management or eDiscovery question to pick up my spirits. Of course a quick question on Master Data Management would squash that burst of enthusiasm.
By the time I finished the 100 questions, I had no idea how I had done. There were 2-3 questions that were outright guesses and there were a large number that had been carefully answered with logic because I didn’t definitively know.
I figured I had broken 500 and definitely not gotten an 800, but anything beyond that was open to speculation. As 560 was needed for passing, I was a tad nervous when I hit the button to conclude the exam.
Obviously I passed. I said so yesterday and you can bet your bottom dollar that I wouldn’t be talking about it if I hadn’t passed. While I’m not going to share my score, I will say that I didn’t squeak by with a sub-600 score. I figure that once you get above 600 that the luck factor is pretty much gone and that there is some knowledge guiding your selections.
This exam, even though I passed, was hard. There were a lot of terms, concepts, and best practices that while I use in practice, I don’t always use the same semantics.
The “easy” questions were the ones in domains that I had the most experience. As easy as those questions were to me, I know that there are people who will take this exam who will think the questions I considered easy to be hard. This should also work in reverse.
It is this realization that makes me think that the exam has real validity. If all the questions were hard and vague, or there were randomly dispersed easy questions, that would be a concern. The challenges I had were exactly the ones I expected to have when I entered.
What does this mean? It means I’m a Certified Information Professional of course.
Seriously though, I’ll tell you right now that if I meet another one, I know that either they did a LOT of studying or have a lot of battle scars. Likely both. Just studying will be hard if you don’t have experience. The topics are so broad that covering each in enough detail to be sure you will pass will be a challenge.
Is the exam perfect? No, but no exams are perfect. It is a version 1.0 as well. The exam does meet its purpose though. The the exam will evolve over time as the role of the Information Professional evolves and our codification of the body of knowledge continues.
The thing that I think gives this certification real legs is the Continuing Education component. Taking another page from the Project Management Professional (PMP) certification, to maintain your status, you have to keep learning. You have the option to just retake the exam every three years, but continuing education is both cheaper and easier on your blood pressure.
This means that in four years, if I am still certified, you will know that I have at least been active in the space, continuing my education.
It really comes down to this. Would I give preferential consideration to someone with their CIP versus someone without it? If it is for a non-developer role, definitely. Would I require it? In a few years, after the certification has been disseminated, I will absolutely require it of my Project Managers, Functional Leads, and Architects.
I will also start telling people now that if they want to move from the tactical/technical roles to the positions that are involved in the strategic and design decisions, then preparing for the CIP will help them begin that journey.
[Edit: Read Kevin Parker’s thoughts on his becoming a CIP from November. Patrick Cunningham took the CIP cold and reviewed the exam like I did when it first came out as well.]
12 thoughts on “Certified Information Professional, A Valid Measure”
“…the gap that it is aiming to fill…”
I see what you did there!
Dude, I swear it wasn’t intentional.
Thanks for this Laurence. This assuages some of my concerns.
Having said that, it’s probably best that I go and check this out for myself.
Mark, it’s going to take a large number of us to reach a consensus before the CIP has real value over just my perceived value. I added the links to the bottom to the two other reviews that I could find. I definitely think it is worth people checking out.
The other side is that feedback needs to be generated and collected to improve the certification. We need to make sure that it never becomes a “memorize X” in order to pass exam and that it does evolve.
I wonder what the first PMP cert was like.
Yeah, I’m interested in the consensus and feedback aspects both so I’m going to come at it from a different angle using one “like” exam (in my mind) from the many I’ve taken in the past.
In 1996 when the CDIA exam first came out I sent my top three guys to the training then scheduled the four of us for an exam. The night before the test by unfortunate coincidence I spent the whole night in the office working on a technical recommendation for a client. I then spent an hour in the conference room that morning, having them brief me on the training and then we went and took the test, me going in largely cold like yourself. Of the four of us I got the second highest score. My #2 was pretty burned about that.
My point? It goes to your comments about experience which will be my feedback to AIIM after I take the test because, as regards my second point, it’s been my experience on virtually every vendor certification I’ve ever taken out there (FileNet, IBM, Microsoft, Oracle) that the definition of the “correct” answer is “What is the answer they want?” And I don’t always agree with that answer, but I’m going to give them the answer they want to pass the test and not waste my certification fee both.
Sooo… I’ll watch the videos, take some notes, review them, then go in, see how I do and then we’ll go from there. Probably give AIIM feedback pre and post-test.
The first PMP cert? I dunna know, but I know someone who does and who’s still a PMP to this day so I’ll ask her and then I’ll get back to you.
What does a score of 560 mean? Is each question worth ten points, so that we only need 56% correct?
No. It isn’t scored like that. The max score is 800 and as some answers have multiple correct answers, you can get partial credit. I don’t know the details mechanics.
Thanks… So a passing grade of 560 is basically 70% of the possible 800. That’s what I was curious about.
Maybe 70%, not sure of the exact math. I wasn’t involved in that process. That is a lot closer to correct than 56%.
Comments are closed.