Posted on Leave a comment

What’s So Hard About Playing with Numbers?

By Dianna Renz, Director of Planning and Improvement, Western Wyoming Community College

Woo-hoo! Rock on! There it is: the happy dance you do when you’ve completed a major reporting project! This is the feeling of satisfaction you get for a job well done. A competent smirk arrives when you’ve successfully built the query and it spits out the information you need. There’s a definite thrill when you put a number in each and every cell in the reporting template. Take it one step further and you can feel the creative high of building pivot tables to discover the fascinating details of your data. With this information you can uncover important information for your stakeholders, which you present in a colorful chart. This is the lovely part of Institutional Research that fulfills the “OCD” in the heart of—and inspires the artist in the soul of—each IR practitioner. This is what makes it all worthwhile, but this is not the difficult part.

No, the difficult part of the Institutional Research field is not the act of doing it. The hard part of the job is serving multiple masters with competing deadlines and agendas. When VFA, CCA, and NCCBP are all due in the same month, how do you divide your time? And where do you prioritize an internal request from the math department for a longitudinal study of student matriculation and success? What about the feeder institution that keeps begging you for information about students who transfer to your institution? Oh, and don’t forget the ad-hoc request from the state legislature!

What is the use of completing reporting efforts if we cannot use the information returned to us? Delving into the data is the fun part; the challenge is finding the time to conduct this critical exploration. Our office has made a commitment to use the data derived from mandatory reporting for other efforts. Using nationally- or state-normed data for comparison to institutional numbers is an excellent approach to inform strategic action projects, and to assess existing initiatives. Our Assessment of Student Learning Team uses CCSSE data, for example, as a qualitative assessment of student learning gains. Our Building Student Connections Team uses math and English pass rates from NCCBP as a quantitative assessment of retention and completion efforts.

Sharing new approaches at the annual RMAIR conference is an exciting part of the job. Presenting at RMAIR means selecting something you’ve done well to showcase for the greater good. What we don’t share are the messy conversations we have with our internal and statewide colleagues regarding the sticky subjects of common coding, extract validation, data integrity, and faulty BI reporting. Research shows there are as many as 250 different ways to wash the dinner dishes, and there are certainly as many varied approaches to institutional data standards and extraction methodology! As I’ve learned from Wyoming’s effort at common coding, reaching agreement among practitioners is often difficult.

But it’s no wonder that we struggle to reach consensus: Institutional Research is still an uncategorized field. Although I’ve learned that some folks have served in IR for over 30 years, there still does not exist a recognized degree in the field (graduate-level certificates do exist, but institutions are divided on whether the certificate is offered through the School of Education, the School of Psychology, or the School of Business). As a result, the strength of this field is that current practitioners have arrived from a wide variety of backgrounds. I know of individuals with degrees in math, psychology, astrophysics, library science, business, and English, just for example. As IR offices are increasingly connected with other institutional effectiveness efforts like assessment and accreditation, this vast experience serves us well, as quality IR is both a science and an art.

In truth, the work we do is critical for the greater success of higher education and student learning, but this charge is not to be taken lightly. Although the thrill is there, our work is NOT just about filling in the boxes of a reporting template. Using information for the lofty goal of continuous quality improvement is both valid and necessary. We must, then, continue to use all our resources to do the work of finding The Answer, but not creating the answer; serving multiple masters, but remaining true to the spirit of inquiry; and sharing successful approaches while always practicing “virtuous data politics.”*

*This succinct phrase borrowed from a discussion on “the Dark Side of Data” at the 2015 RMAIR conference. If you missed this conversation, you really missed out!

What do you find are the most enjoyable parts of your job as an IR professional versus the most challenging? What is your perspective on the practice of “virtuous data politics?”

Posted on Leave a comment

RMAIR 2015 In Review

By Jeff Johnson, Assistant Director of Institutional Effectiveness & Planning, Utah Valley University

“Dear God, please don’t let me screw up.”
—Test Pilot’s Prayer, attr. to astronaut Alan B. Shepard, Jr.

I am quite pleased to say that, thanks to some combination of divine grace and an outstanding team of institutional research professionals, I’ve managed to not screw up RMAIR during my year as president. It has been a very successful year for the association, with many accomplishments to celebrate.

Our annual conference is the focus of RMAIR’s efforts, and this year’s was outstanding. Nearly 100 paid attendees met in Las Vegas earlier this month, the most in recent memory. A fascinating keynote from Stephen R. Porter on the validity and future of student surveys led off a program of 34 presentations organized by program chair Serge Herzog. Local arrangements chair Theresa Farmer’s stellar work on the venue and logistics gave RMAIR members plenty of opportunities to rekindle old relationships and make new connections, and kept costs much lower than we expected. Thanks to the wonderful work of sponsorship chair Tondra De, we raised $16,900 from sponsors. While the final bills aren’t in, we expect to make at least $5,000 on the conference in spite of not charging membership fees this year. I can’t thank enough Theresa, Tondra, and Serge, along with Christina Drum, Mya Starling, Andrea Esguerra, and Mike Ellison for what they did to produce a successful conference.

We have had great financial success as well. We expect the conference to make between $5,000 and $8,000 for the association after all is finalized. That will leave us with approximately $30,000, consistent with our goal of having a reserve of between 1.5 and 2 times the typical conference costs. Working with treasurer Quinn Koller, we have also put in place streamlined processes for financial management of the conference that should allow our success to continue while easing the administrative challenges.

Our previous financial success allowed us to offer free membership this year. That has brought in several entirely new members as well as maintaining membership of many previous members who would not have joined this year because they were not attending the conference; historically very few people have paid membership dues when they weren’t attending. The board has thus decided to continue to offer free membership for 2015-16.

I am pleased especially to have been able to honor several members this year. Thanks to a partnership with AIR, we were able to match our grants with AIR Travel Grants. Serge represented RMAIR at the AIR Forum as the best paper. We also awarded the best presentation grant to Stephanie Kane and Fran Hermanson. We didn’t award any Train the Trainer grants, however, so I encourage you to consider applying for 2016.

The board continued its work to implement the strategic plan while also rethinking its place in the organization. Vice President Joe Curtin implemented the outreach elements, targeting especially institutions with graduate programs in higher education. Incoming Vice President Dianna Renz will be reaching out to IR offices that are not currently involved in RMAIR, building on work done last year by Mya Starling. This coming year we are due for a new plan. This will be informed by our experience with the existing one and will aim to be more realistic about our capabilities and commitments.

Our future will also need to recognize, however, that RMAIR is in a changed environment in which our history of informality is challenged by increasing regulation and a transfer of much of the legal and financial responsibility for the association from AIR to us. Banking regulations designed to prevent terrorist financing and laundering of drug money require us to demonstrate that any change in the account holders is consistent with the bylaws; hence the importance of bylaws that clearly define election rules in ways that will be accepted by courts and lawyers, not just our members. Non-profit status and incorporation are necessary to protect the organization and its officers—it would have been quite easily for officers to have accidentally committed tax fraud before we gained 501(c)(3) status.

The bylaw review has identified several areas in which we will, of necessity, have to change in ways that we aren’t all comfortable with. The contemporary world leaves us with only the alternative of not existing. The board will be working on this in the coming year, and will seek input from and will communicate fully with the members as we do. It is the greatest challenge that RMAIR faces right now. I ask your patience and understanding as we continue this process.

These are only a few of our accomplishments. I can claim little credit for them; they happened on my watch but they happened because we have exceptional people in RMAIR. I am humbled to have worked with such an effective board over the last year: Joe, Quinn, Secretary Tammy Scott, and Past President Ann Murray. I also relied heavily on the generous advice of two former RMAIR Presidents, Nick Valcik and Dawn Kenney. I am pleased to welcome Dianna to the board as Vice President and President Elect. I have great confidence in the coming year’s leadership, and wish all of us continued success.