Survey-style measurement of IT isn’t effective, a ‘rigged lottery’

<div></div> <article id="post-2699738" class="border-top clearfix article-wrapper post-2699738 post type-post status-publish format-standard has-post-thumbnail category-big-data category-cloud category-enterprise tag-algorithims tag-artificial-intelligence tag-category-business-industrial-business-operations tag-category-computers-electronics tag-data-analytics tag-electronic-health-records tag-machine-learning tag-natural-languate-processing tag-salesforce vb_post_designations-homepage has-thumbnail"> <aside id="" class="MainBlock__sidebar"> <div class="vb_widget widget sidebar-widget-featured-event"> <h2 class="widgettitle">Transform 2021</h2> <p class="sidebar-widget-featured-event-description">Elevate your enterprise data technology and strategy.</p> <p> July 12-16</p> <p> <a href="https://venturebeat.com/event/transform-2021/register/#?utm_source=vbhouse&utm_medium=sidebar&utm_content=vbregistration&utm_campaign=elavate" rel="noopener" target="_blank" class="sidebar-widget-featured-event-cta">Register Today</a> </div> <div id="browsi_left_margin"></div> </aside> <p><!-- #secondary .widget-area --></p> <div class="article-content"> <div id="boilerplate_2682874" class="post-boilerplate boilerplate-before"> <p><em>Where does your enterprise stand on the AI adoption curve? Take our <a href="https://forms.gle/FUMFWyRoE7BqoskeA" data-type="URL" data-id="https://forms.gle/FUMFWyRoE7BqoskeA" target="_blank" rel="noreferrer noopener">AI survey</a> to find out. </em></p> <hr class="wp-block-separator is-style-wide"> </div> <p><i>This post is by Yassine Zaied, chief strategy officer at Nexthink  </i></p> <p>“I feel like my job performance is based on a rigged lottery.” That’s what the director of end user computing at a large European bank told me two weeks ago. Every quarter, her company runs an NPS (Net Promoter Score)–style survey asking employees about their IT experience. If you work in a corporate setting, you’ve probably seen these questionnaires before:<br /><i>How would you rate your IT department?</i><br /><i>0 (very dissatisfied)–2–3–4–5–6–7–8–9–10 (very satisfied)</i><br /> The director went on to say “The response rates we receive rarely exceed 10%, and yet our leadership still judges us heavily on this data. It’s a sham, but what can we do?” Anyone in the field of research could tell you, those who do respond to this type of prompt most likely have negative feedback and see the survey as an opportunity to air their grievances.</p> <div id="ac-lre-player-ph"> <div id="ac-lre-player"></div> </div> <p>When it comes to IT, employees often think in very personal terms. They take a negative experience — a slow VPN connection, for example — and they attribute that one instance to the performance of their entire IT experience. On the surface, the problem the director described appears to be about unhappy users and a shoddy survey, but if you dig deeper, it’s always the same issue at play: Most IT teams are not <em>comprehensively</em> measuring and managing their employee experience.</p> <p>Is a quarterly or monthly survey enough to gauge sentiment? Especially if your response rates are low? Surely there must be a smarter way.</p> <h2>No index, no baseline, no sanity</h2> <p>I see an immense amount of pressure being placed on end-user computing leaders to deliver fast, reliable digital environments for employees. But direction from the top is rarely based on reality, or the closest thing you can get to reality: indexing.</p> <p>How many industries rely upon some sort of index to help rate and track success? If the Human Development Index (HDI) can tell us what the average standard of living, health and knowledge in a country is, and the <a href="https://www.investopedia.com/terms/s/sp500.asp">S&P 500</a> can tell us the health of the U.S. stock market, then why can’t IT measure an organization’s overall Digital Employee Experience?</p> <p>I recently spoke with a friend who works as the IT manager at a high-growth U.S. SaaS company. He told me that his team dedicates dozens of hours of work based on the whims of the department’s technology leaders. “You’d be amazed how many multimillion-dollar IT initiatives are based on gut feelings,” he explained.</p> <p>I sensed his frustration came mainly from not having a single source of truth to work from. He explained, “It’s like the goal posts keep being moved on us.” His team feels pressure to fix a problem, they respond, but they don’t know what impact their work has across the user base. “Tomorrow could be a new priority and a new definition of success. That’s a crazy way to work.”</p> <h2>Taking back control</h2> <p>Far too often IT teams can get lost in their own technical metrics, unable to gauge what the average employee might be experiencing from a technology perspective. The strange thing is that we know a strong digital work experience contributes to business benefits like <a href="https://www.cmswire.com/employee-experience/is-your-workplace-aligned-with-your-recruitment-and-retention-goals/">longer employee retention</a>, organizational <a href="https://www.computerworld.com/article/3618001/how-to-create-a-digital-workplace.html">resiliency</a> and <a href="https://www.salesforce.com/blog/employee-experience-and-customer-experience-for-revenue-growth-2/">higher revenue</a>, but the crux of the matter lies in that first part.</p> <p>How can IT even quantify an experience?  Indexing can help. If you compile the right mix of real-time technical data and employee satisfaction feedback, you can set a baseline that forces your department to live closer to reality and work off the same script. Your focus needs to be on understanding, as accurately as possible, each employee’s full digital work journey. You can measure and set a technical performance index score based on each employee’s device, business applications, connectivity, and productivity and collaboration tools—that will tell you the employee’s technical reality.  Then you can combine that information with user feedback that is <a href="https://hbr.org/2016/02/a-refresher-on-statistical-significance">statistically significant</a>.</p> <p>How do you collect statistically significant data?  Boost response rates from employees by sending them smart onscreen push notifications at the right time and in the right context. For example, if an employee is completing a particular transaction, say in MS Teams, and you want to receive feedback, ask a question immediately after they complete that transaction, not before or hours later.</p> <h2>Building an ‘experience’ culture</h2> <p>After I finished speaking with my friend in the U.S., I started thinking about a lesson from my old MBA professor at IMD Switzerland that has stuck with me all these years. The professor used to lecture the class on the difference between running a quality control <i>procedure</i> versus a quality control <em>culture</em>.</p> <p>A company that operates under the former typically runs quality control checks and feedback after they’ve finished the work. That practice is far inferior to a quality control culture where a company runs real-time quality checks on every conceivable step in the production process, to the point where <i>continuous improvement</i> becomes embedded in the company’s culture and becomes part of its DNA.</p> <p>The example that always comes to mind is the famous Six Sigma business philosophy. And that’s the same approach IT needs to take when it comes to Digital Employee Experience.</p> <p>DEX is too important to manage by only running a brief survey every now and then on a small user group. You should measure it factually, based on sound technical metrics and sentiment data, and at every step of your employee’s digital journey. And whether it’s a major IT initiative or a day-to-day project, everything in your IT department should be judged and compared to the same overarching index or score.</p> <p>Otherwise, what’s the point of all those hours enterprise IT dedicates to solving their company’s digital experience problems if the work isn’t being measured and treated in the same way?</p> <div id="boilerplate_2660155" class="post-boilerplate boilerplate-after"> <h3>VentureBeat</h3> <p>VentureBeat’s mission is to be a digital town square for technical decision-makers to gain knowledge about transformative technology and transact.</p> <p>Our site delivers essential information on data technologies and strategies to guide you as you lead your organizations. We invite you to become a member of our community, to access:</p> <ul> <li><span style="font-weight: 400">up-to-date information on the subjects of interest to you</span></li> <li style="font-weight: 400"><span style="font-weight: 400">our newsletters</span></li> <li style="font-weight: 400"><span style="font-weight: 400">gated thought-leader content and discounted access to our prized events, such as <a href="https://events.venturebeat.com/transform2021/"><strong>Transform 2021</strong>: Learn More</a></span></li> <li style="font-weight: 400"><span style="font-weight: 400">networking features, and more</span></li> </ul> <p><a class="membership-link" href="https://venturebeat.com/venturebeat-membership-plans/">Become a member</a> </div> <p><!-- Boilerplate CSS for "after" --></p> <style type="text/css">.article-content .boilerplate-after { background-color: #F5F8FF; padding: 30px; border-left: 4px solid #000E31; line-height: 2em; margin-top: 20px; margin-bottom: 20px; }</p> <p>.article-content .membership-link { background-color: #000E31; color: white; padding: 10px 30px; font-family: Roboto, sans-serif; text-decoration: none; font-weight: 700; font-size: 18px; display: inline-block; }</p> <p>.article-content .membership-link:hover { color: white; background-color: #0B1A42; }</p> <p>.article-content .boilerplate-after h3 { margin-top: 0; font-weight: 700; }</p> <p>.article-content .boilerplate-after ul li { margin-bottom: 10px; }</p> <p>@media (max-width: 500px) { .article-content .boilerplate-after { padding: 20px; } }</style> </p></div> <p><!-- .article-content --></p> </article> <p><!-- #post-2699738 .article-wrapper --></p> <p>The post <a rel="nofollow" href="https://patabook.com/technology/2021/06/24/survey-style-measurement-of-it-isnt-effective-a-rigged-lottery/">Survey-style measurement of IT isn’t effective, a ‘rigged lottery’</a> appeared first on <a rel="nofollow" href="https://patabook.com/technology">Patabook Technology</a>.</p>

source https://patabook.com/blogs/99552/Survey-style-measurement-of-IT-isn-t-effective-a-rigged