Summary

In this scenario the IT team have just completed some improvements to their network. The end-user computing (EUC) manager uses Experience to gather some continuous feedback to see if the improvements have made a difference to the end-user's experience of their service. This is done using a daily survey that gathers responses that contribute towards the Sentiment score, enabling progress and improvements to be monitored over time.




Creating a new User Sentiment Survey

The Experience->Surveys page is where you manage all the User Sentiment and General Purpose Surveys that have been created in Experience. You can easily see for each Survey the Question and Options that it has been configured with, what Management Groups it has been assigned to and whether it's Enabled or not. In the picture opposite you can see the initial state where no Surveys are currently defined, as would be the case for a newly implemented Tachyon system.

Click the New Survey button to begin.

An empty Survey page

User Sentiment or General Purpose Surveys?

The first choice you face is whether to create a User Sentiment or a General Purpose Survey. 

If the EUC manager wanted to create a one-off Survey to gather some user feedback due to a particular event without wanting to monitor the results as part of an ongoing assessment of user experience they would likely choose a General Purpose Survey. The responses for General Purpose Surveys can be modified to a larger extent than User Sentiment Surveys making them great for doing an arbitrary quick poll, but they don't contribute to the Sentiment Score and therefore cannot be monitored over time. For more information on General Purpose Surveys please refer to Getting feedback via General Purpose Surveys.

User Sentiment Surveys are more limited than General Purpose Surveys in the range of possible responses you can select from but this also means they can be consistently measured and reported on. In our scenario the EUC manager wants to create a Survey that contributes towards the Sentiment score they'll be able to monitor from the Experience Overview page, this means they need to create a User Sentiment Survey.

Selecting the Survey Type

Names, Questions, Descriptions and Responses

Having selected the User Sentiment Survey type the next steps are to set a Name for the Survey, the Question and Description that will frame the purpose of the Survey and the range of Responses that will be allowed.

The Name for the Survey will be stored as a metric that Experience can then report on. This Name must be unique amongst all of the metrics that are used by, or have been defined for Experience. In this scenario this is set to Network Performance Survey. But, be aware that Network on its own could not have been used as the Name, as this is already a metric that Experience reports on.

The Question frames the meaning and purpose of the Survey, if the question you choose has not been thought through carefully you will likely confuse your end-users and skew the results. You should also consider the responses you are setting for the Survey as they should relate directly to the question. For example, if, like in our scenario, you choose Visual Rating 5 - which gives you five options ranging from Very Good to Very Poor - you would have problems if your question was: Is your network performing badly? How would you map that question onto the range of chosen responses? Here the question text has been defined as: How would you rate your network connection? You can see how each of the possible responses could be a suitable answer, so this seems an appropriate question.

The Description lets you provide some additional context for the question, and can be used to engage the end-user and provide some guidance as to how the question should be considered. Here the Description is defined as: We've recently made some improvements to the ACME network and wanted to get your feedback on how it's performing for you. This sets the scene for why the question is being asked and gives a small indication on how it could benefit the end-user. The Survey is part of a process for improving the performance of the network and the user's response could help in that process and encourages them to work with the IT department. This aspect of the Survey is subtler than determining the question but can still be important in terms of encouraging the maximum number of responses possible.

As mentioned earlier, the Responses must be closely linked with the Question text and you will likely need to adjust both before you get a suitable fit that is obvious, simple and effective.

For User Sentiment Surveys, you can choose a range of 3 or 5 responses and they can be displayed with several sets of icons or just numbers. You can't change the text of the Responses or the order. Limiting the Responses in this way enables the Survey to be measured consistently and contribute to the Sentiment score and ultimately forms a part of the overall Experience score.

General Purpose Surveys let you choose a greater range, edit the response text and select from a wider palette of colors and icons. But, because of that flexibility, they cannot be measured consistently and therefore cannot contribute towards the Sentiment score and have no bearing on the overall Experience score.

The Allow free text entry checkbox gives the end-users the opportunity to qualify their responses by typing in any text they feel would help clarify their choice. This does not contribute towards the score but can be invaluable in helping you to interpret the results of the Survey. In our scenario the EUC manager chooses to let the responses speak for themselves and leaves the box unchecked.

Creating a new Survey

Setting a Schedule for the Survey

The final configuration option lets you select how often the Survey will be presented to the end-users. We've mentioned that User Sentiment Surveys are a way of assessing progress or change from the perspective of the end-users. They are part of a continuous process and the Schedule determines how often data points are taken in order to measure the process. By repeating the question, end-users get the chance to change their responses according to the ongoing performance. But timing is critical, set a schedule that is too often and the end-users may get tired and not respond as often as you would like. Set a schedule that is too seldom and you may miss out on some changes that occur between polls.

In our scenario the IT department has just made the improvements to the network, and they are keen to get immediate feedback on how those changes are working and how the systems are adjusting to the changes. So the EUC manager sets the most frequent Schedule of prompting the question every day with the view that as the changes mature the Schedule for the question can be adjusted to a larger interval.

Saving the new Survey

When you're happy with the settings you've made in the Survey editor you can click Save to commit the changes and allow the New Survey to go to the next phase.

Enabling the new Survey

Initially after having saved a new Survey it will not be enabled. Before it can be deployed it must first be enabled, so providing an additional gateway that prevents the Survey being sent out too soon before it's ready.

To enable one or more Surveys select the checkbox at the left-hand end of each Survey's entry in the Surveys table and then click the Enable Selection button.

Enabling the new Survey

Doing this displays an Enable Survey confirmation popup that you must acknowledge before the selected Survey or Surveys are actually enabled. Click Yes to confirm the operation and No to cancel it.

Enabling confirmation popup

Deploying the new Survey

So the new Survey has been enabled, it can now be sent to the end-users' devices by clicking the Deploy button. When a Survey is created, the Management Groups parameter defaults to All Devices. This means that clicking Deploy will send the Survey to all the devices currently and subsequently connected to Tachyon.

The Deploy button will send out any changes to the states of the Surveys - meaning you can also use it to set previously deployed Surveys to not Enabled, thereby preventing further responses without completely deleting the Survey, or you can delete Surveys when they are no longer needed. You should be aware that the Deploy button will also send any other Experience Survey administrator's changes as well as any pending Guaranteed State changes.

It's good practice to test the Survey on a few machines first before deploying to All Devices. This lets you see how the Survey will appear to your end-users and gives you the opportunity to debug the text and selections before deploying to a wider audience. Doing this involves assigning a different Management Group to the Survey that targets the selected devices.

In our example, which only involves a few devices anyway, to keep things simple we can get away with sending the Survey out without testing, so the EUC manager clicks the Deploy button.

The new Survey enabled

A Policies Deployment popup appears that shows the changes that will be deployed when the Yes button is clicked. The EUC manager reads the list carefully, sees that the only changes are the ones related to creating and enabling the Network Performance Survey and clicks Yes.

Deploying the enabled Survey

Subsequently a notification appears showing that the policy changes are being applied to the Tachyon Agents.

Deploying confirmation popup

Monitoring the new Survey

So the Survey has been deployed, you will likely want to monitor its responses as they occur. In our scenario, the EUC manager clicks on the Network Performance Survey link in the Name column for the Survey in the Surveys table, to display the responses page for that Survey.

Monitoring the newly created Survey

What the end-user sees

When the 1E Client is installed on a network device, by default it also adds an icon the notification area called 1E Client User Interaction (1E Client UI). Initially this may be hidden, but may be dragged onto the taskbar to make it always visible. When an end-user clicks on the notification icon they will see any Surveys that have been deployed to the device.

In our scenario the end-user Gary Hayes clicks on the 1E Client UI notification icon and sees the newly deployed Survey waiting to be answered. They see both the question and the description text that was defined as part of the Survey.


The following 1E Client 5.1 settings are used to configure the behavior of the 1E Client UI. If you click on a link, it will take you to the 1E Client 5.1 documentation space. 



An end-user viewing the deployed Survey

Submitting a response to the Survey

Clicking on the text of the Survey question displays the range of responses that can be made.

Gary Hayes is happy with the way that the network is currently performing, so he clicks on the Very Good response and then clicks Submit.

The end-user selecting their Survey response

Viewing Survey responses

Pretty soon after Gary Hayes has submitted his response, the EUC manager sees it appear in the Experience interface.

The first Survey response recieved

After a number of responses have been made a clearer picture of the current user sentiment emerges. Here the EUC manager can see that overall the responses have been positive, with 33% being Very Good and another 33% being Good. There are a couple of outlying responses though that might merit some additional investigation.

A number of Survey responses recieved

Viewing the Users page

Now the current set of responses are in, the EUC manager clicks on the Experience→Users page to view how Experience has rated their scores across a range of measurements. Here they notice that one of the users, Oliver Morris, has an exclamation mark showing in the User Sentiment column. 

Checking user sentiments via the Users page

Clicking on the Username link for a user navigates to a page that displays information related solely to that user.  Here the EUC manager has clicked on the link to view the page for oliver.morris. A number of details related to the user are displayed, the Metrics tab and the User Sentiment score are of interest here - particularly the exclamation mark displayed.

Selecting a particular user

Viewing the user's Sentiment Survey responses

Clicking on the Sentiment tab displays the history of Survey responses made by the user. For Oliver.Morris their response to the How would you rate your network connection? Survey was to rate it as Very Poor. This is an interesting outlier for the Survey responses and warrants further investigation, especially given that the other Experience scores for this user are coming back as good.

The EUC manager could click on the User's email and request some clarification directly. Perhaps there was some other cause for the Very Poor rating, such as an accidental response - or perhaps there were other environmental issues that haven't yet come to light. Nonetheless, the manager has been able to investigate the response and is empowered to do something to resolve the user's issue.

Checking the user's Sentiment responses

Adding the new Survey to the Sentiment page

Now that the EUC manager has seen that the Survey is returning the type of information that helps assess how the ACME network changes are affecting users, they would like to have those results figure more prominently and be easier to access. To do this they can add a tile for the Survey to the Sentiment page. By default, the Sentiment page just shows the User sentiment - Latest Score tile, so there's plenty of space available for you to add your own User Sentiment Survey tiles.

Editing the page layout to add the new User Sentiment Survey

You can change the tiles that are displayed on the page by clicking on the Edit Layout button in the page header.

Adding a User Sentiment Survey tile to the Sentiment page

Clicking on Edit Layout opens up the Sentiment Edit mode. Here they can see the tiles that are already displayed on the page as well as the Available Metrics, that is the metrics that can be added to the page. As mentioned earlier the metric that gets added to the system for User Sentiment Surveys is the same as the name set for the Survey when it was created.

The EUC manager can see the User sentiment tile on the left-hand page layout pane, which is the default tile for the Sentiment page, and also the Network Performance Survey entry in the Available Metrics section. To add the new tile they click and drag it from the Available Metrics over on to the layout pane.

Sentiment Edit mode

There are different options for the location of the tile and its dimensions, as described in Adding metrics to a dashboard, here the EUC manager just places the new tile next to the existing one and keeps it at the default size of four squares.

Clicking Save Layout applies the layout to the Sentiment page.

Sentiment Edit mode - The Network Performance Survey added

Changing the tile display

The EUC manager has added the Network Performance Survey tile to the Sentiment page, but it's still not quite displaying the information the way they want to see it. Instead of a line graph, they want to see the latest score for all the 5 possible responses.

The Network Performance Survey tile added

Clicking on the View latest grading button in the tile heading will provide the graphic needed.

Setting the Network Performance Survey tile to View latest grading

So this is the view the EUC manager wanted. Now they need to make it easily accessible after a page refresh or revisiting the site at a later date. To do that they need to save the layout as a Preset, which is done by clicking on the star button in the page header.

The Network Performance Survey tile with View latest grading set

In the Presets popup they add a suitable name for the Preset and click Save.

Saving the Preset

The new Network Performance Survey Preset is added to the page.

The Preset added

Now when they refresh the page it will revert to the default as normal, but they can easily get back to their tailored view by clicking on the Network Performance Survey Preset.

The Preset available when navigating to the Sentiment page

As they create new User Sentiment Surveys, further tiles can be added to this view and stored in the same way, so the EUC manager can keep track of how their users are responding.

The Preset applied

Next steps

Now that you've seen a possible way of using User Sentiment Surveys for capturing ongoing feedback from end-users, you might want to take a look at Getting feedback via General Purpose Surveys to see how one-off Surveys can be created, deployed and monitored in the Experience application.