Analyze On-site Messaging Campaigns

The Campaign Analytics page, visible to you when you open an onsite messaging campaign from the All Campaigns page or when you publish a campaign, can be used to visualize the performance of your campaign.

Campaign Analytics

The following sections describe the various components of the campaign analytics page of an Onsite Messaging campaign.

Aggregate Campaign Stats

This section represents the aggregated campaign metrics for the selected date range, platform, and attribution type.

• Impressions - Number of times a message from this campaign was shown.
• Clicks - Number of times a message from this campaign was clicked.
• CTR - Click through rate, calculated as CTR = Clicks / Impressions
• Close - Number of times a message from this campaign was closed.
• Conversion Events - The total number of conversion goal events executed by all converted users. The number will vary as per the attribution type selected.
• Conversions - Total Number of times the primary conversion goal was performed after an impression/click of this campaign’s message. The number will vary as per the attribution type selected.
• CVR - Conversion Rate, calculate as CVR = Conversions / Impressions.
• Attribution Type - To attribute conversions to this campaign, we support three different models as below -
  • View Through : Conversion event was performed after viewing the message.
  • Click Through : Conversion event was performed after clicking the message.
  • In Session : Conversion event was performed within 30 minutes of viewing the message.
• Attribution Window - Time period for which conversions will be tracked after impression or click as per the attribution type.

Campaign Revenue

You can now define a revenue attribute along with your primary conversion goal while creating an on-site messaging campaign as shown below -

Once defined, you will be able to see the below metrics on the campaign analytics page which will tell you the exact revenue that your campaign is driving.

• Total Campaign Revenue - This represents the total revenue generated through this campaign.
• Average Order Value - Average order value represents the average value of conversions through this campaign. Average Order Value = Total Campaign Revenue / Total Conversion Events.
• Average Revenue Per Converted User - This represents the total revenue generated by each user who performed the conversion event. ARPCU = Total Campaign Revenue / Total Conversion

Please note that you need to set the revenue attribute in your conversion events to be able to see these revenue information in campaign analytics.

Campaign Performance

This section helps you visualize the time series data of how the campaign metrics have varied over time.

Impressions, Clicks, Conversions and Conversion Events are similar to the ones mentioned in aggregate campaign stats. The time scale is represented as per your app timezone.
Change the date range selection, attribution type and platform from the top header. You can also switch to the table view from top right corner to see the time series data in a table.

Periodic Campaigns

The campaign performance section contains information about the performance of the parent campaign. The stats for the child campaigns are available in the Child campaign performance section. You can view the analytics of each of the child campaigns by either clicking on the icon beside the recurrence or by switching to the table view and clicking on the Recurrence field in the table, as depicted below. The child campaign analytics and info that opens in a new tab from the Recurrence tab cannot be edited, paused, or duplicated. However, you can do the same from the parent campaign.

Conversion Goals Stats

This section helps you visualize the performance of each of your conversion goals. In your onsite messaging campaigns, you can now add up to 5 conversion goals and view the performance of each conversion goal in this section.

Here, the goal marked as (Primary) is the primary conversion goal. In the previous sections, only aggregates of the primary conversion goal are listed, whereas in this section, you can view the performance of each conversion goal.

The cards in the top left corner of this section also list the performance of the primary conversion goal, which is also considered the primary indicator of the campaign’s performance. Switch to a time series view from the top right corner.

Campaign Delivery Stats

This section outlines various campaign delivery failures and their reasons.

Errors are categorized under the following headings:

• Selection Failure: This failure occurs when the on-site message is not selected. This can happen due to one of the following reasons:
  • Higher priority campaign available: The campaign was not selected for display because a higher priority campaign was available. You can set the priority as critical while scheduling for delivery to make sure the campaign is selected over all other campaigns. For more information, refer to Scheduling and Goals.
  • Maximum times shown: The campaign was not selected for display as this was already shown for the maximum number of times. For more information, refer to Scheduling and Goals.
  • Minimum delay conditions: This campaign was not selected because it was shown within the minimum delay time frame specified in the campaign. For more information, refer to Scheduling and Goals.
  • Global delay condition: The campaign was not selected because another campaign was displayed earlier within the global delay timeframe. For more information, refer to Scheduling and Goals.
  • Campaign expired: The campaign was not selected because it was expired.
• Delivery Failure: This failure occurs when the on-site message is not delivered to the user. This can happen due to one of the following reasons:
  • API failure: The campaign delivery failed due to an API failure.
  • Personalization failure: The campaign delivery failed as the attribute used for personalization is not available for a specific user. For more information, refer to Personalization of OSM Content.
  • Campaign paused: The campaign delivery failed because the ongoing OSM campaign was paused.
  • Missing parameters: The campaign delivery failed due to missing parameters in the campaign.
• Display Failure: This failure occurs when the on-site message is not displayed. This can happen due to one of these reasons:
  • Another campaign visible: The campaign was not displayed because another campaign was already displayed at the same time.
  • URL changed: The campaign was not displayed because the user changed the page while the campaign was being rendered.
  • Website closed: The campaign was not displayed because the user closed the website before the specified delay for displaying the message elapsed.

Form Inputs

Navigate to the Form Inputs section in your dashboard to view any responses submitted by users when they interact with your campaign, which may consist of surveys or any template with input fields.

You can view the following details:

• • Locales - The Locale is set to default, but you have the option to modify it by selecting from the dropdown.
  • Variations - Select the specific variation from the dropdown to view the corresponding metrics.
  • Total rows - Total number of users who submitted a response.
    You can filter the users from the dropdown based on the following attributes:
    • User ID
    • Name
    • Email
      

• • The response for each user attribute is listed in the adjacent column. For instance, a user with the ID “x1z2y3” might use “[e-mail]” as their email address and submit their response. The analytics page will display the user ID “x1z2y3” and their corresponding response “[e-mail]” when you select User ID from the dropdown. Similarly, when you select Name or Email from the dropdown, the analytics will display the name or email of the users and their corresponding responses.

    • Responses will be shown together for both iOS and Android. You will not be able to filter responses based on the platform. If you want to view separate data, enure that you track different attributes for iOS and Android.
    • The Form Inputs table will display a maximum of seven attributes.
      If you want to view all the attributes, follow the steps below:
      1. Navigate to the MoEngage dashboard > Segment > Create segment.
      2. In the Filter users by tab, select the User behavior and add the Has Executed event as Response Submitted.
      3. Specify the event’s time range and campaign ID to obtain a more precise user count who have submitted a response to the campaign.
      4. Click Show count to analyze the result.
      5. Under Query Results, you’ll see the number of users who’ve submitted a response to the campaign.

  • You can also download the CSV file containing the user responses.

    
    You can only select a maximum of 10 attributes to export. Use date range, locale, and variation filters for more specific data.

Click Analysis

To understand exactly how your end-users are interacting with your on-site message, click the Click analysis tab.

A summary of click metrics is displayed at the top.

The Clicks breakdown table contains the click metrics for the actions for each widget in the on-site message. You can export the table using Download CSV.

The filters at the top allow you to filter the results by date, locale, variation, or platform.

To create a segment of users who have clicked a widget, click the ellipsis icon and click Create segment. On the Create segment dialog box, you can save the segment or take further action. Actions include creating a new campaign or analyzing this segment.

Campaign Info

You can view the following information on the Info tab:

• Preview of the notification along with the campaign’s priority
• Segmentation Criteria for the Campaign
• Trigger Action: How and When will the campaign be triggered
• Goals: Conversion goals associated with the campaign
• Project ID: The unique identifier for the project associated with the campaign. This field is available only for campaigns created in a Portfolio-enabled workspace.
• Timing: The campaign’s delivery schedule will be available here. In the case of periodic campaigns, the periodicity, the campaign’s active window (the time period when the campaign will be shown to the user during its scheduled run), start time, end time, next run, and timezone information will be available.
• Delivery Control: The campaign’s delivery controls, such as the number of times the campaign will be shown, global delay settings, minimum delay time between campaigns, and auto dismiss settings, will be shown.

FAQ

Why Do Certain Devices Fail to Render an OSM?

Problem

During testing, one of two identical devices successfully received the On-site Messaging (OSM) campaign, while the other failed to render it.

Solution

The OSM may not appear on the second device because an installed ad blocker is preventing it from rendering.

MoEngage cannot bypass the ad blocker to display the OSM on the device.