Table of Contents Previous Next Index

Section 13 Tracking Reports

Section 13 Tracking Reports
Once an email job has been sent and enough time has gone by so that recipients have received and have opened the message, data from selected events can be gathered. This data can be used to generate reports in several ways:
1.
Selecting the Reports option opens the Tracking Reports screen. Each report is displayed with its title and the date and time it was last saved. To execute and view the report, click on the title. To edit the report’s settings, click on the report’s Edit link.
Figure 13-1 The Tracking Reports Screen
Selecting the Completed Job Statistics option generates the Completed Jobs Statistics report. See Section 13. 5 Completed Job Statistics for more information on this report.
Selecting the Delivered Recipients Statistics option generates the Delivered Recipients Statistics report. See Section 13.6 Delivered Recipients Statistics for more information on this report.
2.
The second way is by clicking the Reports link located in the Currently In the System section of the Dashboard. This link opens the Tracking Reports screen.
3.
LISTSERV Maestro can generate several different types of reports with these methods, or data can be downloaded for use in other statistical analysis programs. For quick reports on delivery tests, click on the Test Reports tab on the Job Details screen. For more information on test reports, see Section 9.2 Running Test Reports.
For more information on generating reports, see Section 13.2 Executing Reports.
Tip: In many cases, it is easier to start from one of the quick reports available from the Completed Jobs list, save it, and then make changes using the edit reports pages, rather than starting from scratch.
Note: Once a report is created, it can be added to the Dashboard for quick access. For more information, see Section 2.2.2.1 Adding Reports to the Dashboard.
13.1 Creating Reports
To create a new report or edit an existing report, click Report > New Report. The Define Report screen opens.
Figure 13-2 The Define Report Screen
At the top of the Define Report screen, there are four buttons and a text box to enter the report’s title:
[Copy Settings] – Copies settings from a previously generated report to the new report.
[Save & Execute] – Saves the report and executes the collection of the selected data. A graph or table is produced based on the settings.
[OK] – Saves any selections or entered information such as a title.
[Cancel] – Cancels any settings or entered information.
Below the buttons is a tabbed table. Click on the tabs to toggle between the sections.
General Settings – Defines the time period of the report, including time zone, and team collaboration settings. For more information, see Section 13.1.1 General Settings.
Data Sources – Opens the Data Source wizard, a series of screens that leads the user through the process of creating new data sources. Each data source represents a single variable in the report (a line or bar). For more information, see Section 13.1.2 Adding a Data Source.
Result Settings – Defines the type of report and how the data from the job is displayed. For more information, see Section 13.1.3 Result Settings.
13.1.1 General Settings
The General Settings tab lets you define report period and edit the team collaboration settings.
Figure 13-3 Define Report Screen – General Settings Tab
The Report Period section is used to determine the earliest and the latest points in time that are considered when the events are retrieved from Maestro Tracker.
Automatic – LISTSERV Maestro will determine the time period to fit the registered events. From all the events of all of the jobs and/or URLs that are part of the report, LISTSERV Maestro will set the time of the earliest event as the “From” and the time of the latest event as the “To” values of the time period. If two jobs are selected for tracking, LISTSERV Maestro will select the delivery time of the first received event (open-up or click-through) from either job as the start time, and the time of the last received event from either job as the end time.
Defined Period – User can determine the time period for the report, and make this relative to any time zone.
The Team Collaboration section contains an Edit link that is used to change the existing team collaboration settings for the report. If this link is not active, then you do not have permission to use this feature.
If you have permission to delete reports, then the [Delete this Report] button is active.
13.1.2 Adding a Data Source
Adding a data source is a multi-step process that has to be repeated for each separate variable in the report. To begin defining a data source, click on the Data Sources tab.
Figure 13-4 Define Report Screen – Data Sources Tab
The Data Source Description section lists the defined data sources available for use in a report. Click on the title of the data source to open the Report Data Source Definition screen and edit the selections. Click on the copy link to make a copy of the data source. Click on the delete link to delete the data source.
The [Add Data Source] button opens the Report Data Source Definition screen. This screen replaces the old multi-paged wizard and gives the user a sleek, easy to use, and single-page report data source definition interface.
In the Name field, enter the name for the data source.
To change the color, click on the color swatch in the Color field and select the color from the color palette that appears.
Figure 13-5 The Report Data Source Definition Screen
To add jobs to the report, click on a job in the Available Jobs box and drag it to the Report over these jobs box. Click [Apply] when you are finished.
To remove a job from the Report over these jobs box, simply drag and drop it in the Available Jobs box. Click [Apply] when you are finished.
Tip: It is possible to combine data from different jobs into one report from this screen. Different jobs can be combined into one data source or they can each have their own data sources, depending on what the report is set up to compare.
Figure 13-6 Dragging and Dropping Available Jobs
To include specific job data in the report, click on one of the following options in the Include the following job data section:
Tracking Events – This requires additional information to be defined. See below for details.
Total Number of Sent Messages – This includes all sent messages, regardless of whether the mail bounced or not.
Total Number of Unbounced Messages – This includes the number of sent messages, minus the number of messages that were detected as bounces at the time the report is executed.
Total Number of Bounced Messages – This includes the number of messages that were detected as bounces at the time the report is executed.
When the Tracking Events option is selected, additional information becomes available, letting you choose what tracking events will be included in the report:
You can decide which type of events you’d like to track – Open-Up Events, Click Events, or Action Events, if available.
Note: Action Events are part of the new Action Tracking feature. For details see Section 19 Action Tracking.
For example, if Click Events is selected, then you can select the links you’d like tracked in the report. To do so, simply drag and drop the links from the Available Tracked Links box to the Count only the links below box. If you want to track all of the links, click on the Count only the links below link and select Count all links.
Similarly, if Action Events is selected, then you can drag and drop the links from the Available Tracked Actions box to the Count only the actions below box. If you want to track all of the actions, click on the Count only the actions below link and select Count all actions.
Figure 13-7 Defining Tracking Events
If the Forward-to-a-Friend feature is used for any of the email jobs you’re using in the report, then you can decide whether or not to track events performed by your original recipients or by both (original and friend-recipients). To define, click on the Events of drop-down and select one of the following options:
Original Recipients Only – If selected, then the report will only use events that were triggered by the original recipients of the email (there will be no events triggered by friend-recipients). This is the same behavior that was present in earlier versions of LISTSERV Maestro (that is, before the 4.0 release). In addition, this is the same behavior found in Quick Reports.
Original and Forward-to-a-Friend Recipients – If selected, then the report will use all events, both those triggered by original recipients and those triggered by any friend-recipients.
Forward-to-a-Friend Recipients with Level – If selected, then an additional field becomes available. In this field, enter a number greater than or equal to 1. This number defines the forward-level you are interested in. The report will not include the events of the original recipients, but only of the friend-recipients of the given level. If you enter "1", then only events for friend-recipients of the 1st level will be included (i.e. only those friends that got the emails forwarded by the original recipients). If you enter "2", then only events for friend-recipients of the 2nd level will be included (i.e. only those friends who received the email forwarded by other friends from the 1st level), and so on...
Figure 13-8 Defining Job Data and Tracking Events
When you’re finished defining the data source, click the [OK] button to return to the Define Report screen.
Once you are finished defining the remaining report settings, click the [Save & Execute] button. The report is generated and displayed for viewing.
Figure 13-9 Example of a Report with Forward-to-a-Friend Events
13.1.2.1 Reordering Data Sources
When creating or editing a Tracking report, you can rearrange the order of the report’s data sources using the up and down links on the Data Sources tab.
For distribution reports, this ordering affects the order in which the data sources will appear in the legend. It will also affect the order in which the lines in the chart diagram are drawn. This means that the line of the first data source is drawn first, the line of the second data source second, and so on. This order may be of interest if you have data sources with similar values, where the lines are drawn on top of each other, so that lines which are drawn first are "hidden" by lines which are drawn later. By reordering the data sources, you can define which lines are drawn later, making them more likely to be visible in such cases.
For sum-of-events reports, this ordering affects both the order of the bars in the bar chart and the order in which the data sources will appear in the legend.
Figure 13-10 Reordering Data Sources
13.1.3 Result Settings
The third tab of the Define Reports screen is Result Settings. Select the type of report to generate as well as how the report data will be displayed. There are four basic types of report listed under the Result Type section. The type of report selected will determine the other options that appear in the lower half of the screen. Some report types will have many other options to choose, and other types will have no additional options to select.
13.1.3.1 Result Settings for Event Distribution over Time
The Event distribution over time option produces a simple line graph showing the number of responses over time. Time is plotted on the x-axis of the chart and event statistics are charted on the y-axis. Options available for this report type include:
Result Calculation – Defines how the number of events is calculated. There are three choices:
Total number of events – The y-value of the graph will display the total number of events. For example, if 123 events have been counted for an interval, the resulting line height for that interval on the y-value will be 123.
Percentage of the total number of messages sentThe y-value shows percentages in relation to the total number of messages sent. For example, if 300 messages were sent, and if, in an interval, 150 events have been counted, then the line height for that interval on the y-value will be 50% (because 150 is 50% of 300).
Note: The percentage could be more than 100% if multiple event types are being represented by a given data source, or if single recipients produce multiple events.
Percentage of the total number of unbounced messages sent The y-value shows percentages in relation to the total number of messages sent that have not been bounced. For example, if 300 messages were sent, and 50 bounced, there would be 250 unbounced messages. And if, in an interval, 150 events have been counted, then the line height for that interval on the y-value will be 60% (because 150 is 60% of 250).
Interval Size – Defines the size (time period) for each interval on the chart. The number of events that occur within the interval will be plotted on the chart. Events can be grouped hourly, daily, or weekly.
Result Accumulation – Defines whether values plotted on the chart will display cumulatively from one interval to the next (creating an ever increasing line) or whether they will display as non-cumulative intervals (creating a series of peaks and valleys).
Figure 13-11 Result Settings Tab for the Event Distribution over Time Option
13.1.3.2 Result Settings for Sum of Events
The Sum of events option produces a bar graph that shows the number of recipients who clicked on each URL and/or opened up the email message. For each data source, all events of the selected type (open-up and/or click-through), and the selected links (in the case of click-though), are summed up and displayed in the form of a colored bar.
Options available for this report type include:
Result Calculation – Defines how the number of events is calculated. There are three choices:
Total number of events – Displays the total number of events. For example, if 123 events have been counted, the resulting bar length will be 123.
Percentage of the total number of messages sentDisplays percentages in relation to the total number of messages sent. For example, if 300 messages were sent, and if 150 events have been counted, then the bar length will be 50% (because 150 is 50% of 300).
Percentage of the total number of unbounced messages sentDisplays percentages in relation to the total number of messages sent that have not been bounced. For example, if 300 messages were sent, and 50 bounced, there would be 250 unbounced messages. And if 150 events have been counted, then the bar length will be 60% (because 150 is 60% of 250).
Unique or Total Events – Selects the type of events to include in the report.
Count only events unique for each recipient – Plots only a single event of each type for each recipient. Recommended when one of the percentage result calculations has been selected. This chart will register “0” (zero) events if blind tracking has been selected for the tracking type during the tracking definition because blind tracking cannot count any event as unique.
Count all events – Plots all events triggered for each recipient and is available for blind tracking.
Figure 13-12 Result Settings Tab for the Sum of Events Option
13.1.3.3 Result Settings for Recipient Details
The Recipient details option is only used for personal or anonymously tracked jobs because this report type is linked to recipient profile data. This report type displays a multi-frame table that lists each data source and the profile field columns from the recipient definition. You must then download the report to get the recipient detail data.
Figure 13-13 Result Settings Tab for the Recipient Details Option
13.1.3.4 Result Settings for Event Details
The Event details option is available for personal, anonymous, unique, and blind tracking jobs. The report type displays a table that lists the report type, time period of the report, allows for the selection of encoding for downloading the data, and allows for the selection of the time zone to reference the downloaded data. You must then download the report to get the event detail data.
Figure 13-14 Result Setting Tab for the Event Details Option
13.2 Executing Reports
There are several ways to execute reports. LISTSERV Maestro can produce quick reports that are instantly viewable on the screen from the Test Report tab on the Job Details screen (see Section 9.2 Running Test Reports for more information) and from the Reports tab on the Completed Job Details screen (see Section 12.5 Completed Job Reports for more information). LISTSERV Maestro can also produce reports from the Tracking Reports screen and Reports menu as described at the beginning of Section 13 Tracking Reports.
Each report type has its own unique appearance, and its own set of options for viewing, downloading, manipulating, and editing. These options are represented by four icons located at the bottom right side of each report. Clicking on an icons lets you access the options for each report type. The icon currently in use will have a highlighted border around it. Icons that are not available for a particular report type will appear grayed out and will not be clickable.
Table 13-1 Tracking Report Icons
View Report – Displays the currently selected report with the latest report options.
Download Report – Opens the Download Report Result screen. From here it is possible to download report data as a PDF or in a zipped text file.
Change Results Settings – Opens the Change View Settings for Report screen. From here it is possible to change how the results are displayed and downloaded. See Section 13.7.3 Change Result Settings or Section 13.8.3 Change Result Settings for more information.
Edit Report / Create Report – Opens the Define Report screen. See Section 13.3 Editing Reports for more information.
13.2.1 Report Details
Depending on the report type, these additional details may also be available:
Report Type: Distribution Over Time
The report chart itself is an interactive chart. Move the mouse pointer over the chart to display a special interval marker: The marker appears as a red line in the middle of the interval, with a little box at the top that contains the boundary dates (and times) of the interval. With the help of this marker you are able to pick out a certain interval in the chart even if the interval size is very small (so that each interval is only a few pixels wide).
You can then click on any interval to view details about it. The information box of the marker that usually only contains the boundary dates/times is expanded and shows additional details about the selected interval. Click anywhere a second time to close the more detailed information box again.
The information box that is displayed when you click on an interval also allows you to "drill down" into the interval by performing a new report with a period that corresponds to the currently selected interval, and with an interval size that is one unit "finer" than the currently selected interval size. To do this, click on the Chart for days of this month/week/day link in the information box (after you open the more detailed information box by clicking on an interval).
For example: If you are currently viewing a chart with interval size "1 month" and click on an interval (a month), then the information box for this interval will contain the Chart for days of this month link. If you click on this link, then a new report will be executed, where the "from" and "to" dates/times correspond to the beginning and end of the month that was selected in the original report. Also, this new report will then use the interval size "1 day", i.e. it will show the selected month, sub-divided into days.
Similarly, in this new daily report, if you click on an interval (a day), then the information box will contain the Chart for hours of this day link. If you click on this link, then again a new report will be executed, where the "from" and "to" dates/times now correspond to the beginning and end of the day that was selected. Also, this new report will then use the interval size "1 hour", i.e. it will show the selected day, sub-divided into hours.
Once you have drilled down from a monthly/weekly to a daily chart, or a daily to an hourly chart, you can go back to the previous report with the Back to monthly/weekly/daily chart link at the top right above the chart diagram.
Note: You can not "drill down" any further into a diagram that already shows hourly intervals.
In addition to the drill-down into a more fine-grained distribution report, you can also use the information box of an interval to display a Per Job in Period report for the selected interval. In the distribution diagram, click on an interval. In the information box that opens, click on the Recipients statistics for jobs of this month/week/day/hour link in the information box. This will open a Per Job in Period report, where the period corresponds exactly to the interval on which you had clicked. To go back to the previous distribution report, click on the Back to monthly/weekly/daily/hourly chart link at the top right of the bar chart.
Figure 13-15 Example of the Recipients Distribution Over Time Report
Report Type: Per Job in Period
The bar diagram shows one bar for each job in the report period, where the length of the bar corresponds to the total number of recipients in this job. Above each bar, the ID and title of the corresponding job are displayed. The number of recipients in the job is displayed to the left of the bar.
Each bar is separated into a blue part, representing the successfully delivered recipients of the job it represents, and a red part, for the bounced recipients (if any). Hover the mouse over one of the bar parts for a short while and a little popup box will display the exact amount of successful or bounced recipients in this job (depending on which part of the bar the mouse is over).
Of course, if the job contains only successful recipients, then the whole bar will be blue, or if all recipients have bounced, the whole bar will be red.
Figure 13-16 Example of the Recipients Per Job in Period Report
13.2.2 Report Settings
For certain reports, it is possible to adjust the specific settings that define it. The Show Settings link lets you adjust the interval size and period of time for the report.
The Interval Size defines the size of the intervals that the whole report period is divided into. Each interval on the x-axis corresponds to the size-unit selected here. For each interval, the corresponding report value during this interval is plotted against the y-axis. You can choose between the interval sizes of 1 hour, 1 day, 1 week, or 1 month.
Figure 13-17 The Show Settings Section on a Report
The Display Period defines the period that will be shown in the report. There are two methods for defining this setting.
Show Fixed Period – The period is defined by entering explicit "from" and "to" dates and times.
Note: There is a certain maximum size of the report period that must not be exceeded with the given "from" and "to" dates. The actual maximum size of the period depends on the currently chosen interval size (see above). When the given period is divided into the individual intervals, using the given interval size, then the number of resulting intervals must not exceed 125 (an error message will tell you so if this should be the case).
To specify a fixed period, you can either enter the "from" and "to" dates/times into the corresponding edit boxes directly (in the form [Date Time]), or you can click on the Select link and select the report period visually, by dragging markers on a timeline:
The link will open a popup dialog that contains a segment of the timeline with two markers – one for the "from" and one for the "to" date and time. Simply define the report period by dragging each marker to the desired position. The intervals on the timeline (i.e. the units by which the markers will move when dragged) correspond to the interval size chosen on the report page (see above).
The report period can not be longer than the length of the timeline segment in this dialog (which corresponds to the maximum number of 125 intervals). This means that you can not move the two markers further apart than the timeline allows. However, you can scroll the timeline to the left or right (i.e. to earlier and later times) if either the desired to- or from-date is not present on the timeline-segment that is currently visible. For this, use the arrow-icons (for small one-unit steps) and double-arrow-icons (for large steps equal to about half of the total timeline-segment length) at the left and right of the timeline.
Figure 13-18 The Select Display Period Screen
Click either [OK] to only transfer the values from the timeline into the edit boxes of the "from" and "to" values, click [OK & Apply] to both transfer the values and then immediately apply them and execute a report with these values, or click [Cancel] to close the timeline dialog without applying any changes to the report settings.
Show Immediate Past – The period is defined indirectly by specifying how many time-units of the past you want to see in the report. This means that the "to" date and time of the report always equals the present time (at the moment of the report execution), and the "from" date and time is so far in the past as specified. For this, simply enter the number of intervals that the report shall go into the past (but no more than 125). The unit of the intervals depends on the interval size selected above.
Once you have finished editing the report settings, click [OK] to apply them and to execute a report with the new settings (or click [Cancel] to close the settings box without changing the report).
13.3 Editing Reports
Editing tracking reports is a more detailed way to generate custom reports. Unlike the quick reports available from the Completed Jobs screen or the Test Reports tab on the Job Details screen, it is possible to combine data from multiple jobs as well as select the color of each data source.
To edit an existing report:
From the Tracking Reports screen, click the Edit link that corresponds with that report.
— OR —
After performing one of the above actions, the Define Report screen opens if the user has the right to edit reports. The current report’s General Settings, Data Sources, and Result Settings can be edited and saved to reflect any changes in the current report, or they can be saved as a new report. For more information on these tabs, see section 13.1 Creating Reports.
13.4 Creating a Report from a Template
If the current report is a quick report from Delivered Jobs, clicking the Create Report icon will allow the user to create a new report based on the settings of that quick report. Type in a title for the report and then click [OK] to save the quick report as a regular report. Alternatively, click [Save & Execute] to execute the report again (display it) and save the quick report as a regular report. The report title will then show up in the listing of current reports on the Tracking Reports screen. Edit the settings of this new report by clicking the Edit Report icon again. This option is not available for quick reports generated from delivery test data. See Section 12.5 Completed Job Reports for more information.
13.5 Completed Job Statistics
The top of the report contains the Job Category drop-down menu. This selection allows the user to filter the jobs so that only jobs that are in the selected category are included in the statistics. In addition to all available categories, this drop-down menu also contains the following options – <All Categories> (all jobs will be included, no matter what category they are in) and <No Category> (only the jobs which are not in any category will be included).
Below the chart, at the very bottom, a message bar displays additional information about when the report was executed and which period is covered in the report. This message bar also contains the Download icon at the very right. Click on the icon to download the report as a PDF or as a ZIP-file that contains the current report in form of a text file with comma separated values (a CSV-file), plus an additional readme.txt file with details about the report.
The Completed Jobs Statistics report displays a chart of the completed jobs as a timeline graph that plots the number of completed jobs, plus how many of these were successful and how many have failed.
The graph displays a certain time period (with a given "From" and "To" date and time), and divides this period into a number of equally long intervals. For each interval, the number of completed jobs in that interval is plotted against the y-axis.
The graph contains three lines – the green line shows the successful jobs, the red line shows the failed jobs, and the blue line shows the total jobs (both successful and failed).
Note: If for a given interval all jobs are successful, then the blue line, which is plotted last, will cover the green line with the same value, so in these intervals only the blue line will be visible in the graph. The same will happen with the red line for intervals where all jobs have failed.)
Below the graph itself, a summary is displayed for the three job types, including the total count over the whole period.
For information about using the interactive report chart, see Section 13.2.1 Report Details. For information on the Show Settings link, see Section 13.2.2 Report Settings.
13.6 Delivered Recipients Statistics
The top of the report contains the Job Category drop-down menu. This selection allows the user to filter the jobs so that only jobs that are in the selected category are included in the statistics. In addition to all available categories, this drop-down menu also contains the following options – <All Categories> (all jobs will be included, no matter what category they are in) and <No Category> (only the jobs which are not in any category will be included).
Below the chart, at the very bottom, a message bar displays additional information about when the report was executed and which period is covered in the report. This message bar also contains the Download icon at the very right. Click on the icon to download the report as a PDF or as a ZIP-file which contains the current report in form of a text file with comma separated values (a CSV-file), plus an additional readme.txt file with details about the report.
The bounce count of a job can either be refreshed individually for that job (via the job details page of the corresponding job), or you can use the Refresh link at the bottom of this report as a shortcut to refresh the bounce counts of all jobs which fall into the time period that is covered by the current report (i.e. which were delivered between the "from" and "to" date and time).
Note: When determining if a recipient is supposed to be reported as "successful" or "bounced", the report will always use whatever bounce information is currently available for the job that the recipient was part of. This job related bounce information is the information that was obtained during the last bounce count refresh of that job, which means that at the time that the report is executed, the bounce count information of the involved jobs may be partially outdated (if some or all of them were not updated recently, or probably never at all).
The recipients statistics report can be viewed as two different types:
This Distribution Over Time type displays a statistics chart of the delivered recipients as a timeline graph which plots the number of processed recipients, and how many of these were successfully delivered and how many bounced. For more information, see Section 13.2.1 Report Details.
This Per Job in Period type displays a statistics chart of the delivered recipients as a bar char, with one bar per job, where the length of the bar shows the number of recipients in this job (separated into successfully delivered and bounced recipients). For more information, see Section 13.2.1 Report Details.
When this option is selected, the bar diagram is displayed with the job ID and job title of each job above each bar. The job ID is now clickable; therefore, once you click it, the corresponding Completed Job Details screen opens.
Figure 13-19 Delivered Recipients Statistics Report with Job ID
For information about using the interactive report chart, see Section 13.2.1 Report Details. For information on the Show Settings link, see Section 13.2.2 Report Settings.
13.7 Event Distribution Report
An Event Distribution report plots the occurrence of events (open-up and/or click-through) over time. A simple line graph shows the number of responses over time. Time is plotted on the x-axis of the chart and can be measured in intervals of hours, days, or weeks. Events are charted on the y-axis and can be measured as the number of events or as a percentage of either the total number of messages sent, or the total number of unbounced messages.
13.7.1 Viewing Event Distribution Reports
The View Report screen of an Event Distribution report displays the collected data in a chart format.
Figure 13-20 Events Distributed Over Time Report Variations
The View Report screen of this report type changes to reflect different options set on the Change View Settings for Report screen. Depending on what options are set, events on the y-axis can reflect the total number of events, or a percentage of either the total number of messages sent, or the total number of unbounced messages sent. Events occurring over time can be reflected as a total accumulation; each set of measured events is added to the previous set so the plotted data continuously accumulates until all events stop and a plateau is reached. Alternatively, events occurring over time can be reflected as accrued numbers, plotting the data as a series of peaks and valleys.
The report chart is interactive. When you move the mouse pointer over the chart, a special interval marker is displayed. This marker appears as a red line in the middle of the interval, with a little box at the top that contains the boundary dates (and times) of the interval. With the help of this marker you are able to pick out a certain interval in the chart even if the interval size is very small (so that each interval is only a few pixels wide). You can then click on any interval to view details about it. The information box of the marker that usually only contains the boundary dates/times is expanded and shows additional details about the selected interval. Click anywhere on the report to close the more detailed information box.
13.7.2 Downloading Event Distribution Report Data
It is possible to download the data from an event distribution report by clicking the Download Report icon. You can download data in the form of a PDF file or a zipped text file; in addition, you can export the data into Excel.
First, select the time zone that will be used to format the data from the drop-down menu.
Then, choose one of the following methods of download:
To download as a PDF file, click the [Download as PDF] button. You can then open or save the file.
To download as a zipped text file, click the [Download as Text File (CSV)] button. You can then open or save the file.
13.7.3 Change Result Settings
The Change View Setting for Report screen allows the user to change specific options and, as a result, change the appearance of the report on the View Report screen and change the data that is downloaded on the Download Report Result screen. Any changes made on the Change Result Settings screen do not change the actual report definition; they are only temporary, allowing the user to see different views and download different data. To change the report permanently, changes need to be entered on the Result Settings tab on the Define Reports screen, and then the changed report must be saved. See Editing Reports for more information.
For an Events Distribution report the following options can be selected:
Result Calculation – Defines how the results on the chart are calculated.
Total number of events – Displays the total number of events counted per time interval. For example, if 123 events were counted for an interval, the resulting line height for that interval would be 123.
Percentage of total number of events – Displays percentages in relation to the total number of messages sent. For example, if 300 messages were sent, and if, in one interval, 150 events were counted, the line height for that interval would be 50% because 150 is 50% of 300.
Percentage of total number of unbounced messages sent – Displays percentages in relation to the total number of messages sent that have not bounced (at the time the report is executed). For example, if 300 messages were sent and 50 messages bounced, there would be 250 unbounced messages. And, if in one interval, 150 events were counted, the line height for that interval would be 60% because 150 is 60% of 300.
Interval Size – Events are counted as occurring within a certain amount of time. This amount of time is referred to as an interval. Intervals can be set as hours, days, or weeks.
Result Accumulation – Defines whether the values accumulate from one interval to the next.
No accumulation – Each interval’s events are counted and plotted for only that time period. The resulting line on the chart displays as a series of peaks and valleys.
Accumulate interval values – Each interval’s events are counted and plotted, adding to the previous interval’s events until the end of the report period. The resulting line on the chart displays as ever increasing. The incline will become less steep over time until it plateaus into more or less a straight line once recipients no longer trigger events.
Click the [Execute] button to change the View Report screen (the appearance of the chart or graph), and change the downloadable data.
13.8 Sum of Events Report
The Sum of events option produces a bar graph that shows the number of recipients who clicked on each URL and/or opened up the email message. For each data source, all events of the selected type (click-through and/or open-up) and for the selected links (in the case of click-through), are summed up and displayed in the form of a colored bar.
Two types of sum can be chosen for the report – Sum of unique events or Sum of all events. Sum of unique events plots only a single event of each type for each recipient. This chart will register “0” (zero) events if blind tracking has been selected for the tracking type during the tracking definition because blind tracking cannot count any event as unique. Sum of all events counts all events triggered for each recipient and is available for blind tracking.
The Sum of all events will give an overall picture of how many events were generated. When compared to the Sum of unique events, the report gives an idea of how well the overall number of events was distributed over the individual recipients. It is possible to discern whether many recipients generated relatively few events each, or whether most events were generated by only a few recipients (generating the same events over and over), while many other recipients only generated a few events (or none at all).
13.8.1 Viewing the Sum of Events Report
The View Report screen of a Sum of Events report displays the collected data in a bar graph format. The View Report screen of this report type changes to reflect different options set on the Change View Settings for Report screen. Depending on what options are set, the number of recipients can reflect the total number of all recipients, or a percentage of the number of recipients who triggered an event.
Figure 13-21 Example of the Sum of Events Report
13.8.2 Downloading Sum of Event Report Data
It is possible to download the data from a sum of event report by clicking the Download Report icon. You can download data in the form of a PDF file or a zipped text file; in addition, you can export the data into Excel.
First, select the time zone that will be used to format the data from the drop-down menu.
Then, choose one of the following methods of download:
To download as a PDF file, click the [Download as PDF] button. You can then open or save the file.
To download as a zipped text file, click the [Download as Text File (CSV)] button. You can then open or save the file.
13.8.3 Change Result Settings
The Change View Settings for Report screen allows the user to change specific options and as a result change the appearance of the report on the View Report screen and change the data that is downloaded on the Download Report Result screen. Any changes made on the Change View Settings for Report screen do not change the actual report definition; they are only temporary, allowing the user to see different views and download different data. To change the report permanently, changes need to be entered on the Result Settings tab on the Define Report screen and then the changed report saved. See Editing Reports for more information.
For a Sum of Events report, the following options can be selected:
Result Calculation – Defines how the results on chart are calculated.
Total number of events – Displays the total number of events. For example, if 123 events have been counted, the resulting bar length for will be 123.
Percentage of total number of events – Displays percentages in relation to the total number of messages sent. For example, if 300 messages were sent, and if, for a data source, 150 events have been counted, then the line length for that data source will be 50% (because 150 is 50% of 300).
Percentage of total number of unbounced messages sent – Displays percentages in relation to the total number of messages sent that have not been bounced (yet). For example, if 300 messages were sent, and 50 bounced, there would be 250 unbounced messages. And, if 150 events have been counted, then the bar length for that data source will be 60% (because 150 is 60% of 250).
Unique or Total Events – Select whether to count all events that are tracked, or only unique events triggered by recipients.
Count only events unique for each recipient – For each recipient, only one event of each type is counted. For example, if open-up and click-through events are being tracked and a recipient opened the message twice and clicked on the same link three times, only two events would be counted. This method of counting is recommended when one of the percentage result calculations is selected.
Count all events – For each recipient, all triggered events are counted. Using the example above, five events would be counted using the Count all events option.
Figure 13-22 Change View Settings for Sum of Events Report
Click the [Execute] button to change the View Report screen (the chart or graph), and change the downloadable data.
13.9 Recipients Details Reports
The Recipient Details option is only used for personal or anonymously tracked jobs because this report type is linked to recipient profile data. This report type displays a multi-frame table that lists each data source and the profile field columns recipient definition. Use the table to select which data sources and which columns will be downloaded. Data can be downloaded and then imported into a statistical software program to generate charts and graphs.
On the Reports tab of the Completed Job Details screen, the options for defining the Recipient Details report has been streamlined. When you select the Recipient details option, the Include Data Sources For section will contain the Open-Up Events and Click-Through Events options. When Click-Through Events is selected, you can select to Separate data sources per link or Bundle all links in one data source.
Once you are finished defining the report, click [OK]. The Recipient Details Report is displayed. The usability features for the report have changed.
To rearrange the order of the columns, you can use the left and right arrows associated with each column. In addition, to remove a column, simply click the [x] box. When you’re finished rearranging the columns, click [Apply].
Figure 13-23 Applying Column Changes to the Recipient Details Report
If there are additional columns that are not shown on the report, then the More Columns link appears. Use this link to add columns to the report.
Another way to change the order of the data is to click on the Sort Order link and select a sort option from the pop-up menu.
Figure 13-24 Changing the Order of the Report Data
To change the data source for the report, click on the Change link. The Data Source Selection screen opens.
Figure 13-25 Changing the Data Source for the Recipient Details Report
From here, click on the Select link that is associated with the data source you’d like to use. The report will be refreshed using this new data source.
13.9.1 Downloading Recipients Details Report Data
The Download Report Result screen lets you download the Recipient Details report as a PDF or as a Text File (CSV).
Note: The downloaded report will contain the data source that was selected when you were viewing the report. To download a report with a different data source, simply view the report again, select that data source using the Change link, and then use the Download icon to download the new report.
Figure 13-26 Download Report Results Screen
To download as a PDF, click the [Download PDF] button.
To download as a text file, select the file encoding for the download from the drop-down menu, and then click the [Download as Text File (CSV)] button to begin downloading the data.
When downloaded as a text file, the text file in the ZIP archive file will contain a table with the columns that you have selected – in the order you selected them. The rows in this table are generated in the following way:
For each recipient that generated at least one of the events that are counted by the selected data source, one entry is made. Each entry consists of the profile values of this recipient, which are placed into their matching columns. However, only those profile values that match any of the columns you have selected will be used. All columns not selected will be ignored. Because of this, several recipients may now have the same "condensed" profile. This would happen if the only differences in the profile of the recipients were in columns that are not used because they were not selected.
For example, if you use the EMAIL, GENDER, and CITY columns, then each recipient will most likely have a different profile. This is because the combination of EMAIL, GENDER, and CITY will probably be unique for each recipient. However, if you only select the GENDER and CITY columns to form a "condensed" profile, then, in all likelihood, you will have several recipients with the same profile, namely all those of the same gender that live in the same city.
If, during the creation of the report, several recipients are found to have the same "condensed" profile, this profile will be included in the report table only once. Instead of including the same profile several times, LISTSERV Maestro simply counts how many recipients share the same profile for each unique profile.
In the special purpose column, called {COUNT}, each instance of an event for the same profile is recorded. If you include this column, then it will be populated with the number of recipients that were matched to the "condensed" profile defined by the other columns in the same row. Using the {COUNT} column allows you to find out interesting demographic statistics such as how many males or females from a certain city have clicked on a certain link.
Note: The rows in the table will be sorted in ascending order on the first column. If there are profiles with the same values in the first column, then they will be sorted after their second column, and so on.
Example
Assume that the full profile has the three columns from above -- EMAIL, GENDER, and CITY. Also assume that if you included all columns plus the {COUNT} column, then your report table would look like this:
CITY,GENDER,EMAIL,{COUNT}
New York,female,sally@somewhere.com,1
New York,male,john@somewhere.com,1
New York,male,robert@somewhere.com,1
Washington,female,debby@somewhere.com,1
Washington,male,frank@somewhere.com,1
This table means that each of these recipients has generated one event of the type being counted by the data source. You can also see the sort order after first, second, and third column.
Now, if you would leave out the EMAIL column, the result would be:
CITY,GENDER,{COUNT}
New York,female,1
New York,male,2
Washington,female,1
Washington,male,1
As you can see, John and Robert from New York, which differed only in their email addresses, are now aggregated into the "male from New York" profile, and there are now two events shown as coming from recipients that match this profile, one from John and one from Robert.
If you would also leave out the GENDER column, the result would be:
CITY,{COUNT}
New York,3
Washington,2
13.10 Event Details Report
The Event details report is available for personal, anonymous, unique, and blind tracking jobs. This report type displays a multi-frame table that lists each data source. Use the top frame to select the data source, and the bottom frame to select the time zone and file encoding to be used to format the downloaded data. Data must be downloaded and can be imported into a statistical software program to generate charts and graphs.
Figure 13-27 Sample of the Event Details Report
13.10.1 Downloading Events Details Report Data
Select the data source from the top frame by clicking the Select link. The currently selected data source will appear in the lower frame. Select the time zone from the top drop-down menu and the file encoding from the bottom drop-down menu. Click the [Download] button to download the raw data to a local drive.
The downloaded data CSV file contains comma separated and quoted <> tabular data with the following columns:
EVENT_TIME – The date and time, to the second, when the event was triggered.
RECIPIENT_ID – ID of the recipient who triggered the event. If the tracking type is Personal, then the RECIPIENT_ID will be the actual ID of the recipient as defined by the account holder in the Tracking wizard.
If the tracking type is Anonymous, this field will contain a 1-based integer number, which is an internal identifier of the anonymous profile that matches the recipient who triggered the event. This number cannot be used to identify an individual recipient who triggered an event, but can be used to determine if two events were triggered by a recipient with the same anonymous profile (the same number will be used). This number is also used internally in the Recipients Details report to download the profiles that triggered certain events.
If the tracking type is Unique, this field will contain a 0-based integer number that was given out to the recipient during sending. This number cannot be used to identify which recipient triggered which event, but it can be used to determine if multiple events were triggered by the same recipient (the same number will be used).
If the tracking type is Blind, the field will always contain the default value “DEF” and cannot be used to find anything out about the recipient.
CLIENT_ADDRESS – The IP address of the recipient who triggered the event. This is only present for personal tracking, and will appear as “0.0.0.0” for all other types of tracking.
EVENT_TYPE – Either click (for click-through) or openup (for open-up) will appear depending on the type of event.
BODY_TYPE – For open-up events, this field will always be empty because only HTML messages can track open-up events. For click-through events, the body part of the message containing the event will be listed. Possible body types are:
Plain – URL in the body of a plain text message.
Alt – URL in the text alternative of the HTML message.
HTML – URL in the HTML body of the message.
XAOL – URL in the AOL format alternative of the HTML message.
URL – For open-up events, this will always be empty. For click-through events, the URL that was clicked is listed.
ALIAS – For open-up events, this will always be empty. For click-through events, the alias of the URL that was clicked is listed. If there is no defined alias, this field will be empty.
FULL_JOB_ID – The full Job ID including the User Prefix of the job that triggered the event.
AGENT – The user agent string transmitted by the client software of the recipient who triggered the event. This identifies the browser software that was used to click on the link.
13.11 Using the Excel Add-In
The statistics downloaded from LISTSERV Maestro are in CSV format. The data from the Event Distribution and Sum of Events reports can easily be imported into Microsoft® Excel in order to create tables, graphs, and other forms of reports. LISTSERV Maestro comes with an easy to use Excel Add-In that makes this import process a matter of a few clicks.
13.11.1 Downloading the LISTSERV Maestro Excel Add-In
The add-in must be installed into Excel before it can be used. This step is done only once on each workstation, before the add-in is used for the first time. If there is an existing version of the add-in file from an earlier build of LISTSERV Maestro, it must be removed from the local machine and the newest version installed. Please see the Section 13.11.4 Removing an Existing Version of the Add-In for instructions on how to proceed.
From any Event Distribution report or Sum of Events report, click the Download Report icon. This will open the Download Report Result screen. Next, click the download link located under the time zone drop-down menu. The Microsoft Excel Add-In for Tracking Statistics Import screen opens. Click on the ImportTrackerStatistics.xla link to download the add-in file.
13.11.2 Installing the LISTSERV Maestro Add-In into Excel
Follow the steps described below to install the add-in into Microsoft Excel 2000 or later:
1.
2.
From the Tools menu, select Add-Ins (It may be necessary to click on the small arrow symbol at the bottom of the menu to make the command visible.) The Add-Ins screen opens, listing all available add-ins. Click the [Browse…] button.
Figure 13-28 Installing Tracker Add-In
3.
4.
The Add-Ins screen reopens. There will now be an entry for the LISTSERV Maestro add-in, Importtrackerstatistics, which should already have a check mark in front of it (if not, check the box). Click [OK] to install the add-in.
Figure 13-29 Browse for Add-In File
A new toolbar icon that looks like two footprints will appear in the Excel toolbar. This icon will start the LISTSERV Maestro data import.
Figure 13-30 New Excel Tool Bar Button
13.11.3 Using the LISTSERV Maestro Excel Add-In
Download the data to be imported into Excel. The data is downloaded in a compressed ZIP file; open this file. There are at least two files contained inside – readme.txt, another file named for the type of data downloaded, and, optionally, additionalStatistics.txt. Extract the text files and save them on a local drive.
The readme.txt file contains a summary of the report type and other information. The additionalStatistics.txt file contains any additional statistics (i.e. the number of emails sent or the number of bounces) that were requested in the report. The main data file, named for the type of data downloaded (i.e. distributionReport.txt or uniqueSumReport.txt) contains the data that will be imported into Excel. Start Excel and click on the Visualize Tracking Statistics icon in the toolbar (two small footprints).
The Visualizing Tracker Statistics screen opens. Select the Import and convert a downloaded tracking data file option to create a new workbook and generate a chart based on the downloaded tracking data.
Figure 13-31 Using Tracker Add-In with Excel Import
Click the [Start] button. A file selection screen will open. Navigate to the *.txt file with the tracking data previously downloaded and open this file. Excel will automatically open a new workbook. Once the workbook has been created successfully, save it using the Save Statistic File screen. After the file had been saved, a message will appear saying the data has been successfully imported and saved as an Excel Workbook. Click [OK] to close the message.
The new workbook has two sheets – the first sheet shows the imported tracking data in chart form, and the second sheet contains a table with the downloaded tracking data.
Figure 13-32 Example Excel Graph Event Distribution Over Time
Figure 13-33 Example Excel Data Table
It is now possible to use all the regular Excel features to edit and adjust both the graph and the data table.
Select the Convert the current worksheet option on the main add-in menu to create a new chart in the current workbook based on the data of the current worksheet.
13.11.4 Removing an Existing Version of the Add-In
If there is an existing ImportTrackerStatistics.xla file from an earlier version of LISTSERV Maestro installed on the local machine, it may not work with downloaded report data from the newest version of LISTSERV Maestro. The old add-in file must be removed from Excel and a new one must be installed. Follow the steps below to remove an old ImportTrackerStatistics.xla file from Excel and install the latest version.
1.
2.
Click Tools > Add-Ins… > Uncheck the Importtrackerstatisticsa add-in from the list, and then click [OK].
3.
Click View > Toolbars > Uncheck Tracker-Statistics (the little feet icon should disappear).
4.
Click View > Customize… > Toolbars tab > select the Tracker-Statistics listing from the menu (do not check the box) > Click [Delete].
5.
6.
7.
8.
Click the Download Report icon.
9.
Click the download link to download the Excel Add-In.
10.
Right-click the ImportTrackerStatistics.xla link.
11.
Select Save Target As from the menu.
12.
Save the file on a local drive. (If there is an existing version of this file in the same location the new file is being saved in, a query will ask to replace the existing file. Click [Yes].)
13.
14.
Click Tools > Add-Ins… > click [Browse…]
15.
Browse for the ImportTrackerStatistics.xla file that was downloaded, and select it.
16.
If there is an existing version, a query will ask to replace the existing file. Click [Yes]. (The little feet icon should re-appear on the toolbar.)
17.
Click the little feet icon, click [Start], and follow the directions from there.
Important: If the new version of the ImportTrackerStatistics.xla file is downloaded and saved in a different location than the old version, the existing file will not be replaced after answering [Yes] to the query. The old file may remain associated with Excel even when the new version is selected under Tools > Add-Ins… > Browse… If this is the case, an error message will appear saying the file already exists and it is not possible to have two versions of the same file. To correct this situation, search for all versions of the ImportTrackerStatistics.xla file on your local drive and delete them. Then follow all the steps above.