Portlet Library

Browse the portlet library to view examples of existing portlets. Portlets can be easily adopted for use on your project once the initial design and development is complete. The steering committee recommends that projects use eight to twelve portlets on a dashboard. Portlets can be categorized into five main groups: anomalies, staff information, cost, production status, and quality.

AnomaliesPortlets that display entries from multiple data sources surfacing conditions that require immediate investigation e.g, interviewers not following procedures or suspected falsification.

Anomalies

Portlets that display entries from multiple data sources surfacing conditions that require immediate investigation e.g, interviewers not following procedures or suspected falsification.

CostPortlets that use case status and time charge data to compute a cost per complete in terms of staff hours.

Cost

Portlets that use case status and time charge data to compute a cost per complete in terms of staff hours.

Production Status Portlets that use case status information to display current distribution of cases by various standard categories e.g, not started, in process, complete, etc.

Production Status

Portlets that use case status information to display current distribution of cases by various standard categories e.g, not started, in process, complete, etc.

QualityPortlets that use data from various systems, such as CARI Code, to compute and display data that can be used to chart the quality of a person’s work against the average for the groups and show improvements over time.

Quality

Portlets that use data from various systems, such as CARI Code, to compute and display data that can be used to chart the quality of a person’s work against the average for the groups and show improvements over time.

Staff InformationPortlets that show the name and a photo of each field interviewer for a given supervisor, and, if available, their current location and work status.

Staff Information

Portlets that show the name and a photo of each field interviewer for a given supervisor, and, if available, their current location and work status.

Anomalies

Anomalies Table

The anomalies portlet provides a list of issues defined by study that should be reviewed to help improve completion or quality rates.

One example of a common anomaly would be cases that have more than five contacts and are not yet completed. Another example is a list of interviews completed late at night or early in the morning. A supervisor can address each anomaly as they occur. The system maintains a record of each anomaly so patterns can be identified over time.

Box Plot Analysis

Data points can be analyzed using the box plot portlet to determine normal values and identify outlier cases. In this example, we analyzed how many contacts it was taking each stand (field period). Outlier data is determined statistically by identifying the median point and calculating the top and bottom 25% from the median. These plots are easy ways to determine cases outside of the norm and can show how the average may be skewed away from the median.

The data download function will show the anomalous cases.

Cost

Average Hour per Complete for each Interviewer in a Region

By linking work hours with the number of completes for a given task, supervisors can determine how well field interviewers are doing by easily comparing their average hours per complete with their peers. The goal line shows how each interviewer is doing compared to the study’s budgeted hours per complete.

Screenshot for Average Hours Per Complete by Staff

Average Hours per Complete by Week for a Region

Showing a weekly breakdown of the average hours for each complete, allows project managers to see efficiency trends over the course of the project. This portlet will show the average hours charged per instrument complete by week compared to a budgeted hours per complete goal. It has an Interval option to show the data either by cumulative values “By Week” or the weekly values “For Week.”

Screenshot of Average Cumulative Hours per Complete by Week for a Region

View theWeekly Average Hours per Complete by Week for a Region

Average Hours per Complete for each Region

By comparing the average hours of complete for each region to other regions, the study average, and the budgeted goal, study managers can monitor how well each region is doing.

Production Status

Case Dispositions

As a case moves through the various steps of a study's protocol, a rollup status can be calculated. Some studies may have dozens of statuses. This portlet can be configured to show all statuses or only the Top X grouping the remaining statuses into an "other" category.

Goal Chart for Regions

This portlet shows the weekly completes and weekly goals along with the cumulative completes and cumulative goals. It also can show the likelihood of a region or the study to meet goals based on best and average weekly completes, so early in a study’s field periods, staffing needs or field periods can be adjusted.

View theCatch Up Goal Chart for Regions

Intervention Timeline

This portlet shows day by day of the protocol the cumulative completion counts and the effectiveness of each communication.

In this example, the cases flowed into the protocol on different calendar dates. The case communications were aligned such that they all start at day zero. Most of the interventions saw a small uptick in completions, but are barely visible. The day 39 communication was a FedEx package with an incentive. This showed the largest uptick.

This portlet comes with a trendline overlay that will show the upticks, down turns and the leveling off of completions.

This portlet shows day by day after the initial contact the cumulative completes and how the completion counts were affected by each study communication.

View theTrendlines Intervention Timeline

Metrics

The metrics portlet can be configured to show single counts or percentages. These can be color coded, and can include footnotes to better describe the metrics. The first example shows the current week's count of completes compared to the best week of completes.

Metric portlet example showing counts of completed interviews for a region. The sample size of the whole study is also displayed in the footnote section of the metric portlet.

Production Counts by PSU

Pulling data from multiple external systems tends to bring in dozens if not hundreds of different status codes. These portlets categorizes the various status codes into groups and displays counts of the status groups for each primary sampling unit (PSU) in a given region or across all regions.

View theLegend Production Counts by PSU

Response Rates

Pd3 has a variety of portlets to help monitor response rates. The example shows response rates for two surveys given to different populations and a combined total response rate. This portlet can also be configured to response rate goals for each survey. Other variations of this portlet show response rates by collection mode, primary sampling units (PSUs), or regions.

State Map

This portlet can be configured to show how a project's collected data compares to state-by-state expectations. The example below was used for an election study and shows the collected response distribution by state compared to the adult citizen population in each state. This is color coded based on a previous election cycle with the difference in distribution heat mapped with zero being the lightest shade. This portlet allows project managers to make adaptive design decisions to adjust collection efforts to better meet geographic distribution goals.

Heat map of U.S. states showing proportion of completed surveys versus adult citizens in each state

Task or Activity Outcomes

This portlet groups the statuses and outcomes of various tasks into simpler categories such as Completes, Finals, Interims, Ineligibles, or Refusals. Then for specified activities the portlet shows the outcome group breakdowns. This defaults to showing the completes, but users can click on other categories in the legend to see counts.

Counts of specified tasks by outcome group with Completes shown by default

View theAll Outcomes Task or Activity Outcomes

Task Time Analysis

This portlet will help to identify the best and worst hours of each day of the week to successfully complete a task. This analysis helps the study to target the hours that tend to get the most completes and the fewest refusals, and to avoid the hours that tend to get more refusals than completes.

This portlet show a heat map set of points for each business hour of the day for each day of the week.

View theComparisons Task Time Analysis

Top and Bottom Performers

This portlet can be configured to show the top x and bottom x performers of a given category. The example shows the response rates of the top three and bottom three states.

Graph showing the response rates of the top three and bottom three states

Quality

CARI Coding

Based on a review of interviews a CARI score can be applied to each case. In the example a correctness score is shown with 100% being a perfect. This portlet shows a goal range and where the cases fall over time. Scores below the acceptable range require intervention. This portlet can display day by day for an entire region or specific interviewers, and also week by week or case by case.

CARI scoring for Region 4 based on correctness percentage

Completeness of Activity

If the study protocol requires a defined set of activities for each completed task, the completeness of each task can be quantified. This portlet shows varying degrees of completeness for a given task. It can be broken down by region, primary sampling unit (PSU), or staff member, and filtered for time periods, showing how well interventions are working. The example shows counts of interview completed cases, where the interviewer also needs to schedule and push for a completed physical exam.

Completeness by Interviewer of Cases from interview completes through scheduling and physical exam

Sampling Frame Demographics

If the project has an expectation of collecting data in the same proportions as the sampling frame or other demographic characteristics, this portlet could be used to monitor these characteristics over the course of the study. Monitoring strata goals allows projects to enact adaptive designs to target collection efforts to under represented groups.

Sampling Frame Demograhics showing the collected responses by race categories every 7 days over the course of the study compared to census data

Staff Information

At-a-Glance

By calculating a number of key indicators on a daily basis, study managers can determine how much work each staff member is doing across any time range. This portlet defaults to showing summary counts for the region from yesterday. The Staff view shows these counts broken down for each staff member.

Typical counts include the number of completes, number of hours worked, number of miles logged, number of cases worked, number of contacts made, and the number of GPS points accumulated.

Screenshot of the At A Glance portlet summary view with a date range of the entire field period

View theBy Staff At-a-Glance

Interviewer Map

The interviewer map shows all interviewers by region based on their home site. The map displays where a selected interviewer went on a selected day in relation to their assigned tasks using available laptop or mobile GIS data.

My People

This portlet shows at a glance information about each interviewer. Depending on project’s needs, it can show if the interviewer is using their phone GIS tracking app, when the last time their laptop data was transmitted, how many cases are assigned to the interviewer, and contact information.

Clicking on an interviewer will pop-up more interviewer details to help guide interviewer feedback. This includes CARI scores, hours per complete, hours and mileage charged, a list of contact with participants, and a chart showing times and days of the week for each contact.

My People portlet showing staff data color coded based on data transmission dates

Time of Day for Records of Contact

The EROC time of day portlet shows a history of the types of contacts that have been made by the day of the week and time of day. Each segment is a day of the week starting with Monday, and the time of day is shaded by the morning, afternoon, and evening hours of operation. Contacts made outside of normal hours are flagged as outliers. Within each day of the week, the contacts are shown by week of the study to show coverage over time. This portlet can show all of the EROCs for an interviewer or for specific cases to help determine contact opportunities.

Electronic Record of Contacts for a specific interviewer shown by day of week across the hours of operation

View theFor Case Time of Day for Records of Contact

Training Progress

The LMS training portlet allows supervisors to keep tabs on each set of training courses to see where field interviewers are falling behind and may need additional support. This portlet will show the progress of all interviewer by region or across all regions and show progress for each set of training courses that are assigned to them.

There are three main types of issues that this portlet identifies. The first is any currrently assigned courses where the latest status is Failed. The second is any courses that are overdue, and the third issue is when five or more trainings are due the next day.

The View button shows details of each set of training courses assigned to the field interviewer.

List of field interviewer trainings with issues highlighted.