• SKIP TO CONTENT
  • SKIP NAVIGATION
  • Patient Resources
    • COVID-19 Patient Resource Center
    • Clinical Trials
    • Search Clinical Trials
    • Patient Notification System
    • What is Clinical Research?
    • Volunteering for a Clinical Trial
    • Understanding Informed Consent
    • Useful Resources
    • FDA Approved Drugs
  • Professional Resources
    • Research Center Profiles
    • Clinical Trial Listings
    • Market Research
    • FDA Approved Drugs
    • Training Guides
    • Books
    • eLearning
    • Events
    • Newsletters
    • JobWatch
    • White Papers
    • SOPs
    • eCFR and Guidances
  • White Papers
  • Trial Listings
  • Advertise
  • COVID-19
  • iConnect
  • Sign In
  • Create Account
  • Sign Out
  • My Account
Home » Sponsors Should Ensure Remotely Conducted Outcome Measures Are Still Valid and Reliable

Sponsors Should Ensure Remotely Conducted Outcome Measures Are Still Valid and Reliable

Integrity-360x240.png
April 20, 2020
James Miessler

As the COVID-19 pandemic pushes sponsors toward conducting remote outcome measures, it’s important for them to ensure that data they gather and the conclusions drawn from them are still valid and reliable.

“Even when we’re in circumstances that require quick decisions and rapid movement, we still have an obligation to do what we can to assure ourselves, regulatory agencies and other stakeholders that the data we’re collecting is still valid, and that the conclusions we make based on that data are thereby valid,” said Mark Opler, chief research officer of WCG MedAvante-ProPhase, an electronic clinical outcomes assessment group.

The first step is a simple one — look over prior research for guidance. There may be research that has already been done on validity and reliability questions related to conducting outcome measures remotely, and many such questions have already been answered “to a degree,” Opler said at a WCG Clinical webinar last week on COVID-19.

Next, sponsors should think about conducting a nested validity study — a substudy within a trial that analyzes data and evaluates the extent to which it behaves like or resembles data obtained through more traditional methods. True nested validity studies compare the two methods of evaluation side-by-side, often on the same patient, and they are frequently small in size, carefully designed and “very analytically rich,” he said.

Opler said it is of the utmost importance that sponsors keep “a very close eye” on the quality of the data being collected, urging “as near to real-time as possible” quality evaluations to catch any potential anomalies.

“Detection of potential anomalies, changes, anything that looks out of the ordinary … if it were my study, I’d want to know about it soon, so that I could make … decisions about how to proceed,” he said.

Regulatory agencies have accepted data collected remotely prior to the coronavirus pandemic, Opler said, citing one of several examples: in 2019, the FDA approved a rapid-acting antidepressant based on remotely collected data — 24,000 separate evaluations done by telephone. “I think we can take heart that there is some precedent for this, and that some of the methods used in the past for remote evaluation may serve as a path forward.”

Nathaniel Katz, chief science officer of WCG Analgesic Solutions, expanded on outcome measures, listing criteria that should be evaluated to ensure a trial’s performance of outcome measures remains stable during the outbreak:

  • Test-retest reliability should be evaluated by monitoring the test-retest reliability of critical outcome measures over time;
  • Temporal consistency should be evaluated by determining a measure’s variability over time;
  • Internal reliability of multi-item measures should be evaluated using Cronbach’s alpha or another measure of inter-item correlations; and
  • Relationships between measures should be evaluated by simultaneously looking at the concordance of two measures of the same symptom, and by evaluating the relationship between two correlated measures, such as pain and physical function.

When evaluating the impact of COVID-19 on study results, sponsors should consider certain factors. For example, they should consider whether their study results are positive or negative and if the between-group difference (such as the difference between treatment and placebos) vary before and after the pandemic.

In addition, sponsors should analyze the characteristics and baseline symptom intensity of the study population to see if they varied in relation to the crisis, and consider if study results were “robust” to the pandemic.

Katz also suggested that sponsors use infrastructure and techniques already in place to prepare for accountability that will arise in the future when data is being analyzed. Sponsors should realign their central statistical monitoring (CSM) techniques to monitor for any changes in performance of critical assessments, he recommended.

“People will be starting to get data in different ways — telephone interviews, home assessments, videos, audio recordings,” he said. “It’s much better to get the data than to not get the data. Missing data is the worst possible situation to be in.”

With certain sites differing in their capabilities and training for remote data collection, CSM techniques can also be used to determine if a site should be shut down, he said. Interim analyses should also be considered to determine if a study really needs to go on. Studies nearing their end may have already demonstrated positive results or futility to ever be positive, and interim analyses that “are extremely useful” right now may help sponsors determine if it’s worth it to continue, he said.

To listen to the webinar, click here: https://bit.ly/2xAKh5e.

COVID-19
  • Related Directories

    Olumiant (baricitinib)

    Veklury (remdesivir)

    Comirnaty (COVID-19 Vaccine, mRNA)

Upcoming Events

  • 24May

    Powering an Effective Oversight Strategy with Clinical and Operational Insights

  • 25May

    2022 WCG Avoca Quality & Innovation Summit: Own the Future

  • 28Jun

    Effective Root Cause Analysis and CAPA Investigations for the Life Sciences

  • 16Oct

    WCG MAGI's Clinical Research Hybrid Conference - 2022 West

Featured Products

  • Spreadsheet Validation: Tools and Techniques to Make Data in Excel Compliant

    Spreadsheet Validation: Tools and Techniques to Make Data in Excel Compliant

  • Surviving an FDA GCP Inspection

    Surviving an FDA GCP Inspection: Resources for Investigators, Sponsors, CROs and IRBs

Featured Stories

  • Protocol-360x240.png

    Avoid Deviations by Making Protocol Review a Team Effort

  • SelectionProcess-360x240.png

    Give Us a Voice: Sites Clamor for a Say on Vendor Selection

  • Convince-360x240.png

    Use Data and Details to Convince Site Leadership to Add Staff

  • AsktheExpertsBadge-360x240.png

    Ask the Experts: Listing Trial Staff and Others on the Statement of Investigator

Standard Operating Procedures for Risk-Based Monitoring of Clinical Trials

The information you need to adapt your monitoring plan to changing times.

Learn More Here
  • About Us
  • Contact Us
  • Privacy Policy
  • Do Not Sell My Personal Information

Footer Logo

300 N. Washington St., Suite 200, Falls Church, VA 22046, USA

Phone 617.948.5100 – Toll free 866.219.3440

Copyright © 2022. All Rights Reserved. Design, CMS, Hosting & Web Development :: ePublishing