Project Scope |
Comparing Analysis Method Implementations in Software (CAMIS) has evolved from the Clinical Statistical Reporting in a Multilingual World project. Several discrepancies have been discovered in statistical analysis results between different programming languages, even in fully qualified statistical computing environments. Subtle differences exist between the fundamental approaches implemented by each language, yielding differences in results which are each correct in their own right. The fact that these differences exist causes unease on the behalf of sponsor companies when submitting to a regulatory agency, as it is uncertain if the agency will view these differences as problematic. Understanding the agency’s expectations will contribute significantly to enabling the broader adoption of multiple programming languages in the production of data submission packages for regulatory review The Clinical Statistical Reporting in a Multilingual WorldCAMIS project seeks to clearly define this problem and provide a framework for assessing the fundamental differences for a particular statistical analysis across languages. In this context, the risk of interpreting numerical differences in analysis results due solely to differences in programming language can be mitigated, instilling confidence in both the sponsor company and the agency during the review period. This will be accomplished by:
The CAMIS repository to document known differences is now live and open for community contributions. |
Project Leads |
---|
Michael Rimler (GSK)
Mike Stackhouse (Atorus Research)
Objectives and Deliverables | Timelines |
---|---|
GitHub Repository documenting identified differences between statistical analysis implementations (based on R and SAS use cases as a starting point) | Q2 2022 |
Lyn Taylor, Parexel | |
Christina Fillmore, GSK | |
Harshal Khanolkar, Novo Nordisk | |
Alex Pearce, PHUSE Project Assistant |
| ||||||
---|---|---|---|---|---|---|
|
Objectives & Deliverables | Timelines | |||||
---|---|---|---|---|---|---|
Expand repository to provide comparable syntax across languages (based on R and SAS use cases as a starting point) | Q2 20222023 | |||||
Expand GitHub repository to incorporate Python and/or Julia | Q2 2022Q3 2023 | |||||
White Paper providing framework for addressing language discrepancies in statistical analysis implementations, including specific use cases as examples | Q3 2022 | |||||
| ||||||
Started draft writing of white paper with new sub-team. Group are now combining White Paper draft pieces together for wider team review | ||||||
Project Members | Organisation | |||||
Aiming Yang | Merck, Sharp & Dohme | |||||
Amrit Singh | Bayer | |||||
Andy Miskell | Eli Lilly | |||||
Andy Nicholls | GSK | |||||
Brian Varney | Experis | |||||
Chung-kai Sun | Janssen Research & Development | |||||
Clara Beck | Chrestos | |||||
Doug Thompson | GSK | |||||
Harshal Khanolkar | Novo Nordisk | |||||
Joseph Rickert | RStudio | |||||
Karnika Dalal | Regeneron | |||||
Kevin Putschko | Experis | |||||
Kyle Lee | FDA | |||||
Ke Wang | Novartis | |||||
Michael Kane | Yale University | |||||
Matthew Kumar | Bayer | |||||
Mia QI | Janssen Research & Development | |||||
Min-Hua Jen | Eli Lilly | |||||
Soren Lophaven | Omicron | |||||
Suhas Ravindra | GSK | |||||
Steve Walker | ExperisOngoing |