Loading…
Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study
Psoriasis vulgaris (PsV) and Psoriatic arthritis (PsA) are intertwined multifactorial diseases with significant impact on health and quality of life, which can be debilitating due to chronicity and treatment complexity. Predicting treatment response and disease progression in these conditions is cha...
Saved in:
Published in: | JMIR formative research 2024-04 |
---|---|
Main Authors: | , , , , , , , , , , , , |
Format: | Article |
Language: | English |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | |
container_start_page | |
container_title | JMIR formative research |
container_volume | |
creator | Schaffert, Daniel Bibi, Igor Blauth, Mara Lull, Christian von Ahnen, Jan Alwin Groß, Georg Schulze-Hagen, Theresa Knitza, Johannes Kuhn, Sebastian Benecke, Johannes Schmieder, Astrid Leipe, Jan Olsavszky, Victor |
description | Psoriasis vulgaris (PsV) and Psoriatic arthritis (PsA) are intertwined multifactorial diseases with significant impact on health and quality of life, which can be debilitating due to chronicity and treatment complexity. Predicting treatment response and disease progression in these conditions is challenging, but crucial for optimising therapeutic interventions. The advancing technology of automated machine learning (AutoML) holds great promise for rapidly building highly accurate predictive models based on patient features and treatment data.
The study aimed to develop highly accurate ML models using AutoML to address key clinical questions in PsV and PsA patients, including predicting therapy changes and identifying reasons for therapy changes, factors influencing skin lesion progression or factors associated with an abnormal BASDAI score.
After extensive dataset preparation of clinical study data from 309 PsV and PsA patients, a secondary dataset was created and ultimately analysed using AutoML to build a variety of predictive models and select the most accurate one for each variable of interest.
"Therapy change at 24 weeks follow-up" was modelled using the eXtreme Gradient Boosted Trees Classifier with Early Stopping model (AUC of 0.9078 and LogLoss of 0.3955 for the holdout partition) to gain insight into the factors influencing therapy change, such as the initial systemic therapeutic agent, the score achieved in the CASPAR classification criteria at baseline, and changes in quality of life. An AVG blender of 3 models (Gradient Boosted Trees Classifier, ExtraTrees Classifier, Eureqa Generalised Additive Model Classifier) with an AUC of 0.8750 and a LogLoss of 0.4603 was used to predict therapy changes on two hypothetical patients to highlight the importance of such influencing factors. Notably, treatments such as MTX or specific biologicals showed a lower propensity for change. A further AVG Blender of RandomForest Classifier, eXtreme Gradient Boosted Trees Classifier and Eureqa Classifier (AUC of 0.9241 and LogLoss of 0.4498) was then used to estimate "PASI change after 24 weeks" with the primary predictors being the initial PASI score, change in pruritus and change in therapy. A lower initial PASI score, and consistently low pruritus were associated with better outcomes. Finally, "BASDAI classification at baseline" was analysed using an AVG Blender of Eureqa Generalised Additive Model Classifier, eXtreme Gradient Boosted Trees Classifier with Early S |
format | article |
fullrecord | <record><control><sourceid>pubmed</sourceid><recordid>TN_cdi_pubmed_primary_38738977</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>38738977</sourcerecordid><originalsourceid>FETCH-pubmed_primary_387389773</originalsourceid><addsrcrecordid>eNqFj91Kw0AQhRdBbNG-gswLFPKDSetdqIqCP0Fb9a6sm2kykuyGmU0lT-eruQW99urMcA585xypaXKRxfM0yd4naibyGUVREsdZvkxP1CRd5OlimedT9V0M3nXaYwUP2jRkEe5RsyVbQ8lYkfECj2hQRPMIm9647uCtG2Tdj7BqtK1RgCyU2hPaEH8j30ApjkkLCbwOba05HOihYN8w-fAUtoKNNW6PfAB8wZ3dtQPaQIInC1ckqAVDB1dzgJOzl_CMnp30aDztEV78UI1n6ninW8HZr56q85vr9ep23g8fHVbbnqkLxbd_i9N_Az8SPGbm</addsrcrecordid><sourcetype>Index Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study</title><source>Open Access: PubMed Central</source><source>Publicly Available Content Database</source><creator>Schaffert, Daniel ; Bibi, Igor ; Blauth, Mara ; Lull, Christian ; von Ahnen, Jan Alwin ; Groß, Georg ; Schulze-Hagen, Theresa ; Knitza, Johannes ; Kuhn, Sebastian ; Benecke, Johannes ; Schmieder, Astrid ; Leipe, Jan ; Olsavszky, Victor</creator><creatorcontrib>Schaffert, Daniel ; Bibi, Igor ; Blauth, Mara ; Lull, Christian ; von Ahnen, Jan Alwin ; Groß, Georg ; Schulze-Hagen, Theresa ; Knitza, Johannes ; Kuhn, Sebastian ; Benecke, Johannes ; Schmieder, Astrid ; Leipe, Jan ; Olsavszky, Victor</creatorcontrib><description>Psoriasis vulgaris (PsV) and Psoriatic arthritis (PsA) are intertwined multifactorial diseases with significant impact on health and quality of life, which can be debilitating due to chronicity and treatment complexity. Predicting treatment response and disease progression in these conditions is challenging, but crucial for optimising therapeutic interventions. The advancing technology of automated machine learning (AutoML) holds great promise for rapidly building highly accurate predictive models based on patient features and treatment data.
The study aimed to develop highly accurate ML models using AutoML to address key clinical questions in PsV and PsA patients, including predicting therapy changes and identifying reasons for therapy changes, factors influencing skin lesion progression or factors associated with an abnormal BASDAI score.
After extensive dataset preparation of clinical study data from 309 PsV and PsA patients, a secondary dataset was created and ultimately analysed using AutoML to build a variety of predictive models and select the most accurate one for each variable of interest.
"Therapy change at 24 weeks follow-up" was modelled using the eXtreme Gradient Boosted Trees Classifier with Early Stopping model (AUC of 0.9078 and LogLoss of 0.3955 for the holdout partition) to gain insight into the factors influencing therapy change, such as the initial systemic therapeutic agent, the score achieved in the CASPAR classification criteria at baseline, and changes in quality of life. An AVG blender of 3 models (Gradient Boosted Trees Classifier, ExtraTrees Classifier, Eureqa Generalised Additive Model Classifier) with an AUC of 0.8750 and a LogLoss of 0.4603 was used to predict therapy changes on two hypothetical patients to highlight the importance of such influencing factors. Notably, treatments such as MTX or specific biologicals showed a lower propensity for change. A further AVG Blender of RandomForest Classifier, eXtreme Gradient Boosted Trees Classifier and Eureqa Classifier (AUC of 0.9241 and LogLoss of 0.4498) was then used to estimate "PASI change after 24 weeks" with the primary predictors being the initial PASI score, change in pruritus and change in therapy. A lower initial PASI score, and consistently low pruritus were associated with better outcomes. Finally, "BASDAI classification at baseline" was analysed using an AVG Blender of Eureqa Generalised Additive Model Classifier, eXtreme Gradient Boosted Trees Classifier with Early Stopping and Dropout Additive Regression Trees Classifier with an AUC of 0.8274 and LogLoss of 0.5037. Factors influencing BASDAI scores included initial pain, disease activity and HADS scores for depression and anxiety. Increased pain, disease activity and psychological distress were generally likely to lead to higher BASDAI scores.
The practical implications of these models for clinical decision making in PsV and PsA have the potential to guide early investigation and treatment, contributing to improved patient outcomes.</description><identifier>EISSN: 2561-326X</identifier><identifier>PMID: 38738977</identifier><language>eng</language><publisher>Canada</publisher><ispartof>JMIR formative research, 2024-04</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38738977$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Schaffert, Daniel</creatorcontrib><creatorcontrib>Bibi, Igor</creatorcontrib><creatorcontrib>Blauth, Mara</creatorcontrib><creatorcontrib>Lull, Christian</creatorcontrib><creatorcontrib>von Ahnen, Jan Alwin</creatorcontrib><creatorcontrib>Groß, Georg</creatorcontrib><creatorcontrib>Schulze-Hagen, Theresa</creatorcontrib><creatorcontrib>Knitza, Johannes</creatorcontrib><creatorcontrib>Kuhn, Sebastian</creatorcontrib><creatorcontrib>Benecke, Johannes</creatorcontrib><creatorcontrib>Schmieder, Astrid</creatorcontrib><creatorcontrib>Leipe, Jan</creatorcontrib><creatorcontrib>Olsavszky, Victor</creatorcontrib><title>Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study</title><title>JMIR formative research</title><addtitle>JMIR Form Res</addtitle><description>Psoriasis vulgaris (PsV) and Psoriatic arthritis (PsA) are intertwined multifactorial diseases with significant impact on health and quality of life, which can be debilitating due to chronicity and treatment complexity. Predicting treatment response and disease progression in these conditions is challenging, but crucial for optimising therapeutic interventions. The advancing technology of automated machine learning (AutoML) holds great promise for rapidly building highly accurate predictive models based on patient features and treatment data.
The study aimed to develop highly accurate ML models using AutoML to address key clinical questions in PsV and PsA patients, including predicting therapy changes and identifying reasons for therapy changes, factors influencing skin lesion progression or factors associated with an abnormal BASDAI score.
After extensive dataset preparation of clinical study data from 309 PsV and PsA patients, a secondary dataset was created and ultimately analysed using AutoML to build a variety of predictive models and select the most accurate one for each variable of interest.
"Therapy change at 24 weeks follow-up" was modelled using the eXtreme Gradient Boosted Trees Classifier with Early Stopping model (AUC of 0.9078 and LogLoss of 0.3955 for the holdout partition) to gain insight into the factors influencing therapy change, such as the initial systemic therapeutic agent, the score achieved in the CASPAR classification criteria at baseline, and changes in quality of life. An AVG blender of 3 models (Gradient Boosted Trees Classifier, ExtraTrees Classifier, Eureqa Generalised Additive Model Classifier) with an AUC of 0.8750 and a LogLoss of 0.4603 was used to predict therapy changes on two hypothetical patients to highlight the importance of such influencing factors. Notably, treatments such as MTX or specific biologicals showed a lower propensity for change. A further AVG Blender of RandomForest Classifier, eXtreme Gradient Boosted Trees Classifier and Eureqa Classifier (AUC of 0.9241 and LogLoss of 0.4498) was then used to estimate "PASI change after 24 weeks" with the primary predictors being the initial PASI score, change in pruritus and change in therapy. A lower initial PASI score, and consistently low pruritus were associated with better outcomes. Finally, "BASDAI classification at baseline" was analysed using an AVG Blender of Eureqa Generalised Additive Model Classifier, eXtreme Gradient Boosted Trees Classifier with Early Stopping and Dropout Additive Regression Trees Classifier with an AUC of 0.8274 and LogLoss of 0.5037. Factors influencing BASDAI scores included initial pain, disease activity and HADS scores for depression and anxiety. Increased pain, disease activity and psychological distress were generally likely to lead to higher BASDAI scores.
The practical implications of these models for clinical decision making in PsV and PsA have the potential to guide early investigation and treatment, contributing to improved patient outcomes.</description><issn>2561-326X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNqFj91Kw0AQhRdBbNG-gswLFPKDSetdqIqCP0Fb9a6sm2kykuyGmU0lT-eruQW99urMcA585xypaXKRxfM0yd4naibyGUVREsdZvkxP1CRd5OlimedT9V0M3nXaYwUP2jRkEe5RsyVbQ8lYkfECj2hQRPMIm9647uCtG2Tdj7BqtK1RgCyU2hPaEH8j30ApjkkLCbwOba05HOihYN8w-fAUtoKNNW6PfAB8wZ3dtQPaQIInC1ckqAVDB1dzgJOzl_CMnp30aDztEV78UI1n6ninW8HZr56q85vr9ep23g8fHVbbnqkLxbd_i9N_Az8SPGbm</recordid><startdate>20240411</startdate><enddate>20240411</enddate><creator>Schaffert, Daniel</creator><creator>Bibi, Igor</creator><creator>Blauth, Mara</creator><creator>Lull, Christian</creator><creator>von Ahnen, Jan Alwin</creator><creator>Groß, Georg</creator><creator>Schulze-Hagen, Theresa</creator><creator>Knitza, Johannes</creator><creator>Kuhn, Sebastian</creator><creator>Benecke, Johannes</creator><creator>Schmieder, Astrid</creator><creator>Leipe, Jan</creator><creator>Olsavszky, Victor</creator><scope>NPM</scope></search><sort><creationdate>20240411</creationdate><title>Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study</title><author>Schaffert, Daniel ; Bibi, Igor ; Blauth, Mara ; Lull, Christian ; von Ahnen, Jan Alwin ; Groß, Georg ; Schulze-Hagen, Theresa ; Knitza, Johannes ; Kuhn, Sebastian ; Benecke, Johannes ; Schmieder, Astrid ; Leipe, Jan ; Olsavszky, Victor</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-pubmed_primary_387389773</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schaffert, Daniel</creatorcontrib><creatorcontrib>Bibi, Igor</creatorcontrib><creatorcontrib>Blauth, Mara</creatorcontrib><creatorcontrib>Lull, Christian</creatorcontrib><creatorcontrib>von Ahnen, Jan Alwin</creatorcontrib><creatorcontrib>Groß, Georg</creatorcontrib><creatorcontrib>Schulze-Hagen, Theresa</creatorcontrib><creatorcontrib>Knitza, Johannes</creatorcontrib><creatorcontrib>Kuhn, Sebastian</creatorcontrib><creatorcontrib>Benecke, Johannes</creatorcontrib><creatorcontrib>Schmieder, Astrid</creatorcontrib><creatorcontrib>Leipe, Jan</creatorcontrib><creatorcontrib>Olsavszky, Victor</creatorcontrib><collection>PubMed</collection><jtitle>JMIR formative research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schaffert, Daniel</au><au>Bibi, Igor</au><au>Blauth, Mara</au><au>Lull, Christian</au><au>von Ahnen, Jan Alwin</au><au>Groß, Georg</au><au>Schulze-Hagen, Theresa</au><au>Knitza, Johannes</au><au>Kuhn, Sebastian</au><au>Benecke, Johannes</au><au>Schmieder, Astrid</au><au>Leipe, Jan</au><au>Olsavszky, Victor</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study</atitle><jtitle>JMIR formative research</jtitle><addtitle>JMIR Form Res</addtitle><date>2024-04-11</date><risdate>2024</risdate><eissn>2561-326X</eissn><abstract>Psoriasis vulgaris (PsV) and Psoriatic arthritis (PsA) are intertwined multifactorial diseases with significant impact on health and quality of life, which can be debilitating due to chronicity and treatment complexity. Predicting treatment response and disease progression in these conditions is challenging, but crucial for optimising therapeutic interventions. The advancing technology of automated machine learning (AutoML) holds great promise for rapidly building highly accurate predictive models based on patient features and treatment data.
The study aimed to develop highly accurate ML models using AutoML to address key clinical questions in PsV and PsA patients, including predicting therapy changes and identifying reasons for therapy changes, factors influencing skin lesion progression or factors associated with an abnormal BASDAI score.
After extensive dataset preparation of clinical study data from 309 PsV and PsA patients, a secondary dataset was created and ultimately analysed using AutoML to build a variety of predictive models and select the most accurate one for each variable of interest.
"Therapy change at 24 weeks follow-up" was modelled using the eXtreme Gradient Boosted Trees Classifier with Early Stopping model (AUC of 0.9078 and LogLoss of 0.3955 for the holdout partition) to gain insight into the factors influencing therapy change, such as the initial systemic therapeutic agent, the score achieved in the CASPAR classification criteria at baseline, and changes in quality of life. An AVG blender of 3 models (Gradient Boosted Trees Classifier, ExtraTrees Classifier, Eureqa Generalised Additive Model Classifier) with an AUC of 0.8750 and a LogLoss of 0.4603 was used to predict therapy changes on two hypothetical patients to highlight the importance of such influencing factors. Notably, treatments such as MTX or specific biologicals showed a lower propensity for change. A further AVG Blender of RandomForest Classifier, eXtreme Gradient Boosted Trees Classifier and Eureqa Classifier (AUC of 0.9241 and LogLoss of 0.4498) was then used to estimate "PASI change after 24 weeks" with the primary predictors being the initial PASI score, change in pruritus and change in therapy. A lower initial PASI score, and consistently low pruritus were associated with better outcomes. Finally, "BASDAI classification at baseline" was analysed using an AVG Blender of Eureqa Generalised Additive Model Classifier, eXtreme Gradient Boosted Trees Classifier with Early Stopping and Dropout Additive Regression Trees Classifier with an AUC of 0.8274 and LogLoss of 0.5037. Factors influencing BASDAI scores included initial pain, disease activity and HADS scores for depression and anxiety. Increased pain, disease activity and psychological distress were generally likely to lead to higher BASDAI scores.
The practical implications of these models for clinical decision making in PsV and PsA have the potential to guide early investigation and treatment, contributing to improved patient outcomes.</abstract><cop>Canada</cop><pmid>38738977</pmid></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2561-326X |
ispartof | JMIR formative research, 2024-04 |
issn | 2561-326X |
language | eng |
recordid | cdi_pubmed_primary_38738977 |
source | Open Access: PubMed Central; Publicly Available Content Database |
title | Automated Machine Learning Predicts Necessary Upcoming Therapy Changes in Patients With Psoriasis Vulgaris et Arthritis And Uncovers New Influences On Disease Progression: Retrospective Study |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T06%3A38%3A42IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-pubmed&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automated%20Machine%20Learning%20Predicts%20Necessary%20Upcoming%20Therapy%20Changes%20in%20Patients%20With%20Psoriasis%20Vulgaris%20et%20Arthritis%20And%20Uncovers%20New%20Influences%20On%20Disease%20Progression:%20Retrospective%20Study&rft.jtitle=JMIR%20formative%20research&rft.au=Schaffert,%20Daniel&rft.date=2024-04-11&rft.eissn=2561-326X&rft_id=info:doi/&rft_dat=%3Cpubmed%3E38738977%3C/pubmed%3E%3Cgrp_id%3Ecdi_FETCH-pubmed_primary_387389773%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/38738977&rfr_iscdi=true |