diff --git a/assets/images/bmc.png b/assets/images/bmc.png new file mode 100644 index 00000000..fbbd153b Binary files /dev/null and b/assets/images/bmc.png differ diff --git a/content/en/blog/bmc-paper.md b/content/en/blog/bmc-paper.md new file mode 100644 index 00000000..b582dc9f --- /dev/null +++ b/content/en/blog/bmc-paper.md @@ -0,0 +1,47 @@ +--- +title: "Harmony's research has been published in BMC Psychiatry!" +description: "Publication of paper: Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data, published in BMC Psychiatry." +date: "2024-08-20" +categories: + - "psychology" + +image: "/images/bmc.png" +url: "/bmc-psychiatry-paper" + +--- + +# BMC Psychiatry has published our paper validating Harmony on real-world data + +We are pleased to announce the publication of a paper validating Harmony on real-life data: [Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data](https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-024-05954-2), authored by [Eoin McElroy](/our-team/), [Thomas Wood](https://fastdatascience.com), Raymond Bond, Maurice Mulvenna, Mark Shevlin, [George B. Ploubidis](/our-team/), [Mauricio Scopel Hoffmann](/our-team/) and [Bettina Moltrecht](/our-team/), and published in [BMC Psychiatry](https://bmcpsychiatry.biomedcentral.com/). + +* McElroy, E., Wood, T.A., Bond, R., Mulvenna M., Shevlin M., Ploubidis G., Scopel Hoffmann M., Moltrecht B., [Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data](https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-024-05954-2#citeas). BMC Psychiatry 24, 530 (2024). https://doi.org/10.1186/s12888-024-05954-2 + + + + +## Summary of the Harmony real-world validation study + +Our study aimed to evaluate the effectiveness of Natural Language Processing (NLP) in [harmonising mental health questionnaires](/ces-d-vs-gad-7/) for cross-study research. + +By comparing the semantic similarity of questionnaire items using NLP (the [Sentence-BERT transformer model](/measuring-the-performance-of-nlp-algorithms/)) with their actual correlation in a sample population, we found a moderate relationship (*r* = .48, *p* < .001) between the two measures. This suggests that NLP can accurately identify similar questions across different questionnaires. + +While the NLP model showed promise in uncovering underlying patterns in the data, it required manual intervention to determine which relationships were truly relevant. + +Our study showed that NLP can be a useful tool to match similar questions from different questionnaires, but it's not perfect and should be used with caution. + +## Citing the BMC validation paper + +A BibTeX entry for LaTeX users is + +``` +@article{mcelroy2024using, + title={Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data}, + author={McElroy, Eoin and Wood, Thomas and Bond, Raymond and Mulvenna, Maurice and Shevlin, Mark and Ploubidis, George B and Hoffmann, Mauricio Scopel and Moltrecht, Bettina}, + journal={BMC psychiatry}, + volume={24}, + number={1}, + pages={530}, + year={2024}, + publisher={Springer} +} +``` diff --git a/content/en/frequently-asked-questions.md b/content/en/frequently-asked-questions.md index 4340a388..1f1d7da0 100644 --- a/content/en/frequently-asked-questions.md +++ b/content/en/frequently-asked-questions.md @@ -18,7 +18,27 @@ Harmony is a tool that helps researchers automate the process of harmonisation u ## How do I cite Harmony? -If you would like to cite the tool alone, you can cite: +If you would like to cite our [validation study](/bmc-psychiatry-paper/), published in BMC Psychiatry, you can cite: + +* McElroy, E., Wood, T.A., Bond, R., Mulvenna M., Shevlin M., Ploubidis G., Scopel Hoffmann M., Moltrecht B., [Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data](https://bmcpsychiatry.biomedcentral.com/articles/10.1186/s12888-024-05954-2#citeas). BMC Psychiatry 24, 530 (2024). https://doi.org/10.1186/s12888-024-05954-2 + + +A BibTeX entry for LaTeX users is + +``` +@article{mcelroy2024using, + title={Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data}, + author={McElroy, Eoin and Wood, Thomas and Bond, Raymond and Mulvenna, Maurice and Shevlin, Mark and Ploubidis, George B and Hoffmann, Mauricio Scopel and Moltrecht, Bettina}, + journal={BMC psychiatry}, + volume={24}, + number={1}, + pages={530}, + year={2024}, + publisher={Springer} +} +``` + +If you would like to cite the Harmony tool alone, you can cite: Wood, T.A., McElroy, E., Moltrecht, B., Ploubidis, G.B., Scopel Hoffmann, M., Harmony [Computer software], Version 1.0, accessed at https://harmonydata.ac.uk/app. [Ulster University](https://ulster.ac.uk) (2022)