You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: "Harmony online coding competition on DOXA AI"
3
+
categories:
4
+
- "ai-in-research"
5
+
image: "/images/doxa.png"
6
+
date: 2024-10-21
7
+
url: "/doxa/"
8
+
---
9
+
10
+
## Harmony on DOXA AI: Train your own Large Language Model and win up to £500 in vouchers!
11
+
12
+
We would like to improve Harmony's matching algorithm. Quite often, Harmony mistakenly thinks that sentences are similar when a psychologist would consider them dissimilar, or vice versa. We have evaluated Harmony's performance [in this blog post](/nlp-semantic-text-matching/measuring-the-performance-of-nlp-algorithms/).
13
+
14
+
15
+
{{< image src="/images/harmony-vs-human.png" alt="Harmony vs Human" >}}
16
+
17
+
*Harmony is often misaligned with human evaluators*
18
+
19
+
20
+
We would like to improve Harmony with a *fine tuned* large language model. We have teamed up with DOXA AI and made an online competition where you can improve on the off-the-shelf LLMs which we are currently using. You can win up to £500 in vouchers! [Click here to join the Harmony matching competition on DOXA AI](https://doxaai.com/competition/harmony-matching).
21
+
22
+
23
+
{{< grid columns="2" >}}
24
+
{{< card heading="Try competition" copy="Compete on DOXA AI by fine tuning your own large language model and improve Harmony!" url="https://doxaai.com/competition/harmony-matching" >}}
25
+
{{< card heading="Join community" copy="Join the Harmony Discord server. Check out the 🏅「matching-challenge」 channel!" url="https://discord.com/invite/harmonydata" >}}
26
+
{{< /grid >}}
27
+
28
+
29
+
30
+
We will have a livestreamed webinar to launch the competion on **Wednesday 30 October at 5pm UK time**.
31
+
32
+
33
+
## Webinar joining instructions
34
+
35
+
* Harmony and DOXA AI
36
+
* Wednesday, 30 October · 5:00 – 6:00pm
37
+
* Time zone: Europe/London
38
+
* Google Meet joining info
39
+
* Video call link: https://meet.google.com/yko-evnr-ppt
* More phone numbers: https://tel.meet/yko-evnr-ppt?pin=7879899599026
42
+
43
+
44
+
## Prizes
45
+
46
+
The prize for the winner of the competition is £500 in vouchers and the runner up will get £250 in vouchers.
47
+
48
+
## More information about how Harmony's matching compares to human evaluators
49
+
50
+
The Harmony team has recently published a paper in BMC Psychiatry showing that there is a correlation between Harmony's cosine similarity values and human evaluators, but this could be improved:
51
+
52
+
* McElroy, E., Wood, T.A., Bond, R., Mulvenna M., Shevlin M., Ploubidis G., Scopel Hoffmann M., Moltrecht B., [Using natural language processing to facilitate the harmonisation of mental health questionnaires: a validation study using real-world data](/ai-in-mental-health/bmc-psychiatry-paper/). BMC Psychiatry 24, 530 (2024). https://doi.org/10.1186/s12888-024-05954-2
53
+
54
+
55
+
56
+
## See other events
57
+
58
+
* 22 November 2024: [Harmony at Women In Data™️ London Chapter](/open-source-for-social-science/women-in-data/)
59
+
* 8 October 2024: [Harmony: a free online tool using LLMs for research in psychology and social sciences](/psychology-ai-tool/aidl-meetup/) at AI|DL London
60
+
* 11 and 12 September 2024: [Harmony at MethodsCon Futures](/ai-in-mental-health/harmony-at-methodscon-futures/
61
+
) in Manchester
62
+
* 2 July 2024: [Harmony: NLP and generative models for psychology research](/open-source-for-social-science/pydata-meetup/) at Pydata London
63
+
* 3 June 2024: [Harmony Hackathon](/open-source-for-social-science/hackathon/) at UCL
64
+
* 5 May 2024: [Harmony: A global platform for harmonisation, translation and cooperation in mental health](/ai-in-mental-health/harmony-at-lifecourse-seminar/) at Melbourne Children’s LifeCourse Initiative seminar series.
65
+
* 27 March 2024: [Harmony at AI Camp](/psychology-ai-tool/aicamp-meetup/)
66
+
* 17 August 2023: [Harmony and TIDAL workshop](/ai-in-mental-health/harmony-and-tidal-workshop)
## Harmony at Women In Data™️ London Chapter (online event)
13
+
14
+
On 22 November, we will present Harmony at Women In Data™️ London Chapter's event on Application of Generative AI and LLMs. Thomas Wood will demonstrate Harmony and how it uses Gen AI. The event will be livestreamed.
* 22 November 2024: [Harmony at Women In Data™️ London Chapter](/open-source-for-social-science/women-in-data/)
31
+
* 8 October 2024: [Harmony: a free online tool using LLMs for research in psychology and social sciences](/psychology-ai-tool/aidl-meetup/) at AI|DL London
32
+
* 11 and 12 September 2024: [Harmony at MethodsCon Futures](/ai-in-mental-health/harmony-at-methodscon-futures/
33
+
) in Manchester
34
+
* 2 July 2024: [Harmony: NLP and generative models for psychology research](/open-source-for-social-science/pydata-meetup/) at Pydata London
35
+
* 3 June 2024: [Harmony Hackathon](/open-source-for-social-science/hackathon/) at UCL
36
+
* 5 May 2024: [Harmony: A global platform for harmonisation, translation and cooperation in mental health](/ai-in-mental-health/harmony-at-lifecourse-seminar/) at Melbourne Children’s LifeCourse Initiative seminar series.
37
+
* 27 March 2024: [Harmony at AI Camp](/psychology-ai-tool/aicamp-meetup/)
38
+
* 17 August 2023: [Harmony and TIDAL workshop](/ai-in-mental-health/harmony-and-tidal-workshop)
0 commit comments