In recent years, there has been an increase in interest and explorations of the use of machine learning (ML) to assist in the diagnosis of mental health problems; and for improving access to, engagement with, and the outcomes of, therapeutic treatment. Amongst a wide range of diagnosable mental disorders, affective disorders – such as depression, bipolar and anxiety – are the most common. For these disorders, distortions and inconsistencies in a person’s emotional state (their mood) present the primary cause for disruptions to their life. Here, ML promises to offer new routes for improving the identification of health risk factors; the prediction of disease progression; and the development of personalised health interventions. Research to date has started to explore the identification of mental health problems through inferences about peoples’ behaviours on social media, online searches, or mobile phone app uses; as well as varied approaches to assess, or continuously monitor, a person’s mental health and related symptoms by measuring sleep, mood, stress or physical activity via audio, visual or physiological signal processing.

Despite great potential, the realization of effective ML-enabled applications for mental health remains a hugely challenging area for research and development. Among the very many challenges in this domain are the need for a stronger focus on real-world applications and user-centred design processes to aid the identification of real healthcare needs that can sensibly be supported through ML; and accordingly, careful choices in data collection and the design of reliable and fair algorithmic models. Especially in mental health, where data and ML-supported decisions can have far reaching personal, social and economic impact, we need to be very critical of what reasonable inferences can be drawn from specific data; design interfaces that help people to appropriately interpret system inferences; and ensure that, ultimately, humans remain in control over, and accountable for, important ML-informed decisions.

Workshop Focus

This workshop seeks to bring together an inter-disciplinary group of researchers and practitioners from academia and industry to discuss the unique opportunities and challenges for developing effective, ethical and trustworthy ML- approaches and interventions for the diagnosis and treatment of affective disorders. The specific focus will be on (but it is not limited to):

  • Examples of ML-algorithms and ML-enabled applications for detecting, monitoring, or predicting peoples’ mental health and wellbeing using static, longitudinal and/or iterative data (i.e., online learning)
  • Approaches to passive sensing and signal processing of visual, audio, physiological or multi-modal inputs for assessing human emotions and behaviours related to affective disorders
  • Design challenges for interfaces and interactions that incorporate ML for affective disorders
  • ML approaches to assist precision in healthcare, predict health risks, the discovery of disease subtypes, or the development of personalized interventions in the context of affective disorders
  • Practical challenges in conducting ML research to aid affective disorders in real-world situations (i.e., gaining access to users and data; prototyping ML systems end-to-end; working effectively within multi-disciplinary teams)
  • Human-in-the-loop and collaborative approaches in the design of ML interventions that aim to support clinical decision making
  • Reflections on ethics in developing ML interventions for the diagnosis and treatment of affective disorders

Submissions & Dates

We invite submissions of short papers (2-4 pages) in ACII paper format. Submissions will be reviewed by members of the organising and program committee based on relevance to the workshop and potential for contributing to discussions. Workshop proceedings will be published by IEEE Xplore.

Please submit your paper to the "Machine Learning for the Diagnosis and Treatment of Affective Disorders" track via the easychair submission system.

Submissions due: 18th 24th June 2019, 15:00 (London time zone: GMT +1)
Extended deadline due to delayed main conference track notifications!

Author Notifications by: 9th of July 2019

Camera Ready papers due: 12th 19th of July 2019

Registration by: 23rd of August 2019
If online registration is closed, please email Mercedes Torres Torress to register by this date. More details here.

Day of the Workshop: 3rd of September 2019

Meet the Organizers

Anja Thieme

HCI Researcher
Microsoft Research Cambridge
Main contact: anthie [at]

Danielle Belgrave

Researcher in Healthcare ML
Microsoft Research Cambridge

Gavin Doherty

Associate Professor in Computer Science and Statistics at Trinity College Dublin,
UX Director SilverCloud Health

Tad Hirsch

Professor of Art + Design
Northeastern University

Munmun De Choudhury

Assistant Professor in Interactive Computing
Georgia Institute of Technology

Mary Czerwinski

Research Manager of Visualisation and Interaction
Microsoft Research Redmond

Akane Sano

Assistant Professor in Electrical Computer Engineering and Computing Science
Rice University

Program Commitee

Saeed Abdullah, Penn State University, US
Talayeh Aledavood, University of Helsinki, FI
Angel Enrique, Silvercloud Health, IRL
Nadia Bianchi-Berthouze, University College London, UK
Rafael Calvo, Imperial College London, UK
Prerna Chikersal, Carnegie Mellon University, US
Afsaneh Doryab, Carnegie Mellon University, US
Jean Marcel Dos Reis Costa, Cornell University, US
Marzyeh Ghassemi, University of Toronto, CA
Martin Gjoreski, Jožef Stefan Institute, SVN
Mark Matthews, HealthRythms, US
Tristan Naumann, Microsoft Research Redmond, US
Temitayo Olugbade, University College London, UK
Pablo E. Paredes, Standford University, US
Koustuv Saha, Georgia Institute of Technology, US
Björn W. Schuller, University of Augsburg, GER
Greg Wadley, University of Melbourne, AUS
Steffen Walter, University of Ulm, GER

Invited Speakers

Stephen Schuller

Assistant Professor of Psychological Science
University of California, Irvine

Keynote Talk: Using Technology to Build “Smarter” Mental Health Services

Despite advances in the development of evidence-based mental health interventions, we have seen little movement in the prevalence of mental health disorders. Many have proposed that technology can help address problems in mental health services by making them more accessible, available, and cheaper. However, these proposals have not addressed what might be an unfortunate reality in that mental health services may not be as good as we think. Beyond a lack of engagement, mental health services suffer from a lack of quality and measurement. Advances in machine learning offers the potential to create “smarter” mental health services by improving our way to assess mental health issues and building personalized and more efficacious services. In this talk I will present research focused on both the assessment and treatment of mental health issues through technology including the use of sensor-based technologies to identify mental health issues and the IntelliCare platform, a suite of mini-apps capable of creating personalized sequences of technology-enabled care. I will discuss implications for the application of machine learning to mental health services as well as challenges in the design and implementation of these tools.

Mirco Musolesi

University College London

Invited Talk: Sensing and Modelling Human Behaviour & Emotional States using Mobile and IoT Devices

Today's mobile phones are far from mere communication devices they were just ten years ago. Equipped with sophisticated sensors and advanced computing hardware, phones can be used to infer users' location, activity, social setting and more. As devices become increasingly intelligent, their capabilities evolve beyond inferring context to predicting it, and then reasoning and acting upon the predicted context. Information about users’ behaviour can also be gathered by means of wearables and IoT devices as well as by sensors embedded in the fabric of our cities. Inference is not only limited to physical context and activities, but in the recent years mobile phones have been increasingly used to infer users' emotional states. The applications of these techniques are several, from positive behavioural intervention to more natural and effective human-mobile device interaction.
In this talk I will discuss the work of my lab in the area of mobile sensing for modelling and predicting human behaviour and emotional states. I will present our ongoing projects in the area of mobile systems for mood monitoring and mental health. In particular, I will show how mobile phones can be used to collect and analyse mobility patterns of individuals in order to quantitatively understand how mental health problems affect their daily routines and behaviour and how potential changes in mood can be automatically detected from sensor data in a passive way. Finally, I will discuss our research directions in the broader area of anticipatory mobile computing, outlining the open challenges and opportunities.

Zakia Hammal

Senior Project Scientist
Carnegie Mellon University

Invited Talk: Multimodal Human Behavior Analysis and Modeling: Depression Severity Assessment - A Case Study

Nonverbal behavior is multimodal and interpersonal. In several studies, I addressed the dynamics of facial expression, head, and body movement for emotion communication, social interaction, and clinical applications. Leveraging recent advances in AI and machine learning, my work focuses on developing computational models to automatically analyze, recognize, and interpret multimodal social and communicative behavior. By modeling multimodal and interpersonal communication my work seeks to inform affective computing, social interaction, and behavioral health informatics. In this talk, I will focus on our recent work that has addressed computational methods for multimodal assessment of depression severity in participants undergoing treatment for depression.

Rafael Calvo

Professor at Dyson School of Design Engineering
Imperial College London

Invited Talk: Developing Technologies for Health, Mental health and Wellbeing

Substantial investment from government and commercial organisations in health technology reflects the opportunities to promote uniquely tailored, data-rich and autonomy-supportive tools at scale. Still many digital technologies for health and wellbeing go un-evaluated, lack an evidence base, or fall short of achieving the impact intended. Among the challenges to success is achieving the deep interdisciplinarity involved, which often requires continuous collaboration among medical professionals, psychologists, HCI researchers, user experience designers, software developers and end-users. While some projects lack theoretical grounding or an evidence-base, others fail to involve users effectively in order to understand their needs, perceptions and contexts, resulting in technologies that go unused.
Working together, researchers in HCI, health and the social sciences can improve the processes by which digital technologies are developed and distributed for the benefit of population-wide health and wellbeing. In this presentation, I will share some of the multidisciplinary evidence-based approaches to the development of health technologies formerly taken at the Wellbeing Technologies Lab in Sydney, Australia, and now starting at Imperial college London. I will describe some ideas on the contributions HCI can make to this field, and share a number of case studies in the domains of chronic illness, mental health and doctor-patient communication.

Agenda: Workshop Program

LOCATION: William Gates Building
ROOM: FW26 (First Floor, West, Room 26)

9:00 - 9:15 Welcome & Introductions

9:15 - 10:00 Keynote: Stephen Schuller (University of California, Irvine)

10:00 - 10:30 Workshop Talks: Depression & Suicide

Analysis of Online Suicide Risk with Document Embeddings and Latent Dirichlet Allocation
N. Jones, N. Jaques, P. Pataranutaporn, A. Ghandeharioun, R. Picard

Gram Matrix Trajectories of Body Shape Motion: An Application for Depression Severity Assessment
M. Daoudi, Z. Hammal, A. Kacem, J.F. Cohen

10:30 - 11:00 Coffee Break

11:00 - 12:00 Workshop Talks: Stress Recognition

An Effectiveness Comparison between the Use of Activity State Data and That of Activity Magnitude Data in Chronic Stress Recognition
Y. Nakashima, M. Tsujikawa, Y. Onishi, T. Umematsu

A Stress Recognition System Using HRV Parameters and Machine Learning Techniques
G. Giannakakis, K. Marias, M. Tsiknakis

Synthesizing Physiological and Motion Data for Stress and Meditation Detection
Md Taufeeq Uddin, S. Canavan

A Novel Multi-Kernel 1D Convolutional Neural Network for Stress Recognition from ECG (DWNet1D)
G. Giannakakis, E. Trivizakis, M. Tsiknakis, K. Marias

12:00 - 12:15 Workshop Talk: Diagnosing ADHD

Machine Learning Stop Signal Test (ML-SST): ML-based Mouse Tracking Enhances Adult ADHD Diagnosis
A. Leontyev, T. Yamauchi, M. Razavi

12:15 - 12:30 Workshop Talk: Predicting Future Wellbeing

Toward End-to-end Prediction of Future Wellbeing using Deep Sensor Representation Learning
B. Li, H. Yu, A. Sano

12:30 - 14:00 Lunch Break

14:00 - 14:20 Invited Talk: Mirco Musolesi (University College London)

14:20 - 14:40 Invited Talk: Zakia Hammal (Carnegie Mellon University)

14:40 - 15:00 Invited Talk: Rafael Calvo (Imperial College London)

15:00 - 15:30 Coffee Break

15:30 - 15:45 Defining Key Topics for Discussion

15:45 - 17:00 Group Discussions
Formation of 3-4 discussion groups: 45 minutes discussion of key topic + 10 minutes for reporting per group

17:00 - 17:30 Summary