Visualization of Patient Behavior from Natural Language

Jonathan Siddle, Alan Lindsay, Joao Ferreira, Julie Porteous, Jonathon Read, Fred Charles, Marc Cavazza, Gersende Georg

Research output: Contribution to conferencePaper


The visualization of procedural knowledge from textual documents using 3D animation may be a way to improve understanding. We are interested in applying this approach to documents relating to patient education for bariatric surgery: a domain with challenging textual documents describing behavior recommendations that contain few procedural steps and leave much commonsense knowledge unspecified. In this work we look at how to automatically capture knowledge from a range of differently phrased recommendations and use that with implicit knowledge about compliance and violation, such that the recommendations can be visualized using 3D animations. Our solution is an end-to-end system that automates this process via: analysis of input recommendations to uncover their conditional structure; the use of commonsense knowledge and deontic logic to generate compliance and violation rules; and mapping of this knowledge to update a default knowledge base, which is used to generate appropriate sequences of visualizations. In this paper we overview this approach and demonstrate its potential.
Original languageEnglish
Publication statusPublished - 2017
Event9th International Conference on Knowledge Capture 2017 - Austin, United States
Duration: 4 Dec 20176 Dec 2017


Conference9th International Conference on Knowledge Capture 2017
Abbreviated titleK-CAP 2017
CountryUnited States

Fingerprint Dive into the research topics of 'Visualization of Patient Behavior from Natural Language'. Together they form a unique fingerprint.

  • Cite this

    Siddle, J., Lindsay, A., Ferreira, J., Porteous, J., Read, J., Charles, F., Cavazza, M., & Georg, G. (2017). Visualization of Patient Behavior from Natural Language. Paper presented at 9th International Conference on Knowledge Capture 2017, Austin, United States.