Learn more about our researchers and their research topics!
Associate Professor (tenure track)
Using Language to Interpret Unstructured Data
(Emil Aaltonen Foundation, 2021–2023, PI: Tuomas Virtanen/audio signal processing).
The project develops deep learning methods to compute unstructured data, such as images and sounds, into linguistic representations by learning from human communication and intermodal translation. One application of these methods is the automatic translation of non-linguistic information into language, to be deployed for example in audio description and subtitling
Guided Audio Captioning for Complex Acoustic Environments
(Jane and Aatos Erkko Foundation, 2022–2023, PI: Annamaria Mesaros/audio signal processing).
The project develops a novel approach to machine learning to automatically produce linguistic descriptions of everyday acoustic environments. The general aim is to increase the understanding of how people (sighted and blind) interpret the world through sound and to teach intelligent machines to simulate it.
Research on Easy Language, especially Easy Swedish. Interest in how written, spoken, and signed language can be adapted to suit target groups who need easier communication.
Lätt finlandssvenska – en språkform för minoriteter inom minoriteten [Easy Finland Swedish – a language form for minorities within the minority].
The Society of Swedish Literature in Finland (2021–2023)
The project studies how spoken, written, and signed language can be adapted to suit target groups who require easier communication. Swedish-speaking Finns who need easy language constitute a linguistic minority within a minority and run the risk of double marginalisation. The project increases knowledge about their situation, language skills and language needs, strengthening these persons’ position as citizens and facilitating their opportunities to be active in their everyday life and in society.
Postdoctoral Research Fellow
Disabled persons’ digital and technological inclusion in the Finnish society: Subjective experiences
(Jenny and Antti Wihuri Foundation, 2021-2022)
Studying the digital inclusion in the Finnish society among adults with a hearing impairment, physical disability, or visual impairment. The research also investigates practical challenges and possibilities related to digital accessibility. The study is based on large questionnaire data (65 questions in total) collected from the target group representatives (n=282). The results bring concreteness to societal discussion and enable addressing the problems by decision-makers and service providers, among others.
Senior Research Fellow
(Post-doctoral researcher in the Graphic Justice research project, Academy of Finland, 2020–2024, PI Eliisa Pitkäsalo)
Official documents can often be difficult for clients to understand, due overly complicated language, unfamiliar terms, etc. Misunderstandings can impede people from accessing their social rights. The project examines how the comprehensibility of different types of legal documents – such as contracts or administrative documents – could be improved by intersemiotically translating verbal-only documents into comics.
Social Accessibility in Multiplayer Games
The ongoing PhD research studies accessibility in multiplayer game context. The research focuses on social aspects related to gaming and how to make these social aspects accessible to anyone interested. The main goal of the dissertation is to investigate how (socially) accessible multiplayer games are at the moment and how social accessibility could be improved.
The role of interaction and language use in the construction of audio described visual art museum experiences of visually impaired people. Contrastive study: Finland-Germany
Research on accessible visual art museum experiences
The project studies how social interaction and language use construct visual art museum experiences of visually impaired people on audio described and guided art museum tours. The project increases knowledge about the collaborative construction of a visual art experience of visually impaired people through social interaction. Additionally, the project aims to define differences and similarities in social and lingual practices in audio described visual art museum tours in Finland and Germany.
Voice User Interfaces for the Elderly in Semi-Public Spaces
The popularity of smart speakers such as Amazon Alexa and Google Home are on the rise across the globe. Previous studies have revealed that these devices are proving to be a boon for the users, helping them in many ways – reminding them to take medicines, accessing information in a natural way, helping with cooking and so on. My research focuses on how these devices can be utilized in semi-public spaces such as libraries, community centers, health centers by the elderly population. Can these devices be an accessibility tool for different purposes for the target users? What are the challenges of having such devices in semi-public spaces? What are the concerns that inhibit the use of such devices in semi-public spaces?
This research aims to qualitatively understand the user experience of elderly people with the use of smart speakers in semi-public spaces. The probable outcome of this research would throw light on how smart speakers could act as an accessibility tool for the elderly.
Researches the various socio-technical aspects of accessible and assistive technology in the future society. Interest in how emerging technologies (such as AI and XR) can be adapted to enhance accessibility, for example, in built environments, public transportation, and education, social, health care, and rehabilitation services.
Research on written Easy Finnish and its users. Interest in how Easy Finnish lexicon can be adapted to be accessible to people with intellectual disabilities.
Saavutettava selkokieli – Kehitysvammaiset henkilöt selkokielen käyttäjäryhmänä (Accessible language – People with intellectual disabilities as users of Easy Finnish).
The ongoing PhD research studies the accessibility of written Easy Finnish to easy language users with intellectual disabilities. Easy language users with intellectual disabilities are a heterogeneous group with varying language skills. The research increases knowledge about their lexical knowledge. It also provides scientifically based evidence for defining easy Finnish criteria.
Reception study on human-translated and machine-translated subtitles. Interest in how people react to the different kinds of translation and how this can be used to foster easy accessibility to information.
Machine Translation Potential (un)limited? – Investigating quality in machine-translated and human-translated subtitles
The project investigates response (lisibility), reaction (readability), and repercussion (viewer’s preferences and habits) of machine-translated and human-translated subtitles in Finnish and German. Living in a world of constant movement and migration means also adapting to foreigner’s needs regarding language and communication, therefore, to guarantee accessibility and social participation. Machine translation has proven to be an aid, but still lacks in quality, especially compared to human translation, which is still considered as the gold standard. However, time is money and so, there is growing interest in fostering machine translation suitability for subtitling.
The aim of the project is to gain a deeper insight into consumer’s use (interaction) with different sets of subtitles and hence whether there will be differences in attention allocation, comprehension, and attitude.
How do older adults experience learning through games and gaming?
Digitalization has brought challenges for the elderly to survive in everyday life, and many elderly people are in danger of being excluded from society and falling into an unequal position. Different feelings and prejudices towards technology have emerged in teaching the elderly. Some of the elderly students show anxiety and fear, while others are excited and want to know and learn more about new forms of technology.
Social responsibility and sustainable pedagogy are part of the research perspective. The research provides information on the attitudes of the elderly towards educational games and which things in gaming alleviate possible fears and anxiety. There hasn´t been previous research on educational games in the teaching of the elderly. The results of the research can be utilized in the teaching of the elderly and when designing accessible electronic and mobile services for the elderly.
Tekstitysvelvollisuuden täyttämisen keinot: Paraprofessionaalien tekstittäjien automaatioavusteisesti tuottama kielensisäinen tekstitys ja sen prosessit
[Means of meeting the subtitling obligations: Intralingual subtitling and its processes produced by paraprofessional subtitlers using automated tools]
Since a change in legislation in 2019, it is now mandatory for governmental and other public organizations to add intralingual subtitles on videos published on their websites. This has created a new group of paraprofessional subtitlers, who produce subtitles as part of their job, though it is not included in their original field of profession. The ongoing PhD research studies what actions have Finnish organizations affected by the legislation taken to meet the obligations, how the new paraprofessional subtitlers view their work, how they use automated tools, and what the produced subtitles are like from a linguistic perspective.