Researchers

(Emil Aaltonen Foundation, 2021–2023, PI: Tuomas Virtanen/audio signal processing).

The project develops deep learning methods to compute unstructured data, such as images and sounds, into linguistic representations by learning from human communication and intermodal translation. One application of these methods is the automatic translation of non-linguistic information into language, to be deployed for example in audio description and subtitling

(Jane and Aatos Erkko Foundation, 2022–2023, PI: Annamaria Mesaros/audio signal processing).

The project develops a novel approach to machine learning to automatically produce linguistic descriptions of everyday acoustic environments. The general aim is to increase the understanding of how people (sighted and blind) interpret the world through sound and to teach intelligent machines to simulate it.

(Koneen Säätiö, 2024–2027)

Kielellinen affekti, syrjimätön kieli ja tutkimukseen osallistumisen saavutettavuus

Tampere in Emotions is a project in which Finnish-language researchers investigate linguistic affect, bias-free language, and access to participation in research. The project aims to 1) produce knowledge about linguistic affect and bias-free language in Finnish, 2) promote the use of bias-free language in Finnish, and 3) increase the access to participation in research by reducing cognitive and sensory barriers. The project consists of three parts. The first part examines group-based hierarchies that underlie biased language. The second part investigates the connection between affective meanings and bias-free language. The third part explores the language-related experiences of adults with visual impairments in Tampere region. The parts of the project are connected by the idea of Tampere as the heart of research. The researchers and stakeholders are based in Tampere and data are collected from Tampere region. Collaboration between researchers with and without disabilities and co-research with study participants are highlighted in this project.

(Jenny and Antti Wihuri Foundation, 2021-2022)

Studying the digital inclusion in the Finnish society among adults with a hearing impairment, physical disability, or visual impairment. The research also investigates practical challenges and possibilities related to digital accessibility. The study is based on large questionnaire data (65 questions in total) collected from the target group representatives (n=282). The results bring concreteness to societal discussion and enable addressing the problems by decision-makers and service providers, among others.

(Post-doctoral researcher in the Graphic Justice research project, Academy of Finland, 2020–2024, PI Eliisa Pitkäsalo)

Official documents can often be difficult for clients to understand, due overly complicated language, unfamiliar terms, etc. Misunderstandings can impede people from accessing their social rights. The project examines how the comprehensibility of different types of legal documents – such as contracts or administrative documents – could be improved by intersemiotically translating verbal-only documents into comics. 

The ongoing PhD research studies accessibility in multiplayer game context. The research focuses on social aspects related to gaming and how to make these social aspects accessible to anyone interested. The main goal of the dissertation is to investigate how (socially) accessible multiplayer games are at the moment and how social accessibility could be improved.

The project studies how social interaction and language use construct visual art museum experiences of visually impaired people on audio described and guided art museum tours. The project increases knowledge about the collaborative construction of a visual art experience of visually impaired people through social interaction. Additionally, the project aims to define differences and similarities in social and lingual practices in audio described visual art museum tours in Finland and Germany.

The popularity of smart speakers such as Amazon Alexa and Google Home are on the rise across the globe. Previous studies have revealed that these devices are proving to be a boon for the users, helping them in many ways – reminding them to take medicines, accessing information in a natural way, helping with cooking and so on. My research focuses on how these devices can be utilized in semi-public spaces such as libraries, community centers, health centers by the elderly population. Can these devices be an accessibility tool for different purposes for the target users? What are the challenges of having such devices in semi-public spaces? What are the concerns that inhibit the use of such devices in semi-public spaces?

This research aims to qualitatively understand the user experience of elderly people with the use of smart speakers in semi-public spaces. The probable outcome of this research would throw light on how smart speakers could act as an accessibility tool for the elderly.

Researches the various socio-technical aspects of accessible and assistive technology in the future society. Interest in how emerging technologies (such as additive manufacturing, AI and XR) can be adapted to enhance accessibility, for example, in built environments, public transportation, and education, social, health care, and rehabilitation services.

The ongoing PhD research studies the accessibility of written Easy Finnish to easy language users with intellectual disabilities. Easy language users with intellectual disabilities are a heterogeneous group with varying language skills. The research increases knowledge about their lexical knowledge. It also provides scientifically based evidence for defining easy Finnish criteria.

The project investigates response (lisibility), reaction (readability), and repercussion (viewer’s preferences and habits) of machine-translated and human-translated subtitles in Finnish and German. Living in a world of constant movement and migration means also adapting to foreigner’s needs regarding language and communication, therefore, to guarantee accessibility and social participation. Machine translation has proven to be an aid, but still lacks in quality, especially compared to human translation, which is still considered as the gold standard. However, time is money and so, there is growing interest in fostering machine translation suitability for subtitling.

The aim of the project is to gain a deeper insight into consumer’s use (interaction) with different sets of subtitles and hence whether there will be differences in attention allocation, comprehension, and attitude.

Digitalization has brought challenges for the elderly to survive in everyday life, and many elderly people are in danger of being excluded from society and falling into an unequal position. Different feelings and prejudices towards technology have emerged in teaching the elderly. Some of the elderly students show anxiety and fear, while others are excited and want to know and learn more about new forms of technology.

Social responsibility and sustainable pedagogy are part of the research perspective. The research provides information on the attitudes of the elderly towards educational games and which things in gaming alleviate possible fears and anxiety. There hasn´t been previous research on educational games in the teaching of the elderly. The results of the research can be utilized in the teaching of the elderly and when designing accessible electronic and mobile services for the elderly.

[Means of meeting the subtitling obligations: Intralingual subtitling and its processes produced by paraprofessional subtitlers using automated tools]

Since a change in legislation in 2019, it is now mandatory for governmental and other public organizations to add intralingual subtitles on videos published on their websites. This has created a new group of paraprofessional subtitlers, who produce subtitles as part of their job, though it is not included in their original field of profession. The ongoing PhD research studies what actions have Finnish organizations affected by the legislation taken to meet the obligations, how the new paraprofessional subtitlers view their work, how they use automated tools, and what the produced subtitles are like from a linguistic perspective.