Designing Digital Libraries to Support Blind and Visually Impaired Users: A methodological reflection on a large-scale project
Keywords:
Qualitative methods, Quantitative methods, Blind and visually impaired users, reflection, Digital library, Design guidelinesAbstract
Abstract
The purpose of this study is to review and reflect upon the qualitative and quantitative methods applied and lessons learned in the process of completing the project “Creating accessibility and usability of digital library (DL) guidelines to support blind and visually impaired (BVI) users.” This study focuses on the following issues: 1) The recruitment of BVI users, scholars/experts, and DL developers and associated challenges and solutions; 2) The use of data collection methods for diverse DL stakeholders and associated challenges and solutions; 3) The application of data analysis techniques and associated challenges and solutions. It is a challenge to recruit large numbers of BVI participants, and it is an effective approach to establish connections with trusted organizations and institutions - particularly BVI-related organizations - to promote the studies. Multiple data collection methods (questionnaires, think-aloud protocols, transaction logs, diaries, interviews, and focus groups) were used throughout the research project. As BVI users utilize screen readers to understand DL interfaces and simultaneously express their actions and thoughts, the challenge associated with think-aloud protocols can be resolved by offering orientation training and clear instructions. Both quantitative and qualitative data analysis methods were used throughout the project. Descriptive analysis is the most commonly employed quantitative method since statistical analysis cannot be performed due to small sample size. For qualitative analysis, it is critical for sighted researchers to understand BVI users by collaborating with blind researchers and carefully reviewing the video and transcript data to enhance the open coding process. Future research on the methodology applied in BVI-related studies is also discussed.
References
Al-Yateem, N. (2012). The effect of interview recording on quality of data obtained: A methodological reflection. Nurse Researcher, 19(4), 31–35.
Armano, T., Borsero, M., Capietto, A., Murru, N., Panzarea, A., & Ruighi, A. (2018). On the accessibility of Moodle 2 by visually impaired users, with a focus on mathematical content. Universal Access in the Information Society, 17, 865–874.
Babu, R. (2013). Understanding challenges in non-visual interaction with travel sites: An exploratory field study with blind users. First Monday, 18(12). https://doi.org/10.5210/fm.v18i12.4808
Bhardwaj, R. K., & Kumar, S. (2017). A comprehensive digital environment for visually impaired students: User's perspectives. Library Hi Tech, 35(4), 542–557.
Bodaghi, N. B., Cheong, L. S., & Zainab, A. N. (2016). Librarians empathy: Visually impaired students experiences towards inclusion and sense of belonging in an academic library. The Journal of Academic Librarianship, 42(1), 87–96.
Bodaghi, N. B., Cheong, L. S., Zainab, A. N., & Riahikia, M. (2017). Friendly librarians: The culture of caring and inclusion experiences of visually impaired students in an academic library. Information Development, 33(3), 229–242.
Bodaghi, N. B., Zainab, A. N., & Zainab, A. N. (2013). My carrel, my second home: Inclusion and the sense of belonging among visually impaired students in an academic library. Malaysian Journal of Library & Information Science, 18(1), 39–54.
Bodaghi, N. B. , Binti Awang-Ngah, Z., & Abdullah, N. (2014). Student volunteers as academic saviours and social connectors among the visually impaired in an academic library. Libri, 64(1), 40–48.
Buimer, H., Schellens, R., Kostelijk, T., Nemri, A., Zhao, Y., Van der Geest, T., & Van Wezel, R. (2019). Opportunities and pitfalls in applying emotion recognition software for persons with a visual impairment: Simulated real life conversations. JMIR mHealth and uHealth, 7(11), e13722.
Byerley, S. L., & Beth Chambers, M. (2002). Accessibility and usability of Web‐based library databases for non‐visual users. Library Hi Tech, 20(2), 169–178.
Conway, V., Brown, J., Hollier, S., & Nicholl, C. (2012). Website accessibility: A comparative analysis of Australian national and state/territory library websites. The Australian Library Journal, 61(3), 170–188.
Day, M., & Thatcher, J. (2009). “I'm really embarrassed that you're going to read this…”: Reflections on using diaries in qualitative research. Qualitative Research in Psychology, 6(4), 249–259.
Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics. Sage.
Flick, U. (2019). An Introduction to Qualitative Research (6th Edition). Sage.
George, G., & Selimos, E. D. (2018). Using narrative research to explore the welcoming of newcomer immigrants: A methodological reflection on a community-based research project. Forum: Qualitative Social Research, 19(2), 119–138.
Gonçalves, R., Rocha, T., Martins, J., Branco, F., & Au-Yong-Oliveira, M. (2018). Evaluation of e-commerce websites accessibility and usability: An e-commerce platform analysis with the inclusion of blind users. Universal Access in the Information Society, 17, 567–583.
Gooda Sahib, N., Tombros, A., & Stockman, T. (2012). A comparative analysis of the information‐seeking behavior of visually impaired and sighted searchers. Journal of the American Society for Information Science and Technology, 63(2), 377–391.
Gooda Sahib, N., Tombros, A., & Stockman, T. (2015). Evaluating a search interface for visually impaired searchers. Journal of the Association for Information Science and Technology, 66(11), 2235–2248.
Gravetter, F. J., & Wallnau, L. B. (2013). Statistics for the Behavioral Sciences (9th ed.). Wadsworth.
Harris, R. J. (2001). A Primer of Multivariate Statistics. Psychology Press.
Hill, H. (2013). Disability and accessibility in the library and information science literature: A content analysis. Library & Information Science Research, 35(2), 137–142.
Huang, H. (2018). Blind users' expectations of touch interfaces: Factors affecting interface accessibility of touchscreen-based smartphones for people with moderate visual impairment. Universal Access in the Information Society, 17, 291–304.
Johnson, K. (2009). No longer researching about us without us: A researcher's reflection on rights and inclusive research in Ireland. British Journal of Learning Disabilities, 37(4), 250–256.
Lazar, J., Allen, A., Kleinman, J., & Malarkey, C. (2007). What frustrates screen reader users on the web: A study of 100 blind users. International Journal of Human-Computer Interaction, 22(3), 247–269.
Liu, X., & Burnett, D. (2022). Insider-outsider: Methodological reflections on collaborative intercultural research. Humanities and Social Sciences Communications, 9(1), 1–8.
Menzi-Çetin, N., Alemdağ, E., Tüzün, H., & Yıldız, M. (2017). Evaluation of a university website's usability for visually impaired students. Universal Access in the Information Society, 16, 151–160.
Rømen, D., & Svanæs, D. (2012). Validating WCAG versions 1.0 and 2.0 through usability testing with disabled users. Universal Access in the Information Society, 11, 375–385.
Van der Geest, T., van der Meij, H., & Van Puffelen, C. (2014). Self-assessed and actual Internet skills of people with visual impairments. Universal Access in the Information Society, 13, 161– 174.
Xie, I., Babu, R., Castillo, M. & Han, H. (2018) Identification of factors associated with blind users' help-seeking situations in interacting with digital libraries. Journal of the American Association for Information Science and Technology, 69(4), 514–527.
Xie, I., Babu, R., Joo, S., & Fuller, P. (2015). Using digital libraries non-visually: Understanding the help-seeking situations of blind users. Information Research: An International Electronic Journal, 20(2), n2.
Xie, I., Babu, R., Lee, H. S., Wang, S., & Lee, T. H. (2021a). Orientation tactics and associated factors in the digital library environment: Comparison between blind and sighted users. Journal of the Association for Information Science and Technology,72(8), 995–1010.
Xie, I., Babu, R., Lee, T. H., Wang, S., & Lee, H. S. (2021b). Coping tactics of blind and visually impaired users: Responding to help-seeking situations in the digital library environment. Information Processing and Management, 58(5), 102612.
Xie, I., Babu, R., Wang, S., Lee, H. S., & Lee, T. H. (2022). Assessment of digital library design guidelines to support blind and visually impaired users: A study of key stakeholders' perspectives. The Electronic Library, 40(6), 646–661.
Xie, I., Babu, R., Lee, T., Castillo, M., You, S. & Hanlon, A. (2020). Enhancing usability of digital libraries: Designing help features to support blind and visually impaired users. Information Processing and Management, 57(3), 102110.
Xie, I., Wang, S., & Saba, M. (2021c). Studies on blind and visually impaired users in LIS literature: A review of research methods. Library & Information Science Research, 43(3), 101109.
Xie, I., Wang, S., Lee, T, & Lee, H. (Unpublished). Accessibility of Digital Libraries. School of Information Studies, University of Wisconsin-Milwaukee.
Yang, W., Zhao, B., Liu, Y. Q., & Bielefield, A. (2020). Are Ivy League library website homepages accessible?. Information Technology and Libraries (Online), 39(2), 1–18.
Yoon, K., Dols, R., Hulscher, L., & Newberry, T. (2016). An exploratory study of library website accessibility for visually impaired users. Library & Information Science Research, 38(3), 250–258.
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Qualitative and Quantitative Methods in Libraries
This work is licensed under a Creative Commons Attribution 4.0 International License.
