Accessibility Service Design (2020-)
The project used Service Design and UX methods to underpin the introduction of a new accessibility service. This ensured that, project management, identification of stakeholders, rollout phase planning, user training, and referral routes were all underpinned by supporting research. Principally this allowed us to rollout features in an empathetic way, considering timing and adjusting language used in the interface.
Service users for the accessibility service being introduced. Also fellow support providers at the University of Brighton with touchpoints relating to the use of the accessibility service.
As the liaison for accessibility on my team, I was given product ownership of Blackboard Ally. Blackboard Ally is a service which includes a file conversion tool and diagnostic tool to help find and resolve common accessibility issues. Ally focuses on content which is uploaded to a Content Management System (CMS), or in this case a Virtual Learning Environment (VLE), including: Word documents, PDFs, PowerPoint files, and images. It is not an accessibility overlay, but rather helps to surface content-related accessibility issues across a complex CMS.
To plan and implement Blackboard Ally as a new service at a university. To ensure that user adoption was planned and supported based on availability staff resourcing.
How can we support implementation and adoption of a new service during pandemic-related emergency teaching measures?
Roles, Tools and Methods
As the product owner, I planned and managed the project. The project design and associated outreach activities were based on 6-week sprints. I also led on communication, documentation, stakeholder liaison, training and project management.
- Information Architecture principles
- Task Scenarios
- Customer Value Chain Mapping
- Project planning (Mural board)
- Data-driven insights
- Context-aware Language
Information Architecture (IA) principles
Selected slides below explain IA as it applied within the VLE.
Explanation of the gallery images:
Stuff: documents, PowerPoint, content items such as text presented within the VLE, audio and video
Space plan: organisation of content and layout in module for accessibility
Services: communications, assessment, diagnostic (Blackboard Ally), interactivity
Structure: avoiding duplication, wayfinding, use of language
Skin: use of colour, font, and imagery in the VLE
Site: Questions to ask yourself:
Is it always made clear where people are at a given time?
Is this the right place for this information or does it already exist elsewhere?
Is the purpose of this place made clear?
IA based on:
- How Buildings Learn: What Happens After They're Built - Brand (1995)
- Six layers – the “six S’s” as applied in Information Architecture: For the Web and Beyond – Rosenfeld, Morville and Arango (2015)
Task Scenarios and Customer Value Chain Mapping
Task Scenarios were used to itemise the tasks that different user groups needed to complete with the tools which are part of the Ally service. This was used to consider the context of use while users were working/studying from home locations. Customer Value Chain Mapping was used to discover and illustrate hidden value to using the system: it could be used to locate and replace copyrighted material. This allowed for a referral route to library staff for academic staff to get assistance with low accessibility PDFs as part of they mandate to oversee copyright requirements.
Project planning and Data-Driven insights
The slides associated with this case study provide anonymised screenshots of the project planning board. The collaborative planning board was used by the project team to consider all pontential stakeholders at the university, to ensure that anyone who could drive use of the tool was provided with information and training for their team/s. I also used data from the system to plan strategic communications and outreach exercises, such as noting a drop in use and planning a 6-week sprint of outreach during the lead up to Global Accessibility Awareness Day.
My team observed through enquiries and help desk tickets that academic staff were concerned about tools/services which included statistical and diagnostic information. This applies to aspects of the Ally service. Their concerns related to who had access and how the data would be used. Due to this and rapid change as a result of the pandemic, I recommended that phase 2 be delayed. This was also due to overlap with another service that was being introduced which also had statistical features. This was the right decision and when the tool was released I altered the interface to ‘read’ as ‘Accessibility Summary’, rather than ‘Course Accessibility Report’. The word ‘report’ had negative connotations and may have impacted service adoption.
Institutional accessibility was improved as a result of implementing the new service. Outreach efforts contributed to a +7% increase in student engagement with the alternative file formats produced by Ally as compared to a benchmark period (this is termed as conversion rate in the slides associated with this case study). This needs to be considered with the caveat that engagement rate comparisons will have greater value once multiple years’ worth of data is available. Currently there is only one year of data and the cyclical nature of education means that some of the increased engaged will be related to a natural increase in engagement during the lead up to exams.
This was a novel approach to software service implementation in higher education and was therefore accepted for presentation at the Blackboard Ally European User Group (March 2021) and also at the Blackboard World 2021 international conference (July).
The full adoption of Blackboard Ally as a service is an ongoing project and I am planning out the next phases in collaboration with colleagues. A key consideration which I have highlighted is that the accessibility scores provided by the Ally service are algorithmically generated based on a list of requirements. This is therefore an indication of accessibility but it does not provide a complete picture. The wider picture of accessibility is related to content such as: language used, the format of content, an academic subject-specific requirements. So the use of the Ally service and has to take place alongside broader cultural and institutional change in order to be truly effective.
Example Task Scenario
Scenario 1: Check existing documents: Scanned PDFs without OCR (Optical Character Recognition).
Note: this is a document without machine readable text.
Practical Goal: Learn what is wrong with the document using the Ally report tool and resolve the problem.
Context: On a personal computer connected to the Internet using a web browser at home. User will login to the VLE and open their module, then view their Study Materials area. It is likely that they will be running other software such as MS Outlook concurrently, as well as other office productivity software on the computer.
User/s: Academic staff; Professional staff who create student-facing resources (Student Support and Guidance Tutor, library).
Click on red dial. Read what the Ally report says: “0% This PDF is scanned”.
- Judgement call: what type of PDF is it? An article or a scan from a book OR a hand drawn working/diagram which cannot be made accessible.
- If an article or scan from a book contact the library for advice. This PDF needs to be replaced.
- If it is hand drawn working/diagram, can written description be added to this file to make it more accessible? This file may need to be left as-is [no further action].
- When the article or scan from a book has been replaced, the original should be removed from the module. Click on Files > Module code link.
- Click ‘Show All’. Use ctrl and f (cmd and f on Mac) on the keyboard to search for the file.
- Click the chevon next to the file and select delete.
- Go back to Study Materials and click the chevron to delete the ‘item’ or ‘file’ content item. The item will be red.
- If item/file is difficult to find, go to Packages and Utilities > Check course links. This will list broken links and their folder location.
- Go back to Study Materials and delete these links.
- Log out of studentcentral/My Studies (VLE). Close web browser.
Brand, S. (1995) How buildings learn: what happens after they’re built. New York, NY: Penguin Books.
Fry, R. (2020) ‘What happened on Global Accessibility Day at GDS’, Government Digital Service Blog, 2 June. (Accessed: 4 July 2021).
Kalbach, J. (2016) Mapping experiences – a guide to creating value through journeys, blueprints, and diagrams. Sebastopol, CA: O’Reilly Media Inc.
Rosenfeld, L., Morville, P. and Arango, J. (2015) Information architecture: for the web and beyond. Fourth edition. Sebastopol, CA: O’Reilly Media, Inc.