Bulletin Builder: Insights from Bulletin Builder usability testing
The Bulletin Builder is an open, web-based platform designed to automate the creation of agroclimatic bulletins. Usability testing of this tool was conducted in two countries, Vietnam and Guatemala, to assess the intuitiveness, understandability, and alignment with users’ mental models of the platfo...
| Main Authors: | , , , , |
|---|---|
| Format: | Informe técnico |
| Language: | Inglés |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10568/180624 |
| _version_ | 1855538621505863680 |
|---|---|
| author | Lopez, Sebastian Hernandez, Victor Manuel Londoño, Juan Manuel Sotelo, Steven Zapata Caldas, Emmanuel |
| author_browse | Hernandez, Victor Manuel Londoño, Juan Manuel Lopez, Sebastian Sotelo, Steven Zapata Caldas, Emmanuel |
| author_facet | Lopez, Sebastian Hernandez, Victor Manuel Londoño, Juan Manuel Sotelo, Steven Zapata Caldas, Emmanuel |
| author_sort | Lopez, Sebastian |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | The Bulletin Builder is an open, web-based platform designed to automate the creation of agroclimatic bulletins. Usability testing of this tool was conducted in two countries, Vietnam and Guatemala, to assess the intuitiveness, understandability, and alignment with users’ mental models of the platform’s interface, workflow, and visual design. In Vietnam, seven participants from regional and national agricultural institutions took part in usability testing with medium-fidelity prototypes. We applied a qualitative, task-based methodology combining think-aloud protocols and moderated testing to evaluate the full end-to-end bulletin creation process. The findings suggest that, while not immediately intuitive, users find the platform useful and relevant for reducing the technical workload. Key improvement opportunities include greater automation of forecast inputs, clearer workflow sequencing, structured data entry via drop-down menus, stronger integration between the crops and pests modules, and greater flexibility during export and final review. In Guatemala, the study evaluated an operational pilot with four users from one private entity and one public entity. The test combined think-aloud methods and A/B testing to compare light and dark interface versions. The results showed high task completion rates and positive perceptions of clarity and efficiency, as well as mixed but complementary visual preferences. Overall, the findings demonstrate Bulletin Builder’s strong potential to facilitate the time-consuming task of regularly developing bulletins (in some cases, every 10 days) while identifying concrete design refinements to improve usability, learnability, and scalability across contexts. |
| format | Informe técnico |
| id | CGSpace180624 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2025 |
| publishDateRange | 2025 |
| publishDateSort | 2025 |
| record_format | dspace |
| spelling | CGSpace1806242026-01-26T11:22:41Z Bulletin Builder: Insights from Bulletin Builder usability testing Lopez, Sebastian Hernandez, Victor Manuel Londoño, Juan Manuel Sotelo, Steven Zapata Caldas, Emmanuel testing pequeño agricultor climate services servicio climático digital innovation innovación digital smallholders experimentación The Bulletin Builder is an open, web-based platform designed to automate the creation of agroclimatic bulletins. Usability testing of this tool was conducted in two countries, Vietnam and Guatemala, to assess the intuitiveness, understandability, and alignment with users’ mental models of the platform’s interface, workflow, and visual design. In Vietnam, seven participants from regional and national agricultural institutions took part in usability testing with medium-fidelity prototypes. We applied a qualitative, task-based methodology combining think-aloud protocols and moderated testing to evaluate the full end-to-end bulletin creation process. The findings suggest that, while not immediately intuitive, users find the platform useful and relevant for reducing the technical workload. Key improvement opportunities include greater automation of forecast inputs, clearer workflow sequencing, structured data entry via drop-down menus, stronger integration between the crops and pests modules, and greater flexibility during export and final review. In Guatemala, the study evaluated an operational pilot with four users from one private entity and one public entity. The test combined think-aloud methods and A/B testing to compare light and dark interface versions. The results showed high task completion rates and positive perceptions of clarity and efficiency, as well as mixed but complementary visual preferences. Overall, the findings demonstrate Bulletin Builder’s strong potential to facilitate the time-consuming task of regularly developing bulletins (in some cases, every 10 days) while identifying concrete design refinements to improve usability, learnability, and scalability across contexts. 2025-12-15 2026-01-26T09:03:10Z 2026-01-26T09:03:10Z Report https://hdl.handle.net/10568/180624 en Open Access application/pdf Lopez, S.; Hernandez, V.M.; Londoño, J.M.; Sotelo, S.; Zapata Caldas, E. (2025) Bulletin Builder: Insights from Bulletin Builder usability testing. CGIAR Scaling for Impact Science Program. 10 p. |
| spellingShingle | testing pequeño agricultor climate services servicio climático digital innovation innovación digital smallholders experimentación Lopez, Sebastian Hernandez, Victor Manuel Londoño, Juan Manuel Sotelo, Steven Zapata Caldas, Emmanuel Bulletin Builder: Insights from Bulletin Builder usability testing |
| title | Bulletin Builder: Insights from Bulletin Builder usability testing |
| title_full | Bulletin Builder: Insights from Bulletin Builder usability testing |
| title_fullStr | Bulletin Builder: Insights from Bulletin Builder usability testing |
| title_full_unstemmed | Bulletin Builder: Insights from Bulletin Builder usability testing |
| title_short | Bulletin Builder: Insights from Bulletin Builder usability testing |
| title_sort | bulletin builder insights from bulletin builder usability testing |
| topic | testing pequeño agricultor climate services servicio climático digital innovation innovación digital smallholders experimentación |
| url | https://hdl.handle.net/10568/180624 |
| work_keys_str_mv | AT lopezsebastian bulletinbuilderinsightsfrombulletinbuilderusabilitytesting AT hernandezvictormanuel bulletinbuilderinsightsfrombulletinbuilderusabilitytesting AT londonojuanmanuel bulletinbuilderinsightsfrombulletinbuilderusabilitytesting AT sotelosteven bulletinbuilderinsightsfrombulletinbuilderusabilitytesting AT zapatacaldasemmanuel bulletinbuilderinsightsfrombulletinbuilderusabilitytesting |