Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective
Artificial Intelligence (AI) tools are rapidly transforming the way people work, providing opportunities for improving efficiency, accelerating innovations, and supporting human decision making. The area of policymaking is no exception. To explore the advantages and disadvantages of customized chatb...
| Main Author: | |
|---|---|
| Format: | Artículo preliminar |
| Language: | Inglés |
| Published: |
International Food Policy Research Institute
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10568/137261 |
| _version_ | 1855542595210444800 |
|---|---|
| author | Benson, Todd |
| author_browse | Benson, Todd |
| author_facet | Benson, Todd |
| author_sort | Benson, Todd |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | Artificial Intelligence (AI) tools are rapidly transforming the way people work, providing opportunities for improving efficiency, accelerating innovations, and supporting human decision making. The area of policymaking is no exception. To explore the advantages and disadvantages of customized chatbots for supporting food policy research, we created a virtual food policy expert using a customized AI system using training literature drawn from about two dozen food policy research reports or food policy documents. A range of questions seeking food policy advice were then posed to the chatbot to better understand the limits to its expertise, the accuracy of its responses, and the value it might offer users seeking specific advice to guide the formulation and implementation of food policy related strategies and programs. A relatively simple comparative assessment was made of the results obtained from asking the same food policy-related questions to different AI sources, including the customized AI virtual food policy expert. Overall, we found that AI -based chatbots can be useful tools for summarizing research and providing “first cut” information only. We also conclude that, while customized chatbots have the advantage of offering the possibility of uploading pre-selected papers, unless a large amount of information is uploaded or the chatbot is also allowed by design to draw on information from other sources including the internet, the responses the virtual coach provides may be limited to only a small and specific set of questions. To be more credible and useful for policymakers, chatbots need to be enabled to provide more specific information. For the foreseeable future, providing such detailed and often country-specific information will still be in the hands of human experts. |
| format | Artículo preliminar |
| id | CGSpace137261 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2023 |
| publishDateRange | 2023 |
| publishDateSort | 2023 |
| publisher | International Food Policy Research Institute |
| publisherStr | International Food Policy Research Institute |
| record_format | dspace |
| spelling | CGSpace1372612025-11-06T07:45:48Z Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective Benson, Todd artificial intelligence policy innovation innovation technology adoption research Artificial Intelligence (AI) tools are rapidly transforming the way people work, providing opportunities for improving efficiency, accelerating innovations, and supporting human decision making. The area of policymaking is no exception. To explore the advantages and disadvantages of customized chatbots for supporting food policy research, we created a virtual food policy expert using a customized AI system using training literature drawn from about two dozen food policy research reports or food policy documents. A range of questions seeking food policy advice were then posed to the chatbot to better understand the limits to its expertise, the accuracy of its responses, and the value it might offer users seeking specific advice to guide the formulation and implementation of food policy related strategies and programs. A relatively simple comparative assessment was made of the results obtained from asking the same food policy-related questions to different AI sources, including the customized AI virtual food policy expert. Overall, we found that AI -based chatbots can be useful tools for summarizing research and providing “first cut” information only. We also conclude that, while customized chatbots have the advantage of offering the possibility of uploading pre-selected papers, unless a large amount of information is uploaded or the chatbot is also allowed by design to draw on information from other sources including the internet, the responses the virtual coach provides may be limited to only a small and specific set of questions. To be more credible and useful for policymakers, chatbots need to be enabled to provide more specific information. For the foreseeable future, providing such detailed and often country-specific information will still be in the hands of human experts. 2023-12-10 2024-01-05T20:52:49Z 2024-01-05T20:52:49Z Working Paper https://hdl.handle.net/10568/137261 en Open Access application/pdf International Food Policy Research Institute Benson, Todd. 2023. Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective. Washington, DC: International Food Policy Research Institute (IFPRI). https://hdl.handle.net/10568/137261 |
| spellingShingle | artificial intelligence policy innovation innovation technology adoption research Benson, Todd Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title | Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title_full | Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title_fullStr | Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title_full_unstemmed | Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title_short | Exploring the potential of customized AI chatbots in food policy research: Capabilities and constraints in comparative perspective |
| title_sort | exploring the potential of customized ai chatbots in food policy research capabilities and constraints in comparative perspective |
| topic | artificial intelligence policy innovation innovation technology adoption research |
| url | https://hdl.handle.net/10568/137261 |
| work_keys_str_mv | AT bensontodd exploringthepotentialofcustomizedaichatbotsinfoodpolicyresearchcapabilitiesandconstraintsincomparativeperspective |