PROTOCOL: Evidence and gap map protocol: Understanding pathways between agriculture and nutrition: An evidence and gap map of tools, metrics and methods developed and applied in the last 10 yearsстатья из журнала
Аннотация: The global food price crises of 2007–2008 and 2010–2011 drew attention to the need for addressing the underlying determinants of malnutrition in low- and middle-income countries (LMICs; Brinkman, de Pee, Sanogo, Subran, & Bloem, 2010; Webb, 2010). Specifically, as the primary source of food and income in LMICs, agriculture received renewed focus. Making agriculture work for nutrition—nutrition-sensitive agriculture—has climbed the international development agenda (Ruel, Alderman, & Maternal and Child Nutrition Study Group, 2013). More recently, given the sharp increase in diet-related chronic diseases underpinned by overweight and obesity in LMICs and the threats of climate change to diets, attention has expanded to leverage food systems to optimize nutrition, health and environmental outcomes (Johnston, Fanzo, & Cogill, 2014). Donors, researchers and implementers mobilized research agendas to invest in understanding how to strengthen agriculture and food systems to realize nutrition outcomes sustainably. Development of conceptual frameworks to aid the investigation of agriculture-food system and nutrition linkages, highlighting multiple direct and indirect complex pathways (Global Panel, 2015; Hawkes, Turner, & Waage, 2012; Johnston et al., 2014; Kadiyala, Harris, Headey, Yosef, & Gillespie, 2014; Lock et al., 2010; Masters et al., 2018). Empirical examination of the linkages between agriculture-food systems and nutrition and the key pathways mediating or modifying these relationships and systematic reviews (Arimond & Ruel, 2004; Girard, Self, McAuliffe, & Olude, 2012; Ruel, Quisumbing, & Balagamwala, 2018). Experimental studies and novel methodological approaches, with improved rigour in testing conventional (e.g., homestead food production) and novel intervention models (e.g., market-based interventions for nutrition; use of participatory videos). These efforts led to widespread recognition of inadequate tools, methods and metrics to study the direct, indirect and dynamic relationships between in agriculture-food systems and nutrition outcomes. There have been several calls to accelerate the development of innovative tools, methods and metrics to underpin the development of a robust scientific evidence base needed to guide policy investments in agriculture-food systems for improved nutrition and health. In response to this demand, several projects and programmes were launched specifically to develop new research methods, including the DFID-funded Innovative Metrics and Methods for Agriculture and Nutrition Actions (IMMANA) programme (Innovative Methods and Metrics for Agriculture and Nutrition Actions [IMMANA], 2018). Research undertaken under IMMANA and others (CGIAR, 2018; Global Dietary Database [GDD], 2014; International Dietary Data Expansion Project [INDDEX], 2018; Sustainable and Healthy Food Systems [SHEFs], 2018) have built on existing theoretical underpinnings and have helped to refine hypothesized pathways, illuminating additional aspects and dynamics between agriculture or food systems and nutrition outcomes, such as food environments, environmental factors and food safety. The Food and Agriculture Organization (FAO) of the United Nations (UN) adopted the High-Level Panel of Experts (HPLE) definition of a food system: "all the elements (environment, people, inputs, processes, infrastructures, institutions, etc.) and activities that relate to the production, processing, distribution, preparation and consumption of food, and the output of these activities, including socio-economic and environmental outcomes" (HLPE, 2017). Agriculture and health are part of the broader milieu of a food system. As such, there has been a proliferation of innovations in programme design and implementation, as well as in metrics and methods and their application. While the body of evidence on effectiveness of food systems to improve nutrition has been recently summarized (Ruel et al., 2018), the portfolio of new methods and metrics has not. It is now necessary to take stock of these developments and plan for the future to support the production of effective and relevant research. Recognition of the multiple pathways through which nutrition impact is achieved brought about new conceptual frameworks, and along with them, new thinking in how to measure the complexity and dynamism within these systems. The innovations that emerged range from new technology to new indices to the application of methods from other fields. New metrics and methods have been developed throughout the pathways (household production, decision-making, income, etc.) linking agriculture and nutrition. In a standard effectiveness map, the row headings are interventions, and the column headings outcomes. In this map, those thematic pathways or domains will be considered the "interventions" through which nutrition is improved. We consider our "outcome" to be tools, metrics or methodological innovations, which are the columns of this map. Some innovations have been widely adopted across settings, and others are still in development. Therefore, each example innovation will be mapped using the studies that pertain to the innovation. Innovations have taken place at every level of measurement (individual, household, national, etc.) and correspond to certain cross-cutting themes. These additional aspects will be coded internally on the map. As an example of technology application at an individual and household level, researchers have utilized accelerometers to measure calorie expenditure in new ways to address intra-household food allocation and gender roles (Zanello, Srinivasan, & Nkegbe, 2017). At a community level, researchers have employed wearable cameras and GIS technology to map changing food environments in urban areas (Schrempft, van Jaarsveld, & Fisher, 2017). A methodological innovation at a sub-national level has been to use Bayesian theory and decision-analysis for making policy that affects nutrition (Yet et al., 2016). More thorough data collection and new indices to capture prices of nutritious foods in markets at the regional level have led to better estimates of cost of nutritious diets in Ghana (Masters et al., 2018). New innovation in this field also includes tools to conceptualize and operationalize food systems, including how to frame and measure cost-effectiveness of complex interventions, which have a range of outcomes (Masters et al., 2018). In this EGM, the columns will be types of innovation or novel application. The aim of the gap map is to articulate and summarize the innovation in tools, metrics and methods that have been created and applied to understand food systems and agriculture-nutrition linkages in the last ten years. We have chosen the ten-year period based on the focus on and funding for agriculture-nutrition linkages that emerged following the global food price crisis in 2007–2008, as well as wanting to focus on new innovations, which, by definition, would no longer be novel if developed more than a decade ago. We also aim to highlight gaps and opportunities for future development. Although the intervention-outcome framework is most common for maps on effectiveness studies, this framework will be organized differently. We will take an approach that considers tools, metrics and methods (types of innovation/application in the columns) for agriculture-food systems-nutrition research (thematic domain in the rows). The map will be organized around a combination of conceptual frameworks that include the definition of food systems offered by the HPLE report on nutrition (HLPE, 2017), predefined pathways to improved nutrition (Global Panel, 2015; Hawkes et al., 2012; Herforth, Nicolò, Veillerette, & Dufour, 2016; Kadiyala et al., 2014), as well as additional themes that have been identified as more research is being undertaken on this topic (Grace et al., 2018; Masters, 2016; SHEFs, 2018) (Appendix APPENDIX A). These conceptual frameworks (illustrated in Appendix A) overlap a great deal. For instance, each highlights the role of on-farm production as a means for direct consumption as well as a potential income source, both which influence food availability and diet quality, and thus contribute to nutrition outcomes. Frameworks 1 (Kadiyala et al., 2014), 2 (Hawkes et al., 2012) and 3 (Herforth et al., 2016) are very similar—in fact the most substantive difference is the visual organization of components. These frameworks include aspects of women's time, income and employment. The same three highlight interacting aspects of care, education or knowledge, as well as overall health as drivers of nutrition outcomes. Each framework also has differences, both in how it is visualized and the content. Each represents "indirect" determinants of nutrition outcomes, such as the role of climate, the environment, policy, governance and culture, inequity, and so forth, but some are shown as an outside layer of influence, whereas some of these are considered within the central framework. For instance, Framework 4 shows the interactions between environment or sustainability aspects and food production, highlighting that human health should always be balanced against planetary health, since they are symbiotic in the long run (Tuomisto et al., 2017). Several highlight important domains that are not equally represented on the other. Frameworks 5 (Masters, 2016) and 6 (Global Panel, 2015) propose the most current thinking about markets and the economic role of nutrition. These support the idea that production will lead to consumption only where, when and for whom markets are missing. The Global Panel Metrics and Methods Framework (Framework 6) puts the food environment as the central milieu into which other dynamics feed, and diet diversity, adequacy and safety as general by-products of that food environment. In contrast, Framework 2 (Hawkes et al., 2012) specifically articulates the subsequent layers of the food environment that progressively lead to nutritional status. We will use all frameworks generally to ensure that the EGM is comprehensive and that the domains within conceptual pathways in agriculture to nutrition literature are represented and categorized logically, while maintaining iterative methods of refining the domains based on search results. Governments, non-government donors, implementing agencies and academia have all made significant investments, both intellectually and financially, in improving agriculture or food systems for nutrition outcomes. This investment has gone beyond scholarship and documentation and taken the form of application and innovation of tools, metrics and methods at every level. Stakeholders have called for a synthesis project on this topic in order to visualize the current portfolio of these developments, strategically plan the next wave of investment and shape the next generation of agriculture-nutrition research. There are no current gap maps on the topic of metrics and methods on the topic of agriculture and food systems for nutrition (or to improve nutrition outcomes). Some mapping exercises have been undertaken on pathways between agriculture and nutrition, namely the 2012 LCIRAH "Current and planned research on agriculture for improved nutrition: a mapping and a gap analysis", which led the way to the IMMANA programme (IMMANA, 2018). The FAO Compendium of nutrition-sensitive indicators also summarizes the most well-established indicators on the subject (Herforth et al., 2016), but does not fully capture innovative tools and methodologies, as well as metrics that are in development currently. Furthermore, to our knowledge, none of these synthesis projects have been systematic or published as a formal EGM, and overall there have been no EGM of tools, metrics, or methodologies; rather most existing gap maps focus on effectiveness studies. The main objective of this EGM is to guide funders and researchers in the most promising areas of innovation within the study of food systems or agriculture to nutrition pathways, and demonstrate their phase of development and other thematic trends. We also will be able to demonstrate where there are gaps in existing innovative tools, metrics and methods that correspond to key domains identified in these conceptual frameworks. Empty cells in the map will indicate where no new methods, metrics or tools either exist or have been developed in the last decade within those domains. Furthermore, we intend that this EGM will then be used to shape future investments in this field, both by pursuing opportunities to take the most promising developments to the next level, and focusing attention on where there are gaps in available tools, metrics and methods. A secondary objective of this EGM is to identify trends in investigation and application that would be suitable for further synthesis. All previous EGMs published to date have been compilations of effectiveness studies, therefore this EGM will be novel in many aspects. We are not aware of any protocols or published EGMs on which to model this project. There are several synthesis reports on this topic (Hawkes et al., 2012; Herforth et al., 2016), but as mentioned previously, none of them are current, systematic or are formal EGMs. We will use published, well-established conceptual frameworks to define thematic domains of agriculture-to-nutrition in order to categorize the identified tools, metrics and methods. Therefore, our "intervention" will be each broad domain on the food systems or agriculture to nutrition pathway. The columns of our map, (outcome in effectiveness maps) will be each item of innovation (tool, metric or method) that has been developed or applied to capture or measure these domains. Limit the search to work published after 2008. Identify completely new tools, metrics or methods that were introduced after 2008 with no previous iterations. Identify tools, metrics or methods that existed prior to 2008 but have been significantly revised or modified since. As a "significant" change or modification is difficult to determine, we will rely on the group or authors' own assertions and explanations, and make an expert judgement as a group when unclear. Identify new, novel or innovative applications of existing tools and methods. This will mostly entail applying these cross-disciplinarily. This will be the most difficult aspect of "newness" to define, and we therefore will also rely on the authors' description and justification, and secondarily make a collective expert decision. Because some of the tools, metrics and methods are in their infancy, while others are globally adopted and have become standard practice, we will code each study based on the current (e.g. in 2019) stage of development of the innovation. We will further code and categorize innovations by several thematic filters (e.g., gender, equity, economics, technology, private-sector engagement, conflict or political fragility), geographical application, and level of measurement. The "intervention" (rows), will be defined using agriculture-to-nutrition conceptual frameworks mentioned previously, divided into "domains" of influence on agriculture and food systems or nutrition, such as household or on-farm production, food policy and governance, or food environments and markets. The columns, or categories of innovations/applications, will be grouped by different classifications of tools (technology application and instruments to capture data on a range of agriculture-nutrition topics), metrics (new indices and measures to quantify agriculture-nutrition linkages) and methods (research design and analytical approaches applied to agriculture and nutrition research). We will code each study related to an item and group the items iteratively once all items have been mapped. We have chosen to do this since some well-adopted innovations will have many papers that use the tool, metric or method, while others will have only a few, and some will apply the tool, metric or method in different ways. Users will be able to see each individual item as well as grouping by tool, metric or method. Traditional EGMs include a quality assessment of each item, such as a risk of bias rating, which are not designed to evaluate tools, methods or metrics. In place of a quality assessment, this EGM will summarize the stage of development or application (explained below). We will add filter codes for certain cross-cutting themes such as gender or private-sector engagement. It will also categorize the measurement level (individual, household, district, national, etc.), and setting or geographical application (Asia, Africa, global, etc.). We also may add other filters as the search progresses. The framework structure is shown in Appendix APPENDIX B. This map will only include tools, metrics and methods that have been applied to agriculture-nutrition pathways in any country at any level: individual, household, community or district, sub-national, national and global. The problem we are considering is any domain that exists on the conceptual pathway between agriculture and/or food systems and nutrition outcomes. These domains have been grouped (through using frameworks and extensive rounds of expert consultation) by broad themes around food production, food safety, value-chains, markets and food environments, food policy and governance, environment and climate, among others. We have organized the domains around broad themes in order to group items with minimal double- or triple-coding, but we do envision that some items will appear in more than one domain. Whenever possible we will select a "primary" domain and use the filters and codes to indicate other aspects of the tools that are cross-cutting, such as gender, technology or economics. The first column lists 12 broad domains, and the second column are examples of what types of work would fit in to these domains. All included tools, metrics or methods must explicitly relate to either agriculture/food systems, or to nutrition. Any tools, metrics and methods that are not related to either agriculture/food systems or nutrition will be excluded. Most of the domains could be measured at various levels (individual, national, global, etc.). We will not differentiate in the domains, but rather in the internal coding of each tool, metric or method innovation. As the initial results are identified, we may refine these domains and add sub-domains using an iterative methodology. Specifically, we propose the following overarching categories based on the conceptual frameworks discussed previously (Table 1). The domains of food safety, food environments and economic evaluations each have systematic reviews on methods and metrics. We will include the items that are included in those reviews and also use these items to test the framework. The primary "outcome", of the gap map (i.e., the columns in the map) is the innovative item (tool, metric or method) created and applied to studying and describing the broad agriculture to nutrition pathways. We will define "tool" as is a vehicle or an aid to collect information and data (e.g., a survey module to collect data required to compute an index or a piece of technology). "Metrics" will be defined as the parameters (measures) or indices used for measurement, comparison or tracking performance (e.g., disability adjusted life years; household dietary diversity score and Women's Empowerment in Agriculture Index [WEAI]). We define "method" as the process and approach involved in a systematic inquiry of relationships between agriculture, nutrition and health and generally refer to study design or application of an analytical method to this topic (e.g., impact evaluations using various types of counterfactuals, pathway analyses, decision analyses). Several types of "innovation" are described above. We will identify each tool metric or method and group them together once identified. Some methods or tools will have slight variation in their application or analysis, but we will group these logically together as an item if the construction of the item is similar. We will include all of the studies on the map. Each item might have multiple innovative components that fit distinctly within the categories of tools, metrics or methods. We propose that these will not be exclusive, rather the appropriate component of a paper or project will be categorized accordingly, and the total number of items summarized separately. In order to determine what is substantial enough for inclusion as a separate item (rather than a much smaller exploratory innovation and application), we will use the published or unpublished study objectives, considering only primary and secondary objectives. We will group tools, metrics and methods into the following categories, with some illustrative examples in the right-hand column (Table 2). Must describe a tool, metric or method developed or applied (see definition in Section 3.5). Developed or updated since January 1, 2008. In grey literature, published and/or peer-reviewed sources, as well as known projects from grant databases that describe tools, metrics and methods in development. In any country. Developed for the purpose of and/or used to quantify or qualify a potential interaction between agriculture or food systems and nutrition. This will be defined by the tool, metric or method being related to either the broader agriculture field, food systems as defined in the High-level Panel of Experts (HPLE) Report or the broader nutrition field, since several methods and metrics used to study this interaction are only explicitly linked to one side of the pathway. Nutrition or nutritional proxies on the outcome side of the pathway will be considered, including all forms of malnutrition (including diet-related chronic conditions). Different kinds of nutrition measurement (food insecurity, diets, anthropometry, biomarkers, micronutrients), or diet-related non-communicable diseases (namely obesity, diabetes, CVD, or diet-related cancers) will be included. Examples: agricultural interventions to improve nutrition and their evaluation; assessing pathways to impact, the influence of agricultural practices and food value chains on nutrition; governance and policy processes through which agriculture and nutrition are linked; and links between climate, agricultural productivity and/or growth and nutrition at a macro scale, and so forth. Topics that have been linked to agriculture, food systems and nutrition pathways, as long as explicitly framed in relationship to these pathways and meet the eligibility criteria as new, novel or innovative. For instance: Water insecurity and water footprints Hygiene and sanitation, or water access Livelihoods Gender Health care and care seeking Trade/economics/markets Tools, metrics or methods not applied to the domains that link agriculture, food systems and nutrition, as explicitly defined by the HPLE or the conceptual frameworks included in the appendix. Tools, metrics or methods developed or applied prior to 2008. Projects with no reporting in English. In-vivo laboratory animal studies. If the subjects are animals for agricultural production, livelihoods or consumption, they will be considered. If the animals are subjects as a proxy for humans or models for general interests (i.e., if the animals aren't to sell or eat), they will be excluded. In-vivo plant studies not explicitly related to agricultural production, land use, or other related themes. Like the exclusion for animal studies, if the plants are specifically mentioned in the context of agriculture or consumption, even if lab studies, they will be included. If the plants are a model of general cell function or not mentioned in relationship to agriculture/ecology nexus, they will be excluded. Therapeutic nutrition. Enhancement nutrition. If the paper is related to nutrition and nutritional proxies, food supplementation for communicable diseases (e.g., TB, HIV), special groups or niche populations (such as hospital patients, athletes, etc.) will all be excluded. The gap map will include primary research of any design, as certain study designs may in fact be an innovative method of application to study the agriculture-nutrition linkages. Reviews will be excluded. Study types that may demonstrate new innovations or novel applications could include (a) a new study design, (b) standard study designs using new or innovative tools, metrics or methods, or (c) studies specifically developing, piloting or validating a new tool, metric or method. These would therefore include, as examples, a primary study describing how the approach or design is unique methodologically, a validation study, a technical manual or user guide for a new metric, or a newly developed impact evaluation methodology or an impact evaluation using well-established study designs but using new tools or metrics. We will use the four considerations described above to determine what is considered "innovative" or "new" (Table 3). We will include qualitative research in the EGM as long as it fits within the agriculture/food systems to nutrition framework and meets the inclusion and exclusion criteria. Projects could be undertaken as part of a mixed-methods project, or be entirely qualitative. Traditional methods such as mini-ethnography, focus group discussion, or individual interviews will have to be innovative or applied in new ways to be considered for this EGM. Qualitative documentation of the food environment through participatory GIS, using technologies such as PhotoVoice to elicit consumer preferences, or employing a new visualization technique within a survey are all examples of innovation in qualitative methods that will be included in the EGM. Any innovation or application of tools, metrics and methods taking place anywhere will be considered. They could be from a specific country or region, or they could be applied globally, with relevance to LMICs (analytical approaches, trade issues, etc.). We will include ongoing studies and projects, identified through expert consultation, interviews, grant databases and unpublished documentation. We will employ a comprehensive literature, trial and project database search that includes electronic screening with search terms (listed in Appendix APPENDIX C), consultation with subject-matter experts (outlined in Appendix APPENDIX D). We will also search various project and research databases and key websites and backward-track citations in the bibliographies of key papers, both listed below. CAB Abstracts. Web of Science (seven databases). CGIAR research library: IFPRI, Bioversity, World Agroforestry, and International Livestock Research Institute DfID Research for Development Outputs BLDS FAO AGRIS IMMANA grant database The 3ie impact evaluation database IPA and J-PAL since 2015 The World Bank IEG evaluations USAID Development Experience Clearinghouse The proceedings of the Agriculture, Nutrition and Health Academy conference The proceedings of the CSAE Conference The proceedings of the NEUDC Conference The World Bank Economic Review The key publications we will use for backward-citation tracking are: Girard et al. (2012) Global Panel (2015) Hawkes et al. (2012) Herforth et al. (2016) Kadiyala et al. (2014) Masset, Haddad, Cornelius, and Isaza-Castro (2012) Ruel et al. (2013) Ruel et al. (2018) Webb (2013) Some included articles, studies and reports We will use a traditional method of two independent researchers to search and then screen (both on title/abstract and full text) the first 10% of items, with a third researcher (Howard White, Denny John or Thalia Sparling) providing a decision in the case of disagreement. For the remaining search results, we will use single screening with 5% randomly checked by a senior researcher. We do not plan to use any automation or text-mining. The Campbell Collaboration, in collaboration with the IMMANA team, will hire and manage an experienced team to complete the initial search, screen titles and abstracts according to the inclusion and exclusion criteria, and further screen full-text publications. We will then collaboratively extract the data, code the projects and complete the coding for stage of innovation or application, which will replace a traditional quality assessment in this EGM. Stage of innovation or application (definition provided in Quality Appraisal): Concept development and pilot Feasibility, efficacy or internal validity Demonstration and testing, effectiveness and external validity/construct validity Adoption, generalizability and widespread application Measurement unit: Individual Household Community/sub-district District/sub-national National Regional Global Setting or geographical application (Africa, Senegal, Asia-Pacific, global, etc.) Other filters will be used to identify cross-cutting themes, which will not have categories: Private-sector engagement Economics (e.g., cost-benefit, cost-effectiveness, cost of diets) Gender dynamics and parity (Could be about men or women—anything about gender dynamics, e.g., decision-making power over productive resources; employment in agriculture; self-care and health decision-making; social gender cohesion; women's mobility; leadership) Equity (e.g., caste/ethnicity, economic, geographic, age) Technology Political fragility/conflict Diets The filters without categories will be applied if the authors of the item specifically state the relationship of the item to that theme or the research item is clearly linked to a particular filter. The same research team in charge of the search and screening will complete the coding of these filters and categories, which will have been decided through consultation with subject experts and a piloting one grant portfolio, but may also be modified once sear
Год издания: 2019
Авторы: Thalia Sparling, Howard White, Suneetha Kadiyala
Издательство: The Campbell Collaboration
Источник: Campbell Systematic Reviews
Ключевые слова: Child Nutrition and Water Access, Food Security and Health in Diverse Populations, Obesity, Physical Activity, Diet
Другие ссылки: Campbell Systematic Reviews (PDF)
Campbell Systematic Reviews (HTML)
DOAJ (DOAJ: Directory of Open Access Journals) (HTML)
PubMed Central (HTML)
LSHTM Research Online (London School of Hygiene & Tropical Medicine) (HTML)
PubMed (HTML)
Campbell Systematic Reviews (HTML)
DOAJ (DOAJ: Directory of Open Access Journals) (HTML)
PubMed Central (HTML)
LSHTM Research Online (London School of Hygiene & Tropical Medicine) (HTML)
PubMed (HTML)
Открытый доступ: diamond
Том: 15
Выпуск: 3