https://doi.org/10.22319/rmcp.v15i1.6377
Article
Construction and validation of questionnaires to assess the risk of veterinary antibiotics in egg consumption and their impact on food safety
Eriberto Joel Tejada Rodríguez a,b
Andrea Arreguín b,c*
a Universidad Católica del Cibao (UCATECI). Facultad de las Ingenierías, Escuela de Agronomía. La Vega, República Dominicana.
b Universidad Internacional Iberoamericana. Campeche, México.
c Universidad Autónoma de San Luis Potosí. Facultad de Enfermería y Nutrición. San Luis Potosí, México.
*Corresponding author: andrea.arreguin@uaslp.mx
Abstract:
Poultry production is one of the most important agricultural sectors worldwide due to the high nutritional value of its products, such as meat and eggs, for human consumption. In this regard, veterinary antibiotics are used to treat or prevent disease-causing pathogens in order to ensure and maintain production. The objective of the study was to design and validate two questionnaires for assessing the risk of veterinary antibiotics used in egg-laying hens and their perceived impact in relation to food safety. Its logic and the validity of its content were determined by expert evaluation. Its construct validity was assessed by exploratory factor analysis, and its reliability, with Cronbach's Alpha coefficient. The survey was applied to 44 establishments or egg producers in the Espaillat province and to 385 consumers in the Santo Domingo province. A Cronbach's alpha coefficient of 0.799 was obtained for egg producers and veterinarians, and of 0.771, for consumers. The principal component analysis identified a KMO sample size adequacy measure of 0.558 for egg producers and veterinarians, and 0.797 for consumers. The questionnaire for egg producers and veterinarians consists of 8 factors and 22 items, and the questionnaire for consumers, of 3 factors and 8 items. The results confirm that the scale found is reliable and valid for the construct the risks associated with the potential consumption of food containing veterinary antibiotic residues.
Keywords: Egg, Food Safety, Risks, Reliability, Antibiotic, Factor Analysis.
Received: 04/01/2023
Accepted: 18/09/2023
Introduction
Safe animal feeding is important for animal health, animal food consumer safety, and the environment. There is a close link between the safety of animal feed and derived foods such as eggs. However, additives are deliberately added to animal feed or to the animal directly(1). While eggs are a high-demand product that has promoted the growth of the poultry industry and intensive agriculture, they have also increased the morbidity and mortality of farm poultry, which in turn can lead to diseases in the population such as fowl cholera, avian flu, spotted liver disease, avian salmonellosis, infectious bronchitis, Marek's disease, Gumboro disease, and parasitic diseases(2) due to bacteria, viruses, fungi, internal and external parasites, and other handling-related diseases(3). Veterinary antibiotics are one of the most viable solutions to combat them.
There is evidence that some poultry producers administer human antibiotics or antibiotics prescribed for other animal species(4); this may be legal, but their residues may be present in eggs, egg byproducts, and biowaste, including eggshells(5), leading to the development of antimicrobial resistance(6). Thus, the presence of antibiotics in egg yolk and albumin is related to the active ingredient or to the pharmacokinetic properties of the antibiotic in question. which will follow different distribution routes within the organism or in the animal tissues, leaving residues that depend on the type of antimicrobial(7). Consequently, this instills a suspicion of unsafety in egg consumers due to the potential risks involved, mainly because of the constant health crises and alarms, such as the avian flu virus and others that attack poultry.
Food safety is highly compromised when the Maximum Residue Limits, the withdrawal periods for the antibiotics administered, the effects of antibiotics on animals, and the regulatory standards for the use of veterinary antibiotics are not respected. At the international level, the norm CX/MRL 2-2021 of the Codex Alimentarius of the United Nations’ World Health Organization and Food and Agriculture Organization (FAO), which deals with Maximum Residue Limits (MRLs) and Risk Management Recommendations (RMR) for veterinary antibiotic residues in food, is taken as a reference(8). In the case of the Dominican Republic, it is regulated by Decree No. 354-10, which establishes the technical regulation of the MRLs of veterinary antibiotics and related substances in food of animal origin(9). This implies that consumers are constantly exposed to this type of antibiotics and any other additives used in animal feed and disease control that can put their health at risk.
Therefore, it is of great interest to have instruments to determine the reliability and validity of the use of veterinary antibiotics in poultry, in addition to the consumer’s knowledge, attitude, and practice (KAP) for the consumption of food of animal origin, as all these play a role in ensuring food safety.
The objective of this research was to design and validate a questionnaire to assess the risk of veterinary antibiotics used in poultry production in egg-laying hens and their perceived impact on the consumers in terms of food safety in the Dominican Republic.
Material and methods
Design
A study was conducted with a quantitative and qualitative approach and an analytical cross-sectional design for the construction and validation of an instrument (questionnaire) to assess the risk of veterinary antibiotics in egg consumption and their impact on food safety. Study participants received written information on the purpose and procedures of the study, as well as the right to withdraw at any time. They were assured that the data would be treated confidentially. Prior to the data collection, informed consent was obtained from each participant. Participation was on a voluntary basis.
Study population
The study population included the 2010 national census conducted by the National Statistics Office (Oficina Nacional de Estadística, ONE) of the Dominican Republic. A 95 % confidence level and a 5 % error were estimated for a total of 385 people in the Santo Domingo province and 44 farms or veterinaries in the Espaillat province, both in the Dominican Republic. The selected poultry farms had the characteristics of being managed under an intensive production system (birds confined in cages or covered all the time) and were managed within the category of small and medium-sized enterprises.
Research instrument
An online questionnaire was designed to be filled out by two groups ―1) Poultry producers in the selected sample and veterinary-antibiotics sales managers of veterinary and agrochemical centers, and 2) Table egg consumers― in order to obtain information on the perception of the use of veterinary antibiotics, their residual nature and the relationship with food safety and the risk they may pose to human health (Annex 1). In addition, there were collected general data and other data related to the characteristics of the veterinary antibiotics used in this species (commercial presentation, active ingredient, pharmaceutical form, concentration), the management of veterinary antibiotics (dosage used, route, and frequency of administration, duration of treatment, withdrawal time, indications, precautions-warnings-recommendations) and to who prescribes the antibiotics(10-11).
Questions were developed based on the researchers' previous experience, literature reviews, or expert opinions(10-11). The questionnaires were structured considering 15 domains or dimensions. The first questionnaire consists of 29 items, divided into ten sections: 1) General characteristics of egg producers, according to factors such as age, sex, name of the commercial establishment or poultry farm, sector, and province; 2) Technical characteristics of the control and prescription of veterinary antibiotics, knowledge and compliance with regulations for their use in poultry production; 3) Characteristics of the veterinary antibiotics used in poultry production; 4) Technical factors of poultry health management and use of veterinary antibiotics; 5) Duration of veterinary treatments applied to the birds; 6) Frequent application of veterinary antibiotics to laying hens; 7) Regular use of veterinary antibiotics in egg production and food safety; 8) Farm and/or veterinary administrative management; 9) Withdrawal time of veterinary antibiotics prior to use of poultry products; 10) Management of poultry by route of administration of veterinary antibiotics. The second questionnaire applied to consumers consisted of 17 items, divided into five sections: 1) General consumer characteristics; 2) Characteristics of egg consumption such as quantity and frequency; 3) Consumer perception of the presence of veterinary antibiotic residues in eggs and regulatory compliance by poultry producers; 4) Relationship between egg consumption and egg poisoning, and 5) Purchase and verification of the quality and hygiene conditions of eggs at the point of sale (supermarket, market, etc.). Responses to the items were generally four- or five-point Likert scales. A version of the questionnaire was developed using the Google Forms platform.
Validation of the instrument
Validation of the specific contents was carried out based on expert review. Five experts were recruited from various agricultural science disciplines. They were asked to evaluate the questionnaire, using a scale of 1 to 5 points to assess the basic dimensions. They also had the option of adding open comments. Construct validity was assessed using Principal Component Exploratory Factor Analysis (PCA); while reliability was determined by Cronbach's alpha coefficient both overall and for each of the questionnaire’s dimensions.
Data analysis
Internal consistency was evaluated by focusing on the correlations between the questionnaire items, which indicates their degree of theoretical adequacy. Cronbach's alpha was used for this purpose. An alpha between 0.70 and 0.95 was considered acceptable(12). All data were analyzed using IBM SPSS Statistics version 25, and the significance level was set at 0.05 for the confirmatory factor analysis.
Results
A total of 429 people responded to the questionnaire. The sample of this research was made up of 93.2 % men and 6.8 % women in the case of farms and veterinaries. For consumers, it consisted of 50.9 % women and 49.1 % men.
Cronbach's alpha score measuring the internal consistency of the questions was satisfactory (α= 0.799 and 0.771). Tables 1a and 1b show their values for each questionnaire. Internal consistency was satisfactory in all the domains. However, 7 items were eliminated from the initial 29 items of the first questionnaire (Table 1a), and 9 items, from the original 17 items of the second questionnaire (Table 1b), considering the analysis of the corrected item total, whose correction was deemed necessary because it exhibited a negative correlation and very low representativeness among the questions, which affected the subsequent analysis.
Table 1a: Item-total statistics of the reliability test for egg producers and veterinarians
Table 1b: Total item statistics for the reliability test for the consumer questionnaire
The normality test for both questionnaires showed that there is no significant correlation (α= 0.05) for the Kolmogorov-Smirnow and Shapiro-Wilk methods, as all variables show significance results of P<0.000, i.e., below alpha.
The exploratory factor analysis identified a Kaiser - Meyer - Olkin sampling adequacy measure for egg producers and veterinarians of 0.558, while for consumers it was 0.79. Bartlett's test of sphericity is significant at P=0.000 <α<0.0. The degree of significance has a value of 0.000, i.e., the hypothesis of the identity matrix is rejected, and there is a correlation between the variables (Tables 2 and 3).
The total variance explained test for egg producers and veterinarians found that the first 8 components were able to account for 72.035 % of the cumulative variance representativeness of the selected items (Table 2). For consumers, the amount of total variance that is explained by each extracted factor is 3 factors, with a cumulative variance representativeness of 74.807 % (Table 3).
Table 2: Results of total variance explained for the questionnaire applied to egg producers and veterinarians
Table 3: Total variance explained results for consumers
In the test of unidimensionality of the construct, as established by Kaiser's rule in the sedimentation graph, 8 factors were obtained according to the line drawn at the eigenvalue level for egg producers and veterinarians and 3 for consumers, which explain most of the total variability (Figures 1 and 2).
Figure 1: Questionnaire survey from egg producers and veterinarians
Figure 2: Questionnaire for egg consumers
Tables 4 and 5 of the rotated component matrix show the component data that were extracted, using the Varimax orthogonal rotation with Kaiser normalization, for eight components for egg producers and veterinarians and three components for consumers. The cut-off point as coefficient of factor loadings of the weights and weightings started at 0.5 within each factor, and the communality value was equal to or greater than 0.5.
The instrument or model studied for egg producers and veterinarians was structured with 22 items grouped into 9 factors or dimensions. For consumers, it was made up of 8 items and 3 factors or components.
Table 4: Rotated component matrix for egg producers and veterinarians
Extraction method: principal component analysis.
Rotation method: Varimax with Kaiser normalization.
a= Rotation has converged in 16 iterations.
Table 5: Rotated component matrix for consumers
Extraction method: principal component analysis.
Rotation method: Varimax with Kaiser normalization.
a= Rotation has converged in 16 iterations.
The components according to the group of items, and to their internal consistency, that the model incorporates for egg producers and veterinarians are the following:
Factor 1, technical characteristics of the control and prescription of veterinary antibiotics, and knowledge and compliance with regulations for their use in poultry production. It comprises 9 items and accounts for 23.283 % of the total variance. For Factor 2, characteristics of veterinary antibiotics used in poultry production, accounts for 10.435 % of the total variance and contains 4 items. Factor 3, technical factors of poultry sanitary management and use of veterinary antibiotics, produces 9.140 % of the total variance and includes 4 items. Factor 4, time of duration of veterinary treatments when administered to laying hens, is the cause of 7.769 % of the total variance and consists of 2 items. Factor 5, technical characteristics in the frequent application of veterinary antibiotics to laying hens, results in 5.948 % of the total variance and is grouped into 2 items. Factor 6, regular use of veterinary antibiotics in egg production and food safety, accounts for 5.444 % total variance, with a single item. Factor 7, technical characteristics of bird handling in the administration routes of veterinary antibiotics, has an explanatory value of 5.060 % of the total variance and is represented by 2 items. Factor 8, administrative management of the farms/veterinaries with respect to keeping records to establish traceability systems in the production, amounts to 4.955 % of the total variance and is represented by a single item.
The components extracted for the consumers incorporated into the model by group of items and their internal consistency are the following:
Factor 1, characteristic of egg consumption and frequency of consumption. It covers 42.884 % of the total variance, includes 4 items that have a positive correlation with the consumption of hen’s eggs (table eggs) as food; the number of eggs consumed according to the frequency; the manner of egg consumption, and the frequency of consumption of eggs. Factor 2, purchase and verification of the quality and hygiene conditions of eggs at the point of sale (supermarket, market, other). This component accounts for 19.151 % of total variance and comprises 2 items and groups: when you buy the egg products, do you take notice of the packing date and expiration date and the type of commercial brand? Do you consider egg consumption to be safer than that of other foods? The latter corresponds to section 3. While, Factor 3, consumer perception of the presence of veterinary antibiotic residues in eggs and compliance with the regulations by poultry producers, represents the variables considered as consumer perception of compliance by poultry farmers with the sanitary measures in egg production. This component represents 12.772 % of the total variance, includes 2 items, and covers compliance of egg producers in the application of the Dominican animal health legislation to treat diseases in laying hens, as well as compliance with the withdrawal period of veterinary antibiotics in laying hens according to the antibiotic label when placing eggs on the market for consumption.
Discussion
The assessment of the potential risks of veterinary antibiotics in egg consumption and their impact on food safety is not easy to analyze due to various factors associated with the use of veterinary antibiotics. In this sense, this paper provides a practical tool to evaluate aspects related to the use of antibiotics and its role in ensuring food safety. In the present study, construct validity was assessed by means of an exploratory principal-component factor analysis, and the internal consistency of the questionnaires was evaluated by means of Cronbach's alpha coefficient. Cronbach's alpha model in veterinary epidemiology has been applied very scarcely for the development, evaluation, and validation of questionnaires(13); even so, it has been used in preventive veterinary medicine(14), being useful for this research.
The content and logical validity assessments of the questionnaires by a group of experts were favorable. The majority of the surveyed professionals responded with a maximum score, indicating that they agreed with the format, wording, and usefulness of the questionnaire and that Cronbach's alpha model in veterinary epidemiology has been applied very scarcely for the development, evaluation, and validation of questionnaires.
The internal consistency of the questionnaires obtained a Cronbach's alpha of 0.799 for the egg producer/veterinarian questionnaire, and 0.771 for the consumers’ questionnaire, indicating that the instruments have adequate reliability for the measurement of veterinary antibiotic use and the perception of food safety-related impact, respectively.
Regarding the construct validation, it was observed that the principal component analysis yielded 8 factors for the questionnaire for egg producers in poultry farms or veterinary establishments, and 3 factors for the consumer questionnaire, which associates the similarity of correction between the variables of the evaluated study. This suggests that what has been described above constitutes a first insight into the perception by the farm owners, veterinarians, and consumers of the association that exists in the use and management of veterinary antibiotics or the use of antimicrobials in food production for human consumption.
The instrument applied to producers in egg farms and veterinary establishments and consumers was designed to evaluate the use of veterinary antibiotics in laying hens and the consumers' perception of the risk associated with table egg consumption and food safety. The results show that the hypothesis in the correlation matrix was positive between the variables with Bartlett's test of sphericity. The Kaiser-Meyer-Olkin (KMO) measures of sampling adequacy for egg producers and veterinarians (0.558) and consumers (0.797) have a high positive correlation, which indicates that their values are adequate because they range between 0 and 1, i.e., they are close to unity. These results coincide with those found by Salazar((15), who obtained a relatively high KMO (of 0.725). A KMO of over 0.80 in the data matrix is appropriate for running the factorization(16). In another study(17), a high KMO value (0.94) was observed for the food estimation and food frequency section, where Bartlett's test of sphericity proved significant (P<0.001), converging in 10 iterations and a six-factor structure.
The total variance tests of this study confirm that the variance matrix values, covariance, and percentage of each of the items, and the eigenvalues of the quantities of poultry production farms, veterinarians, and egg consumers are accounted for by each extracted factor and by the related percentages in the equation model. The residual analysis for checking the goodness of fit of the utilized factorial model shows that the results of the differences between the initial observed correlation matrix and those reproduced by the model indicate that this value is considered an indicator of good fit as it is close to absolute zero.
The analysis of the resulting principal components that were above 0.5 according to the groups of items, both for egg producers/veterinarians and consumers, made it possible to determine the magnitude of the samples of the effect that the variables had on each one of the components that provide the best exposure of the initial variables obtained in each component, with their respective positive or negative factor loadings. Loadings of 0.50 can generally be considered strong and allow the magnitude of factor loadings to be evaluated as a function of sample size(18,19). This allows the interpretation of the factor loadings that have an absolute value above 0.4 with their variance of the variables evaluated(20). In this sense, another validation study of the questionnaire on food estimation and frequency of food consumption(17) found a correlation ≥ 0.40 with a reliability index of 0.92 for section estimation and of 0.90 for food frequency. The data found in this study allowed us to discriminate the variables with positive or negative factor loadings below 0.5, so that each of the dimensions of the instrument had acceptable values (≥ 0.5) and made it possible to perform the global scale analysis.
The domains or dimensions used for the evaluation of the use of veterinary antibiotic use and fowl management factors in poultry production are related to the items studied by Chah et al(21) mainly in regard to the characteristics of antibiotic use in small-scale poultry farming, the knowledge, and the kinds and frequency of the antibiotics utilized in poultry farms. Speksnijder et al(22) also evaluated dimensions related to having a lower threshold for applying antibiotics to animals; their results resemble the ones obtained for the items evaluated in this research both in sections two and eight, on the characteristics of veterinary antibiotics used in poultry production and farm/veterinary administrative management, respectively.
Principal component analysis for the egg producers’ and veterinarians’ questionnaire confirmed that positive scores above 0.8 were related to such items as whether or not to vaccinate the birds regularly, the route of application of veterinary antibiotics, knowledge of the withdrawal periods of the antibiotics, keeping records of veterinary antibiotic applications, and treatment with antibiotics prohibited for birds. These findings prove that poultry producers adequately manage the following poultry components: 2) characteristics of veterinary antibiotics used in poultry production; 4) duration time of veterinary treatments administered to laying hens; 6) regular use of veterinary antibiotics in egg production and food safety; 7) technical characteristics of poultry handling in veterinary antibiotic administration routes, and 8) administrative management of farms/veterinaries with respect to keeping records to establish a production traceability system, respectively.
The highest score (0.9) for the consumer questionnaire was achieved in section or domain, characteristics of egg consumption, and frequency of egg consumption. The other assessed sections ―including the consumers' perception of the presence of veterinary antibiotic residues in eggs and the verification of egg quality and hygiene conditions in sales outlets (supermarket, market, others)― have lower scores (≥ 0.6 and ≥0.8), which agree with the results obtained by other authors(17). Studies carried out by various researchers(23,24) assessed methods for developing food safety, knowledge, and attitude scales to determine criteria for reliability and validity. According to the study by Al-Makhroumi et al(25), in the three evaluated sections, the respondents had low food safety knowledge, with a value of 44 %, compared to the other sections such as good practices, with 70 %, and positive attitudes, with 77 %. Other researchers(26) found a moderately positive correlation between the mean scores of antibiotic knowledge and antibiotic use (0.55 P<0.001), and a moderately positive correlation between the participants' mean scores on antibiotic resistance knowledge and their scores for knowledge of antibiotic use (0.41 P<0.001). The results obtained from the consumers surveyed in this study show that the second domain, on the consumers' perception of the presence of veterinary antibiotic residues, and the third domain, of egg quality and hygiene verification at points of sale, have low scores compared to the first domain, on the egg consumption and frequency of consumption characteristics, indicating a lack of independent consumer awareness of poultry management practices and little knowledge of the antibiotics administered to laying hens.
Finally, in this study, in order to establish the model with a Cronbach's Alpha coefficient over 0.5, it was necessary to adjust the items, i.e., to eliminate some variables that could be important for future studies and discussions of the original model. Furthermore, as mentioned by Hernández and Amador(27), a confirmatory factor analysis should be performed to confirm the theory, as the purpose of the utilized factor analysis was to construct the theory.
Conclusions and implications
The results of the present study confirm the reliability and validity of the questionnaire items, finding a satisfactory fit between the use of veterinary antibiotics in egg production and egg consumption. The value of over 0.7 obtained for both questionnaires in the assessment of the validity and reliability of the results of Cronbach's Alpha coefficient shows that the established model fits the extracted components with their variance of over 50 %; this represents a strength of the research because the scale of competence used for the construct produces fast and reliable results that serve to measure the incidence or risks in the health of people due to the consumption of food contaminated through the use of veterinary antibiotics in laying hens as antimicrobials or as growth promoters for egg production.
Institutional Review Board Statement
The study was conducted according to the guidelines of the Declaration of Helsinki and was approved by the Institutional Review Board (or Ethics Committee) of the Iberoamerican International University (Universidad Internacional Iberoamericana) in the minutes registered with the number CR-181.
Acknowledgments
The authors are grateful to the National Institute for the Protection of Consumers’ Rights (Instituto Nacional de Protección de los Derechos del Consumidor, ProConsumidor) and to UCATECI and UNINI-Mexico for their contributions to professional training and research.
Conflicts of interest
The authors declare that they have no conflicts of interest.
Literature cited:
Annex 1: Questionnaires applied to poultry producers, veterinarians, and consumers
I. QUESTIONNAIRE APPLIED TO PRODUCERS AND VETERINARIANS
Section 1. General characteristics of egg producers, according to factors such as age, sex, name of the commercial establishment or poultry farm, sector, and province
Name of Business Establishment/ Poultry farm: __________________________
Name of the respondent: ____________________________________________
Age: ______________
Sex: ☠M ☠F.
Sector: ____________________
Province: ___________________
Section 2. Technical characteristics of the control and prescription of veterinary antibiotics, and knowledge and compliance with regulations on their use in poultry production
Section 3. Characteristics of veterinary antibiotics used in poultry production
Section 4. Technical factors of poultry health management and use of veterinary antibiotics
Section 5. Duration of veterinary treatments applied to poultry
Section 6. Frequent use of veterinary antibiotics in laying hens
Section 7. Regular use of veterinary antibiotics in egg production and food safety
Section 8. Farm or veterinary administrative management
Section 9. Withdrawal period of veterinary antibiotics prior to use of poultry products
Section 10. Management of poultry by route of administration of veterinary antibiotics
II. FOOD SAFETY QUESTIONNAIRE ON THE CONSUMPTION OF FOOD CONTAMINATED WITH VETERINARY ANTIBIOTICS
Section 1. General consumer characteristics
Consumer characteristics:
Age: ______________.
Sex: ☠M ☠F.
Sector: ______________, Province: _______________________
Section 2. Characteristics of egg consumption such as quantity and frequency
Section 3. Consumer perception of veterinary antibiotic residues in eggs and poultry producers' compliance with regulations
Section 4. Relationship between egg consumption and intoxications due to egg ingestion
Section 5. Purchase and verification of the quality and hygiene conditions of eggs at the point of sale (supermarket, market, etc.)