Hostname: page-component-586b7cd67f-2brh9 Total loading time: 0 Render date: 2024-11-30T16:00:19.331Z Has data issue: false hasContentIssue false

Invited review: Big Data in precision dairy farming

Published online by Cambridge University Press:  11 January 2019

C. Lokhorst*
Affiliation:
Wageningen Livestock Research, PO Box 338, 6700AH Wageningen, The Netherlands Van Hall Larenstein University for Applied Science, PO Box 1528, 8901BV Leeuwarden, The Netherlands
R. M. de Mol
Affiliation:
Wageningen Livestock Research, PO Box 338, 6700AH Wageningen, The Netherlands
C. Kamphuis
Affiliation:
Wageningen Livestock Research, PO Box 338, 6700AH Wageningen, The Netherlands
*

Abstract

Insight into current scientific applications of Big Data in the precision dairy farming area may help us to understand the inflated expectations around Big Data. The objective of this invited review paper is to give that scientific background and determine whether Big Data has overcome the peak of inflated expectations. A conceptual model was created, and a literature search in Scopus resulted in 1442 scientific peer reviewed papers. After thorough screening on relevance and classification by the authors, 142 papers remained for further analysis. The area of precision dairy farming (with classes in the primary chain (dairy farm, feed, breed, health, food, retail, consumer) and levels for object of interest (animal, farm, network)), the Big Data-V area (with categories on Volume, Velocity, Variety and other V’s) and the data analytics area (with categories in analysis methods (supervised learning, unsupervised learning, semi-supervised classification, reinforcement learning) and data characteristics (time-series, streaming, sequence, graph, spatial, multimedia)) were analysed. The animal sublevel, with 83% of the papers, exceeds the farm sublevel and network sublevel. Within the animal sublevel, topics within the dairy farm level prevailed with 58% over the health level (33%). Within the Big Data category, the Volume category was most favoured with 59% of the papers, followed by 37% of papers that included the Variety category. None of the papers included the Velocity category. Supervised learning, representing 87% of the papers, exceeds unsupervised learning (12%). Within supervised learning, 64% of the papers dealt with classification issues and exceeds the regression methods (36%). Time-series were used in 61% of the papers and were mostly dealing with animal-based farm data. Multimedia data appeared in a greater number of recent papers. Based on these results, it can be concluded that Big Data is a relevant topic of research within the precision dairy farming area, but that the full potential of Big Data in this precision dairy farming area is not utilised yet. However, the present authors expect the full potential of Big Data, within the precision dairy farming area, will be reached when multiple Big Data characteristics (Volume, Variety and other V’s) and sources (animal, groups, farms and chain parts) are used simultaneously, adding value to operational and strategic decision.

Type
Review Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike licence (http://creativecommons.org/licenses/by-nc-sa/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the same Creative Commons licence is included and the original work is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use.
Copyright
© The Animal Consortium 2019

Implications

Insight into current scientific applications of Big Data within the precision dairy farming area may help us to understand the inflated expectations around Big Data. In total, 142 papers were selected, and the analyses demonstrated that the full potential of Big Data has not yet been reached. The papers focussed on farm-related animal data that were based on the Volume and Variety categories, and that were predominantly analysed with supervised classification methods. The dairy sector can possibly benefit more from Big Data if other V categories, such as Velocity, will be incorporated and if more animals, groups, farms and chain parts will be involved.

Introduction

John Mashley introduced the term ‘Big Data’ to the high-tech community in the early 1990s (Lohr, Reference Lohr2013). However, the term was not further defined, and it took some years before the three characteristics (Volume, Velocity and Variety) identified by Laney (Reference Laney2001) became associated with Big Data (De Mauro et al., Reference De Mauro, Greco and Grimaldi2016) to form today’s mainstream description of Big Data. Still, the use of the term Big Data was barely noticeable before 2011, to explode thereafter (Sonka and Cheng, Reference Sonka and Cheng2015a). This increased use of the term Big Data is associated with advances in computer storage and processing power, a sharp reduction in costs of sensors and communication and recent developments in the Internet of Things. These advances result in the use of many sources (e.g. sensors, applications, humans and animals) to start generating data (Zaslavsky et al., Reference Zaslavsky, Perera and Georgakopoulos2012; Sonka, Reference Sonka2015; De Mauro et al., Reference De Mauro, Greco and Grimaldi2016). Notions of successful Big Data stories are limited to organizations such as Google, Yahoo and Microsoft (Zaslavsky et al., Reference Zaslavsky, Perera and Georgakopoulos2012; De Mauro et al., Reference De Mauro, Greco and Grimaldi2016), creating the expectations that every worthwhile organisation is using Big Data, that Big Data brings them instantly success, and that Big Data has all traditional business-intelligence and warehousing characteristics (Devlin, Reference Devlin2012). These developments resulted also in being mentioned in the publication of the Gartner hype cycle (Fenn and Raskino, Reference Fenn and Raskino2008). The Gartner hype cycle positions upcoming technologies in a graph that represents the phases of ‘innovation trigger’, ‘peak of inflated expectations’, ‘trough of disillusionment’, ‘slope of enlightment’ and ‘plateau of productivity’. The peak of inflated expectations is also called the ‘hype’ phase.

Big Data analytics is an increasingly used term within the agro-food domain, where Big Data is described as highly valuable once it is established. For example, Kempenaar et al. (Reference Kempenaar, Lokhorst, Bleumer, Veerkamp, Been, van Evert, Boogaardt, Ge, Wolfert, Verdouw, van Bekkum, Feldbrugge, Verhoosel, van der Waaij, van Persie and Noorbergen2016) explored the field of Big Data in a Dutch context, using the dairy-milk production chain as a use case. According to them, the value of Big Data lies in the information and (new) insights that organisations can draw from it, rather than in the data as such. They raised the perspective that Big Data represents a disruptive innovation, potentially changing organisations dramatically. They concluded that the use of Big Data, once established, will support smart decisions and management, but that the creation of an integration platform for Big Data analysis was still far too ambitious, as well as being much more complex than expected. Despite this complexity, Big Data also is of interest and raises high hopes within the livestock sector: for example, the Animal Task Force, a European public–private platform promoting a sustainable and competitive livestock sector in Europe, published a number of themes with research priorities (Animal Task Force, 2014). One of these themes included resource efficiency, where the topic of Big Data, in combination with phenotyping and precision livestock farming, was identified with a high priority to meet policy goals within the European community. Finally, Big Data is an emerging research field within the precision dairy farming area. There were only a small amount of papers addressing Big Data explicitly in earlier international conferences on precision livestock farming, with one paper in the European conference on precision livestock farming in 2013 (Berckmans and Vandermeulen, Reference Berckmans and Vandermeulen2013) and two papers in 2015 (Guarino and Berckmans, Reference Guarino and Berckmans2015). There was a larger amount of papers having Big Data as a specific topic during the first international Precision Dairy Farming 2016 conference (Kamphuis and Steeneveld, Reference Kamphuis and Steeneveld2016). At that conference Dias et al. (Reference Dias, Garcia and Clark2016) addressed the creation of value with data from pasture-based farming systems, Van der Waaij et al. (Reference Van der Waaij, Feldbrugge and Veerkamp2016) used machine learning to predict individual cow feed intake, Verhoosel and Spek (Reference Verhoosel and Spek2016) examined the semantics for Big Data applications, Harty and Healy (Reference Harty and Healy2016) used Big Data advanced analytics to optimize health and fertility and Bahr et al. (Reference Bahr, Bruininx and van den Belt2016) went into the field of data-driven smart feeding. During the most recent European Conference on Precision Livestock Farming (Berckmans and Keita, Reference Berckmans and Keita2017), there was an entire session specifically devoted to Big Data.

All in all, Big Data is increasingly a theme of interest and high expectations for the precision dairy farming area. Full potential of Big Data is expected to occur when data with different V characteristics (Volume, Variety, Veracity) are used, that originate from more animals, groups, farms and chain parts in adding value to operational and strategic decisions. However, to validate if these high expectations are justified, it is essential to identify the current scientific applications of Big Data in the precision dairy farming area. Insight into these scientific activities will help to identify at what stage Big Data is within the Gartner hype cycle (Fenn and Raskino, Reference Fenn and Raskino2008) with regard to the precision dairy farming area, and whether this can be supported by science. To do so, a literature review has been conducted to find relevant scientific papers addressing the topic of Big Data within the precision dairy farming area.

Based on these developments, Animal requested an update to be given of the scientific status of Big Data in precision dairy farming. Therefore, the goal of this review paper is to give that scientific background and to see whether Big Data has overcome the peak of inflated expectation. Precision dairy farming is interpreted as a subset of precision livestock farming, specifically focussing on the dairy sector.

Material and methods

To structure the selection and review of relevant scientific papers on Big Data within the precision dairy farming area, a conceptual model was constructed. This conceptual model was based on the task and skills mapping from Gartner (Fenn and Raskino, Reference Fenn and Raskino2008). According to this mapping, three core areas were identified to be present in a Big Data project or environment: domain understanding; information technology (IT) to generate data; and skills in data analytics. These three core areas were defined more specifically for this current review into: the precision dairy farming area, the Big Data-V area, and the Big Data analytics area. For each of these three, relevant levels and categories were identified.

Big Data in the precision dairy farming area

The production network in the dairy sector is quite complex, and there are several potential places in that network where decisions could be improved or supported by the use of the Big Data concept. To identify where Big Data was applied within the precision dairy farming area, the dairy chain was categorized into dairy farm, food, retail and consumer as main levels. Added to this were the main partners for dairy farmers, which come from the feed, breed and health organisations. With these categories, the most important stakeholders who might invest and benefit from Big Data, as far as concerning the production side of precision dairy farming, were identified. The financial, legal and governmental aspects of the dairy production network were not taken into account.

Within each level, three sublevels were created to identify the object of interest: the first is the animal sublevel, where data are used originating from individual animal level. The second is the farm sublevel, where a group of cows on a farm was the observed unit. Since data may originate from more than one farm and more than one part of the production chain, the third sublevel was seen as the network. Within each main level (dairy farm, food, retail, consumer, feed, breed, health), the sublevels (animal, farm, network) were classified in the literature review. These main and sublevels will provide basic insights into the type of questions and problems that are currently being addressed with a Big Data approach. In addition to these main levels and sublevels, specific remarks were made for some papers to identify unexpected and specific questions that were addressed.

The Big Data-V area

Big Data is an interplay of various V’s, and analytics (Sonka and Cheng, Reference Sonka and Cheng2015a). The Big Data-V area focusses on various V’s, where the three most commonly used V’s defined by Laney (Reference Laney2001) are Volume, Variety and Velocity:

Over the years, many more V’s have been added: veracity – the need to trust the data; variability – the variance in meaning of data in sentiment analyses; visualization – the creation of complex graphs that include many variables of data while remaining understandable; and value – the value of relying on data-driven analyses for decision-making have been mentioned too (Zaslavsky et al., Reference Zaslavsky, Perera and Georgakopoulos2012; Van Rijmeman, Reference Van Rijmeman2017). Devlin (Reference Devlin2012) adds virality, viscosity and validity, but does not specify any of these terms.

None of the aforementioned V’s used to describe Big Data-V are easy to quantify, imposing a challenge to objectively score which Big Data-V category is fulfilled. For this review, we classified papers into the following four Big Data categories: Volume, Variety, Velocity and Other V’s. For the Volume category, not only the amount of data used was taken into account but also the scalability of the approach. For the Variety category, it was relevant whether or not different types of data were used, for example, milk yield and milk temperature. For the Velocity category, it was checked whether or not an immediate real-time response was required in the application. No restriction or specification was made for the last V category (Other V’s), only the use of such a word. Per paper, individual remarks were stored if they could contribute to a better quantification of the V category that was addressed.

The Big Data analytics and aspects area

Data analytics is needed to transform Big Data into information, knowledge and action. Both traditional statistical techniques and data-driven machine-learning techniques can be used to make sense of Big Data and to translate it into timely and valuable information. Statistical techniques can be seen as a subset of machine-learning techniques, where subsequently machine-learning techniques are a subset of data-mining techniques. Machine-learning algorithms are used to automatically learn patterns and make inferences from data. Those algorithms can be classified according to algorithm type (Murthy et al., Reference Murthy, Bharadwai, Subrahmanyam, Roy and Rajan2014). Within the area of data analytics for this review paper, the following four categories of machine learning were used (Murthy et al., Reference Murthy, Bharadwai, Subrahmanyam, Roy and Rajan2014):

  • Supervised learning: With supervised learning, the outcome of interest is known for each record used for model development. In other words, the data used for model development are labelled. Within this category, papers were classified into regression and classification. For regression, the outcome variable has a numerical value. Possible techniques involve linear regression, polynomial regression, use of radial basis functions, multivariate adaptive regression splines or multilinear interpolation. For classification, the outcome variable is categorical (e.g. binary yes/no). Possible techniques include neural networks, decision trees, naive Bayes model or support vector machines.

  • Unsupervised learning: With unsupervised learning, the outcome of interest is unknown (unlabelled) for each record used for model development. Within this category, papers were classified on clustering and dimensionality reduction. Clustering techniques include K-means, Gaussian mixture modelling, spectral clustering or hierarchical clustering. Dimensionality-reduction techniques include, for example, principal component analysis or independent component analysis.

  • Semi-supervised classification: Here, a mixture of small amounts of labelled data is fused with large unlabelled data sets by using, for example, active learning, transfer learning or co-training (Khoramshahi et al., Reference Khoramshahi, Yun, Hietaoja, Valros and Pastell2013).

  • Reinforcement learning: Here, a mapping function is learnt to maximise a reward function. This technique is used, for example, in Markov decision processes or Q-learning methods.

    To get insight into the type of data used for Big Data, the selected papers were also classified on the following data type aspects (according to Murthy et al., Reference Murthy, Bharadwai, Subrahmanyam, Roy and Rajan2014):

  • Time-series data are sequences of values or events obtained over repeated measurements of time, for instance sensor data of activity or behaviour of dairy cows. Scaling of the existing time-series model algorithms might be needed, and this is successfully done for dynamic time warping.

  • Streaming data are constantly arriving, for instance from remote sensors or surveillance systems, and should be processed in an online fashion. Offline algorithms can be approximated by distributed machine-learning algorithms for streaming data.

  • Sequence data consist of sequences of ordered elements or events that are recorded with or without a concrete notion of time.

  • Graph data where problems are modelled as graphs, like in social networks or biological networks. Algorithms may include a matrix representation and therefore necessitate large matrix solvers that have to be adapted in case of Big Data.

  • Spatial data can be place-related data or remote-sensing data. These data are not independent because of the spatial relationship, and this fact can be exploited by the algorithms.

  • Multimedia data, such as images, videos, audio and text mark-ups, need special digital-signal-processing techniques for image segmentation and motion-vector analysis.

Once the three core areas (precision dairy farming, Big Data category V and Big Data analyticsand aspects) were defined and made more specific as described above, a literature search was performed in Scopus. The search was limited to papers published between 1994 and June 2017. The search string was ‘machine learning OR statistical learning OR big data OR data mining OR neural network OR decision tree OR support vector machine OR k-means cluster* OR component analysis OR semi-supervised learning OR reinforcement learning & subject area = agricultural OR veterinary OR decision sciences’. This search resulted in 1442 scientific peer-reviewed papers. After a first screening by the present authors, the majority of the papers were considered irrelevant as they were not directed to livestock or dairy cattle. A total of 348 papers remained for further evaluation. After a classification by the present authors on fitness to the review, 142 remaining papers were assigned to precision dairy farming area, Big Data category V and Big Data data analytics and aspects areas. The rejected papers were dedicated to other fields of cattle research, like young stock, feeding cattle, dairy processing, genetics or other livestock species, and not on dairy cattle. Per paper, remarks on, for example, accuracy, speed, robustness, scalability or interpretability of the methods used were made. Results are presented as number of papers per core area, and summarized in tables. For the interaction between the areas, cross-tabs were created with the number of papers and the percentage of these papers for all combinations of precision dairy farming area, Big Data-V, Big Data analytics and data type. This resulted in a number of interactions based on a too limited number of papers, disabling any further exploration or interpretation. However, there were some interactions of specific interest, worthwhile to describe, These results were most interesting when the percentage of papers per area deviated from the overall row/column average percentage in the crosstab. For example, in total 54% of the papers dealt with Classification as analytics, but for the Health area this was much higher: 79%. Only large deviations from the overall row/column averages are described in the result section.

Results

Publication dates of papers

In Figure 1, the number of papers published per year from 1994 onwards is presented. Note that the number of papers for 2017 includes only those published in the first 6 months. A small number of papers published per year from 1994 to 2005, where the peak in 1995 are papers that originated mainly from one author. From 2007 onwards, there is a trend of a gradual increase in the amount of papers published. In more recent years, ~20 papers published per year have been dedicated to Big Data in the precision dairy farming area.

Figure 1 Number of papers published relating to Big Data in the precision dairy farming area, per year of publication.

Precision dairy farming area

The results of the classification of the papers per area within precision dairy farming are summarized in Table 1. Since a few papers addressed more than one main or sublevel, 153 classifications were made based on the 142 papers. With 58% of the classifications, the dairy farm stakeholder is by far the biggest, followed with 33% of the classifications for the health stakeholders. Papers involving stakeholders from feed, breed and food, being directly involved in the production chain, are represented limited with 3%, 4% and 2%, respectively. Only one paper involved the retail level and no paper involved the consumers level.

Table 1 Distribution of papers published between 1994 and June 2017 within the precision dairy farming area

The number of papers are classified per main level and sublevel.

1 The totals exceed the number of unique papers used in the review (n=142) since some papers cover more than one main level or sublevel.

Table 1 also shows that the majority of papers analyse Big Data at the animal sublevel (83% of the classifications), whereas Big Data were analysed at the farm or the network sublevel in only 11% and 6% of the classifications, respectively. From the papers that addressed more than one main level at the same time, seven papers were oriented on the dairy farm–health interaction at the animal sublevel. Other interactions were feed–breed, dairy farm–breed and breed–health, with all but one paper at the animal sublevel; that paper was oriented on the dairy farm–food interaction at the network sublevel. Within the main health level, there was one paper addressing both the animal and farm sublevels. The remainder of the papers (n=135) focussed only on one main or sublevel at a time.

The Big Data-V categories

Since some papers covered more than one Big Data-V category, a total of 203 classifications into these Big Data-V categories were made. There were 57 papers addressing the Volume and Variety categories at the same time. The vast majority with 119 (59%) of the 203 classifications addressed the Volume category, and 76 (37%) of the classifications addressed the Variety category. Only eight (4%) of the classifications addressed the Other V’s category and none of the papers addressed the Velocity category. The Other V’s were present in the papers of McQueen et al. (Reference McQueen, Garner, Nevill-Manning and Witten1995), Ortiz-Pelaez and Pfeiffer (Reference Ortiz-Pelaez and Pfeiffer2008), Cole et al. (Reference Cole, Newman, Foertter, Aguilar and Coffey2012), Garcia (Reference Garcia2013), Yoder et al. (Reference Yoder, St-Pierre and Weiss2014), Van Der Weerdt and de Boer (Reference Van Der Weerdt and de Boer2015), Vonder et al. (Reference Vonder, van Der Waaij, Harmsma and Donker2015) and Hermans et al. (Reference Hermans, Waegeman, Opsomer, van Ranst, de Koster, van Eetvelde and Hostens2017).

Big Data analytics area

There were 154 different classifications of the 142 papers into categories and levels within categories of the Big Data analytics area, due to papers relating to machine-learning techniques from more than one main category. Results presented in Table 2 show that 87% of the classifications used supervised learning techniques, and only 12% used unsupervised learning. Semi-supervised learning was used only by Yao et al. (Reference Yao, Zhu and Weigel2016), and no papers were found on reinforcement learning. Within supervised learning, classification was used in 64% of the papers. The other 36% of the papers used regression as supervised learning technique.

Table 2 Distribution of papers published between 1994 and June 2017 (n=142) in the four different categories (and, where applicable, levels within category) of Big Data analytics

1 The total exceeds the number of unique papers used in the review (n=142) since some papers cover more than one main category of level of Big Data analytics.

The paper of Moya et al. (Reference Moya, Silasi, McAllister, Genswein, Crowe, Marti and Schwartzkopf-Genswein2015) is the only paper that addresses three different machine-learning techniques, reporting on supervised classification, unsupervised clustering and dimensionality reduction. The papers from Martinez-Ortiz et al. (Reference Martinez-Ortiz, Everson and Mottram2013), Garcia (Reference Garcia2013), Caraviello et al. (Reference Caraviello, Weigel, Craven, Gianola, Cook, Nordlund, Fricke and Wiltbank2006) and Lacroix et al. (Reference Lacroix, Salehi, Yang and Wade1997) combine supervised regression and classification techniques. Moreover, three papers (Sloth et al., Reference Sloth, Friggens, Løvendahl, Andersen, Jensen and Ingvartsen2003; Caccamo et al., Reference Caccamo, Guarnera, Licitra, Azzaro, Petriglieri and Gallo2015; Kayano and Kida, Reference Kayano and Kida2015) combine the supervised regression techniques with the unsupervised dimensionality reduction techniques. Only two papers (Yoder et al., Reference Yoder, St-Pierre and Weiss2014; Brotzman et al., Reference Brotzman, Cook, Nordlund, Bennett, Gomez Rivas and Döpfer2015) combine the unsupervised clustering and dimensionality reduction techniques. Three different combinations between supervised and unsupervised analytics were reported. Shahriar et al. (Reference Shahriar, Smith, Rahman, Freeman, Hills, Rawnsley, Henry and Bishop-Hurley2016) combined classification and clustering, Schultz et al. (Reference Schultz, Bennett, Nordlund, Döpfer and Cook2016) combined regression and clustering and Nielen et al. (Reference Nielen, Schukken, Brand, Haring and Ferwerda-van Zonneveld1995) combined classification and dimensionality reduction techniques.

From the 142 papers, only 114 could be classified based on the data type (see Table 3). The vast majority of classified papers (61%) used time-series data, followed by 18% of the classified papers using multimedia data. Sequence, graph and spatial data accounted for 9%, 5% and 5%, respectively. The use of streaming data was very limited, involving only one out of the 114 classified papers (1%).

Table 3 Distribution of papers between 1994 and June 2017 (n=142) based on the Big Data aspect

1 The total is less than the number of unique papers used in the review (n=142) since some papers did not cover a Big Data aspect.

There were six papers that combined time-series data with another data type. Williams et al. (Reference Williams, MacParthaláin, Brewer, James and Rose2016), Homburger et al. (Reference Homburger, Schneider, Hilfiker and Lüscher2014) and Nadimi et al. (Reference Nadimi, Jørgensen, Blanes-Vidal and Christensen2012) combined time-series with spatial data, whereas Martinez-Ortiz et al. (Reference Martinez-Ortiz, Everson and Mottram2013), Graunke et al. (Reference Graunke, Nürnberg, Repsilber, Puppe and Langbein2013) and Gargiulo et al. (Reference Gargiulo, Shephard, Tapson, McEwan, Bifulco, Cesarelli, Jin, Al-Ani, Wang and van Schaik2012) combined time-series with multimedia data. In other papers, graph data were combined with sequence data (Nohuddin et al., Reference Nohuddin, Coenen, Christley and Setzkorn2010; Cole et al., Reference Cole, Newman, Foertter, Aguilar and Coffey2012), multimedia data (Guzhva et al., Reference Guzhva, Ardö, Herlin, Nilsson, Aström and Bergsten2015; Guzhva et al., Reference Guzhva, Ardö, Herlin, Nilsson, Åström and Bergsten2016) and spatial data (Dawson et al., Reference Dawson, Werkman, Brooks-Pollock and Tildesley2015).

Interactions between precision dairy farming area, Big Data-V and Big Data analytics

Based on the cross-tabs results the following interactions of specific interest are worthwhile to describe. Papers using spatial data (86%) and multimedia data (81%) were more than the overall average (66%) adressed to the Big Data-V category Volume. Moreover, papers on the dairy farm main level (64%) adressed more than average (58%) the Big Data-V category Volume, and this was less for the papers on the health main level (51%). Papers using spatial data (14%) and multimedia data (19%) were less than the overall average (31%) adressed to the Big Data-V category Variety. However, 38% of the papers using time-series data adressed the Big Data-V category Variety. Papers on the health main level (47%) were more than average (38%) adressing the Big Data-V category Variety, and this was less for papers on the dairy farm main level (32%). This is contrary to Big Data-V category Volume.

When multimedia data were involved, supervised regression occurred relatively more often in the papers: 38%, compared with the expected 27%. There was also a trend that supervised regression was used more at the dairy farm level (47%) and less at the health level (13%), compared with the expected 33%. On the other hand, supervised classification occurred more when time-series were involved (66%) and less when multimedia data were involved (46%), compared with the expected 57%. Supervised classification was used relatively less, with 47% at the dairy farm level and relatively more with 79% at the health level, compared with the expected 54%.

Discussion

As expected, the number of papers on Big Data within the precision dairy farming area has increased in the past decade. This coincides with the predictions of Gartner’s yearly reports on the hype cycle. According to Fenn and Raskino (Reference Fenn and Raskino2008), the ‘hype cycle’ is a branded graphical presentation developed by the Gartner firm for representing the maturity, adoption and social application of specific technologies. Recent publications of the hype cycle show that Big Data is currently passing the peak of inflated expectations, and evidence on useful applications of Big Data will come. Therefore, it is also expected that more scientific papers on Big Data applications in the precision dairy farming area will be published over the coming years.

During the review process, it became clear to the present authors that there is a thin line between Big Data and precision dairy farming and that these two aspects are easy to confuse (Sonka and Cheng, Reference Sonka and Cheng2015a). Certainly, the use of technologies (sensing and others) is increasing on dairy farms (Rutten et al., Reference Rutten, Velthuis, Steeneveld and Hogeveen2013; Caja et al., Reference Caja, Castro-Costa and Knight2016). The number of variables being recorded has also increased, ranging from milk quality parameters to cow behaviour, and new methods required to analyse this data are currently under investigation (Mottram, Reference Mottram2016). Thus, precision dairy farming does include key elements of Big Data, but there are differences between the two terms. One of these differences is that precision dairy farming usually focusses on information on individual cows, or at farm level, but the Volume category of Big Data-V requires observations from many animals or farms (Sonka and Cheng, Reference Sonka and Cheng2015b). Moreover, data from individual farms, or other agricultural stakeholders, are not likely to possess the entire range of data sources needed to generate new insights. Additional sources of data naturally reside and originate outside the farm (Sonka and Cheng, Reference Sonka and Cheng2015b), and our current review confirms that these are not yet fully explored. Traditionally, research in precision dairy farming focusses on one factor (e.g. reproduction or udder health). However, to identify complex interactions across several factors and multiple years requires much more sophisticated tools (Sonka and Cheng, Reference Sonka and Cheng2015b). Getting access to and aggregate data from several sources may be a huge challenge within the current precision dairy area. These challenges include data ownership, intelligent processing and analytics and clear business models (Kempenaar et al., Reference Kempenaar, Lokhorst, Bleumer, Veerkamp, Been, van Evert, Boogaardt, Ge, Wolfert, Verdouw, van Bekkum, Feldbrugge, Verhoosel, van der Waaij, van Persie and Noorbergen2016; Wolfert et al., Reference Wolfert, Ge, Verdouw and Bogaardt2017).

Results of the first core discipline (Big Data within the precision dairy farming area) showed surprisingly more papers at the animal sublevel than at the farm sublevel. The present authors expected that Big Data would be most valuable when data of different dairy farms and parts of the supply chain were combined. Most of the published papers are at the animal sublevel, which suggests that people expect to gain a lot from animal data. Within these animal data, it can be seen that most of the published papers deal with health issues. This seems to be in contrast with the development of funded research projects in the Netherlands, where there is a strong focus on breed- and feed-oriented research projects. From the breed perspective, the focus is on precision phenotyping, where animal performance data are collected in different production environments and used to develop new phenotypes, focussing on animal health and behaviour or proxies for complex traits such as resilience or efficiency, to be used in breeding programmes. For feed, the focus is on precision feeding of individual animals. The Big Data papers seemed to focus on the relationship between health and feed, since changes in health directly impact the feeding of animals. Recently more papers have been published with a focus on the farm sublevel and the production network. This will be more in line with the present authors expectations. It is also interesting that the published papers did not cover the (precision) dairy aspects of food companies, retailers and consumers. This may be explained by precision dairy farming’s focus on individual animals that live in a group and an increased involvement of feed, breed and food advisers. Retailers and consumers are not directly involved yet in precision dairy farming. Thus, we can expect Big Data papers focussing on the food-company perspective to increase in the coming years.

The expectation that Big Data will address more V’s at the same time is not supported by our review. Until now, most of the published papers dealt with Volume or Variety. The large number of papers using Volume is as expected, since data are gathered more at the animal sublevel, and spatial and multimedia data has become easier to process. Developments in the Internet of Things and data platforms will stimulate this even more. These developments also improve the integration of data coming from multiple sources and multiple types. Much to the present authors’ surprise, there were no papers dealing with Velocity. Thus, it seems that Velocity was not considered as important, or there was no demand for studies on real-time decision-making on dairy farms. All other V’s are hardly addressed by the published papers. When they did appear in the reviewed papers, this was more indicative rather than actually involving that aspect in the data analytics. The present authors expect that successful Big Data applications will also support operational decisions. For example, the decision to inseminate a cow will be based not only on the increased activity, lower milk production and increase in milk temperature (De Mol et al., Reference De Mol, Ipema, Roelofs, MAJM and Odinga2007), but also will be based on the actual semen price and milk price. These additional data need to come from sources other than the dairy farm itself. The current papers on Big Data contribute to the scientific knowledge, allowing for the development of new products, services or management strategies.

Data mining is also used in the context of dairy data analysis. Lokhorst et al. (Reference Lokhorst, Kroeze, van der Berg, Blok and de Vries1999) investigated the potential of data mining to benchmark dairy farms at the farm level. The concept of data mining was used to find new insights and knowledge when data from several farms were brought together. Although the development of new insights is also a promise of Big Data, the reviewed papers show a more structural analysis based on assumptions (and biological relevance) and supervised learning techniques. This search might need the combined expertise of domain knowledge and data analytics, as also suggested by Gartner (Fenn and Raskino, Reference Fenn and Raskino2008), when mapping Big Data tasks and skills into the three core disciplines of domain understanding, data science and IT skills. Classification and regression techniques are preferred in the reviewed papers, which seemed to originate from the more classical statistical approaches in data analytics used within the animal sublevel. In the precision dairy farming area, it is generally expected that data sets will contain missing data and/or that only a subset of data will be available. To tackle these issues, semi-supervised learning techniques might be appropriate, however, these techniques were not used in the current papers.

With regard to Big Data analytical aspects, it is logical that time-series are used. This is especially so when the individual animal (cow) level is used and production data are analysed. As such, time-series data were well represented in the current papers. We also see the appearance of spatial and multimedia data in more recent published papers. Use of camera techniques, including three-dimensional (3D) and multispectral cameras, have become possible not only through advances in camera technology, but also the ability to easily acquire, exchange and handle data in an internet-based environment. Examples include the use of 3D cameras to determine body composition (Fischer et al., Reference Fischer, Luginbühl, Delattre, Delouard and Faverdin2015) and locomotion scoring (Viazzi et al., Reference Viazzi, Schlageter Tello, van Hertem, Romanini, Pluk, Halachmi, Lokhorst and Berckmans2013). The data obtained from these developments also become available for Big Data analytics. The main driving force is the availability of the technology itself, rather than the specific need for data. Thus, in Big Data projects, there is still a lot of pragmatism. If data are available, we use them.

The papers published so far have focussed on traditional questions that occur in precision dairy farming. The question then is whether the full potential of Big Data is being realized. Full potential is being able to use data from different V categories and from more animals, groups, farms and chain parts, adding value to operational and strategic decisions. Is it possible that, in this challenging environment, other questions can be asked that currently are not foreseen. How to formulate these more data-driven questions and in which research environments and teams this should be done cannot be answered in this review paper. This will not be the exclusive area of domain experts anymore.

Conclusion

Based on the literature research and analysis of the 142 reviewed papers, the following conclusions can be drawn:

  • Big Data is a topic of research in the precision dairy farming area, with a steady increase of papers in the past decade.

  • The number of published papers focussed on the animal sublevel (83%) exceeded those focussing on the farm or network sublevel (11% and 6%, respectively). At the animal sublevel, topics on the dairy farm level prevail against those on the health level (58% v. 33%, respectively).

  • From the Big Data-V categories, the Volume category is most favoured (59% of the published papers), followed by 37% of published papers that deal with the Variety category. The Velocity category is not dealt with in the reviewed papers.

  • Papers dealing with supervised learning exceed those dealing with unsupervised learning. Within supervised learning, 64% of the papers dealt with classification issues, and exceed the papers dealing with regression methods.

  • Time-series are used in 61% of the papers, and are mostly dealing with animal-based farm data. Recently, multimedia data are appearing increasingly in published papers.

Based on these results and the expectations of the present authors, it can be stated that the full potential of Big Data in the precision dairy farming area has not been realised. Full potential is expected to occur when data with different V characteristics are used, that originate from more animals, groups, farms and chain parts in adding value to operational and strategic decisions.

Acknowledgements

The study is part of the project KB-27-001-001 Big Data for healthy resources utilization, which is funded by the Dutch Ministry of Agriculture, Nature, and Food Quality. The full list of the 142 classified papers can be seen in the supplementary Material S1. The remarks made during the review process, and the crosstabs can be obtained on request by the authors.

Declaration of interest

There is no conflicts of interest.

Ethics statement

The review did not needed the involvement of an ethical committee and does not conflict with legislation issues.

Software and data repository resources

None of the data were deposited in an official repository.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/S1751731118003439

References

Animal Task Force 2014. Research and innovation for a competitive and sustainable animal production in Europe; recommended priorities for support under Horizon 2020 in the 2016/17 work programme. Retrieved on 4 August 2017 from http://www.animaltaskforce.eu/Portals/0/ATF/horizon2020/1st%20Addendum%20ATF%20White%20Paper_final(2014)%20.pdf.Google Scholar
Bahr, C, Bruininx, E and van den Belt, A 2016. Nutrition, sensors and genetics – a data driven smart feeding approach by Agrifirm. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), June 2016, Leeuwarden, The Netherlands, pp. 4953. Wageningen Academic Publishers, Wageningen, The Netherlands.Google Scholar
Berckmans, D and Keita, A (eds.) 2017. Precision livestock farming ‘17 - Papers presented at the 8th European Conference on Precision Livestock Farming, September 2017, Nantes, France.10.21820/23987073.2017.1.4Google Scholar
Berckmans, D and Vandermeulen, J (eds.) 2013. Precision livestock farming ‘13 - Papers presented at the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium.Google Scholar
Brotzman, RL, Cook, NB, Nordlund, K, Bennett, TB, Gomez Rivas, A and Döpfer, D 2015. Cluster analysis of dairy herd improvement data to discover trends in performance characteristics in large upper midwest dairy herds. Journal of Dairy Science 98, 30593070.10.3168/jds.2014-8369Google Scholar
Caccamo, M, Guarnera, GC, Licitra, G, Azzaro, G, Petriglieri, R and Gallo, G 2015. Estimation of cow’s body condition score through statistical shape analysis and regression machines from images acquired using low-cost digital cameras. In Proceedings of the 7th European Conference on Precision Livestock Farming, September 2015, Milan, Italy, pp. 370–378.Google Scholar
Caja, G, Castro-Costa, A and Knight, CH 2016. Engineering to support wellbeing of dairy animals. Journal of Dairy Research 83, 136147.10.1017/S0022029916000261Google Scholar
Caraviello, DZ, Weigel, KA, Craven, M, Gianola, D, Cook, NB, Nordlund, KV, Fricke, PM and Wiltbank, MC 2006. Analysis of reproductive performance of lactating cows on large dairy farms using machine learning algorithms. Journal of Dairy Science 89, 47034722.10.3168/jds.S0022-0302(06)72521-8Google Scholar
Cole, JB, Newman, S, Foertter, F, Aguilar, I and Coffey, M 2012. Breeding and genetics symposium: Really big data: processing and analysis of very large data sets. Journal of Animal Science 90, 723733.10.2527/jas.2011-4584Google Scholar
Dawson, PM, Werkman, M, Brooks-Pollock, E and Tildesley, MJ 2015. Epidemic predictions in an imperfect world: modelling disease spread with partial data. Proceedings of the Royal Society B: Biological Sciences 282, 19.10.1098/rspb.2015.0205Google Scholar
De Mauro, A, Greco, M and Grimaldi, M 2016. A formal definition of Big Data based on its essential features. Library Review 65, 122135.10.1108/LR-06-2015-0061Google Scholar
De Mol, RM, Ipema, AH, Roelofs, RMG, MAJM, Lamers and Odinga, K 2007. An internet application for oestrus and mastitis detection in dairy cows. In Precision Livestock Farming ‘07 – Papers presented at the 3rd European Conference on Precision Livestock Farming (ed. S. Cox), June 2007, Skiathos, Greece, pp. 261–267. Wageningen Academic Publishers, Wageningen, The Netherlands.Google Scholar
Devlin, B 2012. The Big Data zoo – taming the beasts: the need for an integrated platform for enterprise information. Retrieved on 4 August 2017 from http://docs.media.bitpipe.com/io_10x/io_108041/item_630961/big%20data%20zoo.pdf.Google Scholar
Dias, KM, Garcia, SG and Clark, CEF 2016. Creating value of data: milking order and its role in future precision dairy feeding systems. In Precision Dairy Farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, in Leeuwarden, The Netherlands, pp. 383385. Wageningen Academic Publishers, Wageningen, The Netherlands.Google Scholar
Fenn, J and Raskino, M 2008. Mastering the hype cycle: how to choose the right innovation at the right time. Harvard Business Press, Cambridge, MA, USA.Google Scholar
Fischer, A, Luginbühl, T, Delattre, L, Delouard, JM and Faverdin, P 2015. Rear shape in 3 dimensions summarized by principal component analysis is a good predictor of body condition score in Holstein dairy cows. Journal of Dairy Science 98, 44654476.10.3168/jds.2014-8969Google Scholar
Garcia, AB 2013. The use of data mining techniques to discover knowledge from animal and food data: examples related to the cattle industry. Trends in Food Science and Technology 29, 151157.10.1016/j.tifs.2012.10.004Google Scholar
Gargiulo, GD, Shephard, RW, Tapson, J, McEwan, AL, Bifulco, P, Cesarelli, M, Jin, C, Al-Ani, A, Wang, N and van Schaik, A 2012. Pregnancy detection and monitoring in cattle via combined foetus electrocardiogram and phonocardiogram signal processing. BMC Veterinary Research 8, 164.10.1186/1746-6148-8-164Google Scholar
Graunke, KL, Nürnberg, G, Repsilber, D, Puppe, B and Langbein, J 2013. Describing temperament in an ungulate: a multidimensional approach. PLoS One 8, e74579.10.1371/journal.pone.0074579Google Scholar
Guarino, M and Berckmans, D (eds.) 2015. Precision Livestock Farming ‘15 - Papers presented at the 7th European Conference on Precison Livestock Farming, September 2015, Milan, Italy.Google Scholar
Guzhva, O, Ardö, H, Herlin, A, Nilsson, M, Aström, K and Bergsten, C 2015. Automatic detection of social interactions in the waiting area of automatic milking stations using a video surveillance system. In Proceedings of the 7th European Conference on Precision Livestock Farming, September 2015, Milan, Italy, pp. 681–688.Google Scholar
Guzhva, O, Ardö, H, Herlin, A, Nilsson, M, Åström, K and Bergsten, C 2016. Feasibility study for the implementation of an automatic system for the detection of social interactions in the waiting area of automatic milking stations by using a video surveillance system. Computers and Electronics in Agriculture 127, 506509.10.1016/j.compag.2016.07.010Google Scholar
Harty, E and Healy, J 2016. Using big data and advanced analytics top optimise health and fertility. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, Leeuwarden, The Netherlands, pp. 219222. Wageningen Academic Publishers, Wageningen, The Netherlands.Google Scholar
Hermans, K, Waegeman, W, Opsomer, G, van Ranst, B, de Koster, J, van Eetvelde, M and Hostens, M 2017. Novel approaches to assess the quality of fertility data stored in dairy herd management software. Journal of Dairy Science 100, 40784089.10.3168/jds.2016-11896Google Scholar
Homburger, H, Schneider, MK, Hilfiker, S and Lüscher, A 2014. Inferring behavioral states of grazing livestock from high-frequency position data alone. PLoS One 9, e114522.10.1371/journal.pone.0114522Google Scholar
Kamphuis, C and Steeneveld, W (eds.) 2016. Precision dairy farming 2016. Wageningen Academic Publishers, Wageningen, The Netherlands.10.3920/978-90-8686-829-2Google Scholar
Kayano, M and Kida, K 2015. Identifying alterations in metabolic profiles of dairy cows over the past two decades in Japan using principal component analysis. Journal of Dairy Science 98, 87648774.10.3168/jds.2015-9791Google Scholar
Kempenaar, C, Lokhorst, C, Bleumer, EJB, Veerkamp, RF, Been, T, van Evert, FK, Boogaardt, MJ, Ge, L, Wolfert, J, Verdouw, CN, van Bekkum, M, Feldbrugge, L, Verhoosel, JPC, van der Waaij, BD, van Persie, M and Noorbergen, H 2016. Big Data analysis for smart farming: results of TO2 project in theme food security. Wageningen University & Research, Wageningen, The Netherlands.Google Scholar
Khoramshahi, E, Yun, J, Hietaoja, J, Valros, A and Pastell, M 2013. Automatic sow pattern detection in videos: an AI approach. In Proceedings of the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium, pp. 370–378.Google Scholar
Lacroix, R, Salehi, F, Yang, XZ and Wade, KM 1997. Effects of data preprocessing on the performance of artificial neural networks for dairy yield prediction and cow culling classification. Transactions of the American Society of Agricultural Engineers 40, 839846.10.13031/2013.21294Google Scholar
Laney, D 2001. 3D data management: controlling data volume, velocity, and variety. Retrieved on 4 August 2017 from http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf.Google Scholar
Lohr, S 2013. The origins of Big Data’: an etymological detective story. Retrieved on 4 August 2017 from https://bits.blogs.nytimes.com/2013/02/01/the-origins-of-big-data-an-etymological-detective-story/.Google Scholar
Lokhorst, C, Kroeze, GH, van der Berg, JV, Blok, B and de Vries, F 1999. Datamining for knowledge discovery in dutch dairy databases. In Proceedings of the Second European Conference of the European Federation for lnformation on Perspectives of Modern Information and Communication Systems in Agriculture, Food Production and Environmental Control, Technology in Agriculture, Food and the Environment, EFITA (ed. G Schiefer, R Helbig and U Rockert), September 1999, Bonn, Germany, volume B, pp. 533–540. Universität Bonn-ILB, Bonn, Germany.Google Scholar
Martinez-Ortiz, C, Everson, R and Mottram, T 2013. Video tracking of dairy cows for assessing mobility scores. In Proceedinfgs of the 6th European Conference on Precision Livestock Farming, September 2013, Leuven, Belgium, pp. 154–162.Google Scholar
McQueen, RJ, Garner, SR, Nevill-Manning, CG and Witten, IH 1995. Applying machine learning to agricultural data. Computers and Electronics in Agriculture 12, 275293.Google Scholar
Mottram, T 2016. Animal board invited review: precision livestock farming for dairy cows with a focus on oestrus detection. Animal 10, 15751584.Google Scholar
Moya, D, Silasi, R, McAllister, TA, Genswein, B, Crowe, T, Marti, S and Schwartzkopf-Genswein, KS 2015. Use of pattern recognition techniques for early detection of morbidity in receiving feedlot cattle. Journal of Animal Science 93, 36233638.Google Scholar
Murthy, P, Bharadwai, A, Subrahmanyam, PA, Roy, A and Rajan, S 2014. Big Data taxonomy. Retrieved on 4 August 2017 from https://cloudsecurityalliance.org/research/big-data/.Google Scholar
Nadimi, ES, Jørgensen, RN, Blanes-Vidal, V and Christensen, S 2012. Monitoring and classifying animal behavior using ZigBee-based mobile ad hoc wireless sensor networks and artificial neural networks. Computers and Electronics in Agriculture 82, 4454.Google Scholar
Nielen, M, Schukken, YH, Brand, A, Haring, S and Ferwerda-van Zonneveld, RT 1995. Comparison of analysis techniques for on-line detection of clinical mastitis. Journal of Dairy Science 78, 10501061.Google Scholar
Nohuddin, PNE, Coenen, F, Christley, R and Setzkorn, C 2010. Detecting temporal pattern and cluster changes in social networks: a study focusing UK cattle movement database. In Proceedings of the 6th IFIP International Conference on Intelligent Information Processing, 13–16 October 2010, Manchester, UK, pp. 163–172.Google Scholar
Ortiz-Pelaez, A and Pfeiffer, DU 2008. Use of data mining techniques to investigate disease risk classification as a proxy for compromised Biosecurity of cattle herds in Wales. BMC Veterinary Research 4, 2440.Google Scholar
Rutten, CJ, Velthuis, AGJ, Steeneveld, W and Hogeveen, H 2013. Invited review: Sensors to support health management on dairy farms. Journal of Dairy Science 96, 19281952.Google Scholar
Schultz, KK, Bennett, TB, Nordlund, KV, Döpfer, D and Cook, NB 2016. Exploring relationships between dairy herd improvement monitors of performance and the transition cow index in Wisconsin dairy herds. Journal of Dairy Science 99, 75067516.Google Scholar
Shahriar, MS, Smith, D, Rahman, A, Freeman, M, Hills, J, Rawnsley, R, Henry, D and Bishop-Hurley, G 2016. Detecting heat events in dairy cows using accelerometers and unsupervised learning. Computers and Electronics in Agriculture 128, 2026.10.1016/j.compag.2016.08.009Google Scholar
Sloth, KHMN, Friggens, NC, Løvendahl, P, Andersen, PH, Jensen, J and Ingvartsen, KL 2003. Potential for improving description of bovine udder health status by combined analysis of milk parameters. Journal of Dairy Science 86, 12211232.Google Scholar
Sonka, S 2015. Big Data: from hype to agricultural tool. Farm Policy Journal 12, 19.Google Scholar
Sonka, S and Cheng, YT 2015a. Big data: more than a lot of numbers!. Farmdoc Daily 5, 201.Google Scholar
Sonka, S and Cheng, YT 2015b. Precision agriculture: Not the same as Big Data but…. Farmdoc Daily 5, 206.Google Scholar
Van der Waaij, BD, Feldbrugge, RL and Veerkamp, RF 2016. Cow feed intake prediction with machine learning. In Precision dairy farming 2016 (ed. C Kamphuis and W Steeneveld), 21–23 June 2016, Leeuwarden, The Netherlands, pp 377383. Wageningen Academic Publishers, Wageningen, The Netherlands.Google Scholar
Van Der Weerdt, C and de Boer, J 2015. Focusing on behaviour to ensure adoption of Big Data information services. In Precision Livestock Farming ‘15 - Papers presented at the 7th European Conference on Precision Livestock Farming (ed. M Guarino and D Berckmans), 15–18 September, Milan, Italy, pp. 721–729.Google Scholar
Van Rijmeman, M 2017. Why the three V’s are not sufficient to describe Big Data. Retrieved on 4 August 2017 from https://datafloq.com/read/3vs-sufficient-describe-big-data/166.Google Scholar
Verhoosel, JPC and Spek, J 2016. Semantics for big data applications in the smart dairy farming domain. In Proceedings of the 1st Precision Dairy Farming Conference, 21–23 June 2016, Leeuwarden, The Netherlands, pp. 211–218.Google Scholar
Viazzi, S, Schlageter Tello, AA, van Hertem, T, Romanini, CEB, Pluk, A, Halachmi, I, Lokhorst, C and Berckmans, D 2013. Analysis of individual classification of lameness using automatic measurement of back posture in dairy cattle. Journal of Dairy Science 96, 257266.Google Scholar
Vonder, MR, van Der Waaij, BD, Harmsma, EJ and Donker, G 2015. Near real-time large scale (sensor) data provisioning for PLF. In Proceedings of the 7th European Conference on Precision Livestock Farming, 15–18 September, Milan, Italy, pp. 290–297.Google Scholar
Williams, ML, MacParthaláin, N, Brewer, P, James, WPJ and Rose, MT 2016. A novel behavioral model of the pasture-based dairy cow from GPS data using data mining and machine learning techniques. Journal of Dairy Science 99, 20632075.Google Scholar
Wolfert, S, Ge, L, Verdouw, C and Bogaardt, M-J 2017. Big Data in smart farming – a review. Agricultural Systems 153, 6980.Google Scholar
Yao, C, Zhu, X and Weigel, KA 2016. Semi-supervised learning for genomic prediction of novel traits with small reference populations: an application to residual feed intake in dairy cattle. Genetics Selection Evolution 48, 19.Google Scholar
Yoder, PS, St-Pierre, NR and Weiss, WP 2014. A statistical filtering procedure to improve the accuracy of estimating population parameters in feed composition databases. Journal of Dairy Science 97, 56455656.10.3168/jds.2013-7724Google Scholar
Zaslavsky, A, Perera, C and Georgakopoulos, G 2012. Sensing as a service and Big Data. In Proceedings of the International Conference on Advances in Cloud Computing, July 2012, Bangalore, India, pp. 21–29.Google Scholar
Figure 0

Figure 1 Number of papers published relating to Big Data in the precision dairy farming area, per year of publication.

Figure 1

Table 1 Distribution of papers published between 1994 and June 2017 within the precision dairy farming area

Figure 2

Table 2 Distribution of papers published between 1994 and June 2017 (n=142) in the four different categories (and, where applicable, levels within category) of Big Data analytics

Figure 3

Table 3 Distribution of papers between 1994 and June 2017 (n=142) based on the Big Data aspect

Supplementary material: File

Lokhorst et al. supplementary material

Lokhorst et al. supplementary material 1

Download Lokhorst et al. supplementary material(File)
File 52.8 KB