Nomenclature
- α:
-
kernel parameter for α quadratic entropy definition
- σ:
-
conditional parameter defined for bird track information filtering
- B:
-
bird behaviour index
- d:
-
parameter defining a specific date for database construction
- h:
-
hourly interval defined for hourly track count computation
- $\gamma $ :
-
smoothing parameter
- $\boldsymbol{l}$ :
-
all tracks spatial coordinate information within a specific grid
- F:
-
feature vector containing temperature, humidity, wind speed and wind direction parameters
- En:
-
alpha quadratic entropy
- P:
-
probability of bird existence at specific hour and date
- N:
-
track numbers corresponding to the specific date and conditional parameter
- N:
-
track count database integrating all track count information
- G:
-
grade database constructed from database N
- I:
-
bird activity intensity database constructed through normalisation from database N
- Te:
-
entropy threshold value defined for weighing factor computation
- w:
-
weighing factor defined for integrating intensity and uncertainty information of bird activities
- CAST:
-
China academy of Civil Aviation Science and Technology
- UAV:
-
unmanned aerial vehicle
- PCA:
-
principal component analysis
- LDA:
-
linear discrimination algorithm
1.0 Introduction
Interactions between aviation vehicles and flying birds are significant concerns in aviation safety. Bird strikes accidents have caused nonnegligible economy and life loss in past a few years [Reference Chilson, Bridge, Frick, Chapman and Kelly1, Reference Sheridan, Randolet, DeVault, Seamans, Blackwell and Fernández-Juricic2]. Besides structure and component design on aircrafts to reduce bird strike damages [Reference Jang and Ahn3, Reference Heimbs4], ecological solutions are also necessary to manage the coexistence with bird interferences especially in airport airspaces. Timely and effective remote sensing solutions for birds are highly desired to support wildlife surveillance and managements. Avian radar systems are good options for their advantages of long-range and all-weather surveillance capabilities on birds. Their performance for various flying birds are validated in many airports for years [Reference Flock5–Reference Chen, Liu and Li8]. Existing avian radar systems could detect and track various bird targets with satisfied accuracy [Reference Jun, Yulong, Xiancheng, Xiaosheng and Zongxing9, Reference Phillips, Majumdar, Washburn, Mayer, Swearingin, Herricks, Guerrant, Beckerman and Pullins10].
However, these systems are biased on short term temporal functionalities by providing real-time bird detection and tracking information as well as bird strike risk evaluation [Reference Gerringer, Lima and DeVault11, Reference Dokter, Baptist, Ens, Krijgsveld and van Loon12]. It also indicates historical datasets are useless. However, this functionality shortage results in bird behaviour ambiguity in spatial and temporal domains. The information loss of bird behaviour characters and their distributions limits the airport bird situation understanding, and could hardly provide useful references for ecological managements to reduce bird strike risks [Reference Nilsson, Dokter, Schmid, Scacco, Verlinden, Backman, Haase, Dell’Omo, Chapman and Lejinse13, Reference Schmaljohann, Liechti, Bachler, Steuri and Bruderer14]. Moreover, the interference pattern between bird behaviours and environments is also ambiguous without sufficient data supports. Therefore, historical avian radar datasets have significant potentials for mining and proper radar data modelling with bird behaviour characterisation solutions are necessary. Historical observation records reveal the close relevance between bird behaviours and environmental factors [Reference Abraham15]. Reference (Reference Coates, Casazza, Halstead, Fleskes and Laughlin16) demonstrates avian activity index dependence on different meteorological factors, and indicate that avian activity index characters are comprehensive consequences of bird species, time, location and meteorological factors. Reference (Reference Van Doren and Horton17) introduces a bird migration forecasting framework using meteorological information and weather radar systems. Relative works reveal the feasibility of forecasting bird activities using weather information. However, works in Ref. (Reference Gerringer, Lima and DeVault11) only studies avian activity index relevance with single meteorological factors and does not provide a forecasting solution. The migration forecasting framework in Ref. (Reference Van Doren and Horton17) is applicable for large spatial scale based on bird surveillance information from weather radar systems. Therefore, a bird behaviour interpretation model based on multiple meteorological factors is desired to achieve bird behaviour prediction within airspace covered by avian radar systems. Historical avian radar datasets provide solid data support for bird distribution modelling in spatial-temporal domain, and quantitative behaviour characterisation. The integration with airport weather records provides the condition to build bird behaviour prediction models.
The fast development of machine learning techniques enables the bird detection using radar [Reference Chilson, Avery, McGovern, Bridge, Sheldon and Kelly18] and predict bird behaviours with proper modelling strategy [Reference Garcia-Quintas, Roy, Barbraud, Demarcq, Denis and Lanco Bertrand19]. This paper utilises a machine learning model to build the relevance between bird behaviours and weather parameters. Original avian radar datasets are transformed by introducing a bird behaviour characterisation model. Bird behaviour indices are firstly utilised to study relevance with single weather parameters. Behaviour dependence on multivariable weather parameters is constructed with a random forest model. Bird behaviour grades are predicted according to four weather parameters. The proposed method is verified using avian radar datasets from four years field observation experiments. Prediction results verify the feasibility of predicting bird behaviour grades according to weather information. However, some problems that influence prediction accuracy are also discussed as future works.
This paper is organised as follows. Section 2 introduces the radar data modelling and bird behaviour characterisation methods. Section 3 firstly studies bird behaviour relevance with single weather parameters, then extends to multivariable weather parameter study using learning machine model. Experiment setup, analysis results and discussions are given in Section 4. Section 5 draws the conclusion.
2.0 Data modelling and behaviour characterisation
The technique framework of bird behaviour characterisation is presented in Fig. 1. Avian radar datasets are processed in the spatial domain by generating density heatmaps. Extracted reference spots mark significant bird distribution areas. Behaviour characters are modelled within each reference spot to guarantee accuracy. The behaviour index is defined by processing filtered radar data from each reference spot as a quantitative descriptor. Behaviour grades transform indices into qualitative labels for the convenience of prediction. Details are presented in following sections.
2.1 Data modelling in spatial domain
According to historical records, birds might visit some places more frequently for roosting, food hunting or migration. This frequent visitation results in large bird track densities within specific areas. Density heatmaps depict bird distributions in spatial domain, but they are not comprehensive for more accurate description. This paper adopts the concept of reference spots, which are defined as regions with higher visiting frequencies than others [Reference Chen20, Reference Li, Ding, Han, Kays and Nye21]. The first step of spots extraction is meshing radar surveillance airspaces into two-dimensional uniform grids as in Fig. 2. Reasons that airspaces are not meshed into three-dimensional grids are based on two considerations. The first one is the low altitude resolution of avian radar systems. Beamwidth in elevation angle dimension must be large enough to guarantee beam coverage. This makes avian radar systems still could hardly generate accurate bird altitude information as in range and azimuth dimensions. The other consideration is about the data sufficiency. The existing two-dimensional discretisation strategy could guarantee sufficient bird track samples for density computation. If each grid is further decomposed in the altitude dimension, insufficient data support might result in deviations with practical bird spatial distributions.
For a spatial gird at c , its density is evaluated using the kernel density algorithm [Reference Worton22]:
in which $\boldsymbol{l}$ indicates all tracks location information within the grid, $\left| {\boldsymbol{c} - \boldsymbol{l}(i)} \right|$ indicates the distance between $\boldsymbol{c}$ and $\boldsymbol{l}(i)$ . The term $\gamma $ is a smoothing parameter:
Parameters ${\sigma _x}$ and ${\sigma _y}$ are standard deviations of track coordinates in longitudinal and latitudinal dimensions from n track locations.
Density heat maps are generated by calculating densities for all grids. The number of grids, total grid extent as well as a parameter p are adjusted to create landscape configurations for reference spots extraction. The parameter p denotes the percentage of largest densities. Parameters are adjusted to meet the criterion that largest density areas are depicted with discrete polygons. Considering the property that bird tracks distribute within continuous landscapes rather than discrete spots, a range of flexible landscape scenarios should be explored.
To select proper reference spots, three meshing configurations of $ 75 \times 75$ , $ 100 \times 100$ , $ 125 \times 125$ are constructed, and the parameter p ranges from 0.01% to 25%. The quality of extracted reference spots is evaluated artificially. A larger p value usually generates more reference spots, which might not be the optimal solution. The optimised p value should be the one which generates discrete reference spots over landscapes without extra landscape painting. This paper selected the parameter p as 8% rather than the conventional 15% value [Reference Chen20] to accommodate avian radar data properties. Figure 3 presents a distribution of reference spots. Spots I and II are mostly distributed with diurnal bird activities. In contrast, most bird activities within spots III and IV are within nocturnal hours. The yellow arrow indicates the dominant flight directions deduced from massive track information, which indicates migratory activities of nocturnal birds. In following analysis, avian radar datasets are extracted from grids in these four reference spots to provide sufficient samples.
2.2 Bird behaviour characterisation
The behaviour characterisation is composed of two steps. The first step extracts radar data under specific filtering conditions. Bird behaviour characters have close relevance with seasonal and weather conditions. Birds under extreme weather like precipitation, gust, fogs and hails present completely different behaviour characters compared with normal weather conditions. Therefore, data groupings according to weather conditions is necessary to elevate data quality. This paper defines normal and adverse weather conditions $\boldsymbol{\sigma}$ based on historical observation records. Selected datasets are denoted as $\boldsymbol{N} = \left\{ {N\!\left( {{d_1}{\rm{|}}\boldsymbol\sigma } \right),N\!\left( {{d_2}{\rm{|}}\boldsymbol\sigma } \right), \cdots, N\!\left( {{d_K}{\rm{|}}\boldsymbol\sigma } \right)} \right\}$ , in which K indicates selected date number. The term $N\!\left( {{d_k}{\rm{|}}\boldsymbol\sigma } \right)$ indicates track number at date ${d_k}$ under $\boldsymbol\sigma $ .
The number of tracks is a straightforward bird situation indicator, but has many limitations as a behaviour descriptor. The first one is due to blind zones of avian radar systems, which result in bird quantity deviations between reality and radar detection. The incapability of avian radar systems to distinguish a single or flock birds also confines its track number accuracy. The second limitation comes from the large track number fluctuation in temporal domain. This confines bird situation integration under other spatial-temporal windows. The third reason is the ambiguous relevance between bird track count and bird strike risks. Moreover, the bird track count prediction using weather information is not feasible with little application significance. Therefore, this paper proposes a behaviour index for bird behaviour characterisation. Its computation is composed of four steps:
Step 1: Normalised intensity calculation. This intensity is extracted from the number of tracks within one hour. For a date d k , the normalised intensity for one day composes a vector $\boldsymbol{I} = \left\{ {I\!\left( {1{\rm{|}}{d_k}} \right),I\!\left( {2{\rm{|}}{d_k}} \right), \cdots, I\!\left( {24{\rm{|}}{d_k}} \right)} \right\}$ , the term $I\!\left( {i{\rm{|}}{d_k}} \right)$ denotes the intensity between hour i-1 and i. The numerical range of normalisation is [20,100]. The lower bound is 20 rather 0 because it is unreasonable to indicate the minimum number of tracks as no bird activity.
Step 2: Intensity transformation. The intensity vector is integrated by involving data from more selected dates. Denote all selected dates as an vector d, the corresponding dataset for hour h k is I(h k ,d). Track count variations might result in intensity fluctuations, which is misleading for behaviour interpretation. To reduce the interference from intensity fluctuation, normalised intensities are transformed into 10 levels according to the mapping principle in Table 1. A new dataset containing all level information is G(h k , d).
Step 3: Uncertainty modelling. The behaviour uncertainty is an important behaviour indicator. The α-quadratic entropy [Reference Fauvel, Chanussot and Benediktsson23] quantifies behaviour uncertainty as:
The term ${P^j}\!\left( {\boldsymbol{G}\!\left( {h,\boldsymbol{d}} \right)} \right)$ represents the probability of $\boldsymbol{G}\!\left( {h,\boldsymbol{d}} \right)$ at level j. The enlargement parameter $\alpha $ quantifies the uncertainty sensitivity [Reference Li, Ding, Han, Kays and Nye21, Reference Worton22]. This paper selects $\alpha $ as 0.7 since the recommend 0.5 is considered insufficient to quantify behaviour uncertainties. To choose the proper $\alpha $ , the airport staff with rich avian radar observation experience is invited to visually categorise 200 groups of datasets into ‘smaller uncertainties’ and ‘larger uncertainties’. The behaviour characterisation model is adopted to calculate their weighing factors as defined in (4) by increasing $\alpha $ gradually from 0.5. When over 90% of ‘larger uncertainties’ datasets have their weighing factors larger than 1.2, the corresponding $\alpha $ is considered as the selected one.
Step 4: Uncertainty weighing. The bird behaviour character is modelled as an integration of intensity and uncertainty. A weighing factor is proposed to quantify behaviour uncertainty as [Reference Liu, Fang, Xie and Wang24]:
The definition in (4) indicates the uncertainty descriptor is an extra enlargement of intensity. The threshold ${T_e}$ determines the enlargement pattern. Its selection is based on the entropy value of behaviour datasets which are artificially decomposed into large and small variations. The selected threshold minimises the overlapping probability between entropy histograms of large and small variations. Adopted datasets result in the threshold ${T_e}$ as 1.63.
Step 5: Behaviour index calculation. The bird behaviour index is modelled as an integration of intensity and uncertainty. For an hour window h, its behaviour index is:
The term ${I_{avg}}\!\left( {h,\boldsymbol{d}} \right)$ represents an averaged value of all intensity indicators within temporal window $\left( {h,\boldsymbol{d}} \right)$ . The overall framework is demonstrated in Fig. 4.
Technically behaviour indices could be adopted as a behaviour prediction indicator. A proper regression model possesses the feasibility to achieve this functionality. However, this is not adopted in our work since its application significance and regression accuracy are problematic. Behaviour indices indicate a complicated weather dependency. Existing weather measurement systems could hardly guarantee a high quality of parameter accuracy. The constructed regression model based on inaccurate weather parameters also generates in controversy results. Moreover, airport managers prefer more intuitive bird situation information for wildlife management or air traffic control, precise numerical indicators are not mandatory. A more reasonable activity categorisation strategy is useful to facilitate bird strike risk evaluation and air traffic control. Therefore, the precise regression modelling to predict bird behaviour index could not bring extra bird situation awareness, but might elevate bird situation complexity or misleading due to inaccurate regression model and weather information deviation. This paper transforms the bird behaviour prediction from a regression problem into a classification problem by denoting bird behaviours as different grades. The mapping between behaviour index and grade is defined in Table 2.
Another concern motivates the problem transformation from regression classification. Existing avian radar systems could not guarantee a 100% detection accuracy. False alarms and environmental clutters like precipitation might generate non-bird target tracks as interferences. These factors lead to avian radar data credibility and quantity uncertainty. It is possible to build a well-trained regression model with high accuracy, but its construction is based on ‘polluted’ data. Therefore, the proposed method could alleviate the data quality problem and simplify the prediction problem.
3.0 Behaviour dependence study with weather parameters
3.1 Single weather parameter
Existing avian radar datasets are categorised into diurnal local birds and nocturnal migratory birds. Two types of birds cluster within reference spots {I,II} and {III,IV}, respectively. The behaviour relevance study on a single weather parameter is fundamental to explore weather dependence characters of different bird types. Temperature, humidity, wind speed and wind direction are adopted as dominant impact factors influencing bird behaviour characters. Dependence studies are carried out for diurnal and nocturnal bird datasets, respectively. The temporal window for data extraction is from August 1 to October 31 in four years. Hour windows for diurnal and nocturnal bird data extraction are [05:00,19:00] and [17:00,06:00]. One hour is taken as the most fundamental time unit. Weather parameter information comes from historical airport weather records. Temperature, humidity and wind speed are numerical parameters. The wind direction is categorised into eight directions. Averaged behaviour index and three grades’ proportions are presented at each weather parameter span. A bi-axis plotting strategy is adopted to demonstrate two indicators within one figure. A larger averaged behaviour index indicates birds are more active. The proportion of behaviour grades denotes behaviour complexity and uncertainty, which presents positive correlation relevance with medium-grade proportion.
Figure 5 presents behaviour dependence on single weather parameters for diurnal and nocturnal birds, respectively. Larger averaged grade and proportion variations indicate that temperature is the most dominant factor on bird behaviour. Like humans, birds are more active at their comfortable temperature ranges. Diurnal birds present higher behaviour intensities at the temperature span of [60,70] °F, which is consistent with artificial observation records. The most active temperature span is accompanied with smallest proportion of medium activity grade, which indicates a higher behaviour certainty. The temperature dependence of nocturnal bird is different. There is not temperature record within the span of [80,90] °F, and nocturnal temperatures are clustered within the span of [40,60] °F. The temperature relevance for nocturnal bird behaviours is not as explicit as diurnal birds. Moreover, the behaviour grade proportion distribution is more uniform, indicating a lower degree of behaviour complexity. This presents a good consistency with historical analysis and understandings about migratory bird sensitivity to temperatures. The prominent behaviour intensity variation only exists for extreme temperature conditions. Moreover, this relevance ambiguity is partially contributed by measurement deviations. Compared with diurnal birds within low-altitude airspace, the averaged altitude for nocturnal bird activities is higher. According to analysis on historical datasets, over 90% of nocturnal birds distribute within the height layer of [400, 1700] meters. This is also the representative height range for migratory birds. Therefore, nocturnal birds within this height layer are extracted for following analysis. Deviations between ground measurement and real temperatures are inevitable within this airspace. The existing experiment condition could not acquire temperature information from nocturnal bird behaviour airspaces, and this accuracy could temporarily not be solved effectively.
The most preferred humidity span for diurnal birds is within [70,80]% with a larger bird behaviour complexity. Excessively dry or wet environments are not preferred by birds, their larger proportions of medium grades are also contributed by insufficient data. The humidity range in [90,100]% is usually accompanied with fogs with prominent diurnal bird behaviour reduction. Nocturnal behaviours present a similar preference on humidity ranges, grade proportion distributions present lower complexity.
Wind is important for bird activities, but wind speeds and directions have different impacts on bird behaviours. Both indicators demonstrate that stronger winds constrain bird behaviours. The larger medium grade proportion at lower speeds indicates higher behaviour complexities, this is reasonable since in this speed range wind has minor impact on birds. Nocturnal bird behaviours reflect a negative correlation pattern with wind speed. Existing understandings reveal that migratory bird activities are closely related with wind speed and directions for energy consumption considerations. Results in Fig. 5 is controversy due to wind speed information credibility. Similar to temperature and humidity, wind speed is also measured with ground equipment. The real wind speed information at migratory airspace is not clear. In contrast, wind speed has limited impacts on diurnal bird behaviours. Two indicators demonstrate uniform patterns. The larger proportion of medium grades reveals a large degree of behaviour uncertainty. This is consistent with conventional empirical ornithology understandings. In contrast, wind direction impacts on nocturnal bird behaviours are more remarkable. In Fig. 5(b), north, northeast and east directions are preferred for nocturnal birds. The track flight direction analysis reveals that the principal nocturnal migration direction within the fall season is southwest. The wind direction dependency in Fig. 5(b) indicates that birds are inclined to migrate along the wind direction for the consideration of energy consumption. Grade proportions indicate that nocturnal bird behaviour presents larger certainty at preferred wind directions. This wind direction preference might enable the deduction of bird species.
Even though bird behaviour characters are not simply dependent on a single weather parameter, this study reveals reasonability and feasibility of associating bird behaviours with weather parameters. The information deviation between ground measurement equipment and higher airspace might results in modelling error, but this technique routine is still plausible to further explore bird behaviour characters with multivariable weather parameters.
3.2 Behaviour dependence study on multivariable weather parameter
As indicated in section 2, behaviour indices are replaced by grades in the dependence study on multivariable weather parameters. This substitution transforms the bird behaviour prediction model from a regression model into a classification problem. The latter is apparently more reasonable since the behaviour index regression is unnecessary, and regression results also have credibility problems due to regression model and avian radar data uncertainties. Behaviour grades {High, Medium, Low} are used as labels for bird behaviour prediction. This prediction is a representative supervised learning problem. The input is a multivariable weather feature vector F including temperature, humidity, wind speed and wind direction parameters. Each weather parameter has its individual dimension and value ranges. Numerical renormalisation procedures are necessary to reduce feature space distortion. Eight wind directions are mapped into discrete values from 1 to 8. This paper selects the random forest as the classifier. Random forest is an ensembled classification model [Reference Sagayaraj, Jithesh and Roshani25, Reference Genuer, Poggi and Tuleau-Malot26] which is composed of multiple decision trees with intelligent strategy. Each decision tree within the forest selects partial features from the original feature space. Decisions among trees are independent and the final decision is a weighed integration of all trees. The random forest principle is given in Fig. 6. Compared with other popular learning machines, the random forest model possesses particular benefits to handle both numerical and non-numerical features in classification. Moreover, the random forest has a good adaptability on feature dimension inconsistency. An extra benefit of this model is its feature importance evaluation functionality using Gini index [Reference Menze, Kelm, Masuch, Himmelreich, Bachert, Petrich and Hamprecht27]. It is useful for classification problems with ambiguous feature space. The ensembled classification makes the random forest model possess better sample robustness compared with other learning machines.
To elevate samples separability among different behaviour grades, the Linear Discrimination Algorithm (LDA) [Reference Fu, Liao and Yang28–Reference Pan, Jiang, Kong, Shi, Sheng and Zhou31] is applied on original feature vectors. LDA constructs a sample projection matrix according to training datasets to transform original feature vectors. This method has successfully applications in many radar target recognition problems [Reference Liu, Fang, Xie and Wang32, Reference Lee and Ou33]. In this paper, weather feature vectors after LDA projection are applied on the random forest model for classifier training and behaviour grade prediction.
The overall framework of bird behaviour grade prediction using weather parameters is presented in Fig. 7. Data sources are avian radar datasets and airport weather records. Two datasets are processed by the temporal matching to generate behaviour grade and multivariable weather parameter datasets. The prediction model is evaluated using testing datasets.
4.0 Results and discussion
4.1 Experiment setup and data collection
Avian radar datasets are from an avian radar system deployed in an airport. The radar system is deployed in FuCheng airport, BeiHai in GuangXi Province of China. The system is developed by China academy of Civil Aviation Science and Technology (CAST) as in Fig. 8. The system adopts a double antenna configuration to achieve vertical and horizontal scanning modes simultaneously. The radar frequency is at S band. The horizontal scanning antenna is mounted on a platform with adjustable heights to achieve more flexible scanning coverage in horizontal dimension. Both antennas take mechanical rotation with speed of 25 revolutions per minute. Bird target detection and tracking algorithms are embedded in the system to provide real time bird situation visualisation functionality [Reference Chen20].
Datasets are collected from historical data measured in August, September and October from 2016 to 2019. The hour window for diurnal bird datasets is set to [05:00,09:00] according to feedbacks from artificial observation records. The hour window for nocturnal bird dataset construction is defined as [22:00, 02:00] according to historical analysis of avian radar datasets. The conditional parameter $\boldsymbol{\sigma}$ is set to normal weather excluding weather conditions like strong gusts, precipitation, fogs and radar hardware problems. Representative weather parameters under normal weather conditions construct multiple sub-datasets. For example, a temperature sub-dataset defines its lower and upper bounds by extracting 20% and 80% percentile values. Due to weather condition difference between diurnal and nocturnal hour windows, conditional parameters are constructed, respectively. For diurnal bird behaviour analysis, numerical range in the hour window for temperature, air pressure, humidity and wind speed are [60,86] °F, [980,1030] hPa, [67,81] % and [3.2,9.1] m/s, respectively.
Radar data from 2016 to 2018 constructs a training dataset. The data in 2019 composes a test dataset. Numbers of training samples for diurnal and nocturnal bird studies are 545 and 671, the corresponding test sample numbers are 115 and 139, respectively.
4.2 Diurnal and nocturnal bird activity prediction
4.2.1 Feature separability analysis
To test the feasibility of feature space modelled by weather parameters, feature vectors from different behaviour grades are projected onto a two-dimensional plane for intuitive visualisation. The Principal Component Analysis (PCA) [Reference Prasad and Bruce34, Reference Jolliffe and Cadima35] projection method is applied on feature vectors to extract first two principal components of feature vectors for sample separability presentation. Figure 9 illustrates principal components distributions for two types of bird data samples, which are arbitrarily selected from avian radar datasets. Both datasets present prominent sample separability, and the nocturnal bird sample separability is visually larger than that for diurnal birds. The enlarged sample separability provides confidences to build behaviour grade prediction models using multivariable weather parameters.
4.2.2 Diurnal bird behaviour prediction
The random forest classifier is verified through the five-fold cross validation strategy. Rates of correct and incorrect classification are presented in the confusion matrix formulation as in Table 3. The overall self-validation accuracy indicates the random forest model is theoretically qualified for behaviour grade prediction. The dataset from year 2019 is taken to test the training model quality. The rate of correct behaviour grade prediction is 77%. This prediction accuracy is obviously lower than self-validation accuracy. One possible explanation is the dataset difference in 2019. In 2019 we conducted a radar system maintenance and made slight adjustments on radar location and elevation angle. This adjustment might result in radar coverage and data difference compared with previous three years. This also indicates that bird behaviour characterisation and their weather relevance study is highly dependent on radar data quality and spatial domain characters. The behaviour characterisation model proposed in this paper attempt to regularise radar data to reduce the data variation impact, but results indicate that more data standardisation works are required to guarantee the method’s universality.
Compared with other learning machine models, the random forest model possesses its particular advantages. Selected four weather parameters have their unique dimension and physical meanings. This makes the feature space have low dimension with prominent dimension inconsistency. Random forests could outperform other popular models in handling this inconsistency. The other benefit is its capability of feature importance ranking by Gini indices. Figure 10 demonstrates Gini indices of four weather parameters. The dominance property of temperature influence on diurnal bird behaviours is distinctive. The wind speed presents larger significance than wind directions. This is reasonable since diurnal birds usually present short-time flight, they are more sensitive to wind intensity. This results in the lowest rank of wind direction significance. The feature importance ranking is particularly useful for feature selection and feature space construction with ambiguous feature contributions.
4.2.3 Nocturnal bird behaviour prediction
Prediction evaluation for nocturnal bird behaviours takes a similar procedure. Five-fold cross validation results are presented in Table 4. The rate of correct prediction is 74%. Intuitive understandings believe that nocturnal migratory birds possess relatively lower behaviour complexity than diurnal birds. Theoretically their behaviour grade prediction accuracy should be higher. However, both self-validation and test experiments do not reflect expected results. A probable and reasonable explanation to this problem is weather information measurement deviation. The consequence of this deviation is the prediction model quality degradation, and a lower prediction accuracy is reasonable. Besides weather information measurement deviation and data quality uncertainty, it must be admitted that actual bird behaviour characters are not merely dependent on weather parameters. Bird species, location and season also play important roles in determining bird behaviour patterns. Therefore, the prediction model introduced in this paper is not fully comprehensive for bird behaviour prediction. This might be another reason that the prediction accuracy is not satisfactory as expected.
The parameter importance ranking is presented in Fig. 11. Temperature is still the most important factor influencing nocturnal bird behaviours. The wind direction contributes more in nocturnal bird behaviour prediction. This is consistent with conventional studies since diurnal birds usually choose preferred wind conditions for energy saving during migration. The low importance ranking of humidity might be the consequence of parameter deviation between ground equipment and airspace condition.
4.3 Discussion on data sufficiency and severe weather conditions
Existing results partially validate the feasibility of the method. However, the experiment also reveals its limitations like weather information deviations. This section gives further discussion to present another two issues that have nonnegligible impact on weather dependence modelling for bird behaviours.
The first issue is about the connection between prediction accuracy and data sufficiency. Existing experiments integrates radar data from August, September and October into one dataset for training and prediction. This integration strategy is controversy in reasonability since it assumes the same weather dependence of bird behaviours for different months. A more reasonable modelling strategy is considering monthly difference in weather dependence study. However, this monthly modelling requires sufficient data supports, which is not implementable for existing datasets. As an alternative, the three months dataset for diurnal birds is divided into two parts. One dataset collects data from August 1 to September 15, the other one is composed of data from September 16 to October 31. The same training and testing procedures are conducted on two new datasets. Confusion matrices of self-validation results using five-fold cross validation are given in Table 5. Rates of correct prediction are 82% and 83%, respectively. Results from new datasets present prominent performance elevation, and it is promising to achieve higher accuracy based on more sufficient data supports. This experiment indicates the feasibility of prediction modelling at finer temporal scales, and it is implementable based on more sufficient data supports.
The other issue is about severe weather conditions. The existing prediction system excludes datasets under severe weathers. This limits the prediction model for practical engineering applications. According to historical artificial observation records, birds are usually inactive under severe weather conditions. This intuitive understanding needs more efforts to make quantitative modelling and predictions. Figure 12 proposes a conceptual framework based on tree structure to cover the condition of behaviour prediction under severe weather conditions. This framework could guarantee the comprehensiveness of the method, but it requires more accurate modelling for bird behaviour prediction under severe weather conditions.
5.0 Conclusion
Radar systems are proper remote sensing solutions to birds monitoring within low altitude airspace. Existing avian radar systems provide reliable bird target detection and tracking performance with real-time collision risk evaluation and warnings. However, these short-time functionalities are controversy in application significances. Historical avian radar datasets provide a chance to understand birds long-term behaviour characters to elevate bird situation awareness capability. This paper proposes a method to characterise bird behaviours and study their behaviour relevance with weather conditions using avian radar data. A quantitative bird behaviour modelling strategy is introduced. Weather dependency studies on single weather parameters support the feasibility of bird behaviour prediction using multivariable weather parameters. A four-dimensional feature space is constructed to build the mapping between multivariable weather parameter and bird behaviour grades. The random forest model is adopted to build the prediction system. Four years avian radar datasets are taken for validation experiment. Results indicate the feasibility of predicting diurnal and nocturnal bird behaviour characters using weather information. However, experiments also reveal some problems that limit prediction accuracy including weather information deviation, data quality uncertainty, data insufficiency and incomprehensive prediction model. Moreover, the importance of data sufficiency on prediction accuracy is addressed to indicate better prediction performance with abundant data supports. A conceptual framework for more comprehensive bird behaviour predictions is proposed to elevate its application significances, and more efforts are need to further refine the prediction accuracy under severe weather conditions. As the motivation of the proposed method is to elevate bird situation awareness capabilities within the airport, its application significance should be reflected within bird strike prevention administration. Besides behaviour prediction accuracy elevation under finer spatial-temporal scales by involving more conditional parameter, the other branch of our future work is integrating bird behaviour prediction model with air traffic control procedure. By constructing a more refined spatial-temporal bird behaviour description model, it could be applied in the fusion with aircraft’s flight routine model. This fusion could provide a more accurate bird strike risk description and prediction, and the risk might be reduced by adjusting aircraft’s flight plan in both spatial and temporal domains.
Acknowledgements
This paper is supported by National Natural Science Foundation of China (NSFC) under Grant 62371018 and 62361006, Guangxi Natural Science Foundation under Grant 2020GXNSFBA297119, Guangxi Science and Technology Plan Project under Grant GuiKe-AD20238025, the National Natural Science Foundation of China (NSFC) and Civil Aviation Administration of China (CAAC) (U2133216), National Key Research and Development Program (2023YFB2604103).