Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-cd9895bd7-lnqnp Total loading time: 0 Render date: 2024-12-19T06:22:06.010Z Has data issue: false hasContentIssue false

4 - Distributed Adaptive Filters

Published online by Cambridge University Press:  24 November 2022

Paulo S. R. Diniz ,
Marcello L. R. de Campos ,
Wallace A. Martins ,
Markus V. S. Lima  and
Jose A. Apolinário, Jr
Paulo S. R. Diniz
Affiliation:
Universidade Federal do Rio de Janeiro
Marcello L. R. de Campos
Affiliation:
Universidade Federal do Rio de Janeiro
Wallace A. Martins
Affiliation:
University of Luxembourg
Markus V. S. Lima
Affiliation:
Universidade Federal do Rio de Janeiro
Jose A. Apolinário, Jr
Affiliation:
Military Institute of Engineering
Get access

Summary

The chapter shows how the classical adaptive filtering algorithms can be adapted to distributed learning. In distributed learning, there is a set of adaptive filtering placed at nodes utilizing a local input and desired signals. These distributed networks of sensor nodes are located at distinct positions, which might improve the reliability and robustness of the parameter estimation in comparison to stand-alone adaptive filters. In distributed adaptive networks, parameter estimation might be obtained in a centralized form or a decentralized form. The centralized case processes the signals from all nodes of the network in a single fusion center, whereas in the decentralized case, processing is performed locally followed by a proper combination of partial estimates to result in a consensus parameter estimate. The main drawbacks of the centralized configuration are its data communication and computational costs, particularly in networks with a large number of nodes. On the other hand, the decentralized estimators require fewer data to feed the estimators and improve on robustness. The provides a discussion on equilibrium and consensus using arguments drawn from the pari-mutuel betting system. The expert opinion pool is the concept to induce improved estimation and data modeling, utilizing De-Groot’s algorithm and Markov chains as tools to probate equilibrium at consensus. It also introduces the distributed versions of the LMS and RLS adaptive filtering algorithms with emphasis on the decentralized parameter estimation case. This chapter also addresses how data broadcasting can be confined to a subset of nodes so that the overall network reduces the power consumption and bandwidth usage. Then, the chapter discusses a strategy to incorporate a data selection based on the SM adaptive filtering.

Keywords

distributed learningconsensusdiffusion
Type
Chapter
Information
Online Learning and Adaptive Filters , pp. 109 - 151
Publisher: Cambridge University Press
Print publication year: 2022

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Eisenberg, E. and Gale, D., "Consensus of subjective probabilities: The pari- mutuel method," The Annals of Mathematical Statistics 30, pp. 165-168 (1959).Google Scholar
Brown, L. D. and Lin, Y., "Racetrack betting and consensus of subjective probabilities," Statistics & Probability Letters 62, pp. 175-187 (2003).Google Scholar
Norvig, T., "Consensus of subjective probabilities: A convergence theorem," The Annals of Mathematical Statistics 38 pp. 221-225 (1967).Google Scholar
Stone, M., "The opinion pool," The Annals of Mathematical Statistics 32, pp. 1339-1342 (1961).Google Scholar
Winkler, R. L., "The consensus of subjective probability distributions," Management Science 15, pp. B-61-B-75 (1968).Google Scholar
Degroot, M. H., "Reaching a consensus," Journal of the American Statistical Association 69, pp. 118-121 (1974).Google Scholar
Ibe, O. C., Markov processes for stochastic modeling, 2nd ed. (Elsevier, London, 2013).Google Scholar
Kirkland, S., "On the sequence of powers of a stochastic matrix with large exponent," Linear Algebra and Its Applications 310, pp. 109-122 (2000).CrossRefGoogle Scholar
Kani, E., Pullman, N. J., and N. M. Rice, "Powers of matrices," in Algebraic Methods. Kingston: Queen's University, 2019, ch. 7, pp. 311-370.Google Scholar
Rabbat, M. and Nowak, R., "Distributed optimization in sensor networks," in Third International Symposium on Information Processing in Sensor Networks, IPSN 2004, 2004, pp. 20-27.Google Scholar
Spanos, D. P. and Murray, R. M., "Distributed sensor fusion using dynamic consensus," in IFAC World Congress. Prague, Czech Republic: IFAC, 2005.Google Scholar
Predd, J. B., Kulkarni, S. R., and H. V. Poor, "Distributed learning in wireless sensor networks," IEEE Signal Processing Magazine 23, pp. 56-69 (2006).Google Scholar
Xiao, L., Boyd, S., and S. Lall, "A scheme for robust distributed sensor fusion based on average consensus," in 4th International Symposium on Information Processing in Sensor Networks, IPSN 2005, vol. 2005, Los Angeles, CA, USA, 2005, pp. 63-70.Google Scholar
Xiao, L., Boyd, S., and S. Lall, "A space-time diffusion scheme for peer-to-peer least-squares estimation," in Proceedings of the Fifth International Conference on Information Processing in Sensor Networks, IPSN '06, vol. 2006, pp. 168-176, 2006. Google Scholar
Cattivelli, F. S., Lopes, C. G., and A. H. Sayed, "Diffusion recursive least-squares for distributed estimation over adaptive networks," IEEE Transactions on Signal Processing 56, pp. 1865-1877 (2008).Google Scholar
Hero, A. O., Cochran, D., and S. Member, "Sensor management: Past, present, and future," IEEE Sensors Journal 11, pp. 3064-3075 (2011).Google Scholar
Sayed, A., Adaptation, learning, and optimization over networks (Now Publishers, Delft, 2014).CrossRefGoogle Scholar
Lopes, C. G. and Sayed, A. H., "Incremental adaptive strategies over distributed networks," IEEE Transactions on Signal Processing 55, pp. 4064-4077 (2007).Google Scholar
Sayed, A. H. and Lopes, C. G., "Distributed recursive least-squares strategies over adaptive networks," in Fortieth Asilomar Conference on Signals, Systems and Computers, no. 1, 2006, pp. 233-237.Google Scholar
Golub and C. F. Van Loan, G. H., Matrix computations, 4th ed. (John Hopkins University Press, Baltimore, 2013).Google Scholar
Chen, J. and Sayed, A. H., "Diffusion adaptation strategies for distributed optimization and learning over networks," IEEE Transactions on Signal Processing 60, pp. 4289-4305 (2012).Google Scholar
Lopes, C. G. and Sayed, A. H., "Diffusion least-mean squares over adaptive networks: formulation and performance analysis," IEEE Transactions on Signal Processing 56, pp. 3122-3136 (2008).Google Scholar
Gollamudi, S., Nagaraj, S., Kapoor, S., and Y. F. Huang, "Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size," IEEE Signal Processing Letters 5, pp. 111-114 (1998).CrossRefGoogle Scholar
Nagaraj, S., Gollamudi, S., Kapoor, S., and Y. F. Huang, "BEACON: An adaptive set-membership filtering technique with sparse updates," IEEE Transactions on Signal Processing 47, pp. 2928-2941 (1999).Google Scholar
Werner, S., Huang, Y.-F., L. R. de Campos, M., and V. Koivunen, "Distributed parameter estimation with selective cooperation," in 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. Taipei: IEEE, 2009, pp. 2849-2852.Google Scholar
Kahan, W., "Circumscribing an ellipsoid about the intersection of two ellipsoids," Canadian Mathematical Bulletin 11, pp. 437-441 (1968).Google Scholar
Galdino, J. F., A. Apolinario Jr., J., and M. L. R. de Campos, "A set-membership NLMS algorithm with time-varying error bound," in 2006 IEEE International Symposium on Circuits and Systems. Kos: IEEE, pp. 277-280.Google Scholar
Sobron, I., Martins, W. A., L. R. de Campos, M., and M. Velez, "Incumbent and LSA licensee classification through distributed cognitive networks," IEEE Transactions on Communications 64 pp. 94-103 (2016).Google Scholar
Ribeiro Jr., F. C., L. R. de Campos, M., and S. Werner, "Distributed cooperative spectrum sensing with adaptive combining," in 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Kyoto: IEEE, 2012, pp. 3557-3560.Google Scholar
Ribeiro Jr., F. C., Werner, S., and M. L. R. de Campos, "Distributed cooperative spectrum sensing with selective updating," in European Signal Processing Conference (EUSIPCO), Bucharest, 2012, pp. 474-478.Google Scholar
Ribeiro Jr., F. C., L. R. de Campos, M., and S. Werner, "Distributed cooperative spectrum sensing with double-topology," in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. Vancouver: IEEE, 2013, pp. 44894493.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×