1. Introduction
Consensus formation is a problem in which agents initially having different opinions mutually exchange and thereby update their opinions using a distributed algorithm in order to achieve a consensus [Reference DeGroot5]. In the past, this problem has appeared in a number of different contexts, including distributed computation [Reference Tsitsiklis18], load balancing in computer networks [Reference Muthukrishnan, Ghosh and Schultz11, Reference Rabani, Sinclair and Wanka14], distributed data fusion [Reference Xiao, Boyd and Lall19] or clock synchronization in sensor networks [Reference Li and Rus10], coordinate control of mobile agents [Reference Olfati-Saber and Murray13], and opinion formation on social networks [Reference Acemoğlu, Como, Fagnani and Ozdaglar1–Reference Altafini and Lini3, Reference Frasca, Ravazzi, Tempo and Ishii8].
In the present paper, we consider a specific consensus algorithm, namely, the broadcast-based consensus algorithm. In this algorithm, one agent is chosen randomly with a given probability of broadcasting its opinion to neighbor agents. Agents receiving an opinion from their common neighbor compute the weighted average of their opinions and the received opinion. The broadcast-based algorithm is very amenable to implementation because this algorithm can exploit the broadcast nature of the wireless communication environment and does not require bidirectional communication among agents (nodes) [Reference Yang and Blum20]. The broadcast-based algorithm also has high affinity to social networks because, for example, Twitter users very frequently broadcast a received tweet to all followers, which is usually referred to as retweeting. In addition to these features, it has been shown that the broadcast-based algorithm yields a consensus with probability one, and the obtained consensus value is, as expected, equal to the average of the initial opinions of the agents if the agents broadcast their opinions with equal frequency [Reference Aysal, Yildiz, Sarwate and Scaglione4, Reference Fagnani and Zampieri7]. Therefore the broadcast-based consensus-forming algorithm has recently been investigated in several studies [Reference Aysal, Yildiz, Sarwate and Scaglione4, Reference Fagnani and Zampieri7, Reference Silvestre, Hespanha and Silvestre17, Reference Yang and Blum20].
Note that the consensus achieved in the algorithm is not generally a constant, but instead largely varies depending on the order in which agents broadcast. For application of a consensus algorithm to sensor data fusion or coordinate control of mobile agents, the obtained consensus should, as far as possible, be kept around the average of the initial sensor data or the initial coordinates of the agents. In addition, in the formation of consensus on social networks, it is desirable that the obtained consensus is approximately equal to the average of the initial opinions of all users without being strongly influenced by ‘influencers’. Several studies [Reference Aysal, Yildiz, Sarwate and Scaglione4, Reference Fagnani and Zampieri7] investigated the mean deviation of the obtained consensus value from the average of the initial opinions as a metric of the performance of the consensus-forming algorithm. However, little is known about the probability laws of the obtained consensus, not only for broadcast-based algorithms, but also for other general consensus-forming algorithms.
Previously, we investigated the distribution of the consensus obtained in the broadcast-based consensus algorithm and found that the obtained consensus has a complicated probabilistic behavior (e.g. it may follow a Cantor distribution), even if the number of agents is two [Reference Katoh and Shioda9, Reference Shioda15]. We also numerically found that if the initial opinion of the agents follows a stable distribution, such as a Gaussian distribution or a Lévy distribution, the distribution of the consensus approaches the distribution of the initial opinion (with different parameter values) as the number of agents increases. In the present paper, we formally extend our previous results to the case in which the initial opinion of each agent is a random variable. This extension is very natural when applying a consensus algorithm to real engineering issues, such as sensor-data fusion and opinion formation on social networks. For example, the data collected by a sensor, corresponding to the initial opinion of an agent, is usually a random variable because of the random noise included in the data. The opinion of each user of social network services is also a random variable that varies depending on the feelings of the user and the social environment at that time.
In the present paper, after presenting the problem formulation, we first derive two fundamental equations on the time evolution of the weighted average of opinions of the agents (Proposition 3.1 and Corollary 3.1). The derived equations, for example, reveal that the consensus is expressed as a weighted average of the initial opinions of agents. Based on the derived equations, we then investigate the distribution of the consensus in the limit where agents do not have any mutual trust (Theorem 4.1), and show that the consensus obtained is in sharp contrast to that with complete mutual trust in the statistical properties if the initial opinion of each agent is integrable. Next, we provide the formulation necessary to mathematically discuss consensus in the limit that the number of agents tends to infinity, and derive several results concerning the consensus in this limit (Theorem 5.1 and Corollary 5.1). We also show that the central limit theorem for consensus holds in the limit of increasing number of agents together with decreasing mutual trust between agents (Theorem 5.2). If the initial opinions of agents follow the common stable distribution, then the consensus is expected to follow the same stable distribution because the consensus is expressed as a weighted average of the initial opinions of agents. Thus we finally investigate the distribution of consensus in which each agent’s initial opinion follows a stable distribution and derive the analytical expression for the consensus (Theorem 6.2). The derived expression reveals that the consensus does not necessarily follow a stable distribution, even if the initial opinion follows a stable distribution. However, we find a simple relationship between the statistical dispersion of the consensus and that of the initial opinion (Corollary 6.1). We finally show that the consensus follows a stable distribution in the limit of an infinite number of agents (Theorem 6.2 and Corollary 6.1). The last result has been numerically demonstrated in a previous study [Reference Katoh and Shioda9, Reference Shioda15], and the present paper presents a mathematically formal proof.
The remainder of the present paper is organized as follows. In Section 2 we present the problem formulation. Then, in Section 3, we derive two fundamental equations for the time evolution of the weighted average of the opinions of the agents. In Section 4 we consider the distribution of the consensus in the limit where agents do not have any mutual trust. In Section 5 we provide the formulation necessary to mathematically discuss consensus in the limit in which the number of agents tends to infinity, and derive several results concerning the consensus in this limit. In Section 6 we consider the case in which the initial opinions of agents follow a common stable distribution. In Section 7 we conclude the paper with some comments on unresolved issues and prospects for their resolution.
2. Problem formulation
We consider N agents interacting on a complete graph. The agents are numbered from 1 to N. The agents have their own opinions, and the opinion of each agent is expressed as a real number. Let
denote the opinion of agent
at time
. The initial opinions of agents $\{X_n(0)\}_{n\in {\mathcal N}}$ are assumed to be statistically independent and identically distributed, and they are finite with probability one. The agents broadcast their opinions to each other as well as update their opinions at discrete times $t\in\natural$ in the following manner. At each discrete time, one of the agents broadcasts its opinion to its neighbors. The probability that agent n broadcasts its opinion at each discrete time is denoted by $p_n$ . We assume that $p_n>0$ for all $n\in {\mathcal N}$ and $\sum_{n\in {\mathcal N}}p_n=1$ . At each discrete time t, agent n updates its opinion based on the following equation:
where $e_t\in{\mathcal N}$ is a random variable denoting the agent broadcasting its opinion at time t and
Note that $r\in (0,1]$ is a trust parameter that represents the confidence that each agent places on the opinion of other agents. We assume that $\{e_t\}_{t=0}^\infty$ are statistically independent and identically distributed random variables. We also assume that $\{e_t\}_{t=0}^\infty$ and $\{X_n(0)\}_{n\in {\mathcal N}}$ are mutually independent. Equation (2.1) can be expressed in matrix form as follows:
where $Q^{(k)}=\{q^{(k)}_{mn}\}$ is a matrix expressing the opinion updates when agent k is broadcasting its opinion, and its elements are given as
Note that $Q^{(k)}$ is a stochastic matrix, that is, the sum of the elements of each row vector of $Q^{(k)}$ is equal to 1.
We define . The mnth element of Q is given as
In the present paper, we mainly study , where , rather than studying the opinion vector ${\boldsymbol{X}}(t)=(X_1(t),\ldots,X_{N}(t))$ . Note that $\boldsymbol{\pi}$ is the left eigenvector of Q corresponding to an eigenvalue of one. Here $\bar X(t)$ can be considered as the weighted average of opinions of the agents because
and $p_n$ , which is the probability that agent n broadcasts its opinion, expresses the strength of the influence of agent n in the formation of the consensus. There are two reasons why we focus on $\bar X(t)$ rather than handling the opinion vector ${\boldsymbol{X}}(t)=(X_1(t),\ldots,X_{N}(t))$ . One reason is that using $\bar X(t)$ simplifies the discussion. The other reason comes from the properties of $\bar X(t)$ , which are appropriate for discussing the consensus. First, $\bar X(t)$ converges to the consensus as t goes to infinity, and thus the consensus can be known from $\bar X(t)$ . Second, $\bar X(t)$ is a martingale if $X_1(0)$ is integrable, because if $t\ge s$ ,
and thus
Because of this property, the conditional expectation of the consensus of given $\bar X(t)$ is equal to $\bar X(t)$ for all $t\ge 0$ , which will be shown at the end of this section.
Here we give a definition of obtaining the consensus.
Definition 2.1. If a random variable $X_c$ exists and satisfies
then we say that a consensus is obtained and that it is equal to $X_c$ .
If agents whose initial opinions are constant and finite interact in a general directed graph, then the irreducibility of Q is a sufficient condition for obtaining a consensus in the broadcast-based consensus algorithm [Reference Katoh and Shioda9]. The present paper assumes that the graph is complete, $r>0$ , and $p_n>0$ for all $n\in {\mathcal N}$ , under the condition in which Q is irreducible. Since the initial opinions are assumed to be finite with probability one, consensus is reached with probability one in the problem formulation of the present paper. Note that the consensus is obtained if, for any $\epsilon> 0$ ,
where
To see that (2.2) holds in the formulation of the present paper, note that $\mathrm{d} X(t) = (1-r)^t \mathrm{d} X(0)$ , and thus
where in the last line we use the fact that $X_1(0)$ is finite with probability one. A definition of consensus formation similar to that by (2.2) will be used in Section 5 (Definition 5.1).
The notations frequently used in the present paper are summarized in Table 1.
3. Time evolution of average opinion
In this and the following sections, we denote the average opinion at time t, $\bar X(t)$ , by $\bar X^{(N)}(t,r)$ and the consensus, $X_c$ , by $X_c^{(N)}(r)$ in order to recall the dependence of the random variable on the trust parameter r and the number of agents N. Note that the average opinion at time 0 is denoted by $\bar X^{(N)}(0)$ because this opinion does not depend on r.
Proposition 3.1. We have
Proof. $\bar X^{(N)}(t,r)$ can be written in the following form:
Observe that
and
where $\textbf{1}$ is a row vector having all elements equal to 1. Substituting (3.3) and (3.4) into (3.2) yields
Substituting
into (3.5) yields
By iterating this procedure, we finally arrive at
which completes the proof.
Proposition 3.1 implies that the consensus finally achieved is expressed as
Equation (3.1) can be written in a different form, as shown in the following corollary.
Corollary 3.1. We have
where the sum of random variables, $A_1(t,r),\ldots,A_N(t,r)$ , is equal to 1. That is,
Proof. Substituting $\bar X^{(N)}(0) = \sum_{n\in {\mathcal N}} p_n X_n(0)$ into (3.1) yields
where the last equality follows from $(1-r)^t=1-r\sum_{k=0}^{t-1}(1-r)^{k}$ . Equation (3.7) can be shown by direct calculation as follows:
where the last equality follows from $\sum_{n\in {\mathcal N}} p_n=1$ and $\sum_{n\in {\mathcal N}} 1_{(e_k=n)}=1$ .
Note that $A_n(t,r)\in [0,1]$ for all $t\in \natural\cup\{\infty\}$ , and $r\in (0,1]$ , and, as shown in (3.7), $A_1(t,r),\ldots,A_N(t,r)$ are not mutually independent.
Corollary 3.1 implies that the consensus that is finally obtained is expressed as
Note that $\sum_{k=1}^K (1-r)^k (1_{(e_k=n)}-p_n)$ converges as K tends to infinity with probability one, and thus the right-hand side of (3.9) is well-defined because
(for details see Theorem 2.5.6 of [Reference Durrett6]). Equations (3.6) and (3.8) imply that $\bar X^{(N)}(t,r)$ or $X_c^{(N)}(r)$ is a weighted average of the initial opinions of agents having weights that are random variables.
The expectation and variance of $A_n(t,r)$ are given as follows:
As expected, if $X_1(0)$ is integrable, it follows from Corollary 3.1 that
4. Consensus in the limit of no mutual trust
In the case of $r=0$ , the agents have no mutual trust, and thus consensus is not obtained because no agents change their opinions after time 0. The average opinion at $r=0$ ,
exists, but it is not the consensus at $r=0$ . Since the consensus is reached when $r>0$ and it is equal to $\bar X^{(N)}(\infty,r)$ , it is interesting to see whether $\bar X^{(N)}(\infty,r)$ converges to $\bar X^{(N)}(\infty,0)$ as $r\downarrow 0$ . In this section we investigate the convergence of $\bar X^{(N)}(\infty,r)$ in the limit $r\downarrow 0$ . In particular, we investigate whether $\lim_{r\downarrow 0} A_n(r)=p_n$ because $\lim_{r\downarrow 0} \bar X^{(N)}(\infty,r)= \bar X^{(N)}(\infty,0)$ if $\lim_{r\downarrow 0} A_n(r)=p_n$ for all $n\in {\mathcal N}$ . Note that the consensus in the limit $r\downarrow 0$ and that when $r=1$ are contrasting when $X_1(0)$ is integrable, which will be shown in this section.
In this section we use the notation $A_n(r,\omega)$ instead of $A_n(r)$ to explicitly denote that $A_n(r,\omega)$ is a mapping from the probability space $(\Omega,\mathbb{P})$ to . Note that $\lim_{r\downarrow 0} A_n(r,\omega)$ is not necessarily equal to $p_n$ for all $\omega\in \Omega$ . For example, if agent n broadcasts its opinion for all $t=0,1,\ldots,$ then $\lim_{r\downarrow 0} A_n(r,\omega)=1$ , and if agent n never broadcasts its opinion, then $\lim_{r\downarrow 0} A_n(r,\omega)=0$ . However, as shown in the following theorem, $A_n(r,\omega)=p_n$ for almost all of $\omega\in\Omega$ .
Lemma 4.1. We have
Proof. It suffices to show that $B_n(r)\to 0$ as $r\downarrow 0$ with probability one, where
It follows from the Chebyshev inequality that
Let
for any $\alpha>1$ . The Borel–Cantelli lemma implies that $B_n(r_i)\to 0$ as $i\to\infty$ with probability one because
Let
. As we proved above, $\mathbb{P}({\mathcal E}_n)=1$ . Let
Since $r_{i+1}(1-r_{i})^k < r(1-r)^k < r_{i}(1-r_{i+1})^k$ for $r\in [r_i,r_{i+1})$ , we have $B^\uparrow(r) < B_n(r)<B^\downarrow(r)$ , and thus
Observe that
and
It follows from these observations that on ${\mathcal E}_n$
which completes the proof.
Lemma 4.1 readily yields the following result.
Theorem 4.1. $\bar X^{(N)}(\infty,r)$ is right continuous as a function of r at $r=0$ with probability one. That is,
In order to compare with the results for $r\downarrow 0$ , we also show the results for $r=1$ , in which the agents trust each other completely. It follows from $A_n(t,1) = 1_{(e_0=n)}$ that
Since (4.1) holds for $t=1,2,\ldots,$ we have $\lim_{t\to\infty} \bar X^{(N)}(t,1) = X_{e_0}(0)$ . The consensus is readily reached at $t=1$ when $r=1$ and $X_{e_0}(0)\stackrel{d}{=} X_1(0)$ . As such, we finally obtain
where $\stackrel{d}{=}$ indicates equality in the distribution.
Theorem 4.1 and equation (4.2) provide very contrasting results. In the limit $r\downarrow 0$ , the consensus converges to the average of the initial opinions of agents, and, when $r=1$ , the consensus is probabilistically equal to the initial opinion of an arbitrarily chosen agent. It is rather ironic that the consensus converges to the average of the initial opinions of agents as $r\downarrow 0$ because the agents do not trust each other at all in the limit $r\downarrow 0$ . We also note that if $X_1(0)$ is integrable, then the consensus at $r=0$ reaches $\mathbb{E}[X_1(0)]$ as $N\to\infty$ due to the law of large numbers, while the consensus at $r=1$ does not depend on N. However, this is not always the case. If $X_1(0)$ follows a Cauchy distribution (and thus is not integrable), the achieved consensus also follows the same Cauchy distribution with $X_1(0)$ independently of the trust parameter r and the number of agents N, as shown in Section 6.
5. Limit of infinite number of agents
Numerically we found that the consensus tends to gradually approach a Gaussian distribution as the number of agents N tends to infinity while the trust parameter r tends to zero (an example of the numerical results will be shown at the end of this section). This fact suggests that the central limit theorem for the consensus will hold by increasing N to infinity at an appropriate speed while decreasing r closer to 0. Thus, in this section, we first provide the formulation necessary to study the consensus in the limit $N\to\infty$ while letting $p_n=1/N$ for all $n\in {\mathcal N}$ . Under the formulation provided, we then derive several results concerning the consensus in the limit $N\to\infty$ , which will be used in Section 6 to study the consensus when the initial opinions of agents follow a stable distribution. At the end of this section we discuss a central limit theorem for the consensus.
Proposition 5.1. If $X_1(0)$ is integrable, then
where $\varphi_X(\theta)$ is a characteristic function of $X_1(0)$ .
Proof. It follows from Proposition 3.1 that
Let
Since $X_1(0)$ is integrable, the strong law of large numbers implies that $\mathbb{P}(\mathcal{A})=1$ . Let ${\mathcal B}^{(N)}(t)$ denote the event whereby each agent broadcasts its opinion at most once during $[0,t-1]$ , defined as follows:
Note that $\mathbb{P}({\mathcal B}^{(N)}(t))$ converges to 1 as $N\to\infty$ because
Thus it follows that
Since $X_{(e_0)}(0),\ldots,X_{(e_{t-1})}(0)$ are mutually independent on ${\mathcal B}^{(N)}(t)$ , it follows that
which completes the proof.
Remark 5.1. The assumption that $p_n=1/N$ for all $n\in {\mathcal N}$ is only used to prove that $\mathbb{P}({\mathcal B}^{(N)}(t))$ converges to 1 as $N\to\infty$ . Thus this assumption can be replaced by a looser assumption, under which $\mathbb{P}({\mathcal B}^{(N)}(t))\to 1$ as $N\to\infty$ .
Since the right-hand side of (5.1) satisfies the properties of a characteristic function, Proposition 5.1 implies that, as $N\to\infty$ , $\bar X^{(N)}(t,r)$ weakly converges to a random variable, denoted by $\bar X^{(\infty)}(t,r)$ , the characteristic function of which is equal to the right-hand side of (5.1). Here, $\bar X^{(\infty)}(t,r)$ corresponds to the average opinion of the agents in the limit $N\to\infty$ . It follows from (5.1) that
where $Z_0,Z_1,\ldots$ are independent and identically distributed random variables with the same distribution as $X_1(0)$ .
Equation (5.2) implies the following. For finite t, $X_{e_k}$ on the right-hand side of (3.1) can be replaced by $Z_k$ in the limit $N\to\infty$ . Instead of the right-hand side of (3.1), the right-hand side of (5.2) is easy to calculate because $\{Z_k\}_{k=0}^\infty$ is an independent and identically distributed sequence. If, as t goes to infinity, the left-hand side of (5.2) converges to the consensus in the limit $N\to\infty$ , that is,
then the calculation of the consensus seems easy. However, it is not ensured that (5.3) always holds even if $X_1(0)$ is integrable. This is because the difference between the largest and smallest opinions of agents
can go to infinity as $N\to\infty$ , and, in such a case, the formation of a consensus is not mathematically clear, even in the limit $t\to \infty$ . In order to define the consensus in the limit of an infinite number of agents, it is necessary to increase the number of agents N together with the elapsed time t to infinity so that the discrepancy among opinions of agents is kept sufficiently small in order to ensure that a consensus is reached. Based on the consideration mentioned above, in the following we introduce the definition of the consensus formation in the limit $N\to\infty$ . In the definition, we assume that a sequence of trust parameters $\{r_N\}_{N=1}^\infty$ is given.
Definition 5.1. If there is a sequence of non-negative integers $\{t_N\}_{N=1}^\infty$ such that $t_N\to\infty$ as $N\to\infty$ , and $\mathrm{d} X^{(N)}(t_N,r_N)$ converges to 0 as $N\to\infty$ in probability, that is,
then we say that the consensus in the limit $N\to\infty$ , $X_c^{(\infty)}$ , is obtained, and $X_c^{(\infty)}$ is given as $\lim_{N\to\infty}\bar X^{(N)}(t_N,r_N)$ .
In this definition, $\{t_N\}_{N=1}^\infty$ represents how the time required to build a consensus increases with N for a given $\{r_N\}_{N=1}^\infty$ . Note that $\{r_N\}_{N=1}^\infty$ does not necessarily decrease to 0, and $r_N$ can be equal to a constant value r for all N. The definition of consensus formation in such a form has not been used before in the existing literature. Definition 5.1 is related to the definition of consensus formation by (2.2), in which only the time t is scaled to infinity.
In what follows, after deriving supplementary results (Lemma 5.2 and Corollary 5.1), we derive the main results (Theorem 5.1 and Corollary 5.2) on the consensus in the limit $N\to\infty$ when $r_N=r$ for all $N=1,2,\ldots,$ which will be used in Section 6. The following result is repeatedly used to derive the results in this section.
Lemma 5.1. (Lemma 3.1.1 of [Reference Durrett6].) If $c_j\to 0$ , $a_j\to \infty$ , and $a_jc_j\to\lambda$ , then $(1+c_j)^{a_j}\to \mathrm{e}^{\lambda}$ .
The next lemma gives the condition for reaching the consensus in the limit $N\to\infty$ .
Lemma 5.2. Suppose that
Then the consensus in the limit $N\to\infty$ is obtained.
Proof. Let
Since $\mathrm{d} X^{(N)}(t,r)=(1-r)^t \mathrm{d} X^{(N)}(0)$ and $\mathrm{d} X^{(N)}(0)\le 2\max\{|X_1(0)|,\ldots,|X_N(0)|\}$ , we see that on $\mathcal{A}(N,\epsilon)$
This means that $\{\mathrm{d} X^{(N)}(t_N,r_N)\le \epsilon\}\supset \mathcal{A}(N,\epsilon)$ . To complete the proof, we observe that
Thus, if (5.4) holds, then
where the second equality follows from Lemma 5.1. Since $\{\mathrm{d} X^{(N)}(t_N,r_N)\le \epsilon\}\supset \mathcal{A}(N,\epsilon)$ , it follows from (5.5) that
which completes the proof.
Corollary 5.1. If $X_1(0)$ is integrable, then the consensus in the limit $N\to\infty$ is obtained.
Proof. Choose $\{t_N\}_{N=1}^\infty$ satisfying the conditions that $t_Nr_N/\log N\to\infty$ and $t_N\to \infty$ as $N\to\infty$ . (For example, letting $t_N=N/r_N$ meets these conditions.) It follows from Lemma 5.1 that for any $\epsilon > 0$
The above result means that there exists $N_0$ such that $N\le \epsilon (1-r_N)^{-t_N}$ for all $N\ge N_0$ . Since $X_1(0)$ is integrable, it follows that, for all $N\ge N_0$ ,
Thus the desired conclusion follows from Lemma 5.2.
Remark 5.2. According to Corollary 5.1, in order to obtain a consensus we should increase $t_N$ with N faster than $\log N/r_N$ when $X_1(0)$ is integrable.
The next theorem gives the condition for (5.3) being ensured.
Theorem 5.1. Suppose that $r_N=r$ for all $N=1,2,\ldots.$ If (5.4) holds with the choice of $\{t_N\}_{N=1}^\infty$ satisfying $t_N/\sqrt{N}\to 0$ as $N\to\infty$ , then $X_c^{(\infty)}$ , the consensus in the limit $N\to\infty$ , is obtained and
where $Z_0,Z_1,\ldots$ are independent and identically distributed random variables with $X_1(0)$ .
Proof. Suppose that (5.4) holds with the choice of $\{t_N\}_{N=1}^\infty$ satisfying $t_N/\sqrt{N}\to 0$ as $N\to\infty$ . Since (5.4) holds, it follows from Corollary 5 that the consensus is obtained in the limit $N\to\infty$ and $\lim_{N\to\infty}\bar X^{(N)}(t_N,r)$ is equal to the consensus. According to Proposition 3.1,
Since for any $\epsilon > 0$
it follows that
where the last term, $N \mathbb{P}(|X_1(0)| >\epsilon (1-r)^{-t_N})$ , goes to 0 as $N\to \infty$ because of (5.4). This means that $(1-r)^{t_N}|\bar X^{(N)}(0)|\to 0$ as $N\to\infty$ in probability. Next, observe that on ${\mathcal B}^{(N)}(t_N)$ (defined in the proof of Proposition 5.1), $X_{e_0},\ldots,X_{e_{t_N-1}}$ are mutually independent. Thus, if $\mathbb{P}({\mathcal B}^{(N)}(t_N))\to 1$ as $N\to\infty$ , we obtain
The following observation proves $\lim_{N\to\infty}\mathbb{P}({\mathcal B}^{(N)}(t_N))=1$ :
where the last equality follows from Lemma 5.1 and $(t_N-1)t_N/N\to 0$ as $N\to\infty$ because $t_N/\sqrt{N}\to 0$ as $N\to\infty$ . Thus the proof is completed.
Remark 5.3. The assumption $t_N/\sqrt{N}\to 0$ as $N\to\infty$ is not necessary for consensus building but for the consensus to be given as the right-hand side of (5.6). Thus, even if $t_N/\sqrt{N}$ does not go to 0 as $N\to\infty$ , the consensus may be obtained in the limit $N\to\infty$ , but it is not given as the right-hand side of (5.6). Note that the condition $t_N/\sqrt{N}\to 0$ as $N\to\infty$ may need to be replaced by another condition if the assumption $p_n=1/N$ for all $n\in {\mathcal N}$ used in this section is replaced by another condition.
Corollary 5.2. Suppose that $r_N=r$ for all $N=1,2,\ldots.$ If $X_1(0)$ is integrable, then $X_c^{(\infty)}$ is obtained and is given as (5.6).
Proof. Choose $\{t_N\}_{N=1}^\infty$ such that $t_N$ tends to infinity faster than $\log N$ but slower than $\sqrt{N}$ as $N\to\infty$ . With this choice of $\{t_N\}_{N=1}^\infty$ , (5.4) holds, as shown in the proof of Corollary 5.1, and thus applying Theorem 5.1 completes the proof.
In the remainder of this section, we assume $\{r_N\}_{N=1}^\infty$ meets the following conditions:
Then we investigate the behavior of in the limit $N\to\infty$ , where $t_N$ increases faster than $\log N/r_N$ but slower than $\sqrt{N}$ .
Theorem 5.2. Suppose . If $\{t_N\}_{N=1}^\infty$ satisfies $\log N/(t_Nr_N)\to 0$ and $t_N/\sqrt{N}\to 0$ as $N\to \infty$ , then
where $\Rightarrow$ denotes weak convergence and $N(0,\sigma^2/2)$ is a Gaussian distribution with mean 0 and variance ${\sigma^2}/{2}$ .
Proof. Observe that on ${\mathcal B}^{(N)}(t)$ ,
where $Z_0,Z_1,\ldots$ are independent random variables having the same distribution as $X_1(0)$ . Thus, on ${\mathcal B}^{(N)}(t_N)$ , we have
Note that if $t_N/\sqrt{N}\to 0$ as $N\to \infty$ , then $\mathbb{P}({\mathcal B}^{(N)}(t_N))\to 1$ as $N\to\infty$ , as shown in the proof of Theorem 5.1 The first term on the right-hand side of (5.8) converges to 0 as $N\to\infty$ because
where $N^{1/2}(\bar X^{(N)}(0)-\mathbb{E}[X_1(0)])$ converges to a random variable following a Gaussian distribution, $r_N\sqrt{N}\to\infty$ , and $r_N\to 0$ as $N\to\infty$ . Next, let
. Observe that
where the last equality follows from $\lim_{N\to\infty} (1-r_N)^{2t_N}= \mathrm{e}^{-\lim_{N\to\infty} 2t_Nr_N}=0$ because of the assumption $\log N/(r_N t_N)\to 0$ (and thus $r_N t_N\to \infty$ ) as $N\to\infty$ . We can also see that for all $\epsilon>0$
Thus $Y_{N,0},\ldots,Y_{N,t_N-1}$ satisfies Lindeberg’s condition, and applying the central limit theorem to $\sum_{k=0}^{t_N-1} Y_{N,k}$ completes the proof.
As in the proof of Corollary 5.1, if $\log N/(t_Nr_N)\to 0$ as $N\to\infty$ , then $\lim_{N\to\infty} \bar X^{(N)}(t_N,r)$ is the consensus in the limit $N\to\infty$ and thus Theorem 5.2 can be considered as the central limit theorem for the consensus.
Figure 1 shows the results of simulation experiments concerning Theorem 5.2. In Figure 1(a) we assume that the initial opinions of agents follows a uniform distribution on the interval $[-1,1]$ . The dotted lines in the figure show the probability density function (PDF) for $X_c^{(N)}(r_N)/\sqrt{r_N}$ obtained from the results of $10^7$ simulations, and the solid black line shows the PDF for the Gaussian distribution $N(0,\sigma^2/2)$ . We set $r_N = N^{-0.4}$ , which satisfies (5.7). The figure confirms that the PDF of the consensus converges to the PDF of the Gaussian distribution as N increases. In Figure 1(b) we assume that the initial opinions of agents follow an exponential distribution with a mean of 1, and we also set $r_N = N^{-0.4}$ . The figure also confirms that the simulation results converge to the Gaussian distribution $N(0,\sigma^2/2)$ as N increases.
6. Initial opinion follows stable distribution
As shown in (3.8), the consensus can be expressed as a weighted average of the initial opinions of agents. If the initial opinions of agents follow a common stable distribution, the consensus is expected to follow the same stable distribution, and an analytical expression for the distribution of the consensus might be available because the sum of independent random variables following a common stable distribution also follows the same distribution. In this section we consider the case in which the initial opinions of agents, $X_1(0), \ldots,X_N(0)$ , follow a common stable distribution represented by $\textsf{S}(\alpha,\beta,\gamma,\delta;\,0)$ [Reference Nolan12], where $\alpha\in (0,2]$ is the stability parameter (characteristic exponent), $\beta\in [-1,1]$ is the skewness parameter, $\gamma\in(0,\infty)$ is the scale parameter, and $\delta\in(-\infty,\infty)$ is the location parameter. The integer ‘0’ in $\textsf{S}(\alpha,\beta,\gamma,\delta;\,0)$ is used as a distinction between the different parametrizations [Reference Nolan12].
Theorem 6.1. ([Reference Nolan12].) If $\{S_n\}_{n=1}^N$ are mutually independent and $S_n$ $(n=1,\ldots,N)$ follows a stable distribution $\textsf{S}(\alpha,\beta_n,\gamma_n,\delta_n;\,0)$ , then $\sum_{n=0}^N a_nS_n$ follows a stable distribution $\textsf{S}(\alpha,\bar\beta,\bar\gamma,\bar\delta;\,0)$ , where $a_1,\ldots,a_N$ are arbitrary real numbers, and
Applying Theorem 6.1 to a broadcast-based consensus-forming model yields the following result.
Theorem 6.2. If $X_1(0)$ follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma,\delta;\,0)$ , then $\bar X^{(N)}(t,r)$ also follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma_t,\delta_t;\,0)$ for a given outcome of $\{A_n(t,r)\}_{n\in {\mathscr N}}$ , where
Proof. Applying Theorem 6.1 to Corollary 3.1 with $a_n=A_n(t,r), \beta_n=\beta, \gamma_n=\gamma$ , and $\delta_n=\delta$ readily gives the desired conclusion.
According to Theorem 6.2, $\bar X^{(N)}(t,r)$ follows a stable distribution when the outcome of $\{A_n(t,r)\}_{n\in {\mathscr N}}$ is given. Note that the scale parameter of $\bar X^{(N)}(t,r)$ , $\gamma_t$ , is a random variable because $\gamma_t$ depends on $\{A_n(t,r)\}_{n\in {\mathscr N}}$ . However, there is a deterministic relationship between $\gamma_t$ and the scale parameter of $X_1(0)$ , $\gamma$ , as shown in the following corollary.
Corollary 6.1. We have
Proof. First note that $\sum_{n\in {\mathscr N}} A_n(t,r)=1$ . If $\alpha > 1$ , $A_n(t,r)^\alpha\le A_n(t,r)$ and thus
Similar arguments yield $\gamma_\infty\ge \gamma$ when $\alpha < 1$ . If $\alpha=1$ , then
The consensus obtained by the consensus formation algorithm is expected to be around an intermediate value of the initial opinions of agents. At least, the statistical dispersion of the consensus obtained by the algorithm should be smaller than the dispersion of the initial opinions of agents. However, Corollary 6.1 shows that the scale parameter for the obtained consensus, representing the statistical dispersion, does not become smaller than the scale parameter for the initial opinions when $\alpha \le 1$ . This means that the consensus obtained by the broadcast-based algorithm is not a representative opinion of agents when $\alpha \le 1$ .
Corollary 6.1 readily yields the following interesting result.
Corollary 6.2. If $X_1(0)$ follows a Cauchy distribution with scale parameter $\gamma$ , then $\bar X^{(N)}(t,r)$ also follows a Cauchy distribution with scale parameter $\gamma$ .
Proof. A Cauchy distribution is a stable distribution with $\alpha=1$ and $\beta=0$ . Theorem 6.2 implies that $\bar X^{(N)}(t,r)$ also follows a stable distribution, and its location parameter $\delta$ is the same with $X_1(0)$ . In addition, Corollary 6.1 implies that the scale parameter of $\bar X^{(N)}(t,r)$ is the same as that of $X_1(0)$ . These observations complete the proof.
Since $\bar X^{(N)}(t,r)$ converges to the consensus as $t\to\infty$ , Corollary 6.2 implies that if the initial opinion of each agent follows a Cauchy distribution, the consensus has exactly the same distribution as the initial opinion. Although these findings have been numerically demonstrated in previous studies [Reference Katoh and Shioda9, Reference Shioda15], in the present paper, Corollary 6.2 presents a mathematically formal proof.
Even if the initial opinions follow a stable distribution, the consensus as well as $\bar X^{(N)}(t,r)$ does not follow a stable distribution unless the initial opinions follow a Cauchy distribution because the scale parameter is generally a random variable. However, in the limit $N\to\infty$ , while letting $p_n=1/N$ for all $n\in {\mathcal N}$ , the scale parameter becomes a constant, and the consensus, as well as $\bar X^{(N)}(t,r)$ , follows a stable distribution, as shown in the following theorem.
Theorem 6.3. Suppose that $X_1(0)$ follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma,\delta;\,0)$ , and $p_n=1/N$ for all $n\in {\mathcal N}$ . If (5.4) holds with the choice of $\{t_N\}_{N=1}^\infty$ satisfying $t_N/\sqrt{N}\to 0$ as $N\to\infty$ , then the consensus $X_c^{(\infty)}$ in the limit $N\to\infty$ , is obtained, and $X_c^{(\infty)}$ follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma_\infty,\delta;\,0)$ , where
Proof. It follows from Theorem 5.1 that the consensus is obtained in the limit $N\to\infty$ , and $X_c^{(\infty)}$ is given as (5.6). Applying Theorem 6.1 to (5.6) proves the result.
Corollary 6.3. If $X_1(0)$ follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma,\delta;\,0)$ with $\alpha > 1$ and $p_n=1/N$ for all $n\in {\mathcal N}$ , then $X_c^{(\infty)}$ , then the consensus in the limit $N\to\infty$ , is obtained and $X_c^{(\infty)}$ follows a stable distribution $\textsf{S}(\alpha,\beta,\gamma_\infty,\delta;\,0)$ , where
Proof. If $X_1(0)$ follows a stable distribution with $\alpha > 1$ , then $X_1(0)$ is integrable. Thus it follows from Corollary 5.2 that the consensus is obtained in the limit $N\to\infty$ and $X_c^{(\infty)}$ is given as (5.6). Applying Theorem 6.1 to (5.6) proves the result.
Suppose that $X_1(0)$ follows a Gaussian distribution with mean $\mu$ and variance $\sigma^2$ . This is a stable distribution with $\alpha=2$ , $\gamma=\sigma$ , and $\delta=\mu$ . Since a Gaussian distribution has a finite mean, it follows from Corollary 6.3 that $X_c^{(\infty)}$ follows a Gaussian distribution with mean $\mu$ , and its variance $\sigma_\infty^2$ is given by
Figure 2(a) shows the results of simulation experiments when $X_1(0)$ follows a Gaussian distribution with mean 0 and variance 1. The dots in the figure show the PDF for the obtained consensus, which was obtained from the results of $10^7$ simulations, and the black line shows the PDF for the Gaussian distribution with mean 0 and variance $\sigma_\infty$ , which is given by (6.1). The trust parameter r was set at 0.5. The PDF for the obtained consensus of the simulation results converges to the black line as N becomes large, and the simulation results with $N=100$ are almost identical to the results indicated by the black line.
Next, suppose that $X_1(0)$ follows a Lévy distribution with scale parameter $\gamma$ and location parameter $\delta$ , and choose $\{t_N\}_{N=1}^\infty$ such that $t_N$ tends to infinity faster than $\log N$ but slower than $\sqrt{N}$ as $N\to\infty$ . With this choice of $\{t_N\}_{N=1}^\infty$ , (5.6) holds because
where , and we use the fact that the complementary cumulative distribution function for the Lévy distribution can be approximated by a power-law distribution with an exponent of $3/2$ . Thus it follows from Theorem 6.3 that the consensus in the limit $N\to\infty$ is obtained, and $X_c^{(\infty)}$ follows a Lévy distribution with location parameter $\delta$ and scale parameter $\gamma_\infty$ , where
Figure 2(b) shows the results of simulation experiments when $X_1(0)$ follows a Lévy distribution with scale parameter 1 and location parameter 0. The dotted lines in the figure show the PDF for the obtained consensus, which was obtained from the results of $10^7$ simulations, and the solid black line shows the PDF for the Lévy distribution with mean 0 and variance $\gamma_\infty$ , which is given by (6.2). The trust parameter r was also set at 0.5. The figure also shows that the PDF for the obtained consensus of the simulation results converges to the black line as N becomes large, and the simulation results with $N=100$ are almost identical to the results indicated by the black line.
7. Concluding remarks
In the present paper we studied the distribution of the consensus when the initial opinions of agents are random variables following a common distribution. The extension to cases in which initial opinions are random variables created mathematically in the present paper would enrich the consensus formation problem. For example, as shown at the end of Section 4 or some of the results in Section 6 (e.g. Corollary 6.1), the effectiveness of the consensus algorithm largely depends on the integrability of the initial opinion and the consensus algorithm may not be useless when the initial opinion is not integrable. This finding comes from extending the problem when the initial opinion is a random variable. The consideration of the consensus formation problem in the limit in which the number of agents is infinite is also mathematically valuable, and we believe that further interesting results will be obtained.
Some of the results obtained in the present paper can be extended relatively easily to cases in which agents interact on a graph with more general topology. For example, we showed that the consensus is expressed as a weighted average of the initial opinions of agents (Corollary 3.1). We found that the expression of the consensus as a weighted average of the initial opinions of agents is also possible when agents are interacting on a non-complete graph. Since some of the results in Section 4 (Theorems 4.1) and Section 6 (Theorem 6.2, Corollary 6.1, and Corollary 6.1) are derived based on this expression, these results can be extended to cases in which agents interact on a non-complete graph. We also found that the expression of the consensus as a weighted average of the initial opinions of the agents is available not only for a broadcast-based algorithm, but also for a wide range of consensus algorithms, including a gossip-based algorithm. On the other hand, we derive (3.1) in Proposition 3.1 by fully using the completeness of the graph and the homogeneity of the trust parameter, so (3.1) may be able to be extended to more general cases but will have a much more complicated expression. Since most of results in Section 5 are derived based on (3.1), the extension of these results to more general cases will have some difficulties, although this is a very interesting research subject.
Recently, we showed that the time reversal process for the consensus formation process is ergodic when the initial opinions of agents are constant [Reference Shioda and Takehara16]. This allows us to numerically obtain the distribution for the consensus by observing the time reversal process for consensus formation for a fixed sample path. It is also interesting and worth considering to extend this result to cases in which the initial opinions of agents are random variables.
Acknowledgements
We wish to thank the referees for their insightful comments and suggestions which led to a substantial improvement on an earlier version of the manuscript.
Funding information
The present study was supported by the Japan Society for the Promotion of Science (JSPS) through KAKENHI grants JP19H02135, JP19H04096, and JP20K21783.
Competing interests
There are no competing interests to declare that arose during the preparation or publication process of this article.