Hostname: page-component-cd9895bd7-8ctnn Total loading time: 0 Render date: 2024-12-25T19:51:52.423Z Has data issue: false hasContentIssue false

Give us a little social credit: to design or to discover personal ratings in the era of Big Data

Published online by Cambridge University Press:  15 January 2020

Abigail Devereaux*
Affiliation:
New York University, Economics, New York, NY, USA
Linan Peng
Affiliation:
Texas Tech University, Free Market Institute, Lubbock, TX, USA
*
*Corresponding author. Email: [email protected]

Abstract

In 2014, the State Council of the Chinese Communist Party announced the institution of a social credit system by 2020, a follow-up to a similar statement on the creation of a social credit system issued by the State Council in 2007. Social credit ratings of the type being developed by the State Council in partnership with Chinese companies go beyond existing financial credit ratings in an attempt to project less-tangible personal characteristics like trustworthiness, criminal tendencies, and group loyalty onto a single scale. The emergence of personal credit ratings is enabled by Big Data, automated decision-making processes, machine learning, and facial recognition technology. It is quite likely that various kinds of personal and social credit ratings shall become reality in the near future. We explore China's version of its social credit system so far, compare the welfare and epistemological qualities of an ecology of personal ratings emanating from polycentric sources versus a social credit rating, and discuss whether a social credit system in an ideologically driven state is less a tool to maximize social welfare through trustworthiness provision and more a method of preventing and punishing deviance from a set of party-held ideological values.

Type
Research Article
Copyright
Copyright © Millennium Economics Ltd 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Akerlof, G. A. (1970), ‘The Market for “Lemons”: Quality Uncertainty and the Market Mechanism’, The Quarterly Journal of Economics, 84(3): 488500.CrossRefGoogle Scholar
Allen-Ebrahimian, B. (2019), ‘How China's repression playbook backfired in Hong Kong’, Vox, 29 August, https://www.vox.com/world/2019/8/29/20835183/hong-kong-protests-china-repression-tiananmen-square-beijing-response (accessed 5 September 2019).Google Scholar
Anomaly, J. (2017), ‘Trust, Trade, and Moral Progress: How Market Exchange Promotes Trustworthiness’, Social Philosophy and Policy, 34(2): 89107.CrossRefGoogle Scholar
Arrow, K. (1982), Gifts and Exchanges, Princeton, NJ: Princeton University Press.Google Scholar
Arthur, W. B. (2013), Complexity Economics, Oxford: Oxford University Press.Google Scholar
Banerjee, A., Chandrasekhar, A. G., Duflo, E. and Jackson, M. O. (2014), ‘Gossip: Identifying central individuals in a social network’, National Bureau of Economic Research.Google Scholar
Barzel, Y. (1997), The Economic Analysis of Property Rights, Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Beckage, B., Kauffman, S., Gross, L. J., Zia, A. and Koliba, C. (2013), ‘More Complex Complexity: Exploring the Nature of Computational Irreducibility Across Physical, Biological, and Human Social Systems’, In Irreducibility and Computational Equivalence. Berlin, Heidelberg: Springer, pp. 7988.CrossRefGoogle Scholar
Botsman, R. (2017a), ‘Big Data meets Big Brother as China moves to rate its citizens’, Wired.co.uk, 21 October, https://www.wired.co.uk/article/chinese-government-social-credit-score-privacy-invasion (accessed 18 November 2018).Google Scholar
Botsman, R. (2017b), Who Can You Trust?: How Technology Brought Us Together and Why It Might Drive Us Apart, London: Penguin UK.Google Scholar
Brehm, S and Loubere, N. (2018), ‘China's dystopian social credit system is a harbinger of the global age of the algorithm’, Phys.org, 15 January, https://phys.org/news/2018-01-china-dystopian-social-credit-harbinger.html (accessed 21 March 2018).Google Scholar
Calude, C. S. and Longo, G. (2017), ‘The Deluge of Spurious Correlations in big data’, Foundations of Science, 22(3): 595612.CrossRefGoogle Scholar
Candela, R. A. and Geloso, V. J. (2018), ‘The Lightship in Economics’, Public Choice, 176(3–4): 479506.CrossRefGoogle Scholar
Caplan, B. (2018), The Case Against Education: Why the Education System is a Waste of Time and Money, Princeton, NJ: Princeton University Press.Google Scholar
Chen, Y. and Cheung, A. S. (2017), ‘The Transparent Self Under Big Data Profiling: Privacy and Chinese Legislation on the Social Credit System’, The Journal of Comparative Law, 12(2): 356378.Google Scholar
Cheung, S. (1983), ‘The Contractual Nature of the Firm’, The Journal of Law & Economics, 26(1): 121.Google Scholar
Chua, R. Y. (2012), ‘Building Effective Business Relationships in China’, MIT Sloan Management Review, 53(4): 1.Google Scholar
Coase, R and Wang, N. (2012), How China Became Capitalist, New York, NY: Palgrave Macmillan.CrossRefGoogle Scholar
Court Order Execution (2019), Available publicly on http://zxgk.court.gov.cn/ (accessed 19 August 2019).Google Scholar
Cowen, T. (2018), ‘Why does tech have so many political problems?’ Marginal Revolution, 5 August, https://marginalrevolution.com/marginalrevolution/2018/08/tech-many-political-problems.html (accessed 18 November 2018).Google Scholar
Credit China (2019), “2018年失信黑名单年度分析报告发布.” www.gov.cn, 19 February, http://www.gov.cn/fuwu/2019-02/19/content_5366674.htm (accessed 22 June 2019).Google Scholar
Creemers, R. (2017), ‘Part I: Not a Moonshot, but a Legacy of Central Planning’, In ‘China's Plan to ‘Lead’ in AI: Purpose, Prospects, and Problems’, New America online, 1 August, https://www.newamerica.org/cybersecurity-initiative/blog/chinas-plan-lead-ai-purpose-prospects-and-problems/ (accessed 8 November 2019).Google Scholar
Creemers, R. (2018), ‘China's Social Credit System: An Evolving Practice of Control’, SSRN.CrossRefGoogle Scholar
Cuthbertson, A. (2019), ‘Hong Kong protesters use lasers to avoid facial recognition cameras and blind police’, The Independent, 1 August, https://www.independent.co.uk/news/world/asia/hong-kong-protests-lasers-facial-recognition-ai-china-police-a9033046.html (accessed 5 September 2019).Google Scholar
Dearden, L. (2018), ‘Facial recognition cameras scanning unwitting tourists and Christmas shoppers in London's West End’, The Independent, 17 December, https://www.independent.co.uk/news/uk/home-news/facial-recognition-cameras-london-met-police-suspects-arrests-identity-a8687481.html (accessed 19 June 2019).Google Scholar
Devereaux, A. N. (2019), ‘The Nudge Wars: A Modern Socialist Calculation Debate’, The Review of Austrian Economics, 32(2): 139158.CrossRefGoogle Scholar
Devins, C., Felin, T., Kauffman, S. and Koppl, R. (2017), ‘The Law and Big Data’, Cornell JL & Public Policy, 27, 357.Google Scholar
Dobson, W. and Kashyap, A. K. (2006), ‘The contradiction in China's gradualist banking reforms’, Brookings Papers on Economic Activity, 2006(2): 103162.CrossRefGoogle Scholar
Engelmann, S., Chen, M., Fischer, F., Kao, C. Y. and Grossklags, J. (2019), ‘Clear Sanctions, Vague Rewards: How China's Social Credit System Currently Defines Good and Bad Behavior’, Proceedings of the Conference on Fairness, Accountability, and Transparency (pp. 69–78), ACM.CrossRefGoogle Scholar
Epstein, J. M. (2006), Generative Social Science: Studies in Agent-Based Computational Modeling, Princeton, NJ: Princeton University Press.Google Scholar
Feng, E. (2017), ‘China ‘granny Gang’ Jailed in Lending Clampdown’, Financial Times, 11 August, https://www.ft.com/content/34ad1c98-7cd1-11e7-9108-edda0bcbc928 (accessed 11 June 2018).Google Scholar
Foldvary, F. E. and Klein, D. B. (Eds.), (2003), The Half-Life of Policy Rationales: How New Technology Affects Old Policy Issues, New York: NYU Press.Google Scholar
Frydlinger, D and Hart, O. D. (2019), Overcoming Contractual Incompleteness: The Role of Guiding Principles (No. w26245), Cambridge, MA: National Bureau of Economic Research.CrossRefGoogle Scholar
Fungáčová, Z. and Weill, L. (2014). A view on financial inclusion in Asian countries. BOFIT Policy Brief (August 2014).Google Scholar
General Office of the Communist Party of China, and General Office of the State Council. (2016). ‘On the Facilitation of Supervision, Warning, and Punishment of Debtors’’. Chinese Communist Party, 25 September 2016. http://www.gov.cn/zhengce/2016-09/25/content_5111921.htm (accessed 1 September 2018).Google Scholar
Glover, A. and Corbae, D.. (2015), ‘A simple dynamic theory of credit scores under adverse selection’, in 2015 Meeting Papers (No. 1265), Society for Economic Dynamics.Google Scholar
Gupta, A. K., Smith, K. G. and Shalley, C. E. (2006), ‘The interplay between exploration and exploitation.’, Academy of management journal, 49(4): 693706.CrossRefGoogle Scholar
Hao, K. (2018), ‘Is China's social credit system as Orwellian as it sounds?’ MIT Technology Review, 26 February, https://www.technologyreview.com/f/613027/chinas-social-credit-system-isnt-as-orwellian-as-it-sounds/ (accessed 25 June 2019).Google Scholar
Hartzog, W. and Selinger, E. (2013), ‘Big Data in Small Hands’, The Stanford Law Review, 66, 81.Google Scholar
Hayek, F. A. (1945), ‘The Use of Knowledge in Society’, The American Economic Review, 35(4): 519530.Google Scholar
Hoffman, S. (2018), ‘Managing the State: Social Credit, Surveillance and the CCP’s Plan for China’, in Wright, N. (ed), AI, China, Russia, and the Global Order: Technological, Political, Global, and Creative.Google Scholar
Power, JD (2019). Hong Kong Retail Banking Satisfaction Study.Google Scholar
Jing, M. (2019), ‘This small team is building a social credit system app for China's youth to determine who's naughty or nice’, South China Morning Post, 25 March, https://www.scmp.com/tech/apps-social/article/3003158/small-team-building-social-credit-system-app-chinas-youth (accessed 22 June 2019).Google Scholar
Kirzner, I. M. (1997), ‘Entrepreneurial discovery and the competitive market process: An Austrian approach’, Journal of economic literature, 35(1): 6085.Google Scholar
Klein, D. B. (Ed.) (1997), Reputation: Studies in the Voluntary Elicitation of Good Conduct, Ann Arbor, Michigan: University of Michigan Press.CrossRefGoogle Scholar
Kleinberg, J., Mullainathan, S. and Raghavan, M. (2016), ‘Inherent trade-offs in the fair determination of risk scores’, arXiv preprint, arXiv:1609.05807.Google Scholar
Koppl, R. (2018), Expert Failure, Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Koppl, R., Kauffman, S., Felin, T. and Longo, G. (2015), ‘Economics for a Creative World’, Journal of Institutional Economics, 11(1): 131.Google Scholar
Kostka, G. (2018), ‘China's Social Credit Systems and Public Opinion: Explaining High Levels of Approval’, New Media & Society, 1461444819826402.Google Scholar
Liu, M. (2011), ‘Credit Card Fraud Under Chinese Criminal Law’, Frontiers of Law in China 6(3): 369–86.CrossRefGoogle Scholar
Liu, X. (2018), ‘Social credit system must bankrupt discredited people: former official’, China Global Times, 20 May, http://www.globaltimes.cn/content/1103262.shtml (accessed 19 August 2018).Google Scholar
Ma, A. (2018), ‘China has started ranking citizens with a creepy ‘social credit’ system – here's what you can do wrong, and the embarrassing, demeaning ways they can punish you’, Business Insider, 29 October, https://www.businessinsider.com/china-social-credit-system-punishments-and-rewards-explained-2018-4 (accessed 18 November 2018).Google Scholar
MacDonald, T. J. (2019), The Political Economy of Non-Territorial Exit, Cheltenham, UK: Edward Elgar Publishing.Google Scholar
March, (1991), ‘Exploration and exploitation in organizational learning.’, Organization science.CrossRefGoogle Scholar
Margolis, J. (2017), ‘A Big Brother approach has qualities that would benefit society’, Financial Times, 31 October, https://www.ft.com/content/ffe78e52-bd54-11e7-823b-ed31693349d3 (accessed 15 March 2018).Google Scholar
McCahill, M and Finn, R. L. (2014), Surveillance, Capital and Resistance: Theorizing the Surveillance Subject, New York, NY: Routledge.CrossRefGoogle Scholar
Merry, S. E. (1984), ‘Rethinking gossip and scandal’, in Black, D. (ed), Toward a general theory of social control, Academic Press, pp.271302.CrossRefGoogle Scholar
Miller, J. H. and Page, S. E. (2009), Complex Adaptive Systems: An Introduction to Computational Models of Social Life, (Vol. 17), Princeton, NJ: Princeton University Press.CrossRefGoogle Scholar
Ministry of Public Security (2018), ‘Regulations on Internet Security Supervision and Inspection by Public Security Organs (公安机关互联网安全监督检查规定)’, http://www.mps.gov.cn/n2254314/n2254409/n4904353/c6263180/content.html (accessed 23 June 2019).Google Scholar
Mistreanu, S. (2018), ‘Life Inside China's Social Credit Laboratory’, Foreign Policy, 3 April, https://foreignpolicy.com/2018/04/03/life-inside-chinas-social-credit-laboratory/ (accessed 9 October 2018).Google Scholar
Mozur, P. (2019), ‘One Month, 500,000 Face Scans: How China Is Using A.I. to Profile a Minority’, The New York Times, 4 April, https://www.nytimes.com/2019/04/14/technology/china-surveillance-artificial-intelligence-racial-profiling.html (accessed 5 September 2019).Google Scholar
Murgia, M. (2019), ‘Microsoft quietly deletes largest public face recognition data set’, Financial Times, 6 June, https://www.ft.com/content/7d3e0d6a-87a0-11e9-a028-86cea8523dc2 (accessed 19 June 2019).Google Scholar
Norgaard, J. R., Walbert, H. J. and Hardy, R. A. (2018), ‘Shadow markets and hierarchies: comparing and modeling networks in the Dark Net’, Journal of Institutional Economics, 14(5): 877899.CrossRefGoogle Scholar
Osborne, S. (2018), ‘China has made obedience to the State a game’, The Independent, 22 December, http://www.independent.co.uk/news/world/asia/china-has-made-obedience-to-the-state-a-game-a6783841.html (accessed 3 March 2018).Google Scholar
Ostrom, E. (2005), Unlocking Public Entrepreneurship and Public Economies (No. 2005/01), Wider Discussion Papers/World Institute for Development Economics (Unu-Wider).Google Scholar
Ostrom, E. (2010), ‘Beyond Markets and States: Polycentric Governance of complex Economic systems’, American Economic Review, 100(3): 641–72.CrossRefGoogle Scholar
Page, S. E. (2007), ‘Making the Difference: Applying a Logic of Diversity’, Academy of Management Perspectives, 21(4): 620.CrossRefGoogle Scholar
People's Bank of China (PBoC) (2018), ‘关于百行征信有限公司(筹)相关情况的公示 [Notice on relevant information regarding Baihang Credit Co., Ltd.]’, http://www.pbc.gov.cn/rmyh/105208/3456248/index.html (accessed 25 June 2019).Google Scholar
Reagle, J. (2015), ‘The problem with rating people on the new app Peeple’, The Conversation, 2 October, http://theconversation.com/the-problem-with-rating-people-on-the-new-app-peeple-48491 (accessed 26 November 2018).Google Scholar
Reuters staff (2018a), ‘China to bar people with bad “social credit” from planes, trains’, Reuters, 16 March, https://www.reuters.com/article/us-china-credit/china-to-bar-people-with-bad-social-credit-from-planes-trains-idUSKCN1GS10S (accessed 17 March 2018).Google Scholar
Reuters staff (2018b), ‘China's first private credit-scoring firm starts operations: Xinhua’, Reuters, 24 May, https://www.reuters.com/article/us-china-credit/chinas-first-private-credit-scoring-firm-starts-operations-xinhua-idUSKCN1IP02E (accessed 22 June 2019).Google Scholar
Rosenzweig, P. (2007), ‘Misunderstanding the Nature of Company Performance: The Halo Effect and Other Business Delusions’, California Management Review, 49(4): 620.CrossRefGoogle Scholar
Ryser, M. (1997), ‘Sanctions without Law: The Japanese Financial Clearinghouse Guillotine and its Impact on Default Rate’, Reputation: Studies in the Voluntary Elicitation of Good Conduct, Ann Arbor: University of Michigan Press, pp. 225240.Google Scholar
Shearmur, J and Klein, D. B. (1997), ‘Good Conduct in the Great Society: Adam Smith and the Role of Reputation’, in Reputation: Studies in the Voluntary Elicitation of Good Conduct, 29–45.Google Scholar
Simon, H. A. (1996), The Sciences of the Artificial, Cambridge, MA: MIT Press.Google Scholar
State Council of the Chinese Communist Party (2007), ‘国务院办公厅关于社会信用体系建设的若干意见 [Several Opinions of the General Office of the State Council on the Construction of Social Credit System]’, http://www.gov.cn/zwgk/2007-04/02/content_569314.htm (accessed 22 June 2019).Google Scholar
State Council of the Chinese Communist Party (2014), ‘社会信用体系建设规划纲要 [Outline of Social Credit System Construction Planning]’, http://www.gov.cn/zhengce/content/2014-06/27/content_8913.htm (accessed 13 March 2018).Google Scholar
State Council of the Chinese Communist Party (2016), ‘Opinions Concerning Accelerating the Construction of Credit Supervision, Warning and Punishment Mechanisms for Persons Subject to Enforcement for Trust-Breaking’, Translation used https://chinacopyrightandmedia.wordpress.com/2016/09/25/opinions-concerning-accelerating-the-construction-of-credit-supervision-warning-and-punishment-mechanisms-for-persons-subject-to-enforcement-for-trust-breaking/ (accessed 19 August 2018).Google Scholar
Stringham, E. (2015), Private governance: Creating order in economic and social life, Oxford University Press.Google Scholar
Supreme People's Court (2010), “Supreme People's Court's Provisions on Limiting the Discredited's Purchase’, The Supreme People's Court, 20 October, http://www.court.gov.cn/shenpan-xiangqing-1650.html (accessed 8 November 2019).Google Scholar
Trading Economics (2019), ‘China Households’ Debt to GDP’. Trading Economics, https://tradingeconomics.com/china/households-debt-to-gdp (accessed 23 June 2019).Google Scholar
Tullock, G. (2005), in Rowley, C. K. (ed.), The Selected Works of Gordon Tullock. The Organization of Inquiry, Indianapolis: Liberty Fund.Google Scholar
Vanderklippe, N. (2018), ‘Chinese blacklist an early glimpse of sweeping new social-credit control’, The Globe and Mail, 3 January, https://www.theglobeandmail.com/news/world/chinese-blacklist-an-early-glimpse-of-sweeping-new-social-credit-control/article37493300/ (accessed 8 November 2019).Google Scholar
Varian, H. R. (2014), ‘Big data: New tricks for econometrics’, Journal of Economic Perspectives, 28(2): 328.CrossRefGoogle Scholar
Vincent, J. (2018a), ‘Artificial Intelligence is Going to Supercharge Surveillance, The Verge, 23 January, https://www.theverge.com/2018/1/23/16907238/artificial-intelligence-surveillance-cameras-security (accessed 6 March 2018).Google Scholar
Vincent, J. (2018b), ‘Chinese police are using facial recognition sunglasses to track citizens’, The Verge, 8 February, https://www.theverge.com/2018/2/8/16990030/china-facial-recognition-sunglasses-surveillance (accessed 6 March 2018).Google Scholar
Wachter, S., Mittelstadt, B. and Floridi, L. (2017), ‘Why a Right to Explanation of Automated Decision-Making Does not Exist in the General Data Protection Regulation’, International Data Privacy Law, 7(2): 7699.CrossRefGoogle Scholar
Wang, M. (2017), ‘China's Chilling ‘Social Credit’ Blacklist’, The Wall Street Journal, 11 December, https://www.wsj.com/articles/chinas-chilling-social-credit-blacklist-1513036054 (accessed 19 August 2018).Google Scholar
Wang, A. and Buckley, C. (2019), ‘Stuck With an Ex-Husband’s Debt, a Journalist Fights for Divorced Women’, The New York Times, 20 December, https://www.nytimes.com/2019/12/20/world/asia/china-divorce-debts.html (accessed on 28 Dec 2019).Google Scholar
Ward, P. R., Mamerow, L. and Meyer, S. B. (2014), ‘Interpersonal Trust Across Six Asia-Pacific Countries: Testing and Extending the ‘High Trust Society’ and ‘Low Trust Society’ Theory’, PLoS ONE, 9(4): e95555.CrossRefGoogle ScholarPubMed
Weber, M. (2002 (1948)), The Protestant ethic and the ‘spirit’ of capitalism and other writings. London: Penguin.Google Scholar
Weinland, D. (2019), ‘China Shadow Banking Cools for First Time in a Decade’, Financial Times, 18 March, https://www.ft.com/content/fa026b16-492f-11e9-bbc9-6917dce3dc62 (accessed 8 November 2019).Google Scholar
WorldBank (2014), WorldBank Global Findex study, 2014. WorldBank.com. Data from https://databank.worldbank.org/home.aspx (accessed 21 March 2018).Google Scholar
Xie, S. Y. (2018), ‘Jack Ma's Giant Financial Startup Is Shaking the Chinese Banking System’, The Wall Street Journal, July 29, https://www.wsj.com/articles/jack-mas-giant-financial-startup-is-shaking-the-chinese-banking-system-1532885367 (accessed 8 November 2019).Google Scholar
Xinhuanet (2019), ‘Answers to Overcoming the Difficulty of Enforcement of People's Courts’ Orders’, 12 August, http://www.xinhuanet.com/2019-08/12/c_1124863446.htm (accessed 8 November 2019).Google Scholar
Yeung, K. (2017), “Hypernudge’: Big Data as a Mode of Regulation by Design’, Information, Communication & Society, 20(1): 118136.CrossRefGoogle Scholar
Zeng, M. J. (2018), ‘China's Social Credit System puts its people under pressure to be model citizens’, The Conversation, 23 January, https://theconversation.com/chinas-social-credit-system-puts-its-people-under-pressure-to-be-model-citizens-89963 (accessed 6 March 2018).Google Scholar
Zhang, J. (2018), ‘The Xue Liang program, a boost to the Chinese market’, in ‘Top Video Surveillance Trends for 2018’, IHS Markit video surveillance group.Google Scholar
Zhang, Y. and Xin, Z. (2019), ‘Rule Comes First: The Influences of Market Attributes on Interpersonal Trust in the Marketization Process’, Journal of Social Issues, 75(1): 286313.CrossRefGoogle Scholar
Zhou, C. (2012), ‘Credit Information Database in China’, Presented at 4th Credit Reporting and Risk Management Conference, Kuala Lumpur, 5–9 November 2012.Google Scholar
Zuboff, S. (2015), ‘Big Other: Surveillance Capitalism and the Prospects of an Information Civilization’, Journal of Information Technology, 30(1): 7589.CrossRefGoogle Scholar
Zuboff, S. (2019), The age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. London: Profile Books.Google Scholar