区块链和大数据结合,区块链和大数据通俗理解

『一』What is the relationship between blockchain and big data

Blockchain and big data are both hot topics. Many people discuss them together and hope to conflict with more hot

points. Big data has become a huge industry long before the development of blockchain. Although blockchain is in the early stages of the

industry, many technologies and business models are still being explored.

In view of the relative maturity of the big data industry, we use big data as a starting point to study how blockchain technology interfaces with all aspects of the big data

industry.

The big data core industry chain can be roughly divided into the following three parts:

Product part: Including big data software product-related industries such as big data basic software and big data application software.

Data part: including data sources (data collection, data provision), data circulation (data transactions, data sharing

) and other industries directly related to data.

Services: related to big data infrastructure services (data storage, data transmission, data cleaning, data desensitization

, etc.), big data analysis services and big data application services services.

01 Product Section

The combination of software products and blockchain should be based on technology. Big data technology and blockchain technology have similarities: they

are distributed architectures.

But they also have obvious differences: the use of distributed technology in big data technology is computing resources - utilizing the computing resources of multiple

machines and will not be used by a single machine Processing tasks are distributed among multiple computers, each

machine. By processing different tasks, it integrates multiple computing resources to form powerful data processing capabilities.

Using distributed technology in blockchain allows multiple entities to trust each other. Each mainframe participates in the operation of the entire blockchain through the computers it controls

. Each computer runs basically the same task, and the entire blockchain

can achieve mutual trust between multiple entities through repeated redundant calculations.

From a technical perspective, big data technology uses trust to exchange computing resources, while blockchain technology uses computing resources to exchange trust. Due to the differences between the two, technically, it is difficult to find a suitable collision between big data and blockchain

point.

02 Data Part

In the various formats of the data part, the blockchain can find its place.

The chain is of little significance. However, if multiple entities are involved in data collection and data provision, blockchain can

come into its own.

In order to solve the trust problem between multiple entities, each entity broadcasts its own collected data to all consumers

and the hash of that data Values ​​are stored in the blockchain. Based on the hash value on the blockchain, each subject in the blockchain

can verify whether the complete data it received has been tampered with. Blockchain traceability and non-repudiation

make data provided by multiple parties more credible. At the same time, this method also helps maintain the integrity of big data

.

In the data circulation industry, blockchain can play a greater role. In the big data circulation industry, big data itself

is a digital asset. The transaction of digital assets can be realized through the blockchain. Additionally,

decentralized big data transactions implemented on the blockchain can reduce raw data connections. In a decentralized trading platform, only buyers and sellers

have access to the original data; on a centralized trading platform, the data intermediary serving as the trading center usually has access to the original

data. This increases data leakage and assets. Risk of Loss.

03 Service Part

In big data services, the service capabilities as digital assets are the same as the concepts of data and assets in data transactions

and Can be traded.

Blockchain can play an important role in the trading of such digital assets. At the same time, there are many new technologies that are constantly changing the blockchain, such as homomorphic encryption. Homomorphic encryption is an important technology that combines blockchain and big data services

. Homomorphic encryption can truly transform data service functions into digital assets without requiring the big data service provider to copy the original data in the service. risk.

『二』 "Post-Google Era: The Decline of Big Data and the Rise of the Blockchain Economy" pdf download and online reading, please ask for Baidu Netdisk cloud resources

"Post-Google Era: The Decline of Big Data and the Rise of the Blockchain Economy" (George Gilder) E-book network disk download for free online reading

Resource link:

Link:

Extraction code: 56hd

Book title: The Post-Google Era: The Decline of Big Data and the Rise of the Blockchain Economy

Author: George Gilder

Douban Rating: 6.4

Publisher: Modern Publishing House

Publication year: 2018-9-5

Number of pages: 304

Content introduction: The Google era (information Internet era) based on big data and machine intelligence is an awesome era. But it's coming to an end.

George Gilder, the author of "The Post-Google Era", is a visionary and wise man. He has unparalleled vision and insights in technology and culture. He describes to readers the crisis of trust and security facing Google, and bravely predicts the coming post-Google era.

Google has captivated the world with its amazing “search and sort” capabilities. The powerful search engine and seemingly free small applications, such as videos, maps, email, etc., make many users unable to stop. But a system without price competition will stifle entrepreneurship and eventually turn the Internet into an advertising wasteland.

The lack of trust and security is Google's fatal weakness, and the current computer and network system cannot solve this crisis. If value and security are not part of the information technology architecture, then the architecture must be replaced.

A liberal economy based on advertising revenue and secure exploitation of citizens’ privacy will give way to a system based on privacy and security. “Cryptozoological systems”—the new architecture of blockchain and its derivatives—are the future of mankind. Blockchain architectures such as Bitcoin, Ethereum, and Block Heap will create a safe and valuable new Internet.

The Internet, which has long been controlled by a few giants, is facing a "big dismantling". This will decentralize the power of computers and commerce, and ultimately reshape the entire economy and the Internet.

About the author: George Gilder is a visionary and wise man with unparalleled vision and insights in the fields of technology and culture. In the 1980s, he was a representative figure of supply-side economics. His book "Wealth and Poverty", which advocates "reducing taxes and increasing fiscal revenue," sold 1 million copies. Known as the "Reagan Reform Bible", it also had a great impact on China.

In the 1990s, he became an advocate of the Internet and the new economy. In "Communication Revolution", he elaborated on the idea of ​​​​from the "microcosm" of each personal computer to the "remote universe" woven by the interconnection of countless personal computers, which not only gave birth to today's Google, the Internet, Facebook, etc. The large central Internet giant has also completed the overall system construction of Gilder as a futurist.

In his new work "Post-Google Era", he clearly points out that today's centralized Internet will be iterated by the decentralized Internet represented by blockchain. The world of the future will be different from what you imagined.

『三』 Blockchain books, allCan you recommend some?

There are more and more books in the blockchain field, and the quality of many of them is actually not high. I recommend two better books, which I have actually read and summarized. Passed.

A book is "Book Blockchain".

This book is characterized by using interesting and vivid comics to express some principles and applications of blockchain.

This book is especially suitable for newcomers who have just come into contact with blockchain, because the principles in it are analyzed using more real-life cases, which is relatively easy to understand and involves blockchain. Technical knowledge is relatively low.

And this book is not thick, so you can finish it quickly. After all, everyone is very busy at work now. If you read a very thick book, it is indeed difficult to read. This book happens to be more It is thin and light and can easily cultivate your interest in learning knowledge in the blockchain field.

WeChat public account: Shenzhen Blockchain Community

『四』 "Blockchain and Big Data Create Smart Economy" pdf download and read online, please Baidu Netdisk Cloud Resources

"Blockchain and Big Data Create Intelligent Economy" Jingdi Wangtian/Wu Yuanwen/Zhao Guodong/Liu Wenwen download the e-book netdisk for free online reading

Link ：

Book title: Blockchain and big data create an intelligent economy
Author name: Jingdi Wangtian/Wu Yuanwen/Zhao Guodong /Liu Wenwen
Douban score: 6.2
Publisher: People’s Posts and Telecommunications Press
Publishing year: 2017-6-1
Number of pages: 232
Content introduction:< br />In recent years, while big data has developed rapidly, it is also full of hype about the concept and faces many difficulties. So, what methods can be used to promote big data to break through the difficulties and achieve a higher level of development? This is the core idea and value of "Blockchain and Big Data (Creating an Intelligent Economy)" edited by Jingdi Wangtian, Wu Yuanwen, Zhao Guodong, and Liu Wenwen. "Blockchain and Big Data: Building an Intelligent Economy" puts forward the idea of ​​using blockchain technology to solve problems faced in the development of big data. This book is divided into 8 chapters. First, it introduces the rapidly rising blockchain technology by analyzing the difficulties faced by the development of big data, and compares the technological evolution, similarities and differences between the two; then it analyzes the problems existing in data circulation and reveals first introduced the changes brought about by blockchain technology; then introduced the application of blockchain technology in related industries, and began to imagine the combination of blockchain technology and big data. In short, this book stands at the forefront of technological development, provides an in-depth explanation of the integration and development of blockchain and big data, and strives to provide feasible guidance and suggestions for industry development.
Introduction to the author:
Formerly known as Zhou Sha, founder of Silicon Valley venture capital Precision Capital; joined the Silicon Valley high-tech industry in 1996, and has worked in HP, Alteron, NetScaler, NetScreen and JuNiper works; he started a financial weekly in 2012 and founded a series of high-tech companies.

『五』 "An interesting general book on minimalist blockchain that you will love to read" epub download and online reading, please ask for Baidu network disk cloud resources

"Minimalist Blockchain" ([Indian] Sneeva Makali) e-book network disk download for free online reading

Link: https://pan..com/ s/1ONAIxabgGqvZ9BUK5qIjQQ Extraction code: moe0

Book title: Minimalist Blockchain

Author: [Indian] Sneeva Makali

Translator : Youdao AI Translation

Douban score: 4.6

Publisher: Electronic Industry Press

Publication year: 2018-8

Number of pages: 320

Introduction:

Blockchain feels very cold, can I really understand it?

This book leads you to explore the world of blockchain with popular language and vivid cases, comprehensively showing the origin, theoretical framework, application value and future development of blockchain. It is the first book in the field of blockchain. A general book that will start your fantasy journey of exploring the blockchain.

Blockchain is very hot and updates too fast. What knowledge should I know to avoid being OUT?

This book explains the latest technological paradigms that are very attractive in today's world through simple and easy-to-understand language, and comprehensively presents a panoramic blueprint of blockchain, spanning different timelines and technical categories, from the past, present and A future perspective decrypts blockchain stories so that everyone can embrace them like a new faith. After all, only in this way can we ensure our own continuous and stable development in a fast-paced world.

Blockchain, can I really read it?

This book vividly explains the core theory and latest development of blockchain from a comprehensive perspective, combined with popular and interesting cases and illustrations. This book carefully selects 150 illustrations to make blockchain so simple and easy to understand in a colloquial and simple way.

About the author:

Srinivas Mahankali

India’s emerging scientist, best-selling author, veteran in the fields of artificial intelligence and data science Jianghu. He has worked for many multinational IT companies as chief experience officer (CXO). As a weirdo and wizard in the forefront of technology, he is proficient in capital markets, digital marketing, blockchain, big data, data science and Lean Six Sigma, etc. He is an opinion leader with broad appeal who is always at the forefront of technology.

Youdao AI Translation

Youdao AI Translation, also known as Youdao Neural Network Translation, is currently the leading domestic translation engine with Chinese as the core language, aiming to break down language barriers and allow people around the world canCommunicate and connect with each other all the time. The high-quality translation capabilities of Youdao AI Translation benefit from the advanced Youdao Neural Machine Translation (YNMT) technology. After 10 years of accumulation and accumulation, Youdao AI Translation is accurate, timely and comprehensive. Today, Youdao translation services receive more than 280 million requests every day and serve 700 million users around the world.

『Lu』 Big Data and Blockchain

This story still has to start with Bitcoin

Bitcoin The electronic cash system is both disintermediated (electronic cash between individuals does not require the intervention of a trusted third-party intermediary) and decentralized (maintained by an institution) (both parties to the transaction can do so without establishing a trust relationship). Complete the transaction below)

Hash function: Convert any long string into a fixed-length output (the calculation process cannot be too complicated). As long as the input string changes slightly, the output of the hash function It will be completely different.

Blockchain: Divide large things into many blocks for storage. As long as one thing is tampered with and the data below are different, it will be discovered

Uses blockchain (data structure hash function) to ensure that the ledger cannot be tampered with, uses digital signature technology to ensure that only you can use your own account, and uses p2p network and POW consensus mechanism to ensure decentralized operation.

Blockchain is a method that uses block chain data structures to verify and store data, uses distributed node consensus algorithms to generate and update data, and uses cryptography to ensure data transmission and access security. A new distributed infrastructure and computing paradigm.

Three elements:

The essence of blockchain is a distributed ledger, a kind of database. The blockchain uses a hash algorithm to ensure that information cannot be tampered with, uses public keys and private keys to identify identities, and collectively maintains a reliable database in a decentralized and disintermediated manner.

The differences between big data and blockchain are mainly reflected in the following aspects.

(1) Data volume. Blockchain technology is a new application model of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithms. The amount of data processed by the blockchain is small and has a meticulous processing method. Big data manages massive amounts of data, which requires breadth and quantity, and the processing methods will be rougher.

(2) Structured and unstructured. Blockchain is a block with a rigorously defined structure. The chain composed of pointers is a typical structured data, while big data needs to process more unstructured data.

(3) Independence and integration. In order to ensure security, the blockchain system’s information is relatively independent.The focus of big data is the integrated analysis of information.

(4) Direct and indirect. Blockchain is a distributed ledger, which is essentially a database, while big data refers to in-depth analysis and mining of data, which is a kind of indirect data.

(5)CAP theory. C (Consistency) means consistency, which means that any read operation can always read the result of the previously completed write operation. That is, in a distributed environment, data at multiple points is consistent. A (Availability) refers to availability, which refers to obtaining data quickly and returning operation results within a certain time. P (Tolerance of Network Partition) is partition tolerance, which means that when a network partition occurs (that is, some nodes in the system cannot communicate with other nodes), the separated system can still operate normally. CAP theory tells us that a distributed system cannot meet the three requirements of consistency, availability, and partition tolerance at the same time. It can only meet two of them at the same time. As the saying goes, "You can't have your cake and eat it too." Big data usually chooses to implement AP, and blockchain chooses to implement CP.

(6) Basic network. The underlying infrastructure of big data is usually a computer cluster, while the infrastructure of the blockchain is usually a P2P network.

(7) Source of value. For big data, data is information, and value needs to be extracted from the data. For blockchain, data is an asset and the inheritance of value.

(8) Calculation mode. In the big data scenario, one thing is assigned to multiple people. For example, in the MapRece computing framework, a large task will be decomposed into many subtasks and assigned to many nodes for calculation at the same time. In the blockchain scenario, multiple people are allowed to do one thing repeatedly. For example, many nodes in the P2P network record a transaction at the same time.

『撒』 What is the relationship between blockchain and big data storage

The relationship between blockchain and big data storage is as follows:
1. Data security: Zone Blockchain allows data to truly flow "with confidence"
With its trustworthiness, security and non-tamperability, blockchain allows more data to be liberated. Let’s use a typical case to illustrate how blockchain promotes the generation of gene sequencing big data. Blockchain sequencing can use private keys to limit access rights, thereby circumventing legal restrictions on individuals' access to genetic data, and utilize distributed computing resources to complete sequencing services at low cost. The security of blockchain makes sequencing an industrialized solution, enabling global-scale sequencing, thus promoting the massive growth of data.
2. Data openness and sharing: Blockchain ensures data privacy
The government holds a large amount of high-density and high-value data, such as medical data, population data, etc. governmentData openness is a general trend and will have an immeasurable impetus to the development of the entire economy and society. However, the main difficulty and challenge in data openness is how to open data while protecting personal privacy. Blockchain-based data desensitization technology can ensure data privacy and provides a solution for data openness under privacy protection. Data desensitization technology mainly uses encryption algorithms such as hashing. For example, the Enigma system based on blockchain technology can calculate data without accessing the original data, which can protect the privacy of data and eliminate information security issues in data sharing. For example, company employees can safely open access to their salary information and jointly calculate the average salary within the group. Each participant is informed of his relative position within the group but not of the compensation of other members.
Data HASH desensitization processing diagram
3. Data storage: Blockchain is an immutable, full-historical, strongly endorsed database storage technology
Blockchain technology, through the network All nodes in the network participate in calculations and verify the authenticity of their information to reach a consensus across the entire network. It can be said that blockchain technology is a specific database technology. So far, our big data is still in a very basic stage. Trusted blockchain data based on the consensus of the entire network is non-tamperable and full of history, which also enables the quality of the data to gain unprecedented strong trust endorsement. It also brings the development of database into a new era.
4. Data analysis: Blockchain ensures data security
Data analysis is the core of realizing data value. When conducting data analysis, how to effectively protect personal privacy and prevent core data leakage has become the primary consideration. For example, with the popularization of fingerprint data analysis applications and genetic data detection and analysis methods, more and more people are worried that once personal health data is leaked, it may lead to serious consequences. Blockchain technology can prevent such situations through multi-signature private keys, encryption technology, and secure multi-party computing technology. When the data is hashed and placed on the blockchain, digital signature technology is used to allow only authorized people to access the data. The private key ensures data privacy and can be shared with authorized research institutions. The data is uniformly stored on the decentralized blockchain, and data analysis can be performed without accessing the original data. This can not only protect the privacy of the data, but also safely provide it to global scientific research institutions and doctors for sharing. The basic health database will bring great convenience to solve sudden and difficult diseases in the future.
5. Data circulation: Blockchain protects data-related rights and interests
For individuals or institutions’ valuable data assets, blockchain can be used to register them, and transaction records are recognized and transparent by the entire network. , traceable, clarifying the source, ownership, use rights and circulation path of big data assets, which is of great value to data asset transactions.
On the one hand, blockchain can eliminate the threat of intermediaries copying data and help establish trustworthiness.data asset trading environment. Data is a very special commodity, which is essentially different from ordinary commodities. It mainly has characteristics such as unclear ownership and "it is owned after seeing it and copying it". This also determines that the transaction method using traditional commodity intermediaries cannot meet the needs of data. Share, exchange and trade. Because the intermediary center has the conditions and ability to copy and save all the data flowing through it, this is extremely unfair to the data producers. This threat cannot be eliminated by relying on promises alone, and the existence of this threat has also become a huge obstacle to the flow of data. Based on decentralized blockchain, it can eliminate the threat of data copying by intermediary centers and protect the legitimate rights and interests of data owners.
On the other hand, blockchain provides a traceable path and can effectively solve the problem of data verification. The blockchain jointly participates in the calculation and recording of data through multiple nodes participating in calculations in the network, and mutually verifies the validity of their information. It can not only prevent information counterfeiting, but also provide a traceable path. By stringing together the transaction information of each block, a complete list of transaction details is formed. The ins and outs of each transaction are very clear and transparent. In addition, when people have doubts about the "value" of a certain block, they can easily review historical transaction records to determine whether the value is correct, and identify whether the value has been tampered with or recorded incorrectly.
Everything is guaranteed on the blockchain, and big data will naturally become more active.
The tokens of crowdfunding projects on the Biying China platform are all developed based on blockchain technology, and relevant information will be recorded on the blockchain.