从大数据到区块链的过程,从大数据到区块链的转型

A. What is the relationship between blockchain and big data storage

The relationship between blockchain and big data storage is as follows:
1. Data security: Blockchain allows data to truly flow "with confidence"
With its trustworthiness, security and non-tamperability, blockchain allows more data to be liberated. Let’s use a typical case to illustrate how blockchain promotes the generation of gene sequencing big data. Blockchain sequencing can use private keys to limit access rights, thereby circumventing legal restrictions on individuals' access to genetic data, and utilize distributed computing resources to complete sequencing services at low cost. The security of blockchain makes sequencing an industrialized solution, enabling global-scale sequencing, thus promoting the massive growth of data.
2. Data openness and sharing: Blockchain ensures data privacy
The government holds a large amount of high-density and high-value data, such as medical data, population data, etc. The openness of government data is a general trend and will have an immeasurable impetus to the development of the entire economy and society. However, the main difficulty and challenge in data openness is how to open data while protecting personal privacy. Blockchain-based data desensitization technology can ensure data privacy and provides a solution for data openness under privacy protection. Data desensitization technology mainly uses encryption algorithms such as hashing. For example, the Enigma system based on blockchain technology can calculate data without accessing the original data, which can protect the privacy of data and eliminate information security issues in data sharing. For example, company employees can safely open access to their salary information and jointly calculate the average salary within the group. Each participant is informed of his relative position within the group but not of the compensation of other members.
Data HASH desensitization processing diagram
3. Data storage: Blockchain is an immutable, full-historical, strongly endorsed database storage technology
Blockchain technology, through the network All nodes in the network participate in calculations and verify the authenticity of their information to reach a consensus across the entire network. It can be said that blockchain technology is a specific database technology. So far, our big data is still in a very basic stage. Trusted blockchain data based on the consensus of the entire network is non-tamperable and full of history, which also enables the quality of the data to gain unprecedented strong trust endorsement. It also brings the development of database into a new era.
4. Data analysis: Blockchain ensures data security
Data analysis is the core of realizing data value. When conducting data analysis, how to effectively protect personal privacy and prevent core data leakage has become the primary consideration. For example, with the popularization of fingerprint data analysis applications and genetic data detection and analysis methods, more and more people are worried that once personal health data is leaked, it may lead to serious consequences. Blockchain technology can prevent such situations through multi-signature private keys, encryption technology, and secure multi-party computing technology. When the data is hashed and placed on the blockchain, useDigital signature technology allows only authorized people to access data. The private key ensures data privacy and can be shared with authorized research institutions. The data is uniformly stored on the decentralized blockchain, and data analysis can be performed without accessing the original data. This can not only protect the privacy of the data, but also safely provide it to global scientific research institutions and doctors for sharing. The basic health database will bring great convenience to solve sudden and difficult diseases in the future.
5. Data circulation: Blockchain protects data-related rights and interests
For valuable data assets of individuals or institutions, blockchain can be used to register them, and transaction records are recognized and transparent by the entire network. , traceable, clarifying the source, ownership, use rights and circulation path of big data assets, which is of great value to data asset transactions.
On the one hand, blockchain can eliminate the threat of intermediaries copying data and help establish a trustworthy data asset trading environment. Data is a very special commodity, which is essentially different from ordinary commodities. It mainly has characteristics such as unclear ownership and "it is owned after seeing it and copying it". This also determines that the transaction method using traditional commodity intermediaries cannot meet the needs of data. Share, exchange and trade. Because the intermediary center has the conditions and ability to copy and save all the data flowing through it, this is extremely unfair to the data producers. This threat cannot be eliminated by relying on promises alone, and the existence of this threat has also become a huge obstacle to the flow of data. Based on decentralized blockchain, it can eliminate the threat of data copying by intermediary centers and protect the legitimate rights and interests of data owners.
On the other hand, blockchain provides a traceable path and can effectively solve the problem of data verification. Blockchain jointly participates in the calculation and recording of data through multiple nodes participating in calculations in the network, and mutually verifies the validity of their information. It can not only prevent information counterfeiting, but also provide a traceable path. By stringing together the transaction information of each block, a complete list of transaction details is formed. The ins and outs of each transaction are very clear and transparent. In addition, when people have doubts about the "value" of a certain block, they can easily review historical transaction records to determine whether the value is correct, and identify whether the value has been tampered with or recorded incorrectly.
Everything is guaranteed on the blockchain, and big data will naturally become more active.
The tokens of crowdfunding projects on the Biying China platform are all developed based on blockchain technology, and relevant information will be recorded on the blockchain.

B. What is the relationship between blockchain and big data?

Blockchain and big data are both hot topics. Many people discuss them together and hope to conflict with more hot

points. Big data has become a huge industry long before the development of blockchain. Although blockchain is in the early stages of the

industry, many technologies and business models are still being explored.

In view of the relative maturity of the big data industry, we use big dataBased on this, we will study how blockchain technology interfaces with all aspects of the big data

industry.

The big data core industry chain can be roughly divided into the following three parts:

Product part: including big data software product-related industries such as big data basic software and big data application software.

Data part: including data sources (data collection, data provision), data circulation (data transactions, data sharing

) and other industries directly related to data.

Services: related to big data infrastructure services (data storage, data transmission, data cleaning, data desensitization

, etc.), big data analysis services and big data application services services.

01 Product Section

The combination of software products and blockchain should be based on technology. Big data technology and blockchain technology have similarities: they

are distributed architectures.

But they also have obvious differences: the use of distributed technology in big data technology is computing resources - utilizing the computing resources of multiple

machines and will not be used by a single machine Processing tasks are distributed among multiple computers, each

machine. By processing different tasks, it integrates multiple computing resources to form powerful data processing capabilities.

Using distributed technology in blockchain allows multiple entities to trust each other. Each mainframe participates in the operation of the entire blockchain through the computers it controls

. Each computer runs basically the same task, and the entire blockchain

can achieve mutual trust between multiple entities through repeated redundant calculations.

From a technical perspective, big data technology uses trust to exchange computing resources, while blockchain technology uses computing resources to exchange trust. Due to the differences between the two, it is technically difficult to find a suitable collision point between big data and blockchain.

02 Data Part

In the various formats of the data part, the blockchain can find its place.

The chain is of little significance. However, if multiple entities are involved in data collection and data provision, blockchain can

come into its own.

In order to solve the trust problem between multiple entities, each entity broadcasts its own collected data to all messages

consumers and store the hash value of that data in the blockchain. Based on the hash value on the blockchain, each subject in the blockchain

can verify whether the complete data it received has been tampered with. Blockchain traceability and non-repudiation

make data provided by multiple parties more credible. At the same time, this method also helps maintain the integrity of big data

.

In the data circulation industry, blockchain can play a greater role. In the big data circulation industry, big data itself

is a digital asset. The transaction of digital assets can be realized through the blockchain. Additionally,

decentralized big data transactions implemented on the blockchain can reduce raw data connections. In a decentralized trading platform, only buyers and sellers

can access the original data; on a centralized trading platform, the data intermediary serving as the trading center usually has access to the original

data. This increases data leakage and assets. Risk of Loss.

03 Service Part

In big data services, the service capabilities as digital assets are the same as the concepts of data and assets in data transactions

And Can be traded.

Blockchain can play an important role in the trading of such digital assets. At the same time, there are many new technologies that are constantly changing the blockchain, such as homomorphic encryption. Homomorphic encryption is an important technology that combines blockchain and big data services

. Homomorphic encryption can truly transform data service functions into digital assets without requiring the big data service provider to copy the original data in the service. risk.

C. What is the relationship between blockchain and big data?

Big data can be placed on the word data, which is generated by various social activities. The blockchain is an underlying technology, just like the Internet. However, it regards the Internet as its bottom layer and builds a blockchain network on the bottom layer of the Internet. Many people also call it the "Internet of Value."
As for the connection, big data can be combined with blockchain technology. For example, blockchain has traceability features. When a big data package is traded on the blockchain network, it can be seen on the entire network. flow direction. Able to confirm and track the rights of this data package

D. How to use big data to promote the development of the blockchain industry in the future

The future regional economic development will focus on four aspects: industrial agglomeration development Aspects of content will further promote the healthy and rapid development of the city's blockchain industry and better serve the digital transformation of the economy and society.

01. Industrial agglomerationDevelopment

We will scientifically plan the blockchain industrial park, increase the intensity of park construction, improve the supporting service system, and enhance the concentration of industrial development.

02. Increase the introduction and cultivation of blockchain enterprises

We will target leading and well-known enterprises in the international and domestic blockchain field and accelerate the introduction of a group of innovative and developing companies. Blockchain companies with great potential will be supported in setting up R&D centers, project headquarters, etc. in Chongqing, and will further gather industrial resources through leading efforts.

03. Promote the completion of demonstration applications of blockchain in key areas

We will strengthen the research and development of key core technologies of blockchain, focusing on breakthroughs in key technologies such as consensus mechanisms, cryptography technology, and smart contracts. .

04. Actively build a good ecosystem for the blockchain industry

We will promote the establishment of a public service platform for the blockchain industry to provide investment and financing, supply and demand docking, etc. for blockchain companies. One-stop service.

E. Big Data and Blockchain

This story still has to start with Bitcoin

Bitcoin, an electronic cash system, is simultaneously disintermediated. (Electronic cash between individuals does not require the intervention of a trusted third-party intermediary) and decentralized (maintained by an institution) (both parties to the transaction can complete transactions without establishing a trust relationship)

Hash function: Convert an arbitrarily long string into a fixed-length output (the calculation process cannot be too complicated). As long as the input string changes slightly, the output of the hash function will be completely different.

Blockchain: Divide large things into many blocks for storage. As long as one thing is tampered with, the data below will be different and it will be discovered

Uses blockchain (data structure hash function) to ensure that the ledger cannot be tampered with, uses digital signature technology to ensure that only you can use your own account, and uses p2p network and POW consensus mechanism to ensure decentralized operation.

Blockchain is a method that uses block chain data structures to verify and store data, uses distributed node consensus algorithms to generate and update data, and uses cryptography to ensure data transmission and access security. A new distributed infrastructure and computer paradigm.

Three elements:

The essence of blockchain is a distributed ledger, a kind of database. The blockchain uses a hash algorithm to ensure that information cannot be tampered with, uses public keys and private keys to identify identities, and collectively maintains a reliable database in a decentralized and disintermediated manner.

The differences between big data and blockchain are mainly reflected in the following aspects.

(1) Data volume. Blockchain technology is distributed data storage, point-to-point transmission,New application models of computer technologies such as consensus mechanisms and encryption algorithms. The amount of data processed by blockchain is small and has a meticulous processing method. Big data manages massive amounts of data, which requires breadth and quantity, and the processing methods will be rougher.

(2) Structured and unstructured. Blockchain is a block with a rigorously defined structure. The chain composed of pointers is a typical structured data, while big data needs to process more unstructured data.

(3) Independence and integration. In order to ensure security, the blockchain system's information is relatively independent, while the focus of big data is the integrated analysis of information.

(4) Direct and indirect. Blockchain is a distributed ledger, which is essentially a database, while big data refers to in-depth analysis and mining of data, which is a kind of indirect data.

(5)CAP theory. C (Consistency) means consistency, which means that any read operation can always read the result of the previously completed write operation. That is, in a distributed environment, data at multiple points is consistent. A (Availability) refers to availability, which refers to obtaining data quickly and returning operation results within a certain time. P (Tolerance of Network Partition) is partition tolerance, which means that when a network partition occurs (that is, some nodes in the system cannot communicate with other nodes), the separated system can still operate normally. CAP theory tells us that a distributed system cannot meet the three requirements of consistency, availability, and partition tolerance at the same time. It can only meet two of them at the same time. As the saying goes, "You can't have your cake and eat it too." Big data usually chooses to implement AP, and blockchain chooses to implement CP.

(6) Basic network. The underlying infrastructure of big data is usually a computer cluster, while the infrastructure of the blockchain is usually a P2P network.

(7) Source of value. For big data, data is information, and value needs to be extracted from the data. For blockchain, data is an asset and the inheritance of value.

(8) Calculation mode. In the big data scenario, one thing is assigned to multiple people. For example, in the MapRece computing framework, a large task will be decomposed into many subtasks and assigned to many nodes for calculation at the same time. In the blockchain scenario, multiple people are allowed to do one thing repeatedly. For example, many nodes in the P2P network record a transaction at the same time.

F. Are big data and blockchain the same thing?

Not the same thing
Big data refers to the technical difficulties caused by excessive data volume, mainly It is 4V, with large data volume, fast data generation, diverse data formats, and low data value
It corresponds to many technical problems that need to be solved
DistrictBlockchain is a term in the field of information technology. In essence, it is a shared database, and the data or information stored in it has the characteristics of "unforgeable", "full traces left", "traceable", "open and transparent" and "collectively maintained".

G. Is blockchain technology an extension of big data?

Yes, blockchain technology is an extension of big data. Only big data is big enough. With enough categories, blockchain technology will become more and more mature.
Currently, the application of blockchain has extended to many fields such as the Internet of Things, intelligent manufacturing, supply chain management, and digital asset transactions. Chongqing Jinwowo Group analyzes that the development and application of big data technology and blockchain technology will have a profound impact on the organizational structure of society, the governance model of the country, the decision-making structure of enterprises, commercial business strategies, and personal lifestyles.

H. What is the relationship between blockchain and big data?

Blockchain and big data are both hot topics. The development of big data precedes the development of blockchain. Chain has now become a huge industry, and combining the developing blockchain technology with big data will produce different effects. From a technical perspective, big data technology exchanges trust for computing resources, while blockchain technology exchanges computing resources for trust, so the combination of the two has set off a new wave of information security. Based on the characteristics of blockchain distributed data storage, decentralization, non-tampering, traceability, and trustworthiness, Chongqing Jinwowo Network Technology Group has established a strong blockchain research team to professionally provide blockchain as the underlying technology. big data services.

I. What is the role of blockchain in big data

[Introduction] While big data brings great opportunities to all walks of life, it also brings many challenges. . Blockchain, with its decentralization, trustlessness, high transparency and non-tampering characteristics, can provide higher security, transparency and privacy to big data. So, what are the effects of blockchain in big data?

1. Improving data quality

The essence of blockchain is to remove Centralized distributed ledger. It can also be understood as an tamper-proof, fully historical, distributed database storage technology. Therefore, blockchain technology can liberate more data. The trustworthiness, security, and non-tamperability of blockchain technology fundamentally bring about the improvement of data quality and the enhancement of data verification capabilities.

2. Dealing with the data island problem

Big data has a very serious data island problem, and a lot of data is currently inaccessible. Blockchain is expected to solve this problem. The reason why I say this is mainly because the blockchain is not only a distributed ledger, but also has the characteristics of decentralization and openness. As the maintainers of order in the financial market, regulatory organizations can also predict and analyze possible dangerous problems through the data chain in the blockchain.

3. Dealing with data leakage issues

FromIn essence, the blockchain is actually a decentralized database. Therefore, if the data of a certain node in the blockchain changes, other nodes will discover it as soon as possible, which will increase the possibility of data leakage. Amplitude reduced. Only in the form of a private key can the identity information of each node in the blockchain be successfully obtained, and only the data owner can know the private key.

4. Blockchain can protect the relevant rights and interests of data

As for the valuable data assets of individuals or organizations, they can be registered using the blockchain, and the transaction records are recorded on the entire network. Recognized, transparent and traceable. Clarifying the source, ownership, use rights and circulation path of big data assets is of great value to the sale and purchase of data assets.

5. Traceability of blockchain

Every step of data collection, transaction, circulation, and accounting analysis can be recorded on the blockchain, thus making Data quality has received unprecedented strong trust endorsement. At the same time, it also ensures the accuracy of data analysis results and the effectiveness of data mining.

The above is all the content that the editor has compiled and sent to you today on "What is the role of blockchain in big data?" I hope it will be helpful to everyone. As the saying goes, there is no battle without preparation. Generally speaking, with the application of big data in many industries, engineers and developers with the ability to work in big data technology are very popular.