区块链存储越来越大的原因,区块链存储越来越大怎么办

随着区块链技术的发展，区块链存储越来越大，这给用户带来了更多的便利，但也带来了一些问题，比如存储空间不足，数据传输速度慢等。那么，区块链存储越来越大怎么办呢？

首先，可以采用数据压缩技术，通过压缩数据，可以有效减少存储空间的占用，从而解决存储空间不足的问题。其次，可以采用分布式存储技术，将大量数据分布在不同的节点上，从而提高数据传输速度，解决数据传输速度慢的问题。

此外，还可以采用云存储技术，将区块链存储数据迁移到云存储系统，从而实现更大的存储空间。云存储可以提供更多的存储空间，可以让用户轻松获取大量数据，还可以提高数据传输速度，为用户提供更好的服务。

此外，还可以采用数据库管理技术，将大量数据存储在数据库中，以提高存储空间的使用效率，并解决存储空间不足的问题。

总之，当区块链存储越来越大时，我们可以采取多种技术来解决这一问题，比如数据压缩技术、分布式存储技术、云存储技术以及数据库管理技术等，这些技术可以有效地解决存储空间不足以及数据传输速度慢的问题，为用户提供更好的服务。因此，当区块链存储越来越大时，我们应该采取有效的技术来解决存储空间不足和数据传输速度慢的问题，以提供更好的服务。

请查看相关英文文档

『一』 Understand the relationship between blockchain and big data, cloud computing, and Bitcoin

Blockchain is an untamperable, full-historical database storage Technology, a huge set of block data contains the entire history of each transaction. With the rapid development of blockchain applications, the data scale will become larger and larger, and different business scenarios will further expand the data integration of blockchain. Data size and richness. However, what the blockchain provides is the integrity of the ledger, and the ability of data statistical analysis is relatively weak. Big data has massive data storage technology and flexible and efficient analysis technology, which will greatly enhance the value and use space of blockchain data.
Digital currency is a form of expression represented by blockchain 1.0, mainly Bitcoin; as a virtual currency system, the total amount of Bitcoin is limited by the network consensus agreement, and no individual or institution can Changes and modifications to the supply and transaction records, so after the Bitcoin network has been successfully running for many years, the blockchain, as the underlying technology that supports the operation of Bitcoin, is essentially an extremely clever distributed shared ledger and peer-to-peer value transmission technology. It will have a very large potential impact on finance and even all walks of life.
Blockchain and cloud computing, the research, development, and testing of blockchain technology involve multiple systems. Time and capital costs will hinder the breakthrough of blockchain technology. Software development based on blockchain technology, It is still a high-barrier job. Cloud computing services have the characteristics of elastic resource scalability, rapid adjustment, low cost and high reliability, which can help small and medium-sized enterprises to develop and deploy blockchain quickly and at low cost. The integration of the two technologies will accelerate the development of blockchain technology. The blockchain technology is mature and promotes the rapid expansion of blockchain into the financial industry.

『二』Blockchain distributed storage: a new storage model for ecological big data

Blockchain is undoubtedly the most beautiful word in 2019, shining brightly in the field of science and technology. Stars are shining in the real industry.

The 1024 speech in 2019 gave the word blockchain a new look. In the past, it was always associated with pyramid schemes and fraud, and the word "blockchain" was always cast in a layer of gray. But now, blockchain is closely connected with the integration of the real economy and has become a strategic technology for the country. The word instantly shines with passionate red and vibrant green.

"Industrial blockchain" came into being in the context of this era. It is another hot word after "Internet". The core is that blockchain must be integrated with real industries and move away from virtuality to reality. , it is the right way to let blockchain technology find more business scenarios.

The essence of the blockchain is a database, and it uses a distributed storage method. As a blockchain practitioner, today I will talk about the sparks generated by the collision of distributed storage of blockchain and ecological big data.

Most of the current storage is centralized storage, which is stored on traditional centralized servers. If the server is down or malfunctions, or the server stopsoperation, a lot of data will be lost.

For example, the pictures we post in WeChat Moments, the videos uploaded on Douyin, etc. are all centralized storage. Many friends will store things on the Internet, but when they open it one day, the web page will display 404, which means that the stored things have disappeared.

Blockchain, as a distributed database, can solve this problem very well. This is determined by the technical characteristics of the blockchain. Digital records on the blockchain cannot be tampered with or forged. Smart contracts allow everyone to collaborate more efficiently to establish a credible digital economic order, which can improve the efficiency of data flow, break down data silos, and create a new storage model.

Ecological big data is actually closely related to our daily lives, such as daily weather forecasts, traceability data of agricultural products we eat, etc., which are all part of ecological big data. To talk about this combination, first let's take a look at the characteristics of ecological big data storage.

With the development of the Internet, currently, ecological big data has the following characteristics in terms of storage:

From the perspective of data scale, the volume of ecological data It’s huge, and data has jumped from the TB level to the PB level.

With the development of various sensor technologies, satellite remote sensing, radar and video sensing technologies, data not only comes from traditional manual monitoring data, but also includes aviation, aerospace and ground data. Together, they have generated a massive amount of ecological data. environmental data. In the past 10 years, ecological data has grown by hundreds of terabytes per year.

Ecological environment big data requires a combination of dynamic new data and historical data for processing, and real-time continuous observation is particularly important. Only by processing and analyzing these dynamic new data in real time and combining them with existing historical data can we unearth useful information and provide scientific decisions for solving ecological and environmental problems.

For example, in the current urban construction, the ecological environment restoration and ecological model construction advocated require a large amount of ecological big data to be used for analysis, modeling and plan formulation. However, currently a lot of historical data disappears due to improper storage, resulting in the loss of data value.

Since ecological big data has these characteristics, what are its storage requirements?

Currently, ecological big data is facing serious security risks, and strong secure storage is imperative for ecological big data.

The security of big data mainly includes the security of big data itself and the security of big data technology. For example, in the data storage of big data, data information leakage occurs due to external network attacks by hackers and improper human operations. External attacks include data transmission attacks on static and dynamic data, data content attacks, data management and cyber-physical attacks.

For example, many massive data for field ecological environment monitoringData transmission requires network transmission, which increases the risk of cyber attacks. If it involves some ecological and environmental data used by the military, if these data are obtained by hackers, they may infer some information about our military or obtain sensitive ecological and environmental data, with disastrous consequences.

The commercial application of ecological big data requires the integration of data from multiple sources of society such as governments, enterprises, and scientific research institutes. Only when different types of ecological environment big data are connected, collided and shared can the value of ecological environment big data be released.

Taking the current smart city construction as an example, many cities are establishing agricultural information big data centers on intellectual property, germplasm resources, agricultural materials, agricultural products, pests and diseases in all aspects and dimensions to provide agricultural products with Supply and marketing provide full information services. The construction of such a big data center is inseparable from the sharing of ecological big data among various departments.

However, ecological big data sharing faces huge challenges. First of all, my country's ecological environment big data includes big data from meteorology, water conservancy, ecology, land, agriculture, forestry, transportation, social economy and other departments, involving multi-field, multi-sector and multi-source data. Although these departments have currently established their own data platforms, these platforms are not connected to each other and are just isolated data islands.

Secondly, the relevant departments cannot share the data because they are unable to track the trajectory of the data and are worried about the ownership of the data’s interests. Therefore, in order to explore the potential value hidden behind ecological big data, achieving secure data sharing is the key, and it is also the premise and basis for the value of ecological big data.

Ecological big data is hard-won and is the collective wisdom of research institutes, enterprises, individuals and other social sources.

Among them, many ecological big data involve the protection of intellectual property rights. However, the current centralized storage cannot guarantee the protection of intellectual property rights and cannot perform traceability management of data use, which can easily lead to the infringement of intellectual property rights and the leakage of private data.

These are the storage needs of ecological big data. Today, with the rapid development of industrial blockchain, the distributed storage of blockchain can provide a new storage method for ecological big data storage. This core premise is the distributed storage, non-tampering and data tracking characteristics of the blockchain.

Using blockchain as the underlying technology, build such a platform to specifically store ecological big data. You can set up node management, storage management, user management, license management, business channel management, etc. Implementation of the underlying services of the blockchain network that provides high availability and dynamic expansion for upper-layer business applications. In the application layer of this platform, API interfaces can be built to make the use of the entire platform flexible and scalable. Blockchain distributed storage has the following characteristics:

Utilizing the distributed storage of blockchain can achieve truly secure storage of ecological big data.

First, data is never lost. This is particularly friendly to the historical data of ecological big data, making it easier to call and compare new and old data.

Secondly, data is not easily leaked or attacked. Because the data is stored in a distributed manner, if there is an attack, only the data fragments stored in some nodes can be obtained, and the complete data information or data segments cannot be completely obtained.

Blockchain can realize the storage and confirmation of ecological data, so as to avoid the infringement of intellectual property rights and achieve safe sharing. After all, the acquisition of ecological big data requires ecological workers to be stationed in the wild all year round to extract data.

Ecological big data is hard-won and is the hard work of many ecological workers. It needs to be protected by property rights, so that the data can reflect its application value and commercial value, and the work motivation of ecological workers can be protected. They can go deep into the front line and collect more high-quality big data.

At the same time, the use of blockchain's data security sharing mechanism can also break down data barriers in departments such as meteorology, forestry, and wetlands, and build a safe and reliable data sharing mechanism to make data flow more valuable.

Nowadays, some ecological workers will tamper with ecological data for personal gain. If you use blockchain technology, it is not so easy.

Using encryption technology, the stored data is placed on a distributed storage platform for encryption processing. If the ecological big data changes, the platform can record its different versions to facilitate subsequent tracing and verification.

This protection mechanism mainly takes advantage of the non-tamperability of data to meet the requirements for data security in various business processes that use ecological big data.

The blockchain can provide secure monitoring of data, record the operation logs of the application system and the operation log data of the database, encrypt and store them on the system, provide log warning functions, and browse through the blockchain for abnormal situations The device is displayed to facilitate timely detection of illegal operations and the provision of evidence.

The above is the role that distributed storage of blockchain can play in ecological big data. In the future, there will definitely be many platforms for ecological big data storage.

Ecological big data is an important basic data for the construction of smart cities. Using blockchain technology to create a relevant ecological big data storage and management platform can ensure the safe storage and effective sharing of ecological big data and provide wisdom for the future. Contribute to urban construction and promote the development of industrial blockchain.

Author: Justina, WeChat public account: Miaoyishenghua, engaged in blockchain operations, good at content operations and overseas media operations.

The title picture comes from Unsplash, based on the CC0 agreement.

『三』 Where does the data in the blockchain exist

BlockchainAll the data exists in the terminal or in the server. Because we are talking about blockchain, its user terminal can also be a server, and the server can also be a user terminal, so it is all stored on these devices.

『四』What to do if the blockchain information is getting bigger and bigger

Over the past few years, with the vigorous development of Bitcoin, the number of Bitcoin transactions has increased, and a single block The block size has a maximum limit of 1MB, so the free space in the block becomes smaller and smaller. As shown in the figure, the median block size doubled in 2015, growing rapidly from 292KB in January to 749KB in December.

Bitcoin block size

The issue of expansion received full attention and discussion in 2015. Around June 2015, many expansion plans were launched one after another, represented by BIP100, BIP101, BIP102, BIP109, BIP248 and other plans (Table X).

Although various plans have been proposed, they can basically be divided into two categories: the long-term rule-based faction and the short-term shelving faction. The long-term allocation is ideal and rule-based. It is finalized in one go and no more fussing. The typical representative is BIP101/103, which sets a growth rule and no longer adjusts. The short-term group believes that the future is unpredictable and fixed rules are too simple and violent to solve problems. They hope to set up a short-term and multi-year plan to avoid it for the time being and put it on hold until the future. The representative is BIP100. However, due to the complexity of the voting process, it was later simplified to BIP102/ 109 and so on, while BIP248 has been postponed to 2020, and has simply doubled in recent years.

Since June 2015, after more than half a year of extensive and repeated discussions, the long-term rule-based faction has basically been completely defeated. After Pieter Wuille proposed Segregated Witness at the Bitcoin Hong Kong Scaling Conference in December 2015, the scaling issue has even been simplified to only an upgrade to 2MB, but it has been mired in debate about the implementation time.

A seemingly simple expansion technical issue has caused the Bitcoin community to spend more than half a year, hold several global technical conferences, and engage in countless private wars of words, but there is still no clear conclusion. The profound reason behind this is that raising the block limit value cannot truly solve the Bitcoin expansion problem. Scaling issue

In general, based on the understanding of the Bitcoin network, there are two divisions: clearing system and cash system.

Clearing system

The Bitcoin blockchain is a global, distributed, limited-capacity, expensive system. The value content of each transaction is different. When the block capacity is not enough, we should ensure that high-value transactions enter the block. High-value transactions have the willingness and ability to pay high enough network fees to obtain blocks with high enough priority.

As Bitcoin prospers, the number of transactions will become larger and larger, and the limited block capacity will make low-value transactionsTransactions (such as sending 1 cent) can never be entered into blocks, because low-value transactions cannot pay high network fees. Then the network degenerated into a clearing system, low-value transactions were driven out, and these transactions were replaced by third-party accounting systems.

Before the emergence of the Lightning Network, third-party accounting systems were mainly off-chain wallet providers. Users trust a third-party wallet platform and deposit Bitcoins into it. Transfers between users on the same platform only bring about changes in account balances and do not generate Bitcoin transactions.

Cash system

The cash system means that all transactions should enter the block. When the block capacity is not enough, the block size limit should be increased in time to expand the system. Transaction blocking may occur in the short term, but in the long run all transactions should be able to be added to the block. Everyone enjoys the tremendous convenience and advantages brought by the Bitcoin system.

『Wu』Is the blockchain a lie?

"Blockchain" is an important concept in the new era. In essence, it is a Centralized databases are also the underlying technologies such as digital currencies. According to our popular explanation, the "blockchain" can be regarded as a ledger, and each bill is a block. However, this ledger is centralized, and it can be said that no company or team has jurisdiction over it. "Blockchain" technology is a unique informatization that is centralized and cannot cross-change information. Now in daily life, this technology has been applied to a series of applications such as electronic invoices and payment codes.
In today's life, many people use this guise to commit fraud. Direct sales disks, capital disks, technology disks and other names are used to lure people to make money and then run away. As a result, many people have lost their funds and have nowhere to defend their rights. In the end, I can only say that "blockchain" is a lie. There is no right or wrong in technology, it’s the people who are wrong.
With the progress of the times and the progress of society, the initial application of any technology will be subject to various positive and negative doubts. However, with the relative application and maturity of technology, coupled with the improvement of technology, various aspects around people have formed. This application will continue to improve, and I believe that these doubts will slowly dissipate in the near future.
The following is a summary of some blockchain scams that are often around you!
Trap 1: Blockchain is about issuing coins to make money
Trap 2: Conducting virtual currency transactions, promising low investment and high returns
Trap 3: Decentralization can solve all problems
Trap 4: With the extension of the blockchain, you can make money with a mining machine
Trap 5: Transactions on WeChat and Alipay to buy and sell virtual currencies
In short, the methods of scammers are also advancing with the times. Through our "eyes of wisdom", we can improve and enhance our adaptability, discover and alert ourselves, and prevent being deceived. Investors must be wary of various deceptive methods that offer low investment and high returns.

『Lu』 Is blockchain a scam?

Blockchain technology itself is not a scam, but it does not rule out that some people use blockchain as a cover to commit scams. How many blockchains exist?Questions: 1. The problem of excessive blockchain size. With the development of blockchain, the volume of blockchain data stored by nodes will become larger and larger, and the storage and computing burden will become heavier and heavier. Taking the Bitcoin blockchain as an example, the size of its complete data currently reaches about 71GB. If a user uses the Bitcoin Core client to synchronize data, it may not be possible to complete the synchronization for three days and three nights. Moreover, the data of the blockchain The volume is still increasing, which brings a great threshold to the operation of the Bitcoin Core client. 2. The problem of blockchain data confirmation time. The current blockchain system, especially the financial blockchain system, has the problem of long data confirmation time. Taking the Bitcoin blockchain as an example, the current confirmation time of a Bitcoin transaction takes about 10 minutes. In the case of 6 confirmations, you need to wait for about 1 hour. Of course, for credit card transactions, the confirmation time is 2 to 3 days. Bitcoin has made great progress, but it is still far away from the ideal state. 3. Dealing with the problem of transaction frequency The blockchain system faces the problem of too low transaction frequency. Qianyu Taking the Bitcoin blockchain as an example, the average size of each transaction is about 250 bytes. If the block size is limited to 1MB, the number of transactions that can be accommodated is 4,000. Calculated based on the rate of generating one block every 10 minutes, 144 blocks can be generated every day, which can accommodate 576,000 transactions. Divided by the number of seconds per day, 86,400, the Bitcoin blockchain can process a maximum of 6.67 transactions per second. Currently, the actual daily transaction volume on the Bitcoin blockchain is close to the system bottleneck (picture). If the expansion problem is not resolved, it may cause congestion and delays in a large number of transactions. Average number of transactions per Bitcoin block (Source: Block Yuan) In comparison, Paypal’s overall number of transactions in the third quarter of 2013 was 729 million, averaging 93.75 transactions per second. Information from the official website of VISA, the world's largest payment card, shows that VisaNet achieved a processing capacity of 47,000 transactions per second in a 2013 test. Compared with several major payment networks such as Alipay, the Bitcoin blockchain is more like a newborn baby in terms of transaction processing frequency. Of course, this was also an early deliberate design by Satoshi Nakamoto. The Bitcoin block size was limited to 1MB to avoid the malicious behavior of rogue miners and have a negative impact on people. The reason why the Bitcoin blockchain payment network The reason why it has grown to be worth billions of dollars today lies in its decentralization. 4. The development of blockchain is restricted by the current system. On the one hand, the decentralized and autonomous characteristics of blockchain dilute the concept of national supervision and have an impact on the current system. For example, digital currencies represented by Bitcoin not only pose a challenge to the country's right to issue currency, but also affect the transmission effect of monetary policy, weakening the central bank's ability to regulate the economy, causing monetary authorities to remain cautious about the development of digital currencies. On the other hand, regulatory authorities also lack full understanding and expectations of this new technology, and the establishment of laws and systems may lag behind, resulting inEconomic activities related to the use of blockchain lack necessary institutional regulations and legal protection, which virtually increases the risks of market entities. 5. The integration cost of blockchain technology and existing systems is relatively high. For any innovation, existing institutions must ensure that it can not only create economic benefits, but also comply with regulatory requirements and connect with traditional infrastructure. Especially when deploying a new basic system, the cost of time, manpower, and material resources is very large, and the resistance encountered within existing traditional organizations is also not small. Of course, the existence of problems cannot hinder the development of blockchain. The proposal and in-depth research of technologies such as simple payment verification, side chain, and lightning network protocols have provided ideas for solving the above problems.

『撒』 A brief discussion on the accumulation of blockchain storage and traffic technology - the era of real WEB3 is coming

What breakthroughs and advances in storage and traffic technology have modern society made? Let’s briefly summarize it for you.

The current Internet is all about centralized traffic and storage. With the development of the world, the bt network was born. The bt network is a distributed storage and traffic system. But it also has its limitations. First, the bt network can only transfer and share single files. Second, the bt network does not have an incentive mechanism. To put it simply, everyone joins the bt network, but there is no willingness to actively save or distribute files, because this is not beneficial to the participants.

With the exposure of bt network flaws, IPFS was born. That is, the IPFS system developed by the Filecoin project party’s protocol laboratory. IPFS is an upgraded version of the bt network. It adds a folder system based on the bt network. In the IPFS system, folders can be transferred and shared directly. Others can also browse related data, files, etc. directly from the folder.

But IPFS, like the bt network, has several problems. First: There is no incentive system. Second: In the early stage of file transmission, because there are very few nodes to store files, the efficiency is very low. For example, if A uploads a file and B needs to retrieve it, it can only retrieve it from A. Therefore, the efficiency is very low. If C wants to retrieve, it can only retrieve from the two nodes A and B. If both A and B are shut down, the files will not be retrieved. This is the problem with IPFS and BitTorrent networks. Their initial transmission efficiency is extremely low. Only when files are retrieved countless times and widely distributed among nodes, the transmission speed will become very fast. So the bt network and IPFS system are both a process from slow to fast. If you retrieve a file that is distributed less among nodes, the retrieval capability is very weak and the transmission speed is also very slow. In order to solve this incentive mechanism problem, Protocol Labs developed the Filecoin supply chain.

Filecoin and IPFS are two concepts. Filecoin actually combines the realIPFS moves to the blockchain. The characteristic of blockchain is decentralization, and nodes do not trust each other. Data transmitted between nodes must be re-checked. This results in very poor performance of the blockchain. After IPFS was put on the chain, Filecoin was formed. Therefore, Filecoin is also subject to the impact of blockchain performance, resulting in the inability to match valid data and the inability to perform efficient retrieval. Filecoin realizes the storage of data on the blockchain, which is a very significant contribution. Subsequently, SWARM and BZZ appeared, but BZZ has no block incentive mechanism and only has a traffic settlement system, which currently seems to be a failure. However, BZZ has also made certain improvements compared to IPFS and Filecoin: a set of active distribution mechanisms. For example: when I upload a video, the video will be actively distributed by the node. The video will be quickly cached to multiple nodes. Therefore, BZZ has made outstanding contributions in traffic settlement and efficient retrieval. Although it left behind technical contributions, it remained a failed project.

From the current point of view, most of the problems in traffic and storage have been solved in the blockchain field. The second is the issue of blockchain performance. After years of evolution, Layer0, Layer1, and Layer2 have also undergone continuous experiments. In recent years, research in the field of Layer 1 has achieved a lot of results and patents. I believe that breakthroughs in high-performance public chains will appear soon.

Therefore, if you want to build a blockchain network that is truly similar to web3, you should achieve breakthroughs in three aspects: First: efficient retrieval. Second: Incentivize storage and traffic separately. The third is that there must be an authorized access system. The authorized access system is similar to when people watch video websites and need to pay to obtain data. In the traditional Internet world, there are many monetization channels. The Internet world of blockchain has just taken shape. Therefore, ecological builders can directly obtain certain benefits. Only in this way can the prosperity of the ecosystem be promoted, and the builders of the ecosystem can continue to contribute more useful applications. Finally, the breakthrough of high-performance public chains is also an indispensable part. Therefore, with the above four conditions, web3 is getting closer and closer to us.

This content is authorized by the original teacher Zeng Bo and may not be modified or reproduced without permission

『8』What should I do if the blockchain information is getting larger and larger

< p>The increase in blockchain network information will inevitably require expansion, but it is not limited to BTC as a public chain. No matter which public chain develops to a certain stage, it needs expansion technology to support the network. Therefore, it can be said that expansion is the key to blockchain. A necessary link for the implementation of the plan.
Blockchain expansion is a general trend, but there are differences in specific operations. The industry has proposed multiple expansion solutions for different levels of the blockchain architecture: First, optimize the data transmission protocol for the bottom layer of blockchain data. , does not change the areaThe upper-layer architecture of the blockchain improves scalability, such as the blockchain layer 0 expansion plan Bloxroute; the second is for the basic blockchain protocol, changing the data structure and consensus algorithm to improve scalability, such as DAG (Directed Acyclic Graph), Sharding, DPOS algorithm, etc.; the third is for the application level, such as side chains, sub-chains, state channel-Lightning Network and other solutions, to transfer some on-chain transactions to off-chain execution to reduce on-chain processing pressure and improve overall efficiency.

『九』 What to do if the blockchain information is getting bigger and bigger

Honestly, there is no way. Ethereum will exceed 2T, and even if it only synchronizes some blocks, it will take 20g. And now they are all blocked and dissatisfied, and they will inevitably collapse