The number of connections to the project’s image server had become very large. To relieve pressure on the image server, I tried installing a Cache server using Varnish for image caching. It has been running stably and performing well since going live. Here is the installation document; feedback and discussion are welcome:
Installation Environment
Operating System: Cen …
While setting up a Varnish cache server environment today, I encountered an issue during installation. When running configure, the following error appeared:
configure: error: readline library not found
I had already installed the readline package on the system beforehand.
…
FastDFS is an open-source distributed file system designed for file management, offering features such as file storage, file synchronization, and file access (including file uploads and downloads). It addresses the challenges of high-capacity storage and load balancing, making it especially suitable for online services centered around files, such as photo-sharing websites, video …
Primary Configuration Files for MooseFS Components
master
Master Server
Metadata is stored in memory of the managing server and simultaneously is being saved on disk (as a periodically updated binary file and immediately upda …
1、Operations on the client machine will not affect the master under any circumstances.
If the client forcefully kills the mfsmount process using kill -9, you need to unmount first and then mount again. Otherwise, you will see the following error:
fuse: bad mount point `/usr/mfstest/': Transport endpoint is not connected …
Before we start the configuration, let’s go over the lab environment. I used 5 machines for local testing: one master, two chunkservers, and two clients. Also, disable the firewall to avoid affecting the test results: master:192.168.20.210chunkserver1:192.168.20.211chunkserver …
1. Install the Required Environment (Install Related Dependency Packages): CentOS as an Example
#yum -y install gcc gcc-c++ gcc-g77 ncurses-devel bison libaio-devel openssl-devel openssl
2. Download and Install keepalived
Create a folder and enter it
#mkdi …
I recently got acquainted with a distributed file system —— MooseFS. Previously I knew very little about distributed systems; I tended to keep distributed file systems and distributed databases at arm’s length, thinking they were far too complex and still a long way off for me. Urged on by several mentors, I used six machines to get some hands-on practice with MooseF…
Due to work, I previously tested the MooseFS distributed file system. Recently, while learning Hadoop, I noticed that MooseFS’s file system architecture is surprisingly similar to HDFS. The author of MooseFS must have referenced HDFS principles when developing the software!
Let’s start with a general overview …
I. Overview Characteristics of product images on mobile phones or websites like Taobao: (1) A large number of mobile users are online simultaneously, performing image operations such as upload, download, and read. (2) The number of files is huge, with sizes generally ranging from a few KB to dozens of KB. HDFS storage characteristics: (1) Streaming read access, mainly targeted at write-once …
