Category: Files

Distributed File System FastDFS

FastDFS is an open-source distributed file system designed for file management, offering features such as file storage, file synchronization, and file access (including file uploads and downloads). It addresses the challenges of high-capacity storage and load balancing, making it especially suitable for online services centered around files, such as photo-sharing websites, video …

MooseFS Role Usage Guide

Primary Configuration Files for MooseFS Components

master
Master Server
Metadata is stored in memory of the managing server and simultaneously is being saved on disk (as a periodically updated binary file and immediately upda …

MFS Disaster Testing and Recovery

1、Operations on the client machine will not affect the master under any circumstances.
If the client forcefully kills the mfsmount process using kill -9, you need to unmount first and then mount again. Otherwise, you will see the following error:
fuse: bad mount point `/usr/mfstest/': Transport endpoint is not connected …

Introduction to MooseFS

I recently got acquainted with a distributed file system —— MooseFS. Previously I knew very little about distributed systems; I tended to keep distributed file systems and distributed databases at arm’s length, thinking they were far too complex and still a long way off for me. Urged on by several mentors, I used six machines to get some hands-on practice with MooseF…

HDFS Small File Handling Solution Summary + Facebook (Haystack) + Taobao (TFS)

I. Overview Characteristics of product images on mobile phones or websites like Taobao: (1) A large number of mobile users are online simultaneously, performing image operations such as upload, download, and read. (2) The number of files is huge, with sizes generally ranging from a few KB to dozens of KB. HDFS storage characteristics: (1) Streaming read access, mainly targeted at write-once …

TFS: Taobao’s Self-Developed File System

Currently, domestically developed file systems in China are few and far between. Taobao has conducted effective exploration and practice in this area. The Taobao File System (TFS), as a distributed file system used internally by Taobao, is specially optimized for the random read/write access performance of massive small files, carrying Taobao’s main …