场内和场外的场景

Architecture

Master

Worker

Client Read

Local Network Speed

Under Storage Speed

Client Write

Under Storage Speed

Memory Speed

MetaData & Caching

Unified Namespace

S3 Under Storage -> Alluxio Namespace -> HDFS Under Storage

S3a://bucket/directory (mount) -> alluxio://master:port <- mount hdfs://namenode:port/

UFS metadata sync

Active UFS sync -> quiet period

Metastore Management

10亿个文件

metaOp

Cache store

CachingInodeStore

InodeCache

EdgeCache

ListingCache

Write /remove/load

Baking store

RocksInodeStore

inodeTable/Edge Table

Alluxio Storage

Mutiple-tier storage

MEM (memory)

SSD (solid state drives)

HDD( hard disk drives)

Caching

Block annotation policy => LRU?LRFU

Block aligning

Block promotion

### Presto + Alluxio 性能调优五大技巧 Spark + Alluxio 性能调优十大技巧