for Windows File Server

The Windows’ AWS EFS,

for Lustre

Lustre (file system) - Wikipedia

  • Managed Lustre - Designed for HPC - LINUX Clients, supports (POSIX) permissions
  • Machine Learning, Big Data, Financial Modelling
  • 100’s GB/s throughput & sub millisecond latency
  • Deployment types - Persistent or Scratch
  • Scratch - Highly optimised for Short term no replication & fast, no HA.
  • Persistent - longer term, HA (in one AZ), self-healing, if whole AZ fail, bye bye data
  • Can be used with AWS Site-to-Site VPN or AWS Direct Connect (DX)

Data is stored on FS only when precessed (Lazy Loaded from AWS S3 Simple Storage Service), when not used it is stored on S3. Processed data can be backed up to S3 with hsm_archive and automatically on schedule Working with backups - FSx for Lustre