Skip to content

Introduction

This section goes into the details of various solution stacks for deploying popular applications. The pros and cons of each stack are also described so that the user can choose the stack that most closely matches the needs of their workload.

Nextflow on AWS

MM™ Cloud supports a wide range of stacks for Nextflow. Each stack has its own pros and cons. An overview of the stacks along with hints for choosing a suitable one for a specific use case are shown in the chart below. For detailed guides, please see the respective pages from the navigation menu.

Nextflow on AWS with EFS

Filesystems for workdir

Here is a comparison of the various files systems supported for the Nextflow workdir.

Filesystem Pros Cons Best For
S3FS ✅ POSIX-compatible
✅ Highly scalable
✅ Multi-AZ availability
✅ Low storage cost
✅ Minimal setup
❌ High throughput cost
❌ Eventual consistency
❌ Low reliability
🟢 Testing and development
JuiceFS ✅ POSIX-compatible
✅ Highly scalable
✅ Multi-AZ availability
✅ Caching capabilities
✅ S3 as backend
❌ Very high throughput cost
❌ Management overhead
❌ Very slow cleanup
🟢 Workloads involving very large files
EFS ✅ POSIX-compatible
✅ Auto-scaling
✅ High performance
✅ Moderate throughput cost
❌ Management overhead
❌ Zone in/out costs with multi-az deployments
🟢 Long running projects with variable I/O needs
FSX ✅ POSIX-compatible
✅ High performance
✅ Lowest per-TB use cost
❌ Good initial size estimate required
❌ Management overhead
❌ Zone in/out costs with multi-az deployments
🟢 I/O intensive workloads