AWS Introduces S3 Files, Bringing File System Access to S3 Buckets

2026-04-16 · Source: InfoQ · Field: Technology & Digital — Cloud Computing & IT Infrastructure, Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Intermediate, short

Summary

AWS introduced S3 Files on April 16, 2026, enabling users to mount an Amazon S3 bucket and access its data via a standard file system interface. This service automatically translates standard file operations into S3 requests, allowing compute services to interact directly with S3 data. S3 Files utilizes Amazon EFS under the hood, providing approximately 1ms latencies for active data and supporting concurrent access from multiple compute resources with NFS close-to-open consistency. It features intelligent prefetching and allows customers to control data storage on the file system, including loading full file data or only metadata. Changes are aggregated and committed back to S3 roughly every 60 seconds, with S3 acting as the source of truth in conflict scenarios. Data not accessed in 30 days is evicted from the file system view but remains in S3.

Key takeaway

For AI Architects and ML Engineers building data pipelines or agentic AI systems, S3 Files simplifies data access to large S3 datasets by providing a familiar file system interface. This eliminates the need for complex object storage integrations, potentially accelerating development and improving performance for shared, mutable workloads. Be mindful of the EFS-based pricing model, which applies to the active data set, and plan for mandatory S3 versioning.

Key insights

S3 Files provides high-performance, file system access to S3 buckets, translating file operations to object storage.

Principles

• S3 is the source of truth for data conflicts.
• Evict inactive data to optimize storage costs.

Method

Mount an S3 bucket, perform standard file operations; S3 Files translates these to S3 requests, caching active data on EFS for low latency.

In practice

• Use for analytics and ML workloads.
• Optimize access patterns via metadata-only loading.

Topics

• AWS S3 Files
• Amazon S3
• File System Access
• Amazon EFS
• Object Storage

Best for: AI Architect, CTO, VP of Engineering/Data, AI Engineer, Data Engineer, MLOps Engineer

Related on AIssential

• Stop Overpaying for S3 Sync Pipelines! Welcome to Amazon S3 Files — Amazon S3 Files allows direct S3 bucket mounting, simplifying data access and reducing storage costs.
• Twenty years in, Amazon S3 finds itself at the center of AWS’ push beyond storage — Amazon S3 has evolved into a foundational data substrate for AI and analytics, moving beyond basic object storage.
• datasette-files-s3 0.1a1 — datasette-files-s3 0.1a1 adds S3 storage with dynamic, time-limited IAM credential fetching.
• Introducing Storage Buckets — Hugging Face Storage Buckets provide affordable, deduplicated, and CDN-enabled storage for AI workflows.
• The Invisible Layer: Why the success of your data pipeline starts in the File System — Understanding file systems is crucial for optimizing data pipelines and diagnosing performance issues in data engineering.
• Unfreezing The Data Lake: The Future-Proof File Format — F3 is a future-proof file format using flexible layouts and embedded WebAssembly for efficient, extensible data handling.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by InfoQ.