Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release note for protecting the directory size overload #9186

Merged
merged 7 commits into from
Aug 21, 2024
Merged
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions source/releasenotes/2024-08-19-FS-directory-changes.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
---
title: "Preventing filesystem overload to ensure site stability"
published_date: "2024-09-19"
---
Starting September 19, 2024, the Pantheon platform will automatically reject file writes (beyond the 100k limit) that could push the filesystem beyond its capacity. This precaution helps avoid catastrophic failures, ensuring the site remains online and operational.
azharone marked this conversation as resolved.
Show resolved Hide resolved

<img width="999" alt="Screenshot 2024-08-19 at 3 32 29 PM" src="https://github.com/user-attachments/assets/f8d3c57f-d46e-44e3-83c1-6689037d0a4e">


When excessive files are written into a directory due to an owner or developer error, the site may lose access to the filesystem, resulting in a critical failure. Recovery from this issue is complex and often requires manual intervention from the Pantheon Support team. The recovery process can be time-consuming, sometimes taking hours or even days, and full restoration is not always guaranteed.

However, this situation is entirely preventable. By automatically rejecting file writes that exceed the 100k limit, the system prevents catastrophic failures and keeps the site stable.

Currently, Pantheon provides multiple alerts to customers when the directory size reaches various tolerance levels. You can find our recommendations in the [Pantheon docs](https://docs.pantheon.io/guides/filesystem/large-files#highly-populated-directories).

**Upcoming changes**

**Before:** Users could continue writing files to a directory indefinitely, though exceeding 100k files in a single directory would reduce performance and put the site at risk of complete and irreparable volume corruption.

**After:** Sites are permitted to store up to 100k files per directory. When a directory reaches 50k files due to export or backup activities, a warning will be displayed on the dashboard, and an email notification will be sent to the site owner (limited to one per seven days). The warning system functionality remains unchanged. If the file count in a directory exceeds 100k substantially, additional writes will be blocked to maintain system stability.
Loading