-
Notifications
You must be signed in to change notification settings - Fork 20
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #405 from uvarc/staging
Staging
- Loading branch information
Showing
3 changed files
with
61 additions
and
0 deletions.
There are no files selected for viewing
14 changes: 14 additions & 0 deletions
14
content/post/.ipynb_checkpoints/2023-july-scratch-transfer-checkpoint.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
+++ | ||
images = [""] | ||
author = "Staff" | ||
description = "" | ||
date = "2023-07-18T00:00:00-05:00" | ||
title = "New Scratch System on Rivanna July 18, 2023" | ||
# url = "/maintenance" | ||
draft = false | ||
tags = ["rivanna"] | ||
categories = ["feature"] | ||
+++ | ||
|
||
During the July 18th maintenance, we installed a new `/scratch` file storage system on Rivanna. We have created sample scripts and instructions to help you transfer your files from the previous file system to the new one. These instructions are available [here](https://www.rc.virginia.edu/2023/07/rivanna-maintenance-july-18-2023/) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
{ | ||
"cells": [], | ||
"metadata": {}, | ||
"nbformat": 4, | ||
"nbformat_minor": 4 | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,41 @@ | ||
+++ | ||
images = [""] | ||
author = "Staff" | ||
description = "" | ||
date = "2023-07-18T00:00:00-05:00" | ||
title = "New Scratch System on Rivanna: July 18, 2023" | ||
# url = "/maintenance" | ||
draft = false | ||
tags = ["rivanna"] | ||
categories = ["feature"] | ||
+++ | ||
|
||
{{< alert-green >}}During the July 18th maintenance, RC engineers installed a new /scratch file storage system on Rivanna. We have created sample scripts and instructions to help you transfer your files from the previous file system to the new one.(Expand the link below for details.){{< /alert-green >}} | ||
|
||
|
||
|
||
|
||
**The current `/scratch` filesystem will be permanently retired on October 17, 2023 and all the data it contains will be deleted.** | ||
Users should clean up their current `/scratch` directory in preparation, to minimize the load. A sample script is posted below. | ||
|
||
## Transfer Instructions | ||
|
||
**Example script to copy files** | ||
|
||
{{< pull-code file="/static/scripts/demo-copy-scratch.slurm" lang="bash" >}} | ||
|
||
The script will also be available through the Open OnDemand Job Composer: | ||
|
||
1. Go to [Open OnDemand Job Composer](https://rivanna-portal.hpc.virginia.edu/pun/sys/dashboard/apps/show/myjobs) | ||
1. Click: New Job -> From Template | ||
1. Select `demo-copy-scratch` | ||
1. In the right panel, click "Create New Job" | ||
1. This will take you to the "Jobs" page. In the "Submit Script" panel at the bottom right, click "Open Editor" | ||
1. Enter your own allocation. You may edit the script as needed. Click "Save" when done. | ||
1. Going back to the "Jobs" page, select `demo-copy-scratch` and click the green "Submit" button. | ||
|
||
As we expect a high volume of data migration, please refrain from doing so directly on the login nodes but instead submit it as a job via the provided Slurm script as described above. | ||
|
||
The new scratch is subject to the same 10 TB quota and 90-day purge policy. There is no restriction on the number of files. A friendly reminder that scratch is intended as a temporary work directory, not long-term storage space. It is not backed up and old files need to be purged periodically for system stability. RC offers a number of low-cost storage options to researchers. For more information, visit our [storage page](/userinfo/storage). | ||
|
||
|