Skip to content

Commit

Permalink
Add tip to enter already existing job
Browse files Browse the repository at this point in the history
  • Loading branch information
gaardhus committed Dec 6, 2024
1 parent a79ba34 commit 502f137
Showing 1 changed file with 10 additions and 2 deletions.
12 changes: 10 additions & 2 deletions docs/server/usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -125,6 +125,7 @@ Also, the output of the job will be saved in a file with the name
```bash
tail -f slurm-<job-id>.out
```

!!! tip

You can specify an output directory for your slurm outputs in your slurm script by adding:
Expand All @@ -135,7 +136,7 @@ tail -f slurm-<job-id>.out

!!! note

Make sure that the directory exists before running `sbatch`
Make sure that the directory exists before running `sbatch`
Ie: `mkdir slurm`

And then see follow the output of the last running job by running:
Expand All @@ -157,7 +158,6 @@ tail -f slurm-<job-id>.out

Then just type `sfollow` to see the output of a slurm job and follow it in real time.


Get the node information:

```bash
Expand Down Expand Up @@ -203,6 +203,14 @@ resources. To prevent this, you can start a persistent session with [tmux](#pers

Check that you have access to the GPU by running

!!! tip

To run a new interactive shell session in an already running slurm job:

```bash
srun --jobid=<slurm-id> --pty /bin/bash -i
```

```bash
nvidia-smi
```
Expand Down

0 comments on commit 502f137

Please sign in to comment.