Skip to content

Latest commit

 

History

History
149 lines (112 loc) · 5.65 KB

README.md

File metadata and controls

149 lines (112 loc) · 5.65 KB
Raw

Description

This module creates a Toolkit runner that will install HTCondor on RedHat 7 or 8 and its derivative operating systems. These include the CentOS 7 and Rocky Linux 8 releases of the HPC VM Image. It may also function on RedHat 9 and derivatives, however it is not yet supported. Please report any issues on these 3 distributions or open a discussion to request support on Debian or Ubuntu distributions.

It also exports a list of Google Cloud APIs which must be enabled prior to provisioning an HTCondor Pool.

It is expected to be used with the htcondor-setup and htcondor-execute-point modules.

Example

The following code snippet uses this module to create startup scripts that install the HTCondor software into a custom VM image.

deployment_groups:
- group: primary
  modules:
  - id: network1
    source: modules/network/vpc
    outputs:
    - network_name

  - id: htcondor_install
    source: community/modules/scripts/htcondor-install

  - id: htcondor_install_script
    source: modules/scripts/startup-script
    use:
    - htcondor_install

- group: packer
  modules:
  - id: custom-image
    source: modules/packer/custom-image
    kind: packer
    use:
    - network1
    - htcondor_install_script
    settings:
      disk_size: 50
      source_image_family: hpc-rocky-linux-8
      image_family: "htcondor-10x"

A full example can be found in the examples README.

Important note

All POSIX users and HTCondor jobs can act as the service account attached to VMs within the pool. This enables the use of IAM restrictions via service accounts but also allows users to access services to which system daemons need access (e.g. to create Cloud Logging entries). If this is undesirable, one can restrict access to the instance metadata server to the root and condor users. This will allow system services to use the service account, but not other POSIX users or HTCondor jobs. The firewall example below is appropriate for CentOS 7.

firewall-cmd --direct --permanent --add-rule ipv4 filter OUTPUT_direct 1 \
    -m owner --uid-owner root -p tcp -d metadata.google.internal --dport 80 -j ACCEPT
firewall-cmd --direct --permanent --add-rule ipv4 filter OUTPUT_direct 2 \
    -m owner --uid-owner condor -p tcp -d metadata.google.internal --dport 80 -j ACCEPT
firewall-cmd --direct --permanent --add-rule ipv4 filter OUTPUT_direct 3 \
    -p tcp -d metadata.google.internal --dport 80 -j DROP
firewall-cmd --direct --permanent --add-rule ipv4 filter OUTPUT_direct 4 \
    -p tcp -d metadata.google.internal --dport 8080 -j DROP
firewall-cmd --permanent --zone=public --add-port=9618/tcp
firewall-cmd --reload

Support

HTCondor is maintained by the Center for High Throughput Computing at the University of Wisconsin-Madison. Support for HTCondor is available via:

License

Copyright 2022 Google LLC

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

 http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Requirements

Name Version
terraform >= 0.13.0

Providers

No providers.

Modules

No modules.

Resources

No resources.

Inputs

Name Description Type Default Required
condor_version Yum/DNF-compatible version string; leave unset to use latest 23.0 LTS release (examples: "23.0.0","23.*")) string "23.*" no
enable_docker Install and enable docker daemon alongside HTCondor bool true no
http_proxy Set system default web (http and https) proxy for Windows HTCondor installation string "" no
python_windows_installer_url URL of Python installer for Windows string "https://www.python.org/ftp/python/3.11.9/python-3.11.9-amd64.exe" no

Outputs

Name Description
gcp_service_list Google Cloud APIs required by HTCondor
runners Runner to install HTCondor using startup-scripts
windows_startup_ps1 Windows PowerShell script to install HTCondor