Skip to content

schubergphilis/terraform-aws-mcaf-glue-job

Repository files navigation

terraform-aws-mcaf-glue-job

A Terraform module that creates a Glue job.

Requirements

Name Version
terraform >= 1.3
aws >= 4.0.0

Providers

Name Version
aws >= 4.0.0

Modules

Name Source Version
job_execution_role github.com/schubergphilis/terraform-aws-mcaf-role v0.4.0

Resources

Name Type
aws_cloudwatch_log_group.default resource
aws_glue_job.default resource
aws_glue_trigger.default resource

Inputs

Name Description Type Default Required
name The name of the Glue job string n/a yes
script_location Specifies the S3 path to the script that is executed by this job string n/a yes
tags A mapping of tags to assign to all resources map(string) n/a yes
command_name The name of the job command. Defaults to glueetl string "glueetl" no
connections A list with connections for this job list(string) [] no
continuous_logging Whether to enable continuous logging for this job
object({
enabled = optional(bool, true)
log_group_name = optional(string, null)
})
{
"enabled": true,
"log_group_name": null
}
no
default_arguments A map with default arguments for this job map(string) {} no
glue_version The Glue version to use string "4.0" no
kms_key_id The kms key id of the AWS KMS Customer Managed Key to be used to encrypt the log data string null no
log_retention_days The cloudwatch log group retention in days number 365 no
max_capacity The maximum number of data processing units that can be allocated number null no
max_retries The maximum number of times to retry a failing job number null no
number_of_workers The number of workers that are allocated when the job runs string null no
python_version The Python version (2, 3 or 3.9) being used to execute a Python shell job string "3" no
role_arn An optional Glue execution role string null no
role_policy A valid Glue IAM policy JSON document string null no
schedule A cron expression used to specify the schedule for the glue job string null no
schedule_active Whether the glue trigger should be active bool true no
security_configuration The name of the Security Configuration to be associated with the job string null no
timeout The job timeout in minutes number 2880 no
trigger_type The type ('ON_DEMAND' or 'SCHEDULED') of the trigger string null no
worker_type The type ('Standard' or 'G.1X' or 'G.2X') of predefined worker that is allocated when the job runs string null no

Outputs

Name Description
arn ARN of the Glue job
id The Glue job name