Skip to content

Glue Job

Serverless ETL job (Spark / Python shell / Ray).

analytics
category
19
settings
2
inputs
1
outputs
SettingTypeRequiredDefault
Job nameTextYes—
DescriptionText——
Job type
Options: Spark ETL, Spark Streaming, Python shell, Ray
Choice—glueetl
Glue versionText—4.0
Worker type
Options: Standard, G.025X (0.25 DPU), G.1X, G.2X, G.4X, G.8X, Z.2X (Ray)
Choice—G.1X
WorkersNumber—2
Max capacity (DPUs, pythonshell)Number—1
Timeout (min)Number—2880
Max retriesNumber—0
Max concurrent runsNumber—1
IAM role ARNText——
Script S3 locationText——
Python versionText—3
Execution class
Options: Standard, Flex (lower cost)
Choice—STANDARD
Continuous loggingToggle—false
Job metrics enabledToggle—false
Job bookmarkToggle—false
Security configurationText——
TagsKey–value——
SocketDirectionAcceptsTerraform arg
TriggerInputany—
IAM roleInputaws.iam-rolerole_arn
TargetOutputany—