Skip to content

Commit 5cb26ea

Browse files
authored
Fix/docs apply spark job (#715)
* Updating spark job version and DAG syntax * Updating more dags for airflow3
1 parent 0fe8b3a commit 5cb26ea

File tree

4 files changed

+4
-4
lines changed

4 files changed

+4
-4
lines changed

docs/modules/airflow/examples/example-configmap.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ data:
1212
1313
with DAG(
1414
dag_id='test_airflow_dag',
15-
schedule_interval='0 0 * * *',
15+
schedule='0 0 * * *',
1616
start_date=datetime(2021, 1, 1),
1717
catchup=False,
1818
dagrun_timeout=timedelta(minutes=60),

docs/modules/airflow/examples/example-pyspark-pi.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ metadata:
55
name: pyspark-pi
66
spec:
77
sparkImage:
8-
productVersion: 3.5.2
8+
productVersion: 3.5.7
99
mode: cluster
1010
mainApplicationFile: local:///stackable/spark/examples/src/main/python/pi.py
1111
executor:

docs/modules/airflow/examples/example-spark-dag.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@
2929

3030
with DAG( # <4>
3131
dag_id="sparkapp_dag",
32-
schedule_interval=None,
32+
schedule=None,
3333
start_date=datetime(2022, 1, 1),
3434
catchup=False,
3535
dagrun_timeout=timedelta(minutes=60),

examples/simple-airflow-cluster-dags-cmap.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ data:
2828
2929
with DAG(
3030
dag_id='test_airflow_dag',
31-
schedule_interval='0 0 * * *',
31+
schedule='0 0 * * *',
3232
start_date=datetime(2021, 1, 1),
3333
catchup=False,
3434
dagrun_timeout=timedelta(minutes=60),

0 commit comments

Comments
 (0)