3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 770 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 1
Associated Job Ids:
770
DAG Visualization
digraph G { subgraph clusterstage_770 { label="Stage 770"; 3083 [labelType="html" label="SQLExecutionRDD [3083]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster8473 { label="MicroBatchScan"; 3080 [labelType="html" label="DataSourceRDD [3080]<br>start at KafkaDataFrameDataSource.scala:46"]; 3081 [labelType="html" label="MapPartitionsRDD [3081]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster8470 { label="WholeStageCodegen (1)"; 3082 [labelType="html" label="MapPartitionsRDD [3082]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster8474 { label="WholeStageCodegen (1)"; 3084 [labelType="html" label="MapPartitionsRDD [3084]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster8477 { label="mapPartitionsInternal"; 3085 [labelType="html" label="MapPartitionsRDD [3085]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 3080->3081; 3081->3082; 3082->3083; 3083->3084; 3084->3085; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time