3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 999 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
80 ms
Locality Level Summary:
Process local: 1
Input Size / Records:
0.0 B / 9
Associated Job Ids:
999
DAG Visualization
digraph G { subgraph clusterstage_999 { label="Stage 999"; 3995 [labelType="html" label="SQLExecutionRDD [3995]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster10981 { label="MicroBatchScan"; 3992 [labelType="html" label="DataSourceRDD [3992]<br>start at KafkaDataFrameDataSource.scala:46"]; 3993 [labelType="html" label="MapPartitionsRDD [3993]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster10978 { label="WholeStageCodegen (1)"; 3994 [labelType="html" label="MapPartitionsRDD [3994]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster10992 { label="WholeStageCodegen (1)"; 3998 [labelType="html" label="MapPartitionsRDD [3998]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster10995 { label="mapPartitionsInternal"; 3999 [labelType="html" label="MapPartitionsRDD [3999]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 3992->3993; 3993->3994; 3994->3995; 3995->3998; 3998->3999; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time