java - How to understand event timeline in spark? -
im trying investigate performance problem in our spark application. each of executors configured have 5 cores. here saw in stage details on event timeline:
the question 1 one of green rectangles lower/higher one? mean?
judging event timeline... in spite of each executors have 5 cores, of time 1 task ran in parallel. spark properties:
spark.driver.memory 4g spark.executor.instances 48 spark.executor.cores 5
Comments
Post a Comment