1

On EMR I see that my job took 12 minutes to run - according to the Elapsed Time column. However, when I go to the Spark UI > Executors tab the Task Time (GC Time) shows 1 hr (4 s). I totalled up the times as well i could from the Event Timeline and its aprrox 12 minutes.

1 - What does the Task Time (GC Time) mean? I also see in the Spark UI > Jobs > Event Timeline that the job took 12 minutes to run.
2 - Does this affect the total time for the job to run in any way?

Improve this question
Related questions
2
How to get intranet uptime (availability reports) from datadog or newrelic?
2
Can we write an custom check for monitoring a process with Data Dog
2
Creating a datadog dashboard using REST API
Load 7 more related questions Show fewer related questions

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.