Code

add JobLogger to Spark#573

Code

Closed

shimingfei wants to merge 15 commits intomesos:mastermesos/spark:masterfrom shimingfei:masterCopy head branch name to clipboard

+419-16

Commits

Commits on Apr 18, 2013

• Create JobLogger.scala

  

  shimingfei

  committed
  75be4a4

  Copy full SHA for 75be4a4

• add generator information

  

  shimingfei

  committed
  f8ac7c4

  Copy full SHA for f8ac7c4

• add JobLogger and addInfo initialization

  

  shimingfei

  committed
  3c80ece

  Copy full SHA for 3c80ece

• Update SparkContext.scala

  

  shimingfei

  committed
  f7bef28

  Copy full SHA for f7bef28

• add getRDDGenerator function

  

  shimingfei

  committed
  de891e6

  Copy full SHA for de891e6

• Update DAGScheduler.scala

  

  shimingfei

  committed
  f14a706

  Copy full SHA for f14a706

• Update TaskScheduler.scala

  

  shimingfei

  committed
  cbf0031

  Copy full SHA for cbf0031

• Update LocalScheduler.scala

  

  shimingfei

  committed
  ce2d8e3

  Copy full SHA for ce2d8e3

• Update DAGScheduler.scala

  

  shimingfei

  committed
  859aed7

  Copy full SHA for 859aed7

• Update JobLogger.scala

  

  shimingfei

  committed
  1c7d721

  Copy full SHA for 1c7d721

Commits on Apr 28, 2013

• modify according to comments

  

  Mingfei

  committed
  04e2b0f

  Copy full SHA for 04e2b0f

Commits on May 15, 2013

• rewrite JobLogger and implement SparkListener

  

  Mingfei

  committed
  b599c4b

  Copy full SHA for b599c4b

Commits on May 21, 2013

• modify according to comments and add test case for joblogger

  

  Mingfei

  committed
  cb8037b

  Copy full SHA for cb8037b

• merge test case for joblogger to test("local metrics") in SparkListenerSuite

  

  Mingfei

  committed
  42f352f

  Copy full SHA for 42f352f

Commits on May 30, 2013

• modify according to comments and add unit test

  

  Mingfei

  committed
  157141c

  Copy full SHA for 157141c