Angel - MemoryDataBlock - angel.task.estimize.sample.number

Posted 2020-12-25 suanec

angel.task.estimize.sample.number

val validData = new MemoryDataBlock[LabeledData](isVali)
trainData.resetReadIndex()
try {
  val validSample = (0 until isVali).map(i => validData.put(trainData.read()))
  validData.flush()
} catch {
  case e: Exception =>
    throw new AngelException("Create validData found Error.", e);
} finally {
  validData.clean()
}

• in

val validData = new MemoryDataBlock[LabeledData](isVali)

there has a angel config parameter to set the size of vList as a ArrayList

this.estimateSampleNumber = conf.getInt("angel.task.estimize.sample.number", 100);