kd.evals

Contents

kd.evals#

[[Source]]

Evaluator.

Symbols#

Class#

kd.evals.CollectionKeys

Names of the metrics/summaries/losses (displayed in flatboard).

kd.evals.Evaluator

Evaluator running num_batches times.

kd.evals.EvaluatorBase

Base class for inline evaluators.

kd.evals.EveryNSteps

Run eval every N train steps.

kd.evals.FewShotEvaluator

FewShotEvaluator running closed-form few-shot classification.

kd.evals.Once

Run eval only after the XX train steps.

kd.evals.RunStrategy

Base class for info on how to run the evaluation.

kd.evals.StandaloneEveryCheckpoint

Run eval continuously everytime a new checkpoint is found.

kd.evals.StandaloneLastCheckpoint

Run eval only after the last checkpoint, after train has completed.