habitat.core.benchmark module

Implements evaluation of habitat.Agent inside habitat.Env. habitat.Benchmark creates a habitat.Env which is specified through the config_env parameter in constructor. The evaluation is task agnostic and is implemented through metrics defined for habitat.EmbodiedTask.

Classes

class Benchmark
Benchmark for evaluating agents in environments.