Challenge class
Methods
- def evaluate(self, agent: agent.Agent, num_episodes: typing.Optional[int] = None) -> typing.Dict[str, float]
- def local_evaluate(self, agent: agent.Agent, num_episodes: typing.Optional[int] = None) -> typing.Dict[str, float]
- def remote_evaluate(self, agent: agent.Agent, num_episodes: typing.Optional[int] = None)
- def submit(self, agent)
Special methods
- def __init__(self, eval_remote = False)
Method documentation
def habitat.
| Parameters | |
|---|---|
| agent | agent to be evaluated in environment. |
| num_episodes | count of number of episodes for which the evaluation should be run. |
| Returns | dict containing metrics tracked by environment. |