cli.shared.types.evaluation package

cli.shared.types.evaluation.evaluation module

class cli.shared.types.evaluation.evaluation.AdversarialEvaluationCliConfigType(evaluation_config: AdversarialEvaluationConfigType)

Bases: object

This dataclass is used to store the configuration of the evaluation CLI.

evaluation_config: AdversarialEvaluationConfigType

class cli.shared.types.evaluation.evaluation.AdversarialEvaluationConfigType(target_models: List[ModelWithConfigDict], attack: AttackWithNameConfigDict, evaluators: List[str])

Bases: object

This dataclass is used to store the configuration of the evaluation.

attack: AttackWithNameConfigDict

evaluators: List[str]

target_models: List[ModelWithConfigDict]

cli.shared.types.evaluation.testing module

class cli.shared.types.evaluation.testing.Testing(criterion: str, topk: int)

Bases: object

This dataclass is used to store the configuration of the testing.

criterion: str

topk: int

class cli.shared.types.evaluation.testing.TestingCliConfigType(model: ModelCliConfigType, dataset: DatasetCliConfigType, dataloader: DataLoaderCliConfigType, device: DeviceConfig, testing: Testing)

Bases: object

This dataclass is used to store the configuration of the testing CLI.

dataloader: DataLoaderCliConfigType

dataset: DatasetCliConfigType

device: DeviceConfig

model: ModelCliConfigType

testing: Testing