GraphSAGE#

In this notebook, we train a GraphSAGE model with different aggregation methods.

The SAGE layer is defined as :

\(X^l_u = \sigma (W^l \cdot \vert \vert (X^{l-1}_v, AGG(\{X^{l-1}_u, \forall u \in N(v)\})))\)

where \(\vert \vert\) is the concatenation operator and \(AGG\) is a custom aggregation function.

Specifically, we will try these for \(AGG\) :

  • SumAggregation, defined as \(A^l X^{l-1}\), with \(A^l\) the adjacency matrix and \(X^{l-1}\) the previous layer embedding

  • MeanAggregation, similar to GCN aside from the concatenation; where we normalize with the degree matrix, i.e. use \(D^{-1} A^l X^{l-1}\) where \(D\) is the degree matrix of \(A^l\).

  • SquareRootAggregation, same as above but we take the square root of the degree matrix \(D\).

  • LSTMAggregation, where we pass \(A^l X^{l-1}\) through an LSTM layer that takes the features dimension of \(X\) as input dimension and returns with the layer’s specified output dimension.

Training#

Hide code cell source
from os import environ
import warnings
from sys import path

environ["WANDB_NOTEBOOK_NAME"] = "SAGE.ipynb"  # set notebook name
warnings.filterwarnings(
    "ignore"
)  # ignore warnings from missing deterministic implementation
path.append("../code")
Hide code cell source
%load_ext autoreload
%autoreload 2
%matplotlib inline
Hide code cell source
import torch
from torch import nn
import numpy as np
import model as m
import training as t
import utils
import logging
import sys

from utils import LOG as logger

logging.basicConfig(
    format="%(message)s", level=logging.INFO, stream=sys.stdout
)
logger.setLevel(logging.INFO)
# logger.setLevel(logging.DEBUG)

t.WANDB_MODE = "disabled"

DEVICE = torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
dataloaders, dataset = t.create_dataloaders(batch_size=30)
Length of train set: 131
Length of validation set: 28
Length of test set: 29

Model#

node_features = dataset.node_features.shape[2]
conv_dims = [256, 256, 128, 64]
model = m.GraphSAGE(
    num_features=node_features,
    conv_dims=conv_dims,
    # fcn_layers=[128],
    activation=nn.SELU(),
    aggregation=m.LSTMAggregation(),
    dropout=0.2,
    pooling="max",
    norm=nn.BatchNorm1d,
)
# utils._print_gradient_hook(model)

print(model)
Initialized model with 4 graph conv layers
Initialized model with 1 fully connected layers
GraphSAGE(
  (convs_layers): ModuleList(
    (0): GraphSAGEConv(
      (weight): Linear(in_features=14, out_features=256, bias=False)
      (activation): SELU()
      (aggregation): LSTMAggregation(
        (lstm): LSTM(7, 7, batch_first=True)
      )
    )
    (1): GraphSAGEConv(
      (weight): Linear(in_features=512, out_features=256, bias=False)
      (activation): SELU()
      (aggregation): LSTMAggregation(
        (lstm): LSTM(256, 256, batch_first=True)
      )
    )
    (2): GraphSAGEConv(
      (weight): Linear(in_features=512, out_features=128, bias=False)
      (activation): SELU()
      (aggregation): LSTMAggregation(
        (lstm): LSTM(256, 256, batch_first=True)
      )
    )
    (3): GraphSAGEConv(
      (weight): Linear(in_features=256, out_features=64, bias=False)
      (activation): Identity()
      (aggregation): LSTMAggregation(
        (lstm): LSTM(128, 128, batch_first=True)
      )
    )
  )
  (batch_norms): ModuleList(
    (0-1): 2 x BatchNorm1d(256, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (2): BatchNorm1d(128, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
    (3): Identity()
  )
  (fcn_layers): ModuleList(
    (0): Linear(in_features=64, out_features=1, bias=True)
  )
  (dropout): Dropout(p=0.2, inplace=False)
  (pooling): MaxPooling()
)

Training parameters#

learning_rate = 1e-3
epochs = 1400

model.to(DEVICE)

label_counts = dataset.class_y.unique(return_counts=True)[1]
pos_weight = label_counts[0] / label_counts[1]


loss_fn = nn.BCEWithLogitsLoss(pos_weight=torch.tensor(pos_weight))
optimizer = torch.optim.Adam(model.parameters(), lr=learning_rate)

history = {
    "epoch": 0,
    "loss": [],
    "acc": [],
    "val-roc": [],
    "val-ap": [],
}

Train loop#

history = t.train_loop(
    history=history,
    train_dataloader=dataloaders[0],
    val_dataloader=dataloaders[1],
    model=model,
    optimizer=optimizer,
    loss_fn=loss_fn,
    epochs=epochs,
    device=DEVICE,
    use_scheduler=False,
    test_dataloader=dataloaders[2],
)
Watching
Epoch   1/1400:Epoch loss: 0.3882 - avg acc: 30.5% - val-roc: 0.9286 - val-ap: 0.9458 (0.3s/epoch)
Epoch   2/1400:Epoch loss: 0.3434 - avg acc: 30.5% - val-roc: 0.8878 - val-ap: 0.8939 (0.1s/epoch)
Epoch   3/1400:Epoch loss: 0.3085 - avg acc: 42.7% - val-roc: 0.9133 - val-ap: 0.9200 (0.1s/epoch)
Epoch   4/1400:Epoch loss: 0.2333 - avg acc: 90.8% - val-roc: 0.9184 - val-ap: 0.9239 (0.1s/epoch)
Epoch   5/1400:Epoch loss: 0.2223 - avg acc: 44.3% - val-roc: 0.7704 - val-ap: 0.7481 (0.1s/epoch)
Epoch   6/1400:Epoch loss: 0.2244 - avg acc: 33.6% - val-roc: 0.8622 - val-ap: 0.8669 (0.1s/epoch)
Epoch   7/1400:Epoch loss: 0.1718 - avg acc: 70.2% - val-roc: 0.8980 - val-ap: 0.8880 (0.1s/epoch)
Epoch   8/1400:Epoch loss: 0.2359 - avg acc: 71.8% - val-roc: 0.8878 - val-ap: 0.8753 (0.1s/epoch)
Epoch   9/1400:Epoch loss: 0.1723 - avg acc: 83.2% - val-roc: 0.8827 - val-ap: 0.8668 (0.1s/epoch)
Epoch  10/1400:Epoch loss: 0.1752 - avg acc: 64.9% - val-roc: 0.8418 - val-ap: 0.8384 (0.1s/epoch)
Epoch  11/1400:Epoch loss: 0.1950 - avg acc: 42.7% - val-roc: 0.7755 - val-ap: 0.7255 (0.1s/epoch)
Epoch  12/1400:Epoch loss: 0.1820 - avg acc: 68.7% - val-roc: 0.8418 - val-ap: 0.8457 (0.1s/epoch)
Epoch  13/1400:Epoch loss: 0.1996 - avg acc: 58.0% - val-roc: 0.7449 - val-ap: 0.7079 (0.1s/epoch)
Epoch  14/1400:Epoch loss: 0.1503 - avg acc: 86.3% - val-roc: 0.8265 - val-ap: 0.8184 (0.1s/epoch)
Epoch  15/1400:Epoch loss: 0.1953 - avg acc: 68.7% - val-roc: 0.7653 - val-ap: 0.7088 (0.1s/epoch)
Epoch  16/1400:Epoch loss: 0.2100 - avg acc: 57.3% - val-roc: 0.7755 - val-ap: 0.6850 (0.1s/epoch)
Epoch  17/1400:Epoch loss: 0.2200 - avg acc: 81.7% - val-roc: 0.8010 - val-ap: 0.6979 (0.1s/epoch)
Epoch  18/1400:Epoch loss: 0.1686 - avg acc: 70.2% - val-roc: 0.7602 - val-ap: 0.6772 (0.1s/epoch)
Epoch  19/1400:Epoch loss: 0.1535 - avg acc: 87.0% - val-roc: 0.7704 - val-ap: 0.6780 (0.1s/epoch)
Epoch  20/1400:Epoch loss: 0.2059 - avg acc: 85.5% - val-roc: 0.7602 - val-ap: 0.6727 (0.1s/epoch)
Epoch  21/1400:Epoch loss: 0.1357 - avg acc: 77.1% - val-roc: 0.7653 - val-ap: 0.6782 (0.1s/epoch)
Epoch  22/1400:Epoch loss: 0.1079 - avg acc: 84.7% - val-roc: 0.8010 - val-ap: 0.7554 (0.1s/epoch)
Epoch  23/1400:Epoch loss: 0.1035 - avg acc: 66.4% - val-roc: 0.7398 - val-ap: 0.6894 (0.1s/epoch)
Epoch  24/1400:Epoch loss: 0.2216 - avg acc: 36.6% - val-roc: 0.7347 - val-ap: 0.6414 (0.1s/epoch)
Epoch  25/1400:Epoch loss: 0.1529 - avg acc: 87.0% - val-roc: 0.8367 - val-ap: 0.7437 (0.1s/epoch)
Epoch  26/1400:Epoch loss: 0.1640 - avg acc: 51.9% - val-roc: 0.7296 - val-ap: 0.6459 (0.1s/epoch)
Epoch  27/1400:Epoch loss: 0.1763 - avg acc: 58.8% - val-roc: 0.7857 - val-ap: 0.6919 (0.1s/epoch)
Epoch  28/1400:Epoch loss: 0.1430 - avg acc: 83.2% - val-roc: 0.8316 - val-ap: 0.7458 (0.1s/epoch)
Epoch  29/1400:Epoch loss: 0.1615 - avg acc: 77.1% - val-roc: 0.8214 - val-ap: 0.7447 (0.1s/epoch)
Epoch  30/1400:Epoch loss: 0.1674 - avg acc: 77.9% - val-roc: 0.8316 - val-ap: 0.7881 (0.1s/epoch)
Epoch  31/1400:Epoch loss: 0.1432 - avg acc: 82.4% - val-roc: 0.8418 - val-ap: 0.8249 (0.1s/epoch)
Epoch  32/1400:Epoch loss: 0.1367 - avg acc: 89.3% - val-roc: 0.8520 - val-ap: 0.8253 (0.1s/epoch)
Epoch  33/1400:Epoch loss: 0.1033 - avg acc: 79.4% - val-roc: 0.8010 - val-ap: 0.7682 (0.1s/epoch)
Epoch  34/1400:Epoch loss: 0.1098 - avg acc: 87.0% - val-roc: 0.8010 - val-ap: 0.7475 (0.1s/epoch)
Epoch  35/1400:Epoch loss: 0.1076 - avg acc: 91.6% - val-roc: 0.8520 - val-ap: 0.7975 (0.1s/epoch)
Epoch  36/1400:Epoch loss: 0.1450 - avg acc: 84.7% - val-roc: 0.7806 - val-ap: 0.6852 (0.2s/epoch)
Epoch  37/1400:Epoch loss: 0.1637 - avg acc: 77.9% - val-roc: 0.7755 - val-ap: 0.6830 (0.1s/epoch)
Epoch  38/1400:Epoch loss: 0.1271 - avg acc: 86.3% - val-roc: 0.8469 - val-ap: 0.7426 (0.1s/epoch)
Epoch  39/1400:Epoch loss: 0.2064 - avg acc: 86.3% - val-roc: 0.8010 - val-ap: 0.6974 (0.1s/epoch)
Epoch  40/1400:Epoch loss: 0.1389 - avg acc: 86.3% - val-roc: 0.7908 - val-ap: 0.6912 (0.1s/epoch)
Epoch  41/1400:Epoch loss: 0.1274 - avg acc: 90.8% - val-roc: 0.7806 - val-ap: 0.6860 (0.1s/epoch)
Epoch  42/1400:Epoch loss: 0.1035 - avg acc: 88.5% - val-roc: 0.7653 - val-ap: 0.6782 (0.1s/epoch)
Epoch  43/1400:Epoch loss: 0.1056 - avg acc: 75.6% - val-roc: 0.7551 - val-ap: 0.6742 (0.1s/epoch)
Epoch  44/1400:Epoch loss: 0.0899 - avg acc: 90.8% - val-roc: 0.7857 - val-ap: 0.6880 (0.1s/epoch)
Epoch  45/1400:Epoch loss: 0.0790 - avg acc: 91.6% - val-roc: 0.7908 - val-ap: 0.6912 (0.1s/epoch)
Epoch  46/1400:Epoch loss: 0.1019 - avg acc: 77.9% - val-roc: 0.7398 - val-ap: 0.6687 (0.1s/epoch)
Epoch  47/1400:Epoch loss: 0.1051 - avg acc: 86.3% - val-roc: 0.7653 - val-ap: 0.6985 (0.2s/epoch)
Epoch  48/1400:Epoch loss: 0.0845 - avg acc: 90.1% - val-roc: 0.8367 - val-ap: 0.7764 (0.2s/epoch)
Epoch  49/1400:Epoch loss: 0.1059 - avg acc: 74.0% - val-roc: 0.7857 - val-ap: 0.7155 (0.1s/epoch)
Epoch  50/1400:Epoch loss: 0.0758 - avg acc: 87.8% - val-roc: 0.8112 - val-ap: 0.7100 (0.2s/epoch)
Epoch  51/1400:Epoch loss: 0.0844 - avg acc: 93.9% - val-roc: 0.8061 - val-ap: 0.7069 (0.1s/epoch)
Epoch  52/1400:Epoch loss: 0.0692 - avg acc: 87.8% - val-roc: 0.7857 - val-ap: 0.6979 (0.1s/epoch)
Epoch  53/1400:Epoch loss: 0.0822 - avg acc: 93.9% - val-roc: 0.8163 - val-ap: 0.7458 (0.1s/epoch)
Epoch  54/1400:Epoch loss: 0.0849 - avg acc: 87.0% - val-roc: 0.7959 - val-ap: 0.7112 (0.2s/epoch)
Epoch  55/1400:Epoch loss: 0.0864 - avg acc: 93.9% - val-roc: 0.7959 - val-ap: 0.7021 (0.1s/epoch)
Epoch  56/1400:Epoch loss: 0.0666 - avg acc: 86.3% - val-roc: 0.8469 - val-ap: 0.8259 (0.1s/epoch)
Epoch  57/1400:Epoch loss: 0.0754 - avg acc: 76.3% - val-roc: 0.8163 - val-ap: 0.8311 (0.1s/epoch)
Epoch  58/1400:Epoch loss: 0.0746 - avg acc: 90.1% - val-roc: 0.8316 - val-ap: 0.8252 (0.2s/epoch)
Epoch  59/1400:Epoch loss: 0.0646 - avg acc: 81.7% - val-roc: 0.8265 - val-ap: 0.7545 (0.1s/epoch)
Epoch  60/1400:Epoch loss: 0.0841 - avg acc: 88.5% - val-roc: 0.8112 - val-ap: 0.7278 (0.2s/epoch)
Epoch  61/1400:Epoch loss: 0.0703 - avg acc: 96.2% - val-roc: 0.8163 - val-ap: 0.7058 (0.2s/epoch)
Epoch  62/1400:Epoch loss: 0.0924 - avg acc: 78.6% - val-roc: 0.7857 - val-ap: 0.7491 (0.2s/epoch)
Epoch  63/1400:Epoch loss: 0.0853 - avg acc: 88.5% - val-roc: 0.7959 - val-ap: 0.7447 (0.1s/epoch)
Epoch  64/1400:Epoch loss: 0.0592 - avg acc: 96.9% - val-roc: 0.8112 - val-ap: 0.7132 (0.1s/epoch)
Epoch  65/1400:Epoch loss: 0.1169 - avg acc: 79.4% - val-roc: 0.7908 - val-ap: 0.7105 (0.1s/epoch)
Epoch  66/1400:Epoch loss: 0.0822 - avg acc: 95.4% - val-roc: 0.8163 - val-ap: 0.7035 (0.1s/epoch)
Epoch  67/1400:Epoch loss: 0.1072 - avg acc: 90.1% - val-roc: 0.8112 - val-ap: 0.7015 (0.1s/epoch)
Epoch  68/1400:Epoch loss: 0.0972 - avg acc: 82.4% - val-roc: 0.7704 - val-ap: 0.6768 (0.2s/epoch)
Epoch  69/1400:Epoch loss: 0.0535 - avg acc: 96.2% - val-roc: 0.8010 - val-ap: 0.6950 (0.2s/epoch)
Epoch  70/1400:Epoch loss: 0.0560 - avg acc: 79.4% - val-roc: 0.7755 - val-ap: 0.6832 (0.1s/epoch)
Epoch  71/1400:Epoch loss: 0.0638 - avg acc: 77.1% - val-roc: 0.8163 - val-ap: 0.7476 (0.1s/epoch)
Epoch  72/1400:Epoch loss: 0.0564 - avg acc: 95.4% - val-roc: 0.8520 - val-ap: 0.8056 (0.1s/epoch)
Epoch  73/1400:Epoch loss: 0.0620 - avg acc: 96.9% - val-roc: 0.8827 - val-ap: 0.8722 (0.1s/epoch)
Epoch  74/1400:Epoch loss: 0.0564 - avg acc: 89.3% - val-roc: 0.8622 - val-ap: 0.8541 (0.1s/epoch)
Epoch  75/1400:Epoch loss: 0.0549 - avg acc: 96.9% - val-roc: 0.8776 - val-ap: 0.8274 (0.1s/epoch)
Epoch  76/1400:Epoch loss: 0.0364 - avg acc: 95.4% - val-roc: 0.8776 - val-ap: 0.7923 (0.1s/epoch)
Epoch  77/1400:Epoch loss: 0.0792 - avg acc: 76.3% - val-roc: 0.8163 - val-ap: 0.7491 (0.2s/epoch)
Epoch  78/1400:Epoch loss: 0.1375 - avg acc: 71.0% - val-roc: 0.7806 - val-ap: 0.7260 (0.2s/epoch)
Epoch  79/1400:Epoch loss: 0.0813 - avg acc: 95.4% - val-roc: 0.8010 - val-ap: 0.6950 (0.1s/epoch)
Epoch  80/1400:Epoch loss: 0.0796 - avg acc: 95.4% - val-roc: 0.7755 - val-ap: 0.6992 (0.1s/epoch)
Epoch  81/1400:Epoch loss: 0.0413 - avg acc: 82.4% - val-roc: 0.6939 - val-ap: 0.6619 (0.1s/epoch)
Epoch  82/1400:Epoch loss: 0.0571 - avg acc: 95.4% - val-roc: 0.7347 - val-ap: 0.6672 (0.2s/epoch)
Epoch  83/1400:Epoch loss: 0.0632 - avg acc: 96.9% - val-roc: 0.7704 - val-ap: 0.6849 (0.1s/epoch)
Epoch  84/1400:Epoch loss: 0.0602 - avg acc: 96.2% - val-roc: 0.7806 - val-ap: 0.6902 (0.2s/epoch)
Epoch  85/1400:Epoch loss: 0.0479 - avg acc: 95.4% - val-roc: 0.7704 - val-ap: 0.6814 (0.1s/epoch)
Epoch  86/1400:Epoch loss: 0.0348 - avg acc: 95.4% - val-roc: 0.7704 - val-ap: 0.6814 (0.1s/epoch)
Epoch  87/1400:Epoch loss: 0.0189 - avg acc: 93.9% - val-roc: 0.7755 - val-ap: 0.7027 (0.1s/epoch)
Epoch  88/1400:Epoch loss: 0.0315 - avg acc: 96.2% - val-roc: 0.8061 - val-ap: 0.7374 (0.1s/epoch)
Epoch  89/1400:Epoch loss: 0.0400 - avg acc: 90.8% - val-roc: 0.8163 - val-ap: 0.7618 (0.1s/epoch)
Epoch  90/1400:Epoch loss: 0.0306 - avg acc: 88.5% - val-roc: 0.8010 - val-ap: 0.7558 (0.1s/epoch)
Epoch  91/1400:Epoch loss: 0.0327 - avg acc: 91.6% - val-roc: 0.8214 - val-ap: 0.7671 (0.1s/epoch)
Epoch  92/1400:Epoch loss: 0.0223 - avg acc: 97.7% - val-roc: 0.7908 - val-ap: 0.7339 (0.1s/epoch)
Epoch  93/1400:Epoch loss: 0.0824 - avg acc: 79.4% - val-roc: 0.7449 - val-ap: 0.6944 (0.2s/epoch)
Epoch  94/1400:Epoch loss: 0.1421 - avg acc: 52.7% - val-roc: 0.7041 - val-ap: 0.6348 (0.1s/epoch)
Epoch  95/1400:Epoch loss: 0.1069 - avg acc: 79.4% - val-roc: 0.8469 - val-ap: 0.7727 (0.2s/epoch)
Epoch  96/1400:Epoch loss: 0.0991 - avg acc: 96.2% - val-roc: 0.9082 - val-ap: 0.9073 (0.1s/epoch)
Epoch  97/1400:Epoch loss: 0.0499 - avg acc: 89.3% - val-roc: 0.8571 - val-ap: 0.8376 (0.1s/epoch)
Epoch  98/1400:Epoch loss: 0.0454 - avg acc: 80.2% - val-roc: 0.8010 - val-ap: 0.7555 (0.2s/epoch)
Epoch  99/1400:Epoch loss: 0.0493 - avg acc: 94.7% - val-roc: 0.8622 - val-ap: 0.8406 (0.1s/epoch)
Epoch  100/1400:Epoch loss: 0.0434 - avg acc: 96.9% - val-roc: 0.8520 - val-ap: 0.8260 (0.1s/epoch)
Epoch  101/1400:Epoch loss: 0.0947 - avg acc: 96.9% - val-roc: 0.8520 - val-ap: 0.8419 (0.1s/epoch)
Epoch  102/1400:Epoch loss: 0.0424 - avg acc: 85.5% - val-roc: 0.8316 - val-ap: 0.8204 (0.1s/epoch)
Epoch  103/1400:Epoch loss: 0.0720 - avg acc: 93.1% - val-roc: 0.8265 - val-ap: 0.7527 (0.2s/epoch)
Epoch  104/1400:Epoch loss: 0.0546 - avg acc: 97.7% - val-roc: 0.8163 - val-ap: 0.7476 (0.1s/epoch)
Epoch  105/1400:Epoch loss: 0.1072 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7851 (0.1s/epoch)
Epoch  106/1400:Epoch loss: 0.0520 - avg acc: 93.1% - val-roc: 0.8724 - val-ap: 0.8795 (0.1s/epoch)
Epoch  107/1400:Epoch loss: 0.0734 - avg acc: 95.4% - val-roc: 0.8724 - val-ap: 0.8795 (0.2s/epoch)
Epoch  108/1400:Epoch loss: 0.0420 - avg acc: 96.9% - val-roc: 0.8316 - val-ap: 0.8051 (0.2s/epoch)
Epoch  109/1400:Epoch loss: 0.0550 - avg acc: 94.7% - val-roc: 0.7959 - val-ap: 0.7488 (0.1s/epoch)
Epoch  110/1400:Epoch loss: 0.0321 - avg acc: 96.2% - val-roc: 0.7959 - val-ap: 0.7488 (0.1s/epoch)
Epoch  111/1400:Epoch loss: 0.0442 - avg acc: 96.2% - val-roc: 0.8010 - val-ap: 0.7738 (0.1s/epoch)
Epoch  112/1400:Epoch loss: 0.0521 - avg acc: 96.9% - val-roc: 0.8112 - val-ap: 0.7884 (0.1s/epoch)
Epoch  113/1400:Epoch loss: 0.1028 - avg acc: 75.6% - val-roc: 0.7347 - val-ap: 0.6924 (0.2s/epoch)
Epoch  114/1400:Epoch loss: 0.0889 - avg acc: 81.7% - val-roc: 0.8010 - val-ap: 0.7730 (0.1s/epoch)
Epoch  115/1400:Epoch loss: 0.0305 - avg acc: 95.4% - val-roc: 0.8418 - val-ap: 0.8376 (0.1s/epoch)
Epoch  116/1400:Epoch loss: 0.0437 - avg acc: 95.4% - val-roc: 0.8214 - val-ap: 0.8115 (0.1s/epoch)
Epoch  117/1400:Epoch loss: 0.0642 - avg acc: 92.4% - val-roc: 0.7908 - val-ap: 0.7658 (0.1s/epoch)
Epoch  118/1400:Epoch loss: 0.0958 - avg acc: 91.6% - val-roc: 0.7857 - val-ap: 0.7570 (0.1s/epoch)
Epoch  119/1400:Epoch loss: 0.0689 - avg acc: 80.9% - val-roc: 0.7653 - val-ap: 0.6730 (0.1s/epoch)
Epoch  120/1400:Epoch loss: 0.1072 - avg acc: 93.9% - val-roc: 0.7908 - val-ap: 0.7036 (0.1s/epoch)
Epoch  121/1400:Epoch loss: 0.0547 - avg acc: 96.2% - val-roc: 0.8112 - val-ap: 0.7254 (0.2s/epoch)
Epoch  122/1400:Epoch loss: 0.0762 - avg acc: 95.4% - val-roc: 0.7857 - val-ap: 0.7021 (0.1s/epoch)
Epoch  123/1400:Epoch loss: 0.0735 - avg acc: 61.8% - val-roc: 0.7143 - val-ap: 0.6469 (0.1s/epoch)
Epoch  124/1400:Epoch loss: 0.0815 - avg acc: 82.4% - val-roc: 0.7449 - val-ap: 0.6706 (0.1s/epoch)
Epoch  125/1400:Epoch loss: 0.0784 - avg acc: 89.3% - val-roc: 0.7296 - val-ap: 0.6762 (0.1s/epoch)
Epoch  126/1400:Epoch loss: 0.0472 - avg acc: 71.0% - val-roc: 0.7704 - val-ap: 0.7361 (0.2s/epoch)
Epoch  127/1400:Epoch loss: 0.0998 - avg acc: 96.9% - val-roc: 0.8112 - val-ap: 0.8354 (0.2s/epoch)
Epoch  128/1400:Epoch loss: 0.0534 - avg acc: 93.1% - val-roc: 0.8827 - val-ap: 0.9022 (0.1s/epoch)
Epoch  129/1400:Epoch loss: 0.0662 - avg acc: 96.9% - val-roc: 0.8520 - val-ap: 0.8808 (0.1s/epoch)
Epoch  130/1400:Epoch loss: 0.0406 - avg acc: 92.4% - val-roc: 0.8316 - val-ap: 0.8266 (0.1s/epoch)
Epoch  131/1400:Epoch loss: 0.0657 - avg acc: 94.7% - val-roc: 0.8163 - val-ap: 0.8090 (0.1s/epoch)
Epoch  132/1400:Epoch loss: 0.0330 - avg acc: 93.9% - val-roc: 0.8367 - val-ap: 0.8182 (0.1s/epoch)
Epoch  133/1400:Epoch loss: 0.0379 - avg acc: 96.2% - val-roc: 0.8112 - val-ap: 0.7928 (0.1s/epoch)
Epoch  134/1400:Epoch loss: 0.0204 - avg acc: 98.5% - val-roc: 0.7908 - val-ap: 0.7530 (0.1s/epoch)
Epoch  135/1400:Epoch loss: 0.0573 - avg acc: 98.5% - val-roc: 0.7959 - val-ap: 0.7580 (0.1s/epoch)
Epoch  136/1400:Epoch loss: 0.0420 - avg acc: 96.9% - val-roc: 0.8214 - val-ap: 0.7958 (0.2s/epoch)
Epoch  137/1400:Epoch loss: 0.0287 - avg acc: 96.2% - val-roc: 0.8316 - val-ap: 0.8001 (0.1s/epoch)
Epoch  138/1400:Epoch loss: 0.0254 - avg acc: 96.9% - val-roc: 0.8673 - val-ap: 0.8435 (0.2s/epoch)
Epoch  139/1400:Epoch loss: 0.0358 - avg acc: 99.2% - val-roc: 0.8673 - val-ap: 0.8477 (0.2s/epoch)
Epoch  140/1400:Epoch loss: 0.0215 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8403 (0.1s/epoch)
Epoch  141/1400:Epoch loss: 0.0232 - avg acc: 98.5% - val-roc: 0.8469 - val-ap: 0.8478 (0.1s/epoch)
Epoch  142/1400:Epoch loss: 0.0208 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7971 (0.1s/epoch)
Epoch  143/1400:Epoch loss: 0.0203 - avg acc: 96.2% - val-roc: 0.8316 - val-ap: 0.8052 (0.2s/epoch)
Epoch  144/1400:Epoch loss: 0.1357 - avg acc: 81.7% - val-roc: 0.7755 - val-ap: 0.7358 (0.1s/epoch)
Epoch  145/1400:Epoch loss: 0.0861 - avg acc: 40.5% - val-roc: 0.6071 - val-ap: 0.5775 (0.1s/epoch)
Epoch  146/1400:Epoch loss: 0.1169 - avg acc: 65.6% - val-roc: 0.7602 - val-ap: 0.7259 (0.1s/epoch)
Epoch  147/1400:Epoch loss: 0.0749 - avg acc: 90.8% - val-roc: 0.8316 - val-ap: 0.7759 (0.1s/epoch)
Epoch  148/1400:Epoch loss: 0.0569 - avg acc: 96.2% - val-roc: 0.8316 - val-ap: 0.7759 (0.1s/epoch)
Epoch  149/1400:Epoch loss: 0.0686 - avg acc: 96.9% - val-roc: 0.8571 - val-ap: 0.8411 (0.1s/epoch)
Epoch  150/1400:Epoch loss: 0.0343 - avg acc: 84.7% - val-roc: 0.8061 - val-ap: 0.7614 (0.1s/epoch)
Epoch  151/1400:Epoch loss: 0.0472 - avg acc: 87.8% - val-roc: 0.7959 - val-ap: 0.7560 (0.1s/epoch)
Epoch  152/1400:Epoch loss: 0.0274 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7649 (0.1s/epoch)
Epoch  153/1400:Epoch loss: 0.0377 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7705 (0.1s/epoch)
Epoch  154/1400:Epoch loss: 0.0218 - avg acc: 97.7% - val-roc: 0.8316 - val-ap: 0.8353 (0.1s/epoch)
Epoch  155/1400:Epoch loss: 0.0132 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7968 (0.1s/epoch)
Epoch  156/1400:Epoch loss: 0.0208 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7947 (0.1s/epoch)
Epoch  157/1400:Epoch loss: 0.0124 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.7653 (0.1s/epoch)
Epoch  158/1400:Epoch loss: 0.0125 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7612 (0.2s/epoch)
Epoch  159/1400:Epoch loss: 0.0368 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7653 (0.1s/epoch)
Epoch  160/1400:Epoch loss: 0.0079 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.7778 (0.1s/epoch)
Epoch  161/1400:Epoch loss: 0.0203 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.7809 (0.1s/epoch)
Epoch  162/1400:Epoch loss: 0.0111 - avg acc: 98.5% - val-roc: 0.8571 - val-ap: 0.8202 (0.2s/epoch)
Epoch  163/1400:Epoch loss: 0.0139 - avg acc: 96.9% - val-roc: 0.8367 - val-ap: 0.7848 (0.2s/epoch)
Epoch  164/1400:Epoch loss: 0.0156 - avg acc: 98.5% - val-roc: 0.8316 - val-ap: 0.7491 (0.1s/epoch)
Epoch  165/1400:Epoch loss: 0.0196 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7395 (0.1s/epoch)
Epoch  166/1400:Epoch loss: 0.0121 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7430 (0.1s/epoch)
Epoch  167/1400:Epoch loss: 0.0208 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7411 (0.1s/epoch)
Epoch  168/1400:Epoch loss: 0.0216 - avg acc: 98.5% - val-roc: 0.8469 - val-ap: 0.7802 (0.1s/epoch)
Epoch  169/1400:Epoch loss: 0.0118 - avg acc: 95.4% - val-roc: 0.8265 - val-ap: 0.7695 (0.1s/epoch)
Epoch  170/1400:Epoch loss: 0.0294 - avg acc: 92.4% - val-roc: 0.8571 - val-ap: 0.7897 (0.2s/epoch)
Epoch  171/1400:Epoch loss: 0.0123 - avg acc: 93.1% - val-roc: 0.8724 - val-ap: 0.7971 (0.1s/epoch)
Epoch  172/1400:Epoch loss: 0.0560 - avg acc: 97.7% - val-roc: 0.8622 - val-ap: 0.7887 (0.1s/epoch)
Epoch  173/1400:Epoch loss: 0.0464 - avg acc: 96.9% - val-roc: 0.8469 - val-ap: 0.7813 (0.2s/epoch)
Epoch  174/1400:Epoch loss: 0.0342 - avg acc: 93.1% - val-roc: 0.8367 - val-ap: 0.7660 (0.1s/epoch)
Epoch  175/1400:Epoch loss: 0.1042 - avg acc: 93.9% - val-roc: 0.8367 - val-ap: 0.7781 (0.1s/epoch)
Epoch  176/1400:Epoch loss: 0.0235 - avg acc: 90.8% - val-roc: 0.8163 - val-ap: 0.7680 (0.1s/epoch)
Epoch  177/1400:Epoch loss: 0.0780 - avg acc: 90.8% - val-roc: 0.8520 - val-ap: 0.8749 (0.1s/epoch)
Epoch  178/1400:Epoch loss: 0.0312 - avg acc: 87.0% - val-roc: 0.8520 - val-ap: 0.8797 (0.1s/epoch)
Epoch  179/1400:Epoch loss: 0.0217 - avg acc: 96.9% - val-roc: 0.8622 - val-ap: 0.8874 (0.1s/epoch)
Epoch  180/1400:Epoch loss: 0.0316 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8763 (0.1s/epoch)
Epoch  181/1400:Epoch loss: 0.0162 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.8775 (0.2s/epoch)
Epoch  182/1400:Epoch loss: 0.0173 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.8718 (0.2s/epoch)
Epoch  183/1400:Epoch loss: 0.0186 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.8718 (0.1s/epoch)
Epoch  184/1400:Epoch loss: 0.0085 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8738 (0.1s/epoch)
Epoch  185/1400:Epoch loss: 0.0366 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8844 (0.1s/epoch)
Epoch  186/1400:Epoch loss: 0.0060 - avg acc: 93.9% - val-roc: 0.8520 - val-ap: 0.8872 (0.1s/epoch)
Epoch  187/1400:Epoch loss: 0.0618 - avg acc: 94.7% - val-roc: 0.8418 - val-ap: 0.8751 (0.1s/epoch)
Epoch  188/1400:Epoch loss: 0.0198 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8706 (0.1s/epoch)
Epoch  189/1400:Epoch loss: 0.0170 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8801 (0.1s/epoch)
Epoch  190/1400:Epoch loss: 0.0116 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8779 (0.2s/epoch)
Epoch  191/1400:Epoch loss: 0.0123 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8733 (0.2s/epoch)
Epoch  192/1400:Epoch loss: 0.0180 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8733 (0.2s/epoch)
Epoch  193/1400:Epoch loss: 0.0125 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8660 (0.1s/epoch)
Epoch  194/1400:Epoch loss: 0.0157 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8660 (0.1s/epoch)
Epoch  195/1400:Epoch loss: 0.0158 - avg acc: 99.2% - val-roc: 0.8673 - val-ap: 0.8739 (0.2s/epoch)
Epoch  196/1400:Epoch loss: 0.0126 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8698 (0.1s/epoch)
Epoch  197/1400:Epoch loss: 0.0163 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8811 (0.2s/epoch)
Epoch  198/1400:Epoch loss: 0.0047 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8811 (0.1s/epoch)
Epoch  199/1400:Epoch loss: 0.0055 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8811 (0.2s/epoch)
Epoch  200/1400:Epoch loss: 0.0057 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8692 (0.2s/epoch)
Epoch  201/1400:Epoch loss: 0.0061 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8692 (0.2s/epoch)
Epoch  202/1400:Epoch loss: 0.0125 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8692 (0.2s/epoch)
Epoch  203/1400:Epoch loss: 0.0066 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8714 (0.1s/epoch)
Epoch  204/1400:Epoch loss: 0.0022 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8571 (0.1s/epoch)
Epoch  205/1400:Epoch loss: 0.0156 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.8555 (0.2s/epoch)
Epoch  206/1400:Epoch loss: 0.0108 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8817 (0.2s/epoch)
Epoch  207/1400:Epoch loss: 0.0046 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.8682 (0.2s/epoch)
Epoch  208/1400:Epoch loss: 0.0018 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8660 (0.1s/epoch)
Epoch  209/1400:Epoch loss: 0.0041 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.8676 (0.2s/epoch)
Epoch  210/1400:Epoch loss: 0.0073 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.8676 (0.1s/epoch)
Epoch  211/1400:Epoch loss: 0.0113 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8692 (0.2s/epoch)
Epoch  212/1400:Epoch loss: 0.0027 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8655 (0.1s/epoch)
Epoch  213/1400:Epoch loss: 0.0072 - avg acc: 99.2% - val-roc: 0.8444 - val-ap: 0.8640 (0.2s/epoch)
Epoch  214/1400:Epoch loss: 0.0061 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8811 (0.1s/epoch)
Epoch  215/1400:Epoch loss: 0.0020 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8811 (0.1s/epoch)
Epoch  216/1400:Epoch loss: 0.0025 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8817 (0.1s/epoch)
Epoch  217/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8817 (0.2s/epoch)
Epoch  218/1400:Epoch loss: 0.0039 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.8801 (0.1s/epoch)
Epoch  219/1400:Epoch loss: 0.0040 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8711 (0.1s/epoch)
Epoch  220/1400:Epoch loss: 0.0030 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8449 (0.1s/epoch)
Epoch  221/1400:Epoch loss: 0.0045 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8241 (0.1s/epoch)
Epoch  222/1400:Epoch loss: 0.0013 - avg acc: 99.2% - val-roc: 0.8112 - val-ap: 0.8006 (0.1s/epoch)
Epoch  223/1400:Epoch loss: 0.0040 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8220 (0.1s/epoch)
Epoch  224/1400:Epoch loss: 0.0030 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8220 (0.1s/epoch)
Epoch  225/1400:Epoch loss: 0.0042 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8220 (0.1s/epoch)
Epoch  226/1400:Epoch loss: 0.0034 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8256 (0.1s/epoch)
Epoch  227/1400:Epoch loss: 0.0097 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8241 (0.1s/epoch)
Epoch  228/1400:Epoch loss: 0.0017 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8630 (0.2s/epoch)
Epoch  229/1400:Epoch loss: 0.0148 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8733 (0.1s/epoch)
Epoch  230/1400:Epoch loss: 0.0263 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.8002 (0.1s/epoch)
Epoch  231/1400:Epoch loss: 0.0067 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8775 (0.1s/epoch)
Epoch  232/1400:Epoch loss: 0.0043 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.8763 (0.2s/epoch)
Epoch  233/1400:Epoch loss: 0.0078 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.8661 (0.2s/epoch)
Epoch  234/1400:Epoch loss: 0.0054 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8826 (0.1s/epoch)
Epoch  235/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8889 (0.1s/epoch)
Epoch  236/1400:Epoch loss: 0.0085 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8633 (0.1s/epoch)
Epoch  237/1400:Epoch loss: 0.0059 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8416 (0.1s/epoch)
Epoch  238/1400:Epoch loss: 0.0014 - avg acc: 99.2% - val-roc: 0.8061 - val-ap: 0.7958 (0.1s/epoch)
Epoch  239/1400:Epoch loss: 0.0029 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7978 (0.2s/epoch)
Epoch  240/1400:Epoch loss: 0.0058 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8079 (0.1s/epoch)
Epoch  241/1400:Epoch loss: 0.0039 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8407 (0.1s/epoch)
Epoch  242/1400:Epoch loss: 0.0026 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8347 (0.1s/epoch)
Epoch  243/1400:Epoch loss: 0.0012 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8291 (0.1s/epoch)
Epoch  244/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8291 (0.1s/epoch)
Epoch  245/1400:Epoch loss: 0.0040 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8774 (0.1s/epoch)
Epoch  246/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8812 (0.2s/epoch)
Epoch  247/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8812 (0.1s/epoch)
Epoch  248/1400:Epoch loss: 0.0030 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8655 (0.2s/epoch)
Epoch  249/1400:Epoch loss: 0.0035 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8270 (0.1s/epoch)
Epoch  250/1400:Epoch loss: 0.0020 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.8026 (0.1s/epoch)
Epoch  251/1400:Epoch loss: 0.0004 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8026 (0.1s/epoch)
Epoch  252/1400:Epoch loss: 0.0069 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8373 (0.1s/epoch)
Epoch  253/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8370 (0.1s/epoch)
Epoch  254/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8264 (0.1s/epoch)
Epoch  255/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8308 (0.2s/epoch)
Epoch  256/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8105 (0.1s/epoch)
Epoch  257/1400:Epoch loss: 0.0028 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8109 (0.2s/epoch)
Epoch  258/1400:Epoch loss: 0.0017 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8132 (0.1s/epoch)
Epoch  259/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8046 (0.1s/epoch)
Epoch  260/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.8026 (0.1s/epoch)
Epoch  261/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8007 (0.1s/epoch)
Epoch  262/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8007 (0.1s/epoch)
Epoch  263/1400:Epoch loss: 0.0123 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8110 (0.1s/epoch)
Epoch  264/1400:Epoch loss: 0.0085 - avg acc: 100.0% - val-roc: 0.8724 - val-ap: 0.9043 (0.1s/epoch)
Epoch  265/1400:Epoch loss: 0.0428 - avg acc: 90.1% - val-roc: 0.7500 - val-ap: 0.7239 (0.1s/epoch)
Epoch  266/1400:Epoch loss: 0.1231 - avg acc: 56.5% - val-roc: 0.6378 - val-ap: 0.5952 (0.1s/epoch)
Epoch  267/1400:Epoch loss: 0.0946 - avg acc: 93.9% - val-roc: 0.8265 - val-ap: 0.7652 (0.1s/epoch)
Epoch  268/1400:Epoch loss: 0.1347 - avg acc: 95.4% - val-roc: 0.8418 - val-ap: 0.7798 (0.1s/epoch)
Epoch  269/1400:Epoch loss: 0.0956 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7643 (0.1s/epoch)
Epoch  270/1400:Epoch loss: 0.0413 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7663 (0.1s/epoch)
Epoch  271/1400:Epoch loss: 0.0558 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.8003 (0.1s/epoch)
Epoch  272/1400:Epoch loss: 0.0446 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.8060 (0.1s/epoch)
Epoch  273/1400:Epoch loss: 0.0334 - avg acc: 96.2% - val-roc: 0.8673 - val-ap: 0.8617 (0.1s/epoch)
Epoch  274/1400:Epoch loss: 0.0179 - avg acc: 95.4% - val-roc: 0.8827 - val-ap: 0.8895 (0.1s/epoch)
Epoch  275/1400:Epoch loss: 0.0214 - avg acc: 96.2% - val-roc: 0.8622 - val-ap: 0.8874 (0.1s/epoch)
Epoch  276/1400:Epoch loss: 0.0144 - avg acc: 98.5% - val-roc: 0.8367 - val-ap: 0.8503 (0.1s/epoch)
Epoch  277/1400:Epoch loss: 0.0305 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.8503 (0.2s/epoch)
Epoch  278/1400:Epoch loss: 0.0202 - avg acc: 84.7% - val-roc: 0.7857 - val-ap: 0.7698 (0.1s/epoch)
Epoch  279/1400:Epoch loss: 0.0568 - avg acc: 85.5% - val-roc: 0.7602 - val-ap: 0.7501 (0.1s/epoch)
Epoch  280/1400:Epoch loss: 0.0285 - avg acc: 96.9% - val-roc: 0.7908 - val-ap: 0.7688 (0.2s/epoch)
Epoch  281/1400:Epoch loss: 0.0164 - avg acc: 96.2% - val-roc: 0.8214 - val-ap: 0.7895 (0.1s/epoch)
Epoch  282/1400:Epoch loss: 0.0207 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.8101 (0.2s/epoch)
Epoch  283/1400:Epoch loss: 0.0133 - avg acc: 98.5% - val-roc: 0.8469 - val-ap: 0.8116 (0.2s/epoch)
Epoch  284/1400:Epoch loss: 0.0173 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.8798 (0.1s/epoch)
Epoch  285/1400:Epoch loss: 0.0182 - avg acc: 95.4% - val-roc: 0.8571 - val-ap: 0.8912 (0.2s/epoch)
Epoch  286/1400:Epoch loss: 0.0211 - avg acc: 98.5% - val-roc: 0.8571 - val-ap: 0.8910 (0.1s/epoch)
Epoch  287/1400:Epoch loss: 0.0061 - avg acc: 98.5% - val-roc: 0.8597 - val-ap: 0.8690 (0.1s/epoch)
Epoch  288/1400:Epoch loss: 0.0088 - avg acc: 99.2% - val-roc: 0.8673 - val-ap: 0.8730 (0.2s/epoch)
Epoch  289/1400:Epoch loss: 0.0134 - avg acc: 99.2% - val-roc: 0.8776 - val-ap: 0.8774 (0.1s/epoch)
Epoch  290/1400:Epoch loss: 0.0138 - avg acc: 98.5% - val-roc: 0.8827 - val-ap: 0.8893 (0.2s/epoch)
Epoch  291/1400:Epoch loss: 0.0057 - avg acc: 98.5% - val-roc: 0.8673 - val-ap: 0.8755 (0.2s/epoch)
Epoch  292/1400:Epoch loss: 0.0075 - avg acc: 99.2% - val-roc: 0.8724 - val-ap: 0.8857 (0.2s/epoch)
Epoch  293/1400:Epoch loss: 0.0057 - avg acc: 99.2% - val-roc: 0.8776 - val-ap: 0.8946 (0.2s/epoch)
Epoch  294/1400:Epoch loss: 0.0117 - avg acc: 99.2% - val-roc: 0.8878 - val-ap: 0.8965 (0.2s/epoch)
Epoch  295/1400:Epoch loss: 0.0038 - avg acc: 98.5% - val-roc: 0.9235 - val-ap: 0.9206 (0.1s/epoch)
Epoch  296/1400:Epoch loss: 0.0132 - avg acc: 99.2% - val-roc: 0.9184 - val-ap: 0.9177 (0.1s/epoch)
Epoch  297/1400:Epoch loss: 0.1424 - avg acc: 83.2% - val-roc: 0.8265 - val-ap: 0.7964 (0.1s/epoch)
Epoch  298/1400:Epoch loss: 0.1074 - avg acc: 30.5% - val-roc: 0.6122 - val-ap: 0.5735 (0.1s/epoch)
Epoch  299/1400:Epoch loss: 0.0965 - avg acc: 30.5% - val-roc: 0.5969 - val-ap: 0.5424 (0.1s/epoch)
Epoch  300/1400:Epoch loss: 0.1038 - avg acc: 66.4% - val-roc: 0.7347 - val-ap: 0.6665 (0.1s/epoch)
Epoch  301/1400:Epoch loss: 0.1125 - avg acc: 85.5% - val-roc: 0.7602 - val-ap: 0.6807 (0.1s/epoch)
Epoch  302/1400:Epoch loss: 0.0240 - avg acc: 96.2% - val-roc: 0.7755 - val-ap: 0.6842 (0.1s/epoch)
Epoch  303/1400:Epoch loss: 0.0219 - avg acc: 99.2% - val-roc: 0.8112 - val-ap: 0.7096 (0.1s/epoch)
Epoch  304/1400:Epoch loss: 0.0444 - avg acc: 96.2% - val-roc: 0.7806 - val-ap: 0.6969 (0.1s/epoch)
Epoch  305/1400:Epoch loss: 0.0606 - avg acc: 92.4% - val-roc: 0.7245 - val-ap: 0.6609 (0.2s/epoch)
Epoch  306/1400:Epoch loss: 0.0549 - avg acc: 94.7% - val-roc: 0.7857 - val-ap: 0.7379 (0.2s/epoch)
Epoch  307/1400:Epoch loss: 0.0955 - avg acc: 91.6% - val-roc: 0.8061 - val-ap: 0.7519 (0.1s/epoch)
Epoch  308/1400:Epoch loss: 0.0713 - avg acc: 87.8% - val-roc: 0.8520 - val-ap: 0.7805 (0.1s/epoch)
Epoch  309/1400:Epoch loss: 0.0639 - avg acc: 95.4% - val-roc: 0.8520 - val-ap: 0.7820 (0.2s/epoch)
Epoch  310/1400:Epoch loss: 0.0172 - avg acc: 96.9% - val-roc: 0.8214 - val-ap: 0.7626 (0.1s/epoch)
Epoch  311/1400:Epoch loss: 0.0173 - avg acc: 93.9% - val-roc: 0.7704 - val-ap: 0.7334 (0.1s/epoch)
Epoch  312/1400:Epoch loss: 0.0514 - avg acc: 96.9% - val-roc: 0.8112 - val-ap: 0.7587 (0.2s/epoch)
Epoch  313/1400:Epoch loss: 0.0291 - avg acc: 99.2% - val-roc: 0.8954 - val-ap: 0.8709 (0.1s/epoch)
Epoch  314/1400:Epoch loss: 0.0398 - avg acc: 97.7% - val-roc: 0.8980 - val-ap: 0.8880 (0.2s/epoch)
Epoch  315/1400:Epoch loss: 0.0226 - avg acc: 99.2% - val-roc: 0.9031 - val-ap: 0.8915 (0.2s/epoch)
Epoch  316/1400:Epoch loss: 0.0147 - avg acc: 99.2% - val-roc: 0.8878 - val-ap: 0.8558 (0.1s/epoch)
Epoch  317/1400:Epoch loss: 0.0179 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7783 (0.1s/epoch)
Epoch  318/1400:Epoch loss: 0.0260 - avg acc: 98.5% - val-roc: 0.8316 - val-ap: 0.7717 (0.1s/epoch)
Epoch  319/1400:Epoch loss: 0.0116 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.7819 (0.1s/epoch)
Epoch  320/1400:Epoch loss: 0.0678 - avg acc: 96.2% - val-roc: 0.8418 - val-ap: 0.7775 (0.1s/epoch)
Epoch  321/1400:Epoch loss: 0.0534 - avg acc: 93.1% - val-roc: 0.8061 - val-ap: 0.7522 (0.1s/epoch)
Epoch  322/1400:Epoch loss: 0.0244 - avg acc: 96.9% - val-roc: 0.8214 - val-ap: 0.7636 (0.1s/epoch)
Epoch  323/1400:Epoch loss: 0.0153 - avg acc: 97.7% - val-roc: 0.8163 - val-ap: 0.7609 (0.1s/epoch)
Epoch  324/1400:Epoch loss: 0.0276 - avg acc: 96.2% - val-roc: 0.8265 - val-ap: 0.7659 (0.1s/epoch)
Epoch  325/1400:Epoch loss: 0.0169 - avg acc: 99.2% - val-roc: 0.8571 - val-ap: 0.7848 (0.1s/epoch)
Epoch  326/1400:Epoch loss: 0.0175 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.7868 (0.1s/epoch)
Epoch  327/1400:Epoch loss: 0.0409 - avg acc: 97.7% - val-roc: 0.8418 - val-ap: 0.7740 (0.1s/epoch)
Epoch  328/1400:Epoch loss: 0.0136 - avg acc: 98.5% - val-roc: 0.8367 - val-ap: 0.7709 (0.1s/epoch)
Epoch  329/1400:Epoch loss: 0.0104 - avg acc: 96.2% - val-roc: 0.8265 - val-ap: 0.7596 (0.1s/epoch)
Epoch  330/1400:Epoch loss: 0.0095 - avg acc: 96.9% - val-roc: 0.7959 - val-ap: 0.7390 (0.1s/epoch)
Epoch  331/1400:Epoch loss: 0.0086 - avg acc: 96.9% - val-roc: 0.7959 - val-ap: 0.7435 (0.1s/epoch)
Epoch  332/1400:Epoch loss: 0.0085 - avg acc: 98.5% - val-roc: 0.8265 - val-ap: 0.7644 (0.1s/epoch)
Epoch  333/1400:Epoch loss: 0.0047 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7644 (0.1s/epoch)
Epoch  334/1400:Epoch loss: 0.0020 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7644 (0.1s/epoch)
Epoch  335/1400:Epoch loss: 0.0042 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7644 (0.2s/epoch)
Epoch  336/1400:Epoch loss: 0.0127 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.7610 (0.1s/epoch)
Epoch  337/1400:Epoch loss: 0.0098 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7665 (0.1s/epoch)
Epoch  338/1400:Epoch loss: 0.0461 - avg acc: 98.5% - val-roc: 0.8367 - val-ap: 0.7716 (0.1s/epoch)
Epoch  339/1400:Epoch loss: 0.0144 - avg acc: 78.6% - val-roc: 0.8061 - val-ap: 0.7445 (0.1s/epoch)
Epoch  340/1400:Epoch loss: 0.0461 - avg acc: 94.7% - val-roc: 0.8265 - val-ap: 0.7610 (0.2s/epoch)
Epoch  341/1400:Epoch loss: 0.0292 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.7778 (0.1s/epoch)
Epoch  342/1400:Epoch loss: 0.0256 - avg acc: 96.9% - val-roc: 0.8112 - val-ap: 0.7564 (0.1s/epoch)
Epoch  343/1400:Epoch loss: 0.0149 - avg acc: 97.7% - val-roc: 0.8163 - val-ap: 0.7618 (0.1s/epoch)
Epoch  344/1400:Epoch loss: 0.0099 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7618 (0.2s/epoch)
Epoch  345/1400:Epoch loss: 0.0057 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.7696 (0.1s/epoch)
Epoch  346/1400:Epoch loss: 0.0021 - avg acc: 99.2% - val-roc: 0.8112 - val-ap: 0.7537 (0.1s/epoch)
Epoch  347/1400:Epoch loss: 0.0045 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7574 (0.1s/epoch)
Epoch  348/1400:Epoch loss: 0.0075 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7621 (0.1s/epoch)
Epoch  349/1400:Epoch loss: 0.0023 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7574 (0.1s/epoch)
Epoch  350/1400:Epoch loss: 0.0044 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7574 (0.1s/epoch)
Epoch  351/1400:Epoch loss: 0.0037 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7645 (0.1s/epoch)
Epoch  352/1400:Epoch loss: 0.0024 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8121 (0.1s/epoch)
Epoch  353/1400:Epoch loss: 0.0078 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7773 (0.1s/epoch)
Epoch  354/1400:Epoch loss: 0.0012 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7773 (0.1s/epoch)
Epoch  355/1400:Epoch loss: 0.0042 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.7823 (0.1s/epoch)
Epoch  356/1400:Epoch loss: 0.0024 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7803 (0.1s/epoch)
Epoch  357/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7791 (0.1s/epoch)
Epoch  358/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7791 (0.1s/epoch)
Epoch  359/1400:Epoch loss: 0.0023 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7791 (0.1s/epoch)
Epoch  360/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7737 (0.1s/epoch)
Epoch  361/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7824 (0.2s/epoch)
Epoch  362/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7705 (0.1s/epoch)
Epoch  363/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7705 (0.1s/epoch)
Epoch  364/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7705 (0.1s/epoch)
Epoch  365/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7759 (0.1s/epoch)
Epoch  366/1400:Epoch loss: 0.0919 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7584 (0.1s/epoch)
Epoch  367/1400:Epoch loss: 0.0570 - avg acc: 78.6% - val-roc: 0.7398 - val-ap: 0.6574 (0.1s/epoch)
Epoch  368/1400:Epoch loss: 0.0314 - avg acc: 99.2% - val-roc: 0.8112 - val-ap: 0.7498 (0.1s/epoch)
Epoch  369/1400:Epoch loss: 0.0460 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7786 (0.1s/epoch)
Epoch  370/1400:Epoch loss: 0.0174 - avg acc: 93.9% - val-roc: 0.7704 - val-ap: 0.7565 (0.1s/epoch)
Epoch  371/1400:Epoch loss: 0.0645 - avg acc: 97.7% - val-roc: 0.8010 - val-ap: 0.7690 (0.1s/epoch)
Epoch  372/1400:Epoch loss: 0.0092 - avg acc: 98.5% - val-roc: 0.8010 - val-ap: 0.7548 (0.1s/epoch)
Epoch  373/1400:Epoch loss: 0.0304 - avg acc: 96.9% - val-roc: 0.8214 - val-ap: 0.7791 (0.1s/epoch)
Epoch  374/1400:Epoch loss: 0.0249 - avg acc: 96.2% - val-roc: 0.8112 - val-ap: 0.7639 (0.1s/epoch)
Epoch  375/1400:Epoch loss: 0.0111 - avg acc: 93.9% - val-roc: 0.8010 - val-ap: 0.7503 (0.1s/epoch)
Epoch  376/1400:Epoch loss: 0.0062 - avg acc: 93.9% - val-roc: 0.7959 - val-ap: 0.7462 (0.1s/epoch)
Epoch  377/1400:Epoch loss: 0.0078 - avg acc: 97.7% - val-roc: 0.8214 - val-ap: 0.7634 (0.1s/epoch)
Epoch  378/1400:Epoch loss: 0.0040 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.7681 (0.1s/epoch)
Epoch  379/1400:Epoch loss: 0.0036 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7709 (0.1s/epoch)
Epoch  380/1400:Epoch loss: 0.0043 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8028 (0.1s/epoch)
Epoch  381/1400:Epoch loss: 0.0035 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8078 (0.1s/epoch)
Epoch  382/1400:Epoch loss: 0.0008 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.8053 (0.1s/epoch)
Epoch  383/1400:Epoch loss: 0.0071 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.8074 (0.1s/epoch)
Epoch  384/1400:Epoch loss: 0.0025 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7975 (0.1s/epoch)
Epoch  385/1400:Epoch loss: 0.0047 - avg acc: 99.2% - val-roc: 0.8112 - val-ap: 0.7943 (0.1s/epoch)
Epoch  386/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8000 (0.1s/epoch)
Epoch  387/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8019 (0.1s/epoch)
Epoch  388/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8019 (0.1s/epoch)
Epoch  389/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8063 (0.1s/epoch)
Epoch  390/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  391/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  392/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  393/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  394/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  395/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  396/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  397/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  398/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  399/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  400/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  401/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  402/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8095 (0.1s/epoch)
Epoch  403/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8095 (0.1s/epoch)
Epoch  404/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  405/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  406/1400:Epoch loss: 0.0019 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  407/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  408/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  409/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  410/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8073 (0.1s/epoch)
Epoch  411/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8013 (0.1s/epoch)
Epoch  412/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8091 (0.1s/epoch)
Epoch  413/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8031 (0.1s/epoch)
Epoch  414/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8031 (0.1s/epoch)
Epoch  415/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8053 (0.1s/epoch)
Epoch  416/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8067 (0.1s/epoch)
Epoch  417/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  418/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  419/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8114 (0.1s/epoch)
Epoch  420/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7756 (0.1s/epoch)
Epoch  421/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7779 (0.1s/epoch)
Epoch  422/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.7775 (0.1s/epoch)
Epoch  423/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.7835 (0.1s/epoch)
Epoch  424/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  425/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7753 (0.1s/epoch)
Epoch  426/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  427/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7753 (0.1s/epoch)
Epoch  428/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  429/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7812 (0.1s/epoch)
Epoch  430/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7753 (0.1s/epoch)
Epoch  431/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7792 (0.1s/epoch)
Epoch  432/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7809 (0.1s/epoch)
Epoch  433/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7809 (0.1s/epoch)
Epoch  434/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7809 (0.1s/epoch)
Epoch  435/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7822 (0.1s/epoch)
Epoch  436/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7791 (0.1s/epoch)
Epoch  437/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7791 (0.1s/epoch)
Epoch  438/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7791 (0.1s/epoch)
Epoch  439/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.7777 (0.1s/epoch)
Epoch  440/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7785 (0.1s/epoch)
Epoch  441/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7757 (0.1s/epoch)
Epoch  442/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7757 (0.1s/epoch)
Epoch  443/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8054 (0.1s/epoch)
Epoch  444/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8098 (0.1s/epoch)
Epoch  445/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.7835 (0.1s/epoch)
Epoch  446/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.7876 (0.1s/epoch)
Epoch  447/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.7894 (0.1s/epoch)
Epoch  448/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.7886 (0.1s/epoch)
Epoch  449/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.7859 (0.1s/epoch)
Epoch  450/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8210 (0.1s/epoch)
Epoch  451/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8197 (0.1s/epoch)
Epoch  452/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8699 - val-ap: 0.8234 (0.1s/epoch)
Epoch  453/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8699 - val-ap: 0.8234 (0.1s/epoch)
Epoch  454/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8699 - val-ap: 0.8234 (0.1s/epoch)
Epoch  455/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8214 (0.1s/epoch)
Epoch  456/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7927 (0.1s/epoch)
Epoch  457/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8096 (0.1s/epoch)
Epoch  458/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8078 (0.1s/epoch)
Epoch  459/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8056 (0.1s/epoch)
Epoch  460/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.7818 (0.1s/epoch)
Epoch  461/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.7818 (0.1s/epoch)
Epoch  462/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7734 (0.1s/epoch)
Epoch  463/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7734 (0.1s/epoch)
Epoch  464/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.7679 (0.1s/epoch)
Epoch  465/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.7646 (0.1s/epoch)
Epoch  466/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7738 (0.1s/epoch)
Epoch  467/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7976 (0.1s/epoch)
Epoch  468/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7976 (0.1s/epoch)
Epoch  469/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7996 (0.1s/epoch)
Epoch  470/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7780 (0.1s/epoch)
Epoch  471/1400:Epoch loss: 0.0034 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7899 (0.1s/epoch)
Epoch  472/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7924 (0.1s/epoch)
Epoch  473/1400:Epoch loss: 0.0021 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7996 (0.1s/epoch)
Epoch  474/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7965 (0.1s/epoch)
Epoch  475/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7929 (0.1s/epoch)
Epoch  476/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7837 (0.1s/epoch)
Epoch  477/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7799 (0.1s/epoch)
Epoch  478/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7865 (0.1s/epoch)
Epoch  479/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7972 (0.1s/epoch)
Epoch  480/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7813 (0.1s/epoch)
Epoch  481/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7885 (0.1s/epoch)
Epoch  482/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7895 (0.1s/epoch)
Epoch  483/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7885 (0.1s/epoch)
Epoch  484/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7885 (0.1s/epoch)
Epoch  485/1400:Epoch loss: 0.0034 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7781 (0.1s/epoch)
Epoch  486/1400:Epoch loss: 0.0008 - avg acc: 92.4% - val-roc: 0.7755 - val-ap: 0.7394 (0.1s/epoch)
Epoch  487/1400:Epoch loss: 0.0078 - avg acc: 90.8% - val-roc: 0.7653 - val-ap: 0.7298 (0.1s/epoch)
Epoch  488/1400:Epoch loss: 0.0020 - avg acc: 100.0% - val-roc: 0.7883 - val-ap: 0.7450 (0.1s/epoch)
Epoch  489/1400:Epoch loss: 0.0017 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7728 (0.1s/epoch)
Epoch  490/1400:Epoch loss: 0.0025 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7936 (0.1s/epoch)
Epoch  491/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.7987 (0.1s/epoch)
Epoch  492/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7970 (0.1s/epoch)
Epoch  493/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7980 (0.1s/epoch)
Epoch  494/1400:Epoch loss: 0.0001 - avg acc: 99.2% - val-roc: 0.8087 - val-ap: 0.7922 (0.1s/epoch)
Epoch  495/1400:Epoch loss: 0.0073 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7819 (0.1s/epoch)
Epoch  496/1400:Epoch loss: 0.0032 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7526 (0.1s/epoch)
Epoch  497/1400:Epoch loss: 0.0027 - avg acc: 97.7% - val-roc: 0.7602 - val-ap: 0.7278 (0.1s/epoch)
Epoch  498/1400:Epoch loss: 0.0001 - avg acc: 93.1% - val-roc: 0.7551 - val-ap: 0.7198 (0.1s/epoch)
Epoch  499/1400:Epoch loss: 0.2258 - avg acc: 93.1% - val-roc: 0.8112 - val-ap: 0.7802 (0.1s/epoch)
Epoch  500/1400:Epoch loss: 0.0615 - avg acc: 84.7% - val-roc: 0.8061 - val-ap: 0.7767 (0.1s/epoch)
Epoch  501/1400:Epoch loss: 0.0378 - avg acc: 93.9% - val-roc: 0.8393 - val-ap: 0.8245 (0.1s/epoch)
Epoch  502/1400:Epoch loss: 0.0208 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.8041 (0.1s/epoch)
Epoch  503/1400:Epoch loss: 0.0331 - avg acc: 96.9% - val-roc: 0.8367 - val-ap: 0.7965 (0.1s/epoch)
Epoch  504/1400:Epoch loss: 0.0353 - avg acc: 97.7% - val-roc: 0.8316 - val-ap: 0.7685 (0.1s/epoch)
Epoch  505/1400:Epoch loss: 0.0118 - avg acc: 83.2% - val-roc: 0.7857 - val-ap: 0.7262 (0.1s/epoch)
Epoch  506/1400:Epoch loss: 0.0296 - avg acc: 93.9% - val-roc: 0.8265 - val-ap: 0.7624 (0.1s/epoch)
Epoch  507/1400:Epoch loss: 0.0154 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7833 (0.1s/epoch)
Epoch  508/1400:Epoch loss: 0.1030 - avg acc: 97.7% - val-roc: 0.8546 - val-ap: 0.8363 (0.1s/epoch)
Epoch  509/1400:Epoch loss: 0.0776 - avg acc: 93.9% - val-roc: 0.8061 - val-ap: 0.7933 (0.1s/epoch)
Epoch  510/1400:Epoch loss: 0.1065 - avg acc: 90.8% - val-roc: 0.8010 - val-ap: 0.7550 (0.1s/epoch)
Epoch  511/1400:Epoch loss: 0.0449 - avg acc: 93.1% - val-roc: 0.8878 - val-ap: 0.8387 (0.1s/epoch)
Epoch  512/1400:Epoch loss: 0.0408 - avg acc: 96.2% - val-roc: 0.9082 - val-ap: 0.8716 (0.1s/epoch)
Epoch  513/1400:Epoch loss: 0.0673 - avg acc: 95.4% - val-roc: 0.8469 - val-ap: 0.8430 (0.1s/epoch)
Epoch  514/1400:Epoch loss: 0.0358 - avg acc: 97.7% - val-roc: 0.8418 - val-ap: 0.7826 (0.1s/epoch)
Epoch  515/1400:Epoch loss: 0.0149 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7759 (0.1s/epoch)
Epoch  516/1400:Epoch loss: 0.0120 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.7769 (0.1s/epoch)
Epoch  517/1400:Epoch loss: 0.0084 - avg acc: 97.7% - val-roc: 0.8316 - val-ap: 0.7681 (0.1s/epoch)
Epoch  518/1400:Epoch loss: 0.0180 - avg acc: 93.1% - val-roc: 0.8469 - val-ap: 0.7808 (0.1s/epoch)
Epoch  519/1400:Epoch loss: 0.0156 - avg acc: 92.4% - val-roc: 0.8520 - val-ap: 0.7859 (0.1s/epoch)
Epoch  520/1400:Epoch loss: 0.0107 - avg acc: 98.5% - val-roc: 0.8776 - val-ap: 0.7968 (0.1s/epoch)
Epoch  521/1400:Epoch loss: 0.0064 - avg acc: 98.5% - val-roc: 0.8776 - val-ap: 0.7968 (0.2s/epoch)
Epoch  522/1400:Epoch loss: 0.0124 - avg acc: 98.5% - val-roc: 0.8827 - val-ap: 0.8009 (0.2s/epoch)
Epoch  523/1400:Epoch loss: 0.0076 - avg acc: 96.2% - val-roc: 0.8878 - val-ap: 0.8040 (0.1s/epoch)
Epoch  524/1400:Epoch loss: 0.0309 - avg acc: 96.9% - val-roc: 0.8724 - val-ap: 0.8486 (0.1s/epoch)
Epoch  525/1400:Epoch loss: 0.0173 - avg acc: 56.5% - val-roc: 0.6684 - val-ap: 0.7355 (0.1s/epoch)
Epoch  526/1400:Epoch loss: 0.0292 - avg acc: 84.0% - val-roc: 0.7908 - val-ap: 0.7489 (0.1s/epoch)
Epoch  527/1400:Epoch loss: 0.0081 - avg acc: 93.1% - val-roc: 0.8214 - val-ap: 0.7675 (0.1s/epoch)
Epoch  528/1400:Epoch loss: 0.0069 - avg acc: 96.9% - val-roc: 0.8316 - val-ap: 0.7859 (0.1s/epoch)
Epoch  529/1400:Epoch loss: 0.0059 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7851 (0.1s/epoch)
Epoch  530/1400:Epoch loss: 0.0121 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7740 (0.1s/epoch)
Epoch  531/1400:Epoch loss: 0.0021 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7735 (0.1s/epoch)
Epoch  532/1400:Epoch loss: 0.0125 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7714 (0.1s/epoch)
Epoch  533/1400:Epoch loss: 0.0015 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7781 (0.1s/epoch)
Epoch  534/1400:Epoch loss: 0.0093 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7757 (0.1s/epoch)
Epoch  535/1400:Epoch loss: 0.0030 - avg acc: 97.7% - val-roc: 0.8418 - val-ap: 0.7781 (0.1s/epoch)
Epoch  536/1400:Epoch loss: 0.0038 - avg acc: 97.7% - val-roc: 0.8367 - val-ap: 0.7785 (0.1s/epoch)
Epoch  537/1400:Epoch loss: 0.0055 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7832 (0.1s/epoch)
Epoch  538/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7832 (0.1s/epoch)
Epoch  539/1400:Epoch loss: 0.0029 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7867 (0.1s/epoch)
Epoch  540/1400:Epoch loss: 0.0024 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7785 (0.1s/epoch)
Epoch  541/1400:Epoch loss: 0.0009 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7892 (0.1s/epoch)
Epoch  542/1400:Epoch loss: 0.0005 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7848 (0.1s/epoch)
Epoch  543/1400:Epoch loss: 0.0024 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7884 (0.1s/epoch)
Epoch  544/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7884 (0.1s/epoch)
Epoch  545/1400:Epoch loss: 0.0039 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7884 (0.1s/epoch)
Epoch  546/1400:Epoch loss: 0.0020 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7926 (0.1s/epoch)
Epoch  547/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7959 (0.1s/epoch)
Epoch  548/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7951 (0.1s/epoch)
Epoch  549/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7926 (0.1s/epoch)
Epoch  550/1400:Epoch loss: 0.0019 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7926 (0.1s/epoch)
Epoch  551/1400:Epoch loss: 0.0035 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.7868 (0.1s/epoch)
Epoch  552/1400:Epoch loss: 0.0005 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.7817 (0.1s/epoch)
Epoch  553/1400:Epoch loss: 0.0018 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7698 (0.1s/epoch)
Epoch  554/1400:Epoch loss: 0.0047 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7835 (0.1s/epoch)
Epoch  555/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7887 (0.1s/epoch)
Epoch  556/1400:Epoch loss: 0.0031 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7904 (0.1s/epoch)
Epoch  557/1400:Epoch loss: 0.0003 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7925 (0.1s/epoch)
Epoch  558/1400:Epoch loss: 0.0024 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7925 (0.1s/epoch)
Epoch  559/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.7912 (0.1s/epoch)
Epoch  560/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7926 (0.1s/epoch)
Epoch  561/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7909 (0.1s/epoch)
Epoch  562/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7945 (0.1s/epoch)
Epoch  563/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7964 (0.1s/epoch)
Epoch  564/1400:Epoch loss: 0.0025 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7922 (0.1s/epoch)
Epoch  565/1400:Epoch loss: 0.0004 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7904 (0.1s/epoch)
Epoch  566/1400:Epoch loss: 0.0005 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7900 (0.1s/epoch)
Epoch  567/1400:Epoch loss: 0.0010 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.7922 (0.1s/epoch)
Epoch  568/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7980 (0.1s/epoch)
Epoch  569/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7978 (0.1s/epoch)
Epoch  570/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8000 (0.1s/epoch)
Epoch  571/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7993 (0.1s/epoch)
Epoch  572/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7993 (0.1s/epoch)
Epoch  573/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8000 (0.1s/epoch)
Epoch  574/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8083 (0.1s/epoch)
Epoch  575/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8083 (0.1s/epoch)
Epoch  576/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8105 (0.1s/epoch)
Epoch  577/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8105 (0.1s/epoch)
Epoch  578/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8113 (0.1s/epoch)
Epoch  579/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8105 (0.1s/epoch)
Epoch  580/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8029 (0.1s/epoch)
Epoch  581/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8105 (0.1s/epoch)
Epoch  582/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7926 (0.1s/epoch)
Epoch  583/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.7926 (0.1s/epoch)
Epoch  584/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7980 (0.1s/epoch)
Epoch  585/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.8045 (0.1s/epoch)
Epoch  586/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.8045 (0.1s/epoch)
Epoch  587/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.8063 (0.1s/epoch)
Epoch  588/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8008 (0.1s/epoch)
Epoch  589/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8083 (0.1s/epoch)
Epoch  590/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8000 (0.1s/epoch)
Epoch  591/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8022 (0.1s/epoch)
Epoch  592/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8022 (0.1s/epoch)
Epoch  593/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8022 (0.1s/epoch)
Epoch  594/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8111 (0.1s/epoch)
Epoch  595/1400:Epoch loss: 0.0053 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8105 (0.1s/epoch)
Epoch  596/1400:Epoch loss: 0.0019 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.7903 (0.1s/epoch)
Epoch  597/1400:Epoch loss: 0.0066 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7967 (0.1s/epoch)
Epoch  598/1400:Epoch loss: 0.0066 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8047 (0.1s/epoch)
Epoch  599/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8000 (0.1s/epoch)
Epoch  600/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8000 (0.1s/epoch)
Epoch  601/1400:Epoch loss: 0.0031 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.8061 (0.1s/epoch)
Epoch  602/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8102 (0.1s/epoch)
Epoch  603/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8126 (0.1s/epoch)
Epoch  604/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8136 (0.1s/epoch)
Epoch  605/1400:Epoch loss: 0.0032 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7978 (0.1s/epoch)
Epoch  606/1400:Epoch loss: 0.0001 - avg acc: 99.2% - val-roc: 0.8418 - val-ap: 0.7902 (0.1s/epoch)
Epoch  607/1400:Epoch loss: 0.0039 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7885 (0.1s/epoch)
Epoch  608/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7820 (0.1s/epoch)
Epoch  609/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7880 (0.1s/epoch)
Epoch  610/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7931 (0.1s/epoch)
Epoch  611/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7939 (0.1s/epoch)
Epoch  612/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  613/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  614/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  615/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8058 (0.1s/epoch)
Epoch  616/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  617/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  618/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  619/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  620/1400:Epoch loss: 0.0023 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7975 (0.1s/epoch)
Epoch  621/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7866 (0.1s/epoch)
Epoch  622/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  623/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  624/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  625/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  626/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  627/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  628/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  629/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  630/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7800 (0.1s/epoch)
Epoch  631/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7867 (0.1s/epoch)
Epoch  632/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7836 (0.1s/epoch)
Epoch  633/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.7867 (0.1s/epoch)
Epoch  634/1400:Epoch loss: 0.0019 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8026 (0.1s/epoch)
Epoch  635/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7998 (0.1s/epoch)
Epoch  636/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8018 (0.1s/epoch)
Epoch  637/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8018 (0.1s/epoch)
Epoch  638/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8056 (0.1s/epoch)
Epoch  639/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8028 (0.1s/epoch)
Epoch  640/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8045 (0.1s/epoch)
Epoch  641/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8080 (0.1s/epoch)
Epoch  642/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8073 (0.1s/epoch)
Epoch  643/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8063 (0.1s/epoch)
Epoch  644/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8095 (0.1s/epoch)
Epoch  645/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8063 (0.1s/epoch)
Epoch  646/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8095 (0.1s/epoch)
Epoch  647/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8107 (0.1s/epoch)
Epoch  648/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8113 (0.1s/epoch)
Epoch  649/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.8236 (0.1s/epoch)
Epoch  650/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8105 (0.1s/epoch)
Epoch  651/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8140 (0.1s/epoch)
Epoch  652/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8095 (0.1s/epoch)
Epoch  653/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8140 (0.1s/epoch)
Epoch  654/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8140 (0.1s/epoch)
Epoch  655/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8130 (0.1s/epoch)
Epoch  656/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8140 (0.1s/epoch)
Epoch  657/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8113 (0.1s/epoch)
Epoch  658/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8181 (0.1s/epoch)
Epoch  659/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8279 (0.1s/epoch)
Epoch  660/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8279 (0.1s/epoch)
Epoch  661/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8279 (0.1s/epoch)
Epoch  662/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8188 (0.1s/epoch)
Epoch  663/1400:Epoch loss: 0.0644 - avg acc: 98.5% - val-roc: 0.8189 - val-ap: 0.7605 (0.1s/epoch)
Epoch  664/1400:Epoch loss: 0.0774 - avg acc: 61.1% - val-roc: 0.7041 - val-ap: 0.6458 (0.1s/epoch)
Epoch  665/1400:Epoch loss: 0.0711 - avg acc: 90.1% - val-roc: 0.7857 - val-ap: 0.7229 (0.1s/epoch)
Epoch  666/1400:Epoch loss: 0.0302 - avg acc: 92.4% - val-roc: 0.8367 - val-ap: 0.7678 (0.1s/epoch)
Epoch  667/1400:Epoch loss: 0.0744 - avg acc: 93.9% - val-roc: 0.8750 - val-ap: 0.8651 (0.1s/epoch)
Epoch  668/1400:Epoch loss: 0.0039 - avg acc: 95.4% - val-roc: 0.7857 - val-ap: 0.8190 (0.1s/epoch)
Epoch  669/1400:Epoch loss: 0.0136 - avg acc: 96.9% - val-roc: 0.7704 - val-ap: 0.7623 (0.1s/epoch)
Epoch  670/1400:Epoch loss: 0.0593 - avg acc: 93.1% - val-roc: 0.7857 - val-ap: 0.7441 (0.2s/epoch)
Epoch  671/1400:Epoch loss: 0.0451 - avg acc: 91.6% - val-roc: 0.7959 - val-ap: 0.7593 (0.1s/epoch)
Epoch  672/1400:Epoch loss: 0.0379 - avg acc: 96.9% - val-roc: 0.8265 - val-ap: 0.7583 (0.1s/epoch)
Epoch  673/1400:Epoch loss: 0.0263 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7639 (0.1s/epoch)
Epoch  674/1400:Epoch loss: 0.0143 - avg acc: 98.5% - val-roc: 0.8087 - val-ap: 0.7522 (0.1s/epoch)
Epoch  675/1400:Epoch loss: 0.0176 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.7736 (0.1s/epoch)
Epoch  676/1400:Epoch loss: 0.0073 - avg acc: 98.5% - val-roc: 0.8469 - val-ap: 0.7923 (0.1s/epoch)
Epoch  677/1400:Epoch loss: 0.0047 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.7989 (0.1s/epoch)
Epoch  678/1400:Epoch loss: 0.0037 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.7941 (0.1s/epoch)
Epoch  679/1400:Epoch loss: 0.0082 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.7846 (0.1s/epoch)
Epoch  680/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.7939 (0.2s/epoch)
Epoch  681/1400:Epoch loss: 0.0068 - avg acc: 95.4% - val-roc: 0.8316 - val-ap: 0.7756 (0.1s/epoch)
Epoch  682/1400:Epoch loss: 0.0095 - avg acc: 98.5% - val-roc: 0.8265 - val-ap: 0.7762 (0.1s/epoch)
Epoch  683/1400:Epoch loss: 0.0094 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.7941 (0.1s/epoch)
Epoch  684/1400:Epoch loss: 0.0024 - avg acc: 99.2% - val-roc: 0.8291 - val-ap: 0.7899 (0.1s/epoch)
Epoch  685/1400:Epoch loss: 0.0025 - avg acc: 99.2% - val-roc: 0.8342 - val-ap: 0.7963 (0.2s/epoch)
Epoch  686/1400:Epoch loss: 0.0017 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8096 (0.2s/epoch)
Epoch  687/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8229 (0.2s/epoch)
Epoch  688/1400:Epoch loss: 0.0222 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.7917 (0.1s/epoch)
Epoch  689/1400:Epoch loss: 0.0745 - avg acc: 88.5% - val-roc: 0.8112 - val-ap: 0.8157 (0.2s/epoch)
Epoch  690/1400:Epoch loss: 0.0544 - avg acc: 96.2% - val-roc: 0.8036 - val-ap: 0.7884 (0.1s/epoch)
Epoch  691/1400:Epoch loss: 0.0423 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.8050 (0.1s/epoch)
Epoch  692/1400:Epoch loss: 0.0053 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8838 (0.1s/epoch)
Epoch  693/1400:Epoch loss: 0.0124 - avg acc: 100.0% - val-roc: 0.8699 - val-ap: 0.8954 (0.1s/epoch)
Epoch  694/1400:Epoch loss: 0.0087 - avg acc: 100.0% - val-roc: 0.8724 - val-ap: 0.9043 (0.1s/epoch)
Epoch  695/1400:Epoch loss: 0.0087 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8881 (0.1s/epoch)
Epoch  696/1400:Epoch loss: 0.0021 - avg acc: 99.2% - val-roc: 0.8673 - val-ap: 0.8928 (0.1s/epoch)
Epoch  697/1400:Epoch loss: 0.0060 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8928 (0.1s/epoch)
Epoch  698/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8919 (0.1s/epoch)
Epoch  699/1400:Epoch loss: 0.0044 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8919 (0.1s/epoch)
Epoch  700/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8715 (0.1s/epoch)
Epoch  701/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8613 (0.1s/epoch)
Epoch  702/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8715 (0.1s/epoch)
Epoch  703/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8795 (0.1s/epoch)
Epoch  704/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8693 (0.1s/epoch)
Epoch  705/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8693 (0.1s/epoch)
Epoch  706/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8715 (0.1s/epoch)
Epoch  707/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8919 (0.1s/epoch)
Epoch  708/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8919 (0.1s/epoch)
Epoch  709/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8919 (0.1s/epoch)
Epoch  710/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8693 (0.1s/epoch)
Epoch  711/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8698 (0.1s/epoch)
Epoch  712/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8698 (0.1s/epoch)
Epoch  713/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8715 (0.1s/epoch)
Epoch  714/1400:Epoch loss: 0.0103 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8693 (0.1s/epoch)
Epoch  715/1400:Epoch loss: 0.0204 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7782 (0.1s/epoch)
Epoch  716/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8801 - val-ap: 0.8429 (0.1s/epoch)
Epoch  717/1400:Epoch loss: 0.0101 - avg acc: 100.0% - val-roc: 0.8750 - val-ap: 0.8575 (0.1s/epoch)
Epoch  718/1400:Epoch loss: 0.0232 - avg acc: 98.5% - val-roc: 0.8673 - val-ap: 0.8824 (0.1s/epoch)
Epoch  719/1400:Epoch loss: 0.0057 - avg acc: 97.7% - val-roc: 0.8673 - val-ap: 0.8913 (0.1s/epoch)
Epoch  720/1400:Epoch loss: 0.0069 - avg acc: 99.2% - val-roc: 0.8724 - val-ap: 0.8931 (0.1s/epoch)
Epoch  721/1400:Epoch loss: 0.0025 - avg acc: 99.2% - val-roc: 0.8776 - val-ap: 0.8954 (0.1s/epoch)
Epoch  722/1400:Epoch loss: 0.0714 - avg acc: 99.2% - val-roc: 0.8724 - val-ap: 0.8980 (0.1s/epoch)
Epoch  723/1400:Epoch loss: 0.0132 - avg acc: 66.4% - val-roc: 0.8214 - val-ap: 0.8539 (0.1s/epoch)
Epoch  724/1400:Epoch loss: 0.1202 - avg acc: 96.9% - val-roc: 0.8214 - val-ap: 0.7858 (0.1s/epoch)
Epoch  725/1400:Epoch loss: 0.0151 - avg acc: 96.9% - val-roc: 0.8571 - val-ap: 0.8462 (0.1s/epoch)
Epoch  726/1400:Epoch loss: 0.0138 - avg acc: 96.9% - val-roc: 0.8699 - val-ap: 0.8479 (0.1s/epoch)
Epoch  727/1400:Epoch loss: 0.0445 - avg acc: 98.5% - val-roc: 0.8418 - val-ap: 0.7849 (0.2s/epoch)
Epoch  728/1400:Epoch loss: 0.0040 - avg acc: 95.4% - val-roc: 0.7449 - val-ap: 0.7096 (0.1s/epoch)
Epoch  729/1400:Epoch loss: 0.1537 - avg acc: 90.8% - val-roc: 0.8163 - val-ap: 0.7526 (0.1s/epoch)
Epoch  730/1400:Epoch loss: 0.0704 - avg acc: 90.1% - val-roc: 0.8214 - val-ap: 0.7588 (0.1s/epoch)
Epoch  731/1400:Epoch loss: 0.0720 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7677 (0.1s/epoch)
Epoch  732/1400:Epoch loss: 0.0362 - avg acc: 97.7% - val-roc: 0.8112 - val-ap: 0.7590 (0.1s/epoch)
Epoch  733/1400:Epoch loss: 0.0332 - avg acc: 97.7% - val-roc: 0.8112 - val-ap: 0.7590 (0.1s/epoch)
Epoch  734/1400:Epoch loss: 0.0204 - avg acc: 97.7% - val-roc: 0.7959 - val-ap: 0.7535 (0.1s/epoch)
Epoch  735/1400:Epoch loss: 0.0224 - avg acc: 97.7% - val-roc: 0.8112 - val-ap: 0.7720 (0.1s/epoch)
Epoch  736/1400:Epoch loss: 0.0186 - avg acc: 97.7% - val-roc: 0.8214 - val-ap: 0.7756 (0.1s/epoch)
Epoch  737/1400:Epoch loss: 0.0143 - avg acc: 97.7% - val-roc: 0.8163 - val-ap: 0.7739 (0.1s/epoch)
Epoch  738/1400:Epoch loss: 0.0093 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7803 (0.1s/epoch)
Epoch  739/1400:Epoch loss: 0.0082 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7744 (0.1s/epoch)
Epoch  740/1400:Epoch loss: 0.0063 - avg acc: 97.7% - val-roc: 0.8265 - val-ap: 0.7761 (0.1s/epoch)
Epoch  741/1400:Epoch loss: 0.0033 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7744 (0.1s/epoch)
Epoch  742/1400:Epoch loss: 0.0065 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.7723 (0.1s/epoch)
Epoch  743/1400:Epoch loss: 0.0025 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7705 (0.1s/epoch)
Epoch  744/1400:Epoch loss: 0.0024 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7782 (0.1s/epoch)
Epoch  745/1400:Epoch loss: 0.0028 - avg acc: 98.5% - val-roc: 0.8163 - val-ap: 0.7705 (0.1s/epoch)
Epoch  746/1400:Epoch loss: 0.0020 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.7765 (0.1s/epoch)
Epoch  747/1400:Epoch loss: 0.0013 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.7744 (0.1s/epoch)
Epoch  748/1400:Epoch loss: 0.0025 - avg acc: 99.2% - val-roc: 0.8291 - val-ap: 0.7725 (0.1s/epoch)
Epoch  749/1400:Epoch loss: 0.0017 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7762 (0.1s/epoch)
Epoch  750/1400:Epoch loss: 0.0023 - avg acc: 98.5% - val-roc: 0.8138 - val-ap: 0.7724 (0.1s/epoch)
Epoch  751/1400:Epoch loss: 0.0012 - avg acc: 99.2% - val-roc: 0.8138 - val-ap: 0.7724 (0.1s/epoch)
Epoch  752/1400:Epoch loss: 0.0035 - avg acc: 99.2% - val-roc: 0.8138 - val-ap: 0.7724 (0.1s/epoch)
Epoch  753/1400:Epoch loss: 0.0008 - avg acc: 99.2% - val-roc: 0.8138 - val-ap: 0.7664 (0.1s/epoch)
Epoch  754/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7734 (0.1s/epoch)
Epoch  755/1400:Epoch loss: 0.0006 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7698 (0.1s/epoch)
Epoch  756/1400:Epoch loss: 0.0018 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7698 (0.1s/epoch)
Epoch  757/1400:Epoch loss: 0.0018 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.7680 (0.1s/epoch)
Epoch  758/1400:Epoch loss: 0.0005 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.7680 (0.1s/epoch)
Epoch  759/1400:Epoch loss: 0.0016 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.7697 (0.1s/epoch)
Epoch  760/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7739 (0.1s/epoch)
Epoch  761/1400:Epoch loss: 0.0022 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7754 (0.1s/epoch)
Epoch  762/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7811 (0.1s/epoch)
Epoch  763/1400:Epoch loss: 0.0036 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.7849 (0.1s/epoch)
Epoch  764/1400:Epoch loss: 0.0028 - avg acc: 99.2% - val-roc: 0.8342 - val-ap: 0.7835 (0.1s/epoch)
Epoch  765/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8291 - val-ap: 0.7798 (0.1s/epoch)
Epoch  766/1400:Epoch loss: 0.0015 - avg acc: 99.2% - val-roc: 0.8291 - val-ap: 0.7739 (0.1s/epoch)
Epoch  767/1400:Epoch loss: 0.0008 - avg acc: 99.2% - val-roc: 0.8291 - val-ap: 0.7815 (0.1s/epoch)
Epoch  768/1400:Epoch loss: 0.0057 - avg acc: 99.2% - val-roc: 0.8240 - val-ap: 0.7780 (0.1s/epoch)
Epoch  769/1400:Epoch loss: 0.0309 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.7838 (0.1s/epoch)
Epoch  770/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8323 (0.1s/epoch)
Epoch  771/1400:Epoch loss: 0.2239 - avg acc: 99.2% - val-roc: 0.8036 - val-ap: 0.7629 (0.1s/epoch)
Epoch  772/1400:Epoch loss: 0.1008 - avg acc: 45.8% - val-roc: 0.6276 - val-ap: 0.6119 (0.1s/epoch)
Epoch  773/1400:Epoch loss: 0.0800 - avg acc: 47.3% - val-roc: 0.6429 - val-ap: 0.6260 (0.1s/epoch)
Epoch  774/1400:Epoch loss: 0.0591 - avg acc: 50.4% - val-roc: 0.6429 - val-ap: 0.6273 (0.1s/epoch)
Epoch  775/1400:Epoch loss: 0.0706 - avg acc: 63.4% - val-roc: 0.6837 - val-ap: 0.6814 (0.1s/epoch)
Epoch  776/1400:Epoch loss: 0.0400 - avg acc: 71.0% - val-roc: 0.6735 - val-ap: 0.6778 (0.1s/epoch)
Epoch  777/1400:Epoch loss: 0.0548 - avg acc: 97.7% - val-roc: 0.7704 - val-ap: 0.7373 (0.1s/epoch)
Epoch  778/1400:Epoch loss: 0.0145 - avg acc: 96.9% - val-roc: 0.8622 - val-ap: 0.8477 (0.1s/epoch)
Epoch  779/1400:Epoch loss: 0.0354 - avg acc: 96.9% - val-roc: 0.8724 - val-ap: 0.8694 (0.1s/epoch)
Epoch  780/1400:Epoch loss: 0.0198 - avg acc: 99.2% - val-roc: 0.8520 - val-ap: 0.8205 (0.1s/epoch)
Epoch  781/1400:Epoch loss: 0.0090 - avg acc: 97.7% - val-roc: 0.8061 - val-ap: 0.7621 (0.1s/epoch)
Epoch  782/1400:Epoch loss: 0.0035 - avg acc: 98.5% - val-roc: 0.8087 - val-ap: 0.7647 (0.1s/epoch)
Epoch  783/1400:Epoch loss: 0.0089 - avg acc: 98.5% - val-roc: 0.8061 - val-ap: 0.7961 (0.1s/epoch)
Epoch  784/1400:Epoch loss: 0.0106 - avg acc: 98.5% - val-roc: 0.8087 - val-ap: 0.7961 (0.1s/epoch)
Epoch  785/1400:Epoch loss: 0.0094 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.8243 (0.1s/epoch)
Epoch  786/1400:Epoch loss: 0.0092 - avg acc: 98.5% - val-roc: 0.8214 - val-ap: 0.8395 (0.1s/epoch)
Epoch  787/1400:Epoch loss: 0.0046 - avg acc: 97.7% - val-roc: 0.8316 - val-ap: 0.8556 (0.1s/epoch)
Epoch  788/1400:Epoch loss: 0.0059 - avg acc: 97.7% - val-roc: 0.8163 - val-ap: 0.8160 (0.1s/epoch)
Epoch  789/1400:Epoch loss: 0.0044 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.8270 (0.1s/epoch)
Epoch  790/1400:Epoch loss: 0.0020 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8250 (0.1s/epoch)
Epoch  791/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8250 (0.1s/epoch)
Epoch  792/1400:Epoch loss: 0.0053 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8358 (0.1s/epoch)
Epoch  793/1400:Epoch loss: 0.0028 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8469 (0.1s/epoch)
Epoch  794/1400:Epoch loss: 0.0015 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8501 (0.1s/epoch)
Epoch  795/1400:Epoch loss: 0.0045 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.8358 (0.1s/epoch)
Epoch  796/1400:Epoch loss: 0.0035 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8393 (0.1s/epoch)
Epoch  797/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8437 (0.1s/epoch)
Epoch  798/1400:Epoch loss: 0.0067 - avg acc: 99.2% - val-roc: 0.8214 - val-ap: 0.8393 (0.1s/epoch)
Epoch  799/1400:Epoch loss: 0.0011 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.8579 (0.1s/epoch)
Epoch  800/1400:Epoch loss: 0.0034 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.8579 (0.1s/epoch)
Epoch  801/1400:Epoch loss: 0.0009 - avg acc: 99.2% - val-roc: 0.8316 - val-ap: 0.8579 (0.1s/epoch)
Epoch  802/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8587 (0.1s/epoch)
Epoch  803/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8437 (0.1s/epoch)
Epoch  804/1400:Epoch loss: 0.0027 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8437 (0.1s/epoch)
Epoch  805/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8258 (0.1s/epoch)
Epoch  806/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8258 (0.1s/epoch)
Epoch  807/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8268 (0.1s/epoch)
Epoch  808/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8258 (0.1s/epoch)
Epoch  809/1400:Epoch loss: 0.0027 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8258 (0.1s/epoch)
Epoch  810/1400:Epoch loss: 0.0019 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8199 (0.1s/epoch)
Epoch  811/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8199 (0.1s/epoch)
Epoch  812/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8199 (0.1s/epoch)
Epoch  813/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8199 (0.1s/epoch)
Epoch  814/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8199 (0.1s/epoch)
Epoch  815/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8199 (0.1s/epoch)
Epoch  816/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8199 (0.1s/epoch)
Epoch  817/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7961 (0.1s/epoch)
Epoch  818/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8199 (0.1s/epoch)
Epoch  819/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7971 (0.1s/epoch)
Epoch  820/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8209 (0.1s/epoch)
Epoch  821/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7926 (0.1s/epoch)
Epoch  822/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8207 (0.1s/epoch)
Epoch  823/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8199 (0.1s/epoch)
Epoch  824/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7926 (0.1s/epoch)
Epoch  825/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8164 (0.1s/epoch)
Epoch  826/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7926 (0.1s/epoch)
Epoch  827/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8300 (0.1s/epoch)
Epoch  828/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8300 (0.1s/epoch)
Epoch  829/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8300 (0.1s/epoch)
Epoch  830/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8300 (0.1s/epoch)
Epoch  831/1400:Epoch loss: 0.0017 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7783 (0.1s/epoch)
Epoch  832/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7776 (0.1s/epoch)
Epoch  833/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7740 (0.1s/epoch)
Epoch  834/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7740 (0.1s/epoch)
Epoch  835/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7740 (0.1s/epoch)
Epoch  836/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7740 (0.1s/epoch)
Epoch  837/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7677 (0.1s/epoch)
Epoch  838/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7722 (0.1s/epoch)
Epoch  839/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7686 (0.1s/epoch)
Epoch  840/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7730 (0.1s/epoch)
Epoch  841/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7784 (0.1s/epoch)
Epoch  842/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7759 (0.1s/epoch)
Epoch  843/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7732 (0.1s/epoch)
Epoch  844/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7759 (0.1s/epoch)
Epoch  845/1400:Epoch loss: 0.0028 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7723 (0.1s/epoch)
Epoch  846/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.7832 - val-ap: 0.7615 (0.1s/epoch)
Epoch  847/1400:Epoch loss: 0.0024 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7487 (0.1s/epoch)
Epoch  848/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7679 - val-ap: 0.7514 (0.1s/epoch)
Epoch  849/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7577 (0.1s/epoch)
Epoch  850/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7612 (0.1s/epoch)
Epoch  851/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7650 (0.1s/epoch)
Epoch  852/1400:Epoch loss: 0.0087 - avg acc: 100.0% - val-roc: 0.7577 - val-ap: 0.7355 (0.1s/epoch)
Epoch  853/1400:Epoch loss: 0.0016 - avg acc: 99.2% - val-roc: 0.7577 - val-ap: 0.7367 (0.1s/epoch)
Epoch  854/1400:Epoch loss: 0.0007 - avg acc: 99.2% - val-roc: 0.7602 - val-ap: 0.7474 (0.1s/epoch)
Epoch  855/1400:Epoch loss: 0.0033 - avg acc: 100.0% - val-roc: 0.7551 - val-ap: 0.7475 (0.1s/epoch)
Epoch  856/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7603 (0.1s/epoch)
Epoch  857/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7603 (0.1s/epoch)
Epoch  858/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7704 - val-ap: 0.7674 (0.1s/epoch)
Epoch  859/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7704 - val-ap: 0.7674 (0.1s/epoch)
Epoch  860/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7787 (0.1s/epoch)
Epoch  861/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7787 (0.1s/epoch)
Epoch  862/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7704 (0.1s/epoch)
Epoch  863/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7758 (0.1s/epoch)
Epoch  864/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7879 (0.1s/epoch)
Epoch  865/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7883 - val-ap: 0.7934 (0.1s/epoch)
Epoch  866/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7849 (0.1s/epoch)
Epoch  867/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7879 (0.1s/epoch)
Epoch  868/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  869/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  870/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  871/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  872/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  873/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7997 (0.1s/epoch)
Epoch  874/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7982 (0.1s/epoch)
Epoch  875/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7927 (0.1s/epoch)
Epoch  876/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8060 (0.1s/epoch)
Epoch  877/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8060 (0.1s/epoch)
Epoch  878/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8060 (0.1s/epoch)
Epoch  879/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7927 (0.1s/epoch)
Epoch  880/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7997 (0.1s/epoch)
Epoch  881/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7982 (0.1s/epoch)
Epoch  882/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.8004 (0.1s/epoch)
Epoch  883/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7949 (0.1s/epoch)
Epoch  884/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7919 (0.1s/epoch)
Epoch  885/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7919 (0.1s/epoch)
Epoch  886/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7949 (0.1s/epoch)
Epoch  887/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  888/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8082 (0.1s/epoch)
Epoch  889/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  890/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8082 (0.1s/epoch)
Epoch  891/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  892/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  893/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  894/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.8082 (0.1s/epoch)
Epoch  895/1400:Epoch loss: 0.0025 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8050 (0.1s/epoch)
Epoch  896/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7915 (0.1s/epoch)
Epoch  897/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7850 (0.1s/epoch)
Epoch  898/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7850 (0.1s/epoch)
Epoch  899/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.8035 (0.1s/epoch)
Epoch  900/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.8063 (0.1s/epoch)
Epoch  901/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  902/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.8019 (0.1s/epoch)
Epoch  903/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  904/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  905/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7864 (0.1s/epoch)
Epoch  906/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  907/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  908/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7982 (0.1s/epoch)
Epoch  909/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.8082 (0.1s/epoch)
Epoch  910/1400:Epoch loss: 0.0067 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.8141 (0.1s/epoch)
Epoch  911/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8154 (0.1s/epoch)
Epoch  912/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.8055 (0.1s/epoch)
Epoch  913/1400:Epoch loss: 0.0234 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7787 (0.1s/epoch)
Epoch  914/1400:Epoch loss: 0.0305 - avg acc: 97.7% - val-roc: 0.7372 - val-ap: 0.7193 (0.1s/epoch)
Epoch  915/1400:Epoch loss: 0.0025 - avg acc: 96.2% - val-roc: 0.7959 - val-ap: 0.8239 (0.1s/epoch)
Epoch  916/1400:Epoch loss: 0.0689 - avg acc: 96.2% - val-roc: 0.7806 - val-ap: 0.8108 (0.1s/epoch)
Epoch  917/1400:Epoch loss: 0.0463 - avg acc: 86.3% - val-roc: 0.6531 - val-ap: 0.6423 (0.1s/epoch)
Epoch  918/1400:Epoch loss: 0.0591 - avg acc: 96.2% - val-roc: 0.8827 - val-ap: 0.8548 (0.1s/epoch)
Epoch  919/1400:Epoch loss: 0.0289 - avg acc: 90.1% - val-roc: 0.8878 - val-ap: 0.8582 (0.1s/epoch)
Epoch  920/1400:Epoch loss: 0.0348 - avg acc: 100.0% - val-roc: 0.8724 - val-ap: 0.8435 (0.1s/epoch)
Epoch  921/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8452 (0.1s/epoch)
Epoch  922/1400:Epoch loss: 0.0067 - avg acc: 98.5% - val-roc: 0.8367 - val-ap: 0.8319 (0.1s/epoch)
Epoch  923/1400:Epoch loss: 0.0052 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.8744 (0.1s/epoch)
Epoch  924/1400:Epoch loss: 0.0107 - avg acc: 99.2% - val-roc: 0.8673 - val-ap: 0.8974 (0.1s/epoch)
Epoch  925/1400:Epoch loss: 0.0026 - avg acc: 99.2% - val-roc: 0.8878 - val-ap: 0.9120 (0.1s/epoch)
Epoch  926/1400:Epoch loss: 0.0073 - avg acc: 98.5% - val-roc: 0.8827 - val-ap: 0.9096 (0.1s/epoch)
Epoch  927/1400:Epoch loss: 0.0030 - avg acc: 99.2% - val-roc: 0.8724 - val-ap: 0.9054 (0.1s/epoch)
Epoch  928/1400:Epoch loss: 0.0021 - avg acc: 98.5% - val-roc: 0.8622 - val-ap: 0.8885 (0.1s/epoch)
Epoch  929/1400:Epoch loss: 0.0015 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8791 (0.1s/epoch)
Epoch  930/1400:Epoch loss: 0.0024 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8804 (0.1s/epoch)
Epoch  931/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8823 (0.1s/epoch)
Epoch  932/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8823 (0.1s/epoch)
Epoch  933/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8823 (0.1s/epoch)
Epoch  934/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8836 (0.1s/epoch)
Epoch  935/1400:Epoch loss: 0.0059 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8672 (0.1s/epoch)
Epoch  936/1400:Epoch loss: 0.0019 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8636 (0.1s/epoch)
Epoch  937/1400:Epoch loss: 0.0037 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8619 (0.1s/epoch)
Epoch  938/1400:Epoch loss: 0.0028 - avg acc: 100.0% - val-roc: 0.8622 - val-ap: 0.8704 (0.1s/epoch)
Epoch  939/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8130 (0.1s/epoch)
Epoch  940/1400:Epoch loss: 0.0059 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8634 (0.1s/epoch)
Epoch  941/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8602 (0.1s/epoch)
Epoch  942/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8602 (0.1s/epoch)
Epoch  943/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8013 (0.1s/epoch)
Epoch  944/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8023 (0.1s/epoch)
Epoch  945/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8023 (0.1s/epoch)
Epoch  946/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8023 (0.1s/epoch)
Epoch  947/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8013 (0.1s/epoch)
Epoch  948/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8013 (0.1s/epoch)
Epoch  949/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8063 (0.1s/epoch)
Epoch  950/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8063 (0.1s/epoch)
Epoch  951/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  952/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  953/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  954/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  955/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  956/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8035 (0.1s/epoch)
Epoch  957/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  958/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  959/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  960/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  961/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  962/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  963/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  964/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  965/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8088 (0.1s/epoch)
Epoch  966/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8055 (0.1s/epoch)
Epoch  967/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8065 (0.1s/epoch)
Epoch  968/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  969/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  970/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  971/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8088 (0.1s/epoch)
Epoch  972/1400:Epoch loss: 0.0011 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8055 (0.1s/epoch)
Epoch  973/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8080 (0.1s/epoch)
Epoch  974/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8002 (0.1s/epoch)
Epoch  975/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  976/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8168 (0.1s/epoch)
Epoch  977/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8130 (0.1s/epoch)
Epoch  978/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8168 (0.1s/epoch)
Epoch  979/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8143 (0.1s/epoch)
Epoch  980/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8143 (0.1s/epoch)
Epoch  981/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  982/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  983/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  984/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  985/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8090 (0.1s/epoch)
Epoch  986/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  987/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8047 (0.1s/epoch)
Epoch  988/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8090 (0.1s/epoch)
Epoch  989/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  990/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8140 (0.1s/epoch)
Epoch  991/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8193 (0.1s/epoch)
Epoch  992/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8190 (0.1s/epoch)
Epoch  993/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8190 (0.1s/epoch)
Epoch  994/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8190 (0.1s/epoch)
Epoch  995/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8190 (0.1s/epoch)
Epoch  996/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8190 (0.1s/epoch)
Epoch  997/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8275 (0.1s/epoch)
Epoch  998/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8275 (0.1s/epoch)
Epoch  999/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.8211 (0.1s/epoch)
Epoch  1000/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1001/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1002/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1003/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1004/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1005/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1006/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1007/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1008/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1009/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1010/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1011/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1012/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1013/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1014/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8341 (0.1s/epoch)
Epoch  1015/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8392 (0.1s/epoch)
Epoch  1016/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8392 (0.1s/epoch)
Epoch  1017/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8597 - val-ap: 0.8392 (0.1s/epoch)
Epoch  1018/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8571 - val-ap: 0.8325 (0.1s/epoch)
Epoch  1019/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8294 (0.1s/epoch)
Epoch  1020/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.8360 (0.1s/epoch)
Epoch  1021/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1022/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1023/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8284 (0.1s/epoch)
Epoch  1024/1400:Epoch loss: 0.0052 - avg acc: 97.7% - val-roc: 0.8061 - val-ap: 0.7780 (0.1s/epoch)
Epoch  1025/1400:Epoch loss: 0.0001 - avg acc: 91.6% - val-roc: 0.7857 - val-ap: 0.7473 (0.1s/epoch)
Epoch  1026/1400:Epoch loss: 0.0260 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1027/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8648 - val-ap: 0.8522 (0.1s/epoch)
Epoch  1028/1400:Epoch loss: 0.0516 - avg acc: 97.7% - val-roc: 0.8112 - val-ap: 0.8374 (0.1s/epoch)
Epoch  1029/1400:Epoch loss: 0.0179 - avg acc: 52.7% - val-roc: 0.6020 - val-ap: 0.5965 (0.1s/epoch)
Epoch  1030/1400:Epoch loss: 0.0527 - avg acc: 92.4% - val-roc: 0.7602 - val-ap: 0.7165 (0.1s/epoch)
Epoch  1031/1400:Epoch loss: 0.0232 - avg acc: 99.2% - val-roc: 0.8010 - val-ap: 0.8037 (0.1s/epoch)
Epoch  1032/1400:Epoch loss: 0.0021 - avg acc: 99.2% - val-roc: 0.8367 - val-ap: 0.8264 (0.1s/epoch)
Epoch  1033/1400:Epoch loss: 0.0123 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8305 (0.1s/epoch)
Epoch  1034/1400:Epoch loss: 0.0044 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8319 (0.1s/epoch)
Epoch  1035/1400:Epoch loss: 0.0098 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8319 (0.1s/epoch)
Epoch  1036/1400:Epoch loss: 0.0043 - avg acc: 98.5% - val-roc: 0.8520 - val-ap: 0.8331 (0.1s/epoch)
Epoch  1037/1400:Epoch loss: 0.0104 - avg acc: 99.2% - val-roc: 0.8648 - val-ap: 0.8819 (0.1s/epoch)
Epoch  1038/1400:Epoch loss: 0.0025 - avg acc: 99.2% - val-roc: 0.8622 - val-ap: 0.8819 (0.1s/epoch)
Epoch  1039/1400:Epoch loss: 0.0022 - avg acc: 99.2% - val-roc: 0.8469 - val-ap: 0.8514 (0.1s/epoch)
Epoch  1040/1400:Epoch loss: 0.0144 - avg acc: 100.0% - val-roc: 0.8673 - val-ap: 0.8392 (0.1s/epoch)
Epoch  1041/1400:Epoch loss: 0.0008 - avg acc: 99.2% - val-roc: 0.9158 - val-ap: 0.9147 (0.1s/epoch)
Epoch  1042/1400:Epoch loss: 0.0517 - avg acc: 99.2% - val-roc: 0.9235 - val-ap: 0.9267 (0.1s/epoch)
Epoch  1043/1400:Epoch loss: 0.0307 - avg acc: 99.2% - val-roc: 0.8750 - val-ap: 0.8780 (0.1s/epoch)
Epoch  1044/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8501 (0.1s/epoch)
Epoch  1045/1400:Epoch loss: 0.0133 - avg acc: 97.7% - val-roc: 0.8061 - val-ap: 0.8417 (0.1s/epoch)
Epoch  1046/1400:Epoch loss: 0.0058 - avg acc: 99.2% - val-roc: 0.8163 - val-ap: 0.8550 (0.1s/epoch)
Epoch  1047/1400:Epoch loss: 0.0018 - avg acc: 99.2% - val-roc: 0.8265 - val-ap: 0.8601 (0.1s/epoch)
Epoch  1048/1400:Epoch loss: 0.0680 - avg acc: 96.2% - val-roc: 0.8291 - val-ap: 0.8114 (0.1s/epoch)
Epoch  1049/1400:Epoch loss: 0.0593 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7926 (0.1s/epoch)
Epoch  1050/1400:Epoch loss: 0.0868 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7927 (0.1s/epoch)
Epoch  1051/1400:Epoch loss: 0.0098 - avg acc: 96.9% - val-roc: 0.8265 - val-ap: 0.8050 (0.1s/epoch)
Epoch  1052/1400:Epoch loss: 0.1831 - avg acc: 95.4% - val-roc: 0.8061 - val-ap: 0.8535 (0.1s/epoch)
Epoch  1053/1400:Epoch loss: 0.0225 - avg acc: 90.1% - val-roc: 0.7500 - val-ap: 0.7834 (0.1s/epoch)
Epoch  1054/1400:Epoch loss: 0.0363 - avg acc: 99.2% - val-roc: 0.7653 - val-ap: 0.7379 (0.1s/epoch)
Epoch  1055/1400:Epoch loss: 0.0121 - avg acc: 99.2% - val-roc: 0.8087 - val-ap: 0.7564 (0.1s/epoch)
Epoch  1056/1400:Epoch loss: 0.0467 - avg acc: 98.5% - val-roc: 0.7959 - val-ap: 0.7474 (0.1s/epoch)
Epoch  1057/1400:Epoch loss: 0.0251 - avg acc: 83.2% - val-roc: 0.7194 - val-ap: 0.7037 (0.1s/epoch)
Epoch  1058/1400:Epoch loss: 0.0208 - avg acc: 99.2% - val-roc: 0.7551 - val-ap: 0.7296 (0.1s/epoch)
Epoch  1059/1400:Epoch loss: 0.0079 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7577 (0.1s/epoch)
Epoch  1060/1400:Epoch loss: 0.0094 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7446 (0.1s/epoch)
Epoch  1061/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.7602 - val-ap: 0.7401 (0.1s/epoch)
Epoch  1062/1400:Epoch loss: 0.0012 - avg acc: 97.7% - val-roc: 0.7449 - val-ap: 0.7345 (0.1s/epoch)
Epoch  1063/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.7551 - val-ap: 0.7468 (0.1s/epoch)
Epoch  1064/1400:Epoch loss: 0.0081 - avg acc: 100.0% - val-roc: 0.7832 - val-ap: 0.7641 (0.1s/epoch)
Epoch  1065/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7747 (0.1s/epoch)
Epoch  1066/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7880 (0.1s/epoch)
Epoch  1067/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7878 (0.1s/epoch)
Epoch  1068/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7858 (0.1s/epoch)
Epoch  1069/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7873 (0.1s/epoch)
Epoch  1070/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7873 (0.1s/epoch)
Epoch  1071/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8010 - val-ap: 0.7813 (0.1s/epoch)
Epoch  1072/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7795 (0.1s/epoch)
Epoch  1073/1400:Epoch loss: 0.0014 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7795 (0.1s/epoch)
Epoch  1074/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7770 (0.1s/epoch)
Epoch  1075/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7770 (0.1s/epoch)
Epoch  1076/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7737 (0.1s/epoch)
Epoch  1077/1400:Epoch loss: 0.0023 - avg acc: 100.0% - val-roc: 0.7883 - val-ap: 0.7832 (0.1s/epoch)
Epoch  1078/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.7806 - val-ap: 0.7720 (0.1s/epoch)
Epoch  1079/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.7704 - val-ap: 0.7549 (0.1s/epoch)
Epoch  1080/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7492 (0.1s/epoch)
Epoch  1081/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7492 (0.1s/epoch)
Epoch  1082/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7492 (0.1s/epoch)
Epoch  1083/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.7653 - val-ap: 0.7492 (0.1s/epoch)
Epoch  1084/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7630 (0.1s/epoch)
Epoch  1085/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7630 (0.1s/epoch)
Epoch  1086/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7781 - val-ap: 0.7662 (0.1s/epoch)
Epoch  1087/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.7832 - val-ap: 0.7687 (0.1s/epoch)
Epoch  1088/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7704 - val-ap: 0.7683 (0.1s/epoch)
Epoch  1089/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7708 (0.1s/epoch)
Epoch  1090/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7704 (0.1s/epoch)
Epoch  1091/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7734 (0.1s/epoch)
Epoch  1092/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7755 - val-ap: 0.7734 (0.1s/epoch)
Epoch  1093/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7704 - val-ap: 0.7708 (0.1s/epoch)
Epoch  1094/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7781 - val-ap: 0.7671 (0.1s/epoch)
Epoch  1095/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.7806 - val-ap: 0.7737 (0.1s/epoch)
Epoch  1096/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7730 - val-ap: 0.7642 (0.1s/epoch)
Epoch  1097/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7781 - val-ap: 0.7671 (0.1s/epoch)
Epoch  1098/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.7781 - val-ap: 0.7650 (0.1s/epoch)
Epoch  1099/1400:Epoch loss: 0.0675 - avg acc: 90.8% - val-roc: 0.7449 - val-ap: 0.7260 (0.1s/epoch)
Epoch  1100/1400:Epoch loss: 0.0509 - avg acc: 41.2% - val-roc: 0.5153 - val-ap: 0.5673 (0.1s/epoch)
Epoch  1101/1400:Epoch loss: 0.0656 - avg acc: 75.6% - val-roc: 0.6122 - val-ap: 0.6041 (0.1s/epoch)
Epoch  1102/1400:Epoch loss: 0.0246 - avg acc: 93.1% - val-roc: 0.7194 - val-ap: 0.6937 (0.1s/epoch)
Epoch  1103/1400:Epoch loss: 0.0736 - avg acc: 87.0% - val-roc: 0.7092 - val-ap: 0.6884 (0.1s/epoch)
Epoch  1104/1400:Epoch loss: 0.0158 - avg acc: 91.6% - val-roc: 0.7347 - val-ap: 0.7096 (0.1s/epoch)
Epoch  1105/1400:Epoch loss: 0.0186 - avg acc: 99.2% - val-roc: 0.7653 - val-ap: 0.7452 (0.1s/epoch)
Epoch  1106/1400:Epoch loss: 0.0042 - avg acc: 100.0% - val-roc: 0.7832 - val-ap: 0.7813 (0.1s/epoch)
Epoch  1107/1400:Epoch loss: 0.0152 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7764 (0.1s/epoch)
Epoch  1108/1400:Epoch loss: 0.0013 - avg acc: 98.5% - val-roc: 0.7781 - val-ap: 0.7635 (0.1s/epoch)
Epoch  1109/1400:Epoch loss: 0.0071 - avg acc: 98.5% - val-roc: 0.7806 - val-ap: 0.7543 (0.1s/epoch)
Epoch  1110/1400:Epoch loss: 0.0021 - avg acc: 99.2% - val-roc: 0.8010 - val-ap: 0.7613 (0.1s/epoch)
Epoch  1111/1400:Epoch loss: 0.0008 - avg acc: 99.2% - val-roc: 0.8010 - val-ap: 0.7613 (0.1s/epoch)
Epoch  1112/1400:Epoch loss: 0.0027 - avg acc: 99.2% - val-roc: 0.8138 - val-ap: 0.7837 (0.1s/epoch)
Epoch  1113/1400:Epoch loss: 0.0026 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.7836 (0.1s/epoch)
Epoch  1114/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1115/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1116/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1117/1400:Epoch loss: 0.0010 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1118/1400:Epoch loss: 0.0012 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1119/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1120/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1121/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1122/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1123/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7788 (0.1s/epoch)
Epoch  1124/1400:Epoch loss: 0.0015 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7785 (0.1s/epoch)
Epoch  1125/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7768 (0.1s/epoch)
Epoch  1126/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1127/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1128/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7807 (0.1s/epoch)
Epoch  1129/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7830 (0.1s/epoch)
Epoch  1130/1400:Epoch loss: 0.0022 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7924 (0.1s/epoch)
Epoch  1131/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7761 (0.1s/epoch)
Epoch  1132/1400:Epoch loss: 0.0023 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7761 (0.1s/epoch)
Epoch  1133/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7761 (0.1s/epoch)
Epoch  1134/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7830 (0.1s/epoch)
Epoch  1135/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7847 (0.1s/epoch)
Epoch  1136/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.7866 (0.1s/epoch)
Epoch  1137/1400:Epoch loss: 0.0009 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7823 (0.1s/epoch)
Epoch  1138/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7847 (0.1s/epoch)
Epoch  1139/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7823 (0.1s/epoch)
Epoch  1140/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7823 (0.1s/epoch)
Epoch  1141/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7823 (0.1s/epoch)
Epoch  1142/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7807 (0.1s/epoch)
Epoch  1143/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7807 (0.1s/epoch)
Epoch  1144/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7823 (0.1s/epoch)
Epoch  1145/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1146/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1147/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7799 (0.1s/epoch)
Epoch  1148/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1149/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1150/1400:Epoch loss: 0.0024 - avg acc: 100.0% - val-roc: 0.7985 - val-ap: 0.7791 (0.1s/epoch)
Epoch  1151/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7934 - val-ap: 0.7760 (0.1s/epoch)
Epoch  1152/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7883 - val-ap: 0.7722 (0.1s/epoch)
Epoch  1153/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.7908 - val-ap: 0.7829 (0.1s/epoch)
Epoch  1154/1400:Epoch loss: 0.0042 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7867 (0.1s/epoch)
Epoch  1155/1400:Epoch loss: 0.0001 - avg acc: 99.2% - val-roc: 0.7883 - val-ap: 0.7739 (0.1s/epoch)
Epoch  1156/1400:Epoch loss: 0.0007 - avg acc: 99.2% - val-roc: 0.7832 - val-ap: 0.7725 (0.1s/epoch)
Epoch  1157/1400:Epoch loss: 0.0007 - avg acc: 99.2% - val-roc: 0.7832 - val-ap: 0.7725 (0.1s/epoch)
Epoch  1158/1400:Epoch loss: 0.0063 - avg acc: 100.0% - val-roc: 0.7832 - val-ap: 0.7707 (0.1s/epoch)
Epoch  1159/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.7857 - val-ap: 0.7801 (0.1s/epoch)
Epoch  1160/1400:Epoch loss: 0.0008 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7861 (0.1s/epoch)
Epoch  1161/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.7959 - val-ap: 0.7861 (0.1s/epoch)
Epoch  1162/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7929 (0.1s/epoch)
Epoch  1163/1400:Epoch loss: 0.0013 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1164/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1165/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7948 (0.1s/epoch)
Epoch  1166/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.7914 (0.1s/epoch)
Epoch  1167/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8036 - val-ap: 0.7807 (0.1s/epoch)
Epoch  1168/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7850 (0.1s/epoch)
Epoch  1169/1400:Epoch loss: 0.0006 - avg acc: 100.0% - val-roc: 0.8087 - val-ap: 0.7850 (0.1s/epoch)
Epoch  1170/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7957 (0.1s/epoch)
Epoch  1171/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7989 (0.1s/epoch)
Epoch  1172/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7989 (0.1s/epoch)
Epoch  1173/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7989 (0.1s/epoch)
Epoch  1174/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1175/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1176/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1177/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1178/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1179/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1180/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1181/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1182/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1183/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1184/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1185/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1186/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1187/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1188/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1189/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1190/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1191/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8042 (0.1s/epoch)
Epoch  1192/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1193/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.8006 (0.1s/epoch)
Epoch  1194/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8042 (0.1s/epoch)
Epoch  1195/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8265 - val-ap: 0.8042 (0.1s/epoch)
Epoch  1196/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1197/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1198/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1199/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1200/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1201/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1202/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1203/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1204/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1205/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1206/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1207/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1208/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1209/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1210/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1211/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1212/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1213/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1214/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1215/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1216/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1217/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1218/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1219/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1220/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1221/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1222/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1223/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1224/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1225/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1226/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1227/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1228/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1229/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1230/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1231/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7963 (0.1s/epoch)
Epoch  1232/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1233/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1234/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8214 - val-ap: 0.7999 (0.1s/epoch)
Epoch  1235/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8163 - val-ap: 0.7982 (0.1s/epoch)
Epoch  1236/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1237/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1238/1400:Epoch loss: 0.0030 - avg acc: 100.0% - val-roc: 0.8112 - val-ap: 0.7946 (0.1s/epoch)
Epoch  1239/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8138 - val-ap: 0.8024 (0.1s/epoch)
Epoch  1240/1400:Epoch loss: 0.0080 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1241/1400:Epoch loss: 0.0002 - avg acc: 99.2% - val-roc: 0.8138 - val-ap: 0.8090 (0.1s/epoch)
Epoch  1242/1400:Epoch loss: 0.0089 - avg acc: 99.2% - val-roc: 0.8189 - val-ap: 0.8128 (0.1s/epoch)
Epoch  1243/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8131 (0.1s/epoch)
Epoch  1244/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1245/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1246/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1247/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1248/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1249/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8161 (0.1s/epoch)
Epoch  1250/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1251/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1252/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1253/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1254/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1255/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1256/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1257/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1258/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1259/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1260/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1261/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8155 (0.1s/epoch)
Epoch  1262/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8146 (0.1s/epoch)
Epoch  1263/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1264/1400:Epoch loss: 0.0004 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1265/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1266/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1267/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1268/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1269/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1270/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1271/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8113 (0.1s/epoch)
Epoch  1272/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1273/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1274/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1275/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1276/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8113 (0.1s/epoch)
Epoch  1277/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1278/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1279/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1280/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1281/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1282/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1283/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1284/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1285/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1286/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1287/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1288/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1289/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1290/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1291/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1292/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1293/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1294/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1295/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1296/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1297/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1298/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1299/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1300/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1301/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1302/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1303/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1304/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1305/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8105 (0.1s/epoch)
Epoch  1306/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1307/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8069 (0.1s/epoch)
Epoch  1308/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1309/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1310/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1311/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1312/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1313/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1314/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1315/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1316/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1317/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1318/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1319/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8082 (0.1s/epoch)
Epoch  1320/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1321/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8094 (0.1s/epoch)
Epoch  1322/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1323/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8130 (0.1s/epoch)
Epoch  1324/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8120 (0.1s/epoch)
Epoch  1325/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8291 - val-ap: 0.8120 (0.1s/epoch)
Epoch  1326/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1327/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1328/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8240 - val-ap: 0.8115 (0.1s/epoch)
Epoch  1329/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8079 (0.1s/epoch)
Epoch  1330/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1331/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1332/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1333/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1334/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1335/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1336/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1337/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1338/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1339/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1340/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1341/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1342/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1343/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1344/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1345/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1346/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1347/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1348/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1349/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1350/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1351/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1352/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1353/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8222 (0.1s/epoch)
Epoch  1354/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1355/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1356/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1357/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1358/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1359/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1360/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1361/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1362/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1363/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1364/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1365/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1366/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1367/1400:Epoch loss: 0.0005 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1368/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1369/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1370/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1371/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1372/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1373/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1374/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8215 (0.1s/epoch)
Epoch  1375/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1376/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1377/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1378/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1379/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8232 (0.1s/epoch)
Epoch  1380/1400:Epoch loss: 0.0038 - avg acc: 100.0% - val-roc: 0.8189 - val-ap: 0.8069 (0.1s/epoch)
Epoch  1381/1400:Epoch loss: 0.0001 - avg acc: 98.5% - val-roc: 0.7857 - val-ap: 0.7820 (0.1s/epoch)
Epoch  1382/1400:Epoch loss: 0.0029 - avg acc: 100.0% - val-roc: 0.8061 - val-ap: 0.8096 (0.1s/epoch)
Epoch  1383/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8205 (0.1s/epoch)
Epoch  1384/1400:Epoch loss: 0.0018 - avg acc: 100.0% - val-roc: 0.8418 - val-ap: 0.8369 (0.1s/epoch)
Epoch  1385/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8469 - val-ap: 0.8389 (0.1s/epoch)
Epoch  1386/1400:Epoch loss: 0.0016 - avg acc: 100.0% - val-roc: 0.8520 - val-ap: 0.8421 (0.1s/epoch)
Epoch  1387/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8314 (0.1s/epoch)
Epoch  1388/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8264 (0.1s/epoch)
Epoch  1389/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8288 (0.1s/epoch)
Epoch  1390/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8444 - val-ap: 0.8288 (0.1s/epoch)
Epoch  1391/1400:Epoch loss: 0.0002 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8272 (0.1s/epoch)
Epoch  1392/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8191 (0.1s/epoch)
Epoch  1393/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8316 - val-ap: 0.8191 (0.1s/epoch)
Epoch  1394/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8209 (0.1s/epoch)
Epoch  1395/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8393 - val-ap: 0.8268 (0.1s/epoch)
Epoch  1396/1400:Epoch loss: 0.0001 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8311 (0.1s/epoch)
Epoch  1397/1400:Epoch loss: 0.0000 - avg acc: 100.0% - val-roc: 0.8342 - val-ap: 0.8249 (0.1s/epoch)
Epoch  1398/1400:Epoch loss: 0.0003 - avg acc: 100.0% - val-roc: 0.8367 - val-ap: 0.8219 (0.1s/epoch)
Epoch  1399/1400:Epoch loss: 0.0027 - avg acc: 100.0% - val-roc: 0.8495 - val-ap: 0.8306 (0.1s/epoch)
Epoch  1400/1400:Epoch loss: 0.0007 - avg acc: 100.0% - val-roc: 0.8546 - val-ap: 0.8334 (0.1s/epoch)
Done!
Test ROC: 0.8778 - Test AP: 0.9535

Plots of training history#

utils.plot_history(history)
../_images/3084b9a670801a9ce8871934081fd416c72a999b0d8afa55b386f505a3f868e6.png

Validation on unseen data#

test_roc, test_ap, preds, ys = t.test(
    dataloaders[2].dataset, model, return_preds=True
)
print(f"Test ROC-AUC: {test_roc:.4f}")
print(f"Test AP: {test_ap:.4f}")

# Plot the ROC curve
fig = t.plot_roc_curve(dataloaders[2].dataset, model)
print(
    f"Number of correct positive predictions on test set: {torch.sum((preds > 0.5) & (ys == 1)).numpy()} out of {torch.sum(ys == 1).numpy()}"
)
print(
    f"Number of correct negative predictions on test set: {torch.sum((preds < 0.5) & (ys == 0)).numpy()} out of {torch.sum(ys == 0).numpy()}"
)
Test ROC-AUC: 0.8778
Test AP: 0.9535
../_images/7b80d95788ad95d77800787d0bd964754767052d6987ce003e02c0cab1d32e09.png
Number of correct positive predictions on test set: 16 out of 20
Number of correct negative predictions on test set: 5 out of 9
utils.show_preds_distribution(preds, ys)
../_images/d89420029180ad3432bc8cf224d77f4febeabec6044f7935fa8162ba1c33a47f.png
This plot shows the distribution of the labels and predictions;
predictions are overlayed on top of the labels,
showing whether they are missing or surnumerous.
The labels are 20 positive and 9 negative.
The predictions are 20 positive and 9 negative.
utils.plot_confusion_matrix(preds, ys)
../_images/a682d4aeb6ec1945bf6a1bab749b32dde041bfdb3398b12d4d7c1b96959933ab.png
mislabeled = utils.find_mislabeled_molecules(preds, ys.numpy().astype(int))
print(f"{len(mislabeled)} mislabeled molecules")
mols = []
for id_mol in mislabeled:
    mols.append(dataloaders[2].dataset[id_mol])

thresh_preds = np.where(preds > 0.5, 1, 0)[mislabeled]
utils.draw_molecule_from_dict(
    mols[:10],
    preds=thresh_preds,
    mol_ids=mislabeled,
    n_cols=2,
    n_rows=5,
    figsize=(6,10),
)
8 mislabeled molecules
../_images/b263734f8e584cede6e67c9aafd8a0d808859acfcc75c9c407efcfec7021b198.png

Full dataset performance#

data_all = t.create_dataset_dict(add_edge_features=True)
full_dataset = t.MutagDataset(data_all)

Full ROC curve#

full_roc, full_ap, preds, ys = t.test(dataset, model, return_preds=True)
print(f"Full ROC-AUC: {full_roc:.4f}")
print(f"Full AP: {full_ap:.4f}")

# Plot the ROC curve
fig = t.plot_roc_curve(dataset, model)

preds = preds.cpu().detach().numpy()
ys = ys.cpu().detach().numpy()
print(
    f"Number of correct positive predictions on test set: {np.sum((preds > 0.5) & (ys == 1))} out of {np.sum(ys == 1)}"
)
print(
    f"Number of correct negative predictions on test set: {np.sum((preds < 0.5) & (ys == 0))} out of {np.sum(ys == 0)}"
)
Full ROC-AUC: 0.9676
Full AP: 0.9767
../_images/87a8bd5626519c488f2d07fd497a347dc39919d7c981367d53daefd51848850e.png
Number of correct positive predictions on test set: 118 out of 125
Number of correct negative predictions on test set: 55 out of 63

Predictions distribution#

utils.show_preds_distribution(preds, ys)
../_images/9950860073f70c1de9b6ab27a529c9ffbedcc818953f2ea1147ad843952eb6a4.png
This plot shows the distribution of the labels and predictions;
predictions are overlayed on top of the labels,
showing whether they are missing or surnumerous.
The labels are 125 positive and 63 negative.
The predictions are 126 positive and 62 negative.

Confusion matrix#

utils.plot_confusion_matrix(preds, ys)
../_images/f59a30e79af581fa05a62ba0d763d06dfd27d1f9a9207effb967731f08d6bc57.png

Check mislabelled molecules#

mislabeled = utils.find_mislabeled_molecules(preds, ys.astype(int))
print(f"{len(mislabeled)} mislabeled molecules")
mols = []
for id_mol in mislabeled:
    mols.append(full_dataset[id_mol])

thresh_preds = np.where(preds > 0.5, 1, 0)[mislabeled]
utils.draw_molecule_from_dict(
    mols[:30],
    preds=thresh_preds,
    mol_ids=mislabeled,
    n_cols=5,
    n_rows=6,
    figsize=(15, 15),
)
15 mislabeled molecules
../_images/137b6fde1c6cd050bbe2d17468e6b5484091b99a4bd943d8383bd3c2cc9bfe6b.png