Image Classification

In this project, you'll classify images from the CIFAR-10 dataset. The dataset consists of airplanes, dogs, cats, and other objects. You'll preprocess the images, then train a convolutional neural network on all the samples. The images need to be normalized and the labels need to be one-hot encoded. You'll get to apply what you learned and build a convolutional, max pooling, dropout, and fully connected layers. At the end, you'll get to see your neural network's predictions on the sample images.

Get the Data

Run the following cell to download the CIFAR-10 dataset for python.

In [2]:
"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
from urllib.request import urlretrieve
from os.path import isfile, isdir
from tqdm import tqdm
import problem_unittests as tests
import tarfile

cifar10_dataset_folder_path = 'cifar-10-batches-py'

class DLProgress(tqdm):
    last_block = 0

    def hook(self, block_num=1, block_size=1, total_size=None):
        self.total = total_size
        self.update((block_num - self.last_block) * block_size)
        self.last_block = block_num

if not isfile('cifar-10-python.tar.gz'):
    with DLProgress(unit='B', unit_scale=True, miniters=1, desc='CIFAR-10 Dataset') as pbar:
        urlretrieve(
            'https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz',
            'cifar-10-python.tar.gz',
            pbar.hook)

if not isdir(cifar10_dataset_folder_path):
    with tarfile.open('cifar-10-python.tar.gz') as tar:
        tar.extractall()
        tar.close()


tests.test_folder_path(cifar10_dataset_folder_path)
All files found!

Explore the Data

The dataset is broken into batches to prevent your machine from running out of memory. The CIFAR-10 dataset consists of 5 batches, named data_batch_1, data_batch_2, etc.. Each batch contains the labels and images that are one of the following:

  • airplane
  • automobile
  • bird
  • cat
  • deer
  • dog
  • frog
  • horse
  • ship
  • truck

Understanding a dataset is part of making predictions on the data. Play around with the code cell below by changing the batch_id and sample_id. The batch_id is the id for a batch (1-5). The sample_id is the id for a image and label pair in the batch.

Ask yourself "What are all possible labels?", "What is the range of values for the image data?", "Are the labels in order or random?". Answers to questions like these will help you preprocess the data and end up with better predictions.

In [3]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'

import helper
import numpy as np

# Explore the dataset
batch_id = 1
sample_id = 5
helper.display_stats(cifar10_dataset_folder_path, batch_id, sample_id)
Stats of batch 1:
Samples: 10000
Label Counts: {0: 1005, 1: 974, 2: 1032, 3: 1016, 4: 999, 5: 937, 6: 1030, 7: 1001, 8: 1025, 9: 981}
First 20 Labels: [6, 9, 9, 4, 1, 1, 2, 7, 8, 3, 4, 7, 7, 2, 9, 9, 9, 3, 2, 6]

Example of Image 5:
Image - Min Value: 0 Max Value: 252
Image - Shape: (32, 32, 3)
Label - Label Id: 1 Name: automobile

Implement Preprocess Functions

Normalize

In the cell below, implement the normalize function to take in image data, x, and return it as a normalized Numpy array. The values should be in the range of 0 to 1, inclusive. The return object should be the same shape as x.

In [4]:
def normalize(x):
    """
    Normalize a list of sample image data in the range of 0 to 1
    : x: List of image data.  The image shape is (32, 32, 3)
    : return: Numpy array of normalize data
    """
    # TODO: Implement Function
    return x / 255


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_normalize(normalize)
Tests Passed

One-hot encode

Just like the previous code cell, you'll be implementing a function for preprocessing. This time, you'll implement the one_hot_encode function. The input, x, are a list of labels. Implement the function to return the list of labels as One-Hot encoded Numpy array. The possible values for labels are 0 to 9. The one-hot encoding function should return the same encoding for each value between each call to one_hot_encode. Make sure to save the map of encodings outside the function.

Hint: Don't reinvent the wheel.

In [5]:
from sklearn.preprocessing import LabelBinarizer

encoder = LabelBinarizer()
encoder.fit(range(10))

def one_hot_encode(x):
    """
    One hot encode a list of sample labels. Return a one-hot encoded vector for each label.
    : x: List of sample Labels
    : return: Numpy array of one-hot encoded labels
    """
    # TODO: Implement Function
    
    return encoder.transform(x)

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_one_hot_encode(one_hot_encode)
Tests Passed

Randomize Data

As you saw from exploring the data above, the order of the samples are randomized. It doesn't hurt to randomize it again, but you don't need to for this dataset.

Preprocess all the data and save it

Running the code cell below will preprocess all the CIFAR-10 data and save it to file. The code below also uses 10% of the training data for validation.

In [6]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Preprocess Training, Validation, and Testing Data
helper.preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode)

Check Point

This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk.

In [7]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
import pickle
import problem_unittests as tests
import helper

# Load the Preprocessed Validation data
valid_features, valid_labels = pickle.load(open('preprocess_validation.p', mode='rb'))

Build the network

For the neural network, you'll build each layer into a function. Most of the code you've seen has been outside of functions. To test your code more thoroughly, we require that you put each layer in a function. This allows us to give you better feedback and test for simple mistakes using our unittests before you submit your project.

Note: If you're finding it hard to dedicate enough time for this course each week, we've provided a small shortcut to this part of the project. In the next couple of problems, you'll have the option to use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages to build each layer, except the layers you build in the "Convolutional and Max Pooling Layer" section. TF Layers is similar to Keras's and TFLearn's abstraction to layers, so it's easy to pickup.

However, if you would like to get the most out of this course, try to solve all the problems without using anything from the TF Layers packages. You can still use classes from other packages that happen to have the same name as ones you find in TF Layers! For example, instead of using the TF Layers version of the conv2d class, tf.layers.conv2d, you would want to use the TF Neural Network version of conv2d, tf.nn.conv2d.

Let's begin!

Input

The neural network needs to read the image data, one-hot encoded labels, and dropout keep probability. Implement the following functions

  • Implement neural_net_image_input
    • Return a TF Placeholder
    • Set the shape using image_shape with batch size set to None.
    • Name the TensorFlow placeholder "x" using the TensorFlow name parameter in the TF Placeholder.
  • Implement neural_net_label_input
    • Return a TF Placeholder
    • Set the shape using n_classes with batch size set to None.
    • Name the TensorFlow placeholder "y" using the TensorFlow name parameter in the TF Placeholder.
  • Implement neural_net_keep_prob_input
    • Return a TF Placeholder for dropout keep probability.
    • Name the TensorFlow placeholder "keep_prob" using the TensorFlow name parameter in the TF Placeholder.

These names will be used at the end of the project to load your saved model.

Note: None for shapes in TensorFlow allow for a dynamic size.

In [8]:
import tensorflow as tf

def neural_net_image_input(image_shape):
    """
    Return a Tensor for a bach of image input
    : image_shape: Shape of the images
    : return: Tensor for image input.
    """
    # TODO: Implement Function
    
    return tf.placeholder(tf.float32, shape=[None, image_shape[0], image_shape[1], image_shape[2]], name="x")


def neural_net_label_input(n_classes):
    """
    Return a Tensor for a batch of label input
    : n_classes: Number of classes
    : return: Tensor for label input.
    """
    # TODO: Implement Function
    
    return tf.placeholder(tf.float32, shape=[None, n_classes], name="y")


def neural_net_keep_prob_input():
    """
    Return a Tensor for keep probability
    : return: Tensor for keep probability.
    """
    # TODO: Implement Function
    
    return tf.placeholder(tf.float32, name="keep_prob")


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tf.reset_default_graph()
tests.test_nn_image_inputs(neural_net_image_input)
tests.test_nn_label_inputs(neural_net_label_input)
tests.test_nn_keep_prob_inputs(neural_net_keep_prob_input)
Image Input Tests Passed.
Label Input Tests Passed.
Keep Prob Tests Passed.

Convolution and Max Pooling Layer

Convolution layers have a lot of success with images. For this code cell, you should implement the function conv2d_maxpool to apply convolution then max pooling:

  • Create the weight and bias using conv_ksize, conv_num_outputs and the shape of x_tensor.
  • Apply a convolution to x_tensor using weight and conv_strides.
    • We recommend you use same padding, but you're welcome to use any padding.
  • Add bias
  • Add a nonlinear activation to the convolution.
  • Apply Max Pooling using pool_ksize and pool_strides.
    • We recommend you use same padding, but you're welcome to use any padding.

Note: You can't use TensorFlow Layers or TensorFlow Layers (contrib) for this layer, but you can still use TensorFlow's Neural Network package. You may still use the shortcut option for all the other layers.

In [9]:
def conv2d_maxpool(x_tensor, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides):
    """
    Apply convolution then max pooling to x_tensor
    :param x_tensor: TensorFlow Tensor
    :param conv_num_outputs: Number of outputs for the convolutional layer
    :param conv_ksize: kernal size 2-D Tuple for the convolutional layer
    :param conv_strides: Stride 2-D Tuple for convolution
    :param pool_ksize: kernal size 2-D Tuple for pool
    :param pool_strides: Stride 2-D Tuple for pool
    : return: A tensor that represents convolution and max pooling of x_tensor
    """
    # TODO: Implement Function
    # Weight and bias
    channels = x_tensor.get_shape().as_list()[3]

    weights = tf.Variable(tf.random_normal([conv_ksize[0], conv_ksize[1], channels, conv_num_outputs]))
    bias = tf.Variable(tf.zeros(conv_num_outputs))
    
    # Apply convolution
    conv_layer = tf.nn.conv2d(x_tensor, weights, strides=[1, conv_strides[0], conv_strides[1], 1], padding="SAME")
    
    # Add bias
    conv_layer = tf.nn.bias_add(conv_layer, bias)
    
    # Apply non-linear activation function
    conv_layer = tf.nn.relu(conv_layer)
    
    # Apply max-pooling
    conv_layer = tf.nn.max_pool(conv_layer, \
                                ksize=[1, pool_ksize[0], pool_ksize[1], 1], \
                                strides=[1, pool_strides[0], pool_strides[1], 1], \
                                padding='SAME')
    
    return conv_layer


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_con_pool(conv2d_maxpool)
Tests Passed

Flatten Layer

Implement the flatten function to change the dimension of x_tensor from a 4-D tensor to a 2-D tensor. The output should be the shape (Batch Size, Flattened Image Size). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

In [10]:
def flatten(x_tensor):
    """
    Flatten x_tensor to (Batch Size, Flattened Image Size)
    : x_tensor: A tensor of size (Batch Size, ...), where ... are the image dimensions.
    : return: A tensor of size (Batch Size, Flattened Image Size).
    """
    # TODO: Implement Function
    dim_list = x_tensor.get_shape().as_list()
    batch_size = dim_list[0]
    height = dim_list[1]
    width = dim_list[2]
    depth = dim_list[3]
    
    flattened = int(height * width * depth)
    
    return tf.reshape(x_tensor, [-1, flattened])

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_flatten(flatten)
Tests Passed

Fully-Connected Layer

Implement the fully_conn function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

In [11]:
def fully_conn(x_tensor, num_outputs):
    """
    Apply a fully connected layer to x_tensor using weight and bias
    : x_tensor: A 2-D tensor where the first dimension is batch size.
    : num_outputs: The number of output that the new tensor should be.
    : return: A 2-D tensor where the second dimension is num_outputs.
    """
    # TODO: Implement Function
    num_in = x_tensor.get_shape().as_list()[1]
    weights = tf.Variable(tf.random_normal([num_in, num_outputs]))
    bias = tf.Variable(tf.zeros(num_outputs))
    
    fully_conn = tf.add(tf.matmul(x_tensor, weights), bias)
    
    fully_conn = tf.nn.relu(fully_conn)
    
    return fully_conn


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_fully_conn(fully_conn)
Tests Passed

Output Layer

Implement the output function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

Note: Activation, softmax, or cross entropy should not be applied to this.

In [12]:
def output(x_tensor, num_outputs):
    """
    Apply a output layer to x_tensor using weight and bias
    : x_tensor: A 2-D tensor where the first dimension is batch size.
    : num_outputs: The number of output that the new tensor should be.
    : return: A 2-D tensor where the second dimension is num_outputs.
    """
    # TODO: Implement Function
    num_in = x_tensor.get_shape().as_list()[1]
    weights = tf.Variable(tf.random_normal([num_in, num_outputs]))
    bias = tf.Variable(tf.zeros(num_outputs))
    
    fully_conn = tf.add(tf.matmul(x_tensor, weights), bias)
    
    return fully_conn


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_output(output)
Tests Passed

Create Convolutional Model

Implement the function conv_net to create a convolutional neural network model. The function takes in a batch of images, x, and outputs logits. Use the layers you created above to create this model:

  • Apply 1, 2, or 3 Convolution and Max Pool layers
  • Apply a Flatten Layer
  • Apply 1, 2, or 3 Fully Connected Layers
  • Apply an Output Layer
  • Return the output
  • Apply TensorFlow's Dropout to one or more layers in the model using keep_prob.
In [23]:
def conv_net(x, keep_prob):
    """
    Create a convolutional neural network model
    : x: Placeholder tensor that holds image data.
    : keep_prob: Placeholder tensor that hold dropout keep probability.
    : return: Tensor that represents logits
    """
    # TODO: Apply 1, 2, or 3 Convolution and Max Pool layers
    #    Play around with different number of outputs, kernel size and stride
    # Function Definition from Above:
    #    conv2d_maxpool(x_tensor, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides)
    
    # Variable initialization
    conv_ksize = (3, 3)
    conv_strides = (2, 2)
    pool_ksize = (2, 2)
    pool_strides = (1, 1)
    conv_num_outputs = 48
    
    # CNN layer 1 -- 32x32x3 to 16x16x48
    conv_layer = conv2d_maxpool(x, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides)
    
    # CNN layer 2 -- 16x16x48 to 8x8x192
    conv_layer = conv2d_maxpool(conv_layer, 192, (2, 2), conv_strides, pool_ksize, (1, 1))
    
    # CNN layer 3 -- 8x8x192 to 4x4x384
    conv_layer = conv2d_maxpool(conv_layer, 384, (2, 2), conv_strides, (1, 1), pool_strides)
    
    # CNN layer 4 - 4x4x384 to 2x2x512
    conv_layer = conv2d_maxpool(conv_layer, 512, (2, 2), (2, 2), (1, 1), (1, 1))
    
    # TODO: Apply a Flatten Layer
    # Function Definition from Above:
    #   flatten(x_tensor)
    
    # 2x2x512 to 2048
    conv_layer = flatten(conv_layer)

    # TODO: Apply 1, 2, or 3 Fully Connected Layers
    #    Play around with different number of outputs
    # Function Definition from Above:
    #   fully_conn(x_tensor, num_outputs)
    
    # Dropout -- 3072 to (keep_prob * 3072)
    fully_conn_layer = tf.nn.dropout(conv_layer, keep_prob)
    
    # Fully connected layer 1 -- (keep_prob * 3072) to 512
    fully_conn_layer = fully_conn(conv_layer, 512)
    
    # Fully connected layer 2 -- 512 to 128
    fully_conn_layer = fully_conn(fully_conn_layer, 128)
    
    # TODO: Apply an Output Layer
    #    Set this to the number of classes
    # Function Definition from Above:
    #   output(x_tensor, num_outputs)
    
    # Output layer -- 128 to 10
    out = output(fully_conn_layer, 10)
    
    # TODO: return output
    return out


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""

##############################
## Build the Neural Network ##
##############################

# Remove previous weights, bias, inputs, etc..
tf.reset_default_graph()

# Inputs
x = neural_net_image_input((32, 32, 3))
y = neural_net_label_input(10)
keep_prob = neural_net_keep_prob_input()

# Model
logits = conv_net(x, keep_prob)

# Name logits Tensor, so that is can be loaded from disk after training
logits = tf.identity(logits, name='logits')

# Loss and Optimizer
cost = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits(logits=logits, labels=y))
optimizer = tf.train.AdamOptimizer().minimize(cost)

# Accuracy
correct_pred = tf.equal(tf.argmax(logits, 1), tf.argmax(y, 1))
accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32), name='accuracy')

tests.test_conv_net(conv_net)
Neural Network Built!

Train the Neural Network

Single Optimization

Implement the function train_neural_network to do a single optimization. The optimization should use optimizer to optimize in session with a feed_dict of the following:

  • x for image input
  • y for labels
  • keep_prob for keep probability for dropout

This function will be called for each batch, so tf.global_variables_initializer() has already been called.

Note: Nothing needs to be returned. This function is only optimizing the neural network.

In [24]:
def train_neural_network(session, optimizer, keep_probability, feature_batch, label_batch):
    """
    Optimize the session on a batch of images and labels
    : session: Current TensorFlow session
    : optimizer: TensorFlow optimizer function
    : keep_probability: keep probability
    : feature_batch: Batch of Numpy image data
    : label_batch: Batch of Numpy label data
    """
    # TODO: Implement Function
    session.run(optimizer, feed_dict={
        x: feature_batch, 
        y: label_batch, 
        keep_prob: keep_probability
    })
    
    pass


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
tests.test_train_nn(train_neural_network)
Tests Passed

Show Stats

Implement the function print_stats to print loss and validation accuracy. Use the global variables valid_features and valid_labels to calculate validation accuracy. Use a keep probability of 1.0 to calculate the loss and validation accuracy.

In [25]:
def print_stats(session, feature_batch, label_batch, cost, accuracy):
    """
    Print information about loss and validation accuracy
    : session: Current TensorFlow session
    : feature_batch: Batch of Numpy image data
    : label_batch: Batch of Numpy label data
    : cost: TensorFlow cost function
    : accuracy: TensorFlow accuracy function
    """
    # TODO: Implement Function
    loss = session.run(cost, feed_dict={
        x: feature_batch, 
        y: label_batch,
        keep_prob: 1.})
    valid_acc = session.run(accuracy, feed_dict={
        x: valid_features,
        y: valid_labels,
        keep_prob: 1.})
        
    print('Loss: {:>10.4f} | Validation Accuracy: {:.4f}'.format(
        loss,
        valid_acc))
    
    pass

Hyperparameters

Tune the following parameters:

  • Set epochs to the number of iterations until the network stops learning or start overfitting
  • Set batch_size to the highest number that your machine has memory for. Most people set them to common sizes of memory:
    • 64
    • 128
    • 256
    • ...
  • Set keep_probability to the probability of keeping a node using dropout
In [28]:
# TODO: Tune Parameters
epochs = 600
batch_size = 256
keep_probability = 0.5

Train on a Single CIFAR-10 Batch

Instead of training the neural network on all the CIFAR-10 batches of data, let's use a single batch. This should save time while you iterate on the model to get a better accuracy. Once the final validation accuracy is 50% or greater, run the model on all the data in the next section.

In [29]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
print('Checking the Training on a Single Batch...')
with tf.Session() as sess:
    # Initializing the variables
    sess.run(tf.global_variables_initializer())
    
    # Training cycle
    for epoch in range(epochs):
        batch_i = 1
        for batch_features, batch_labels in helper.load_preprocess_training_batch(batch_i, batch_size):
            train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels)
        print('Epoch {:>2}, CIFAR-10 Batch {}:  '.format(epoch + 1, batch_i), end='')
        print_stats(sess, batch_features, batch_labels, cost, accuracy)
Checking the Training on a Single Batch...
Epoch  1, CIFAR-10 Batch 1:  Loss: 10279422.0000 | Validation Accuracy: 0.2000
Epoch  2, CIFAR-10 Batch 1:  Loss: 5859998.0000 | Validation Accuracy: 0.2348
Epoch  3, CIFAR-10 Batch 1:  Loss: 4305946.0000 | Validation Accuracy: 0.2598
Epoch  4, CIFAR-10 Batch 1:  Loss: 2903409.2500 | Validation Accuracy: 0.2752
Epoch  5, CIFAR-10 Batch 1:  Loss: 2287536.0000 | Validation Accuracy: 0.2886
Epoch  6, CIFAR-10 Batch 1:  Loss: 1772890.3750 | Validation Accuracy: 0.3022
Epoch  7, CIFAR-10 Batch 1:  Loss: 1319545.2500 | Validation Accuracy: 0.3084
Epoch  8, CIFAR-10 Batch 1:  Loss: 1309733.6250 | Validation Accuracy: 0.3182
Epoch  9, CIFAR-10 Batch 1:  Loss: 996289.8750 | Validation Accuracy: 0.3294
Epoch 10, CIFAR-10 Batch 1:  Loss: 804032.1250 | Validation Accuracy: 0.3356
Epoch 11, CIFAR-10 Batch 1:  Loss: 783548.7500 | Validation Accuracy: 0.3300
Epoch 12, CIFAR-10 Batch 1:  Loss: 712943.1875 | Validation Accuracy: 0.3388
Epoch 13, CIFAR-10 Batch 1:  Loss: 853747.1250 | Validation Accuracy: 0.3356
Epoch 14, CIFAR-10 Batch 1:  Loss: 741972.7500 | Validation Accuracy: 0.3336
Epoch 15, CIFAR-10 Batch 1:  Loss: 497203.1250 | Validation Accuracy: 0.3480
Epoch 16, CIFAR-10 Batch 1:  Loss: 376018.4375 | Validation Accuracy: 0.3540
Epoch 17, CIFAR-10 Batch 1:  Loss: 385720.7812 | Validation Accuracy: 0.3550
Epoch 18, CIFAR-10 Batch 1:  Loss: 452472.8125 | Validation Accuracy: 0.3616
Epoch 19, CIFAR-10 Batch 1:  Loss: 399473.0625 | Validation Accuracy: 0.3582
Epoch 20, CIFAR-10 Batch 1:  Loss: 313905.1875 | Validation Accuracy: 0.3554
Epoch 21, CIFAR-10 Batch 1:  Loss: 298068.7188 | Validation Accuracy: 0.3540
Epoch 22, CIFAR-10 Batch 1:  Loss: 266328.1875 | Validation Accuracy: 0.3574
Epoch 23, CIFAR-10 Batch 1:  Loss: 208074.2812 | Validation Accuracy: 0.3632
Epoch 24, CIFAR-10 Batch 1:  Loss: 159477.2812 | Validation Accuracy: 0.3614
Epoch 25, CIFAR-10 Batch 1:  Loss: 115495.5781 | Validation Accuracy: 0.3814
Epoch 26, CIFAR-10 Batch 1:  Loss: 183548.3594 | Validation Accuracy: 0.3686
Epoch 27, CIFAR-10 Batch 1:  Loss: 281172.2500 | Validation Accuracy: 0.3692
Epoch 28, CIFAR-10 Batch 1:  Loss: 163516.9688 | Validation Accuracy: 0.3872
Epoch 29, CIFAR-10 Batch 1:  Loss: 58812.2344 | Validation Accuracy: 0.3834
Epoch 30, CIFAR-10 Batch 1:  Loss: 24850.6328 | Validation Accuracy: 0.3872
Epoch 31, CIFAR-10 Batch 1:  Loss: 33393.5000 | Validation Accuracy: 0.3790
Epoch 32, CIFAR-10 Batch 1:  Loss: 46821.2734 | Validation Accuracy: 0.3854
Epoch 33, CIFAR-10 Batch 1:  Loss: 56232.7734 | Validation Accuracy: 0.3798
Epoch 34, CIFAR-10 Batch 1:  Loss:  1104.6500 | Validation Accuracy: 0.3858
Epoch 35, CIFAR-10 Batch 1:  Loss: 38847.6797 | Validation Accuracy: 0.3806
Epoch 36, CIFAR-10 Batch 1:  Loss: 58660.7578 | Validation Accuracy: 0.3696
Epoch 37, CIFAR-10 Batch 1:  Loss: 81208.3672 | Validation Accuracy: 0.3580
Epoch 38, CIFAR-10 Batch 1:  Loss: 41457.1875 | Validation Accuracy: 0.3710
Epoch 39, CIFAR-10 Batch 1:  Loss: 93428.2578 | Validation Accuracy: 0.3696
Epoch 40, CIFAR-10 Batch 1:  Loss: 12661.4248 | Validation Accuracy: 0.3896
Epoch 41, CIFAR-10 Batch 1:  Loss:  9250.4004 | Validation Accuracy: 0.4012
Epoch 42, CIFAR-10 Batch 1:  Loss:  5926.4937 | Validation Accuracy: 0.3984
Epoch 43, CIFAR-10 Batch 1:  Loss:  5983.5815 | Validation Accuracy: 0.3866
Epoch 44, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.3926
Epoch 45, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.3886
Epoch 46, CIFAR-10 Batch 1:  Loss: 11769.7686 | Validation Accuracy: 0.4038
Epoch 47, CIFAR-10 Batch 1:  Loss: 43007.2852 | Validation Accuracy: 0.3914
Epoch 48, CIFAR-10 Batch 1:  Loss: 33837.4570 | Validation Accuracy: 0.3814
Epoch 49, CIFAR-10 Batch 1:  Loss:  8944.9375 | Validation Accuracy: 0.3678
Epoch 50, CIFAR-10 Batch 1:  Loss: 27589.4062 | Validation Accuracy: 0.3768
Epoch 51, CIFAR-10 Batch 1:  Loss: 11855.7803 | Validation Accuracy: 0.3920
Epoch 52, CIFAR-10 Batch 1:  Loss: 68372.7344 | Validation Accuracy: 0.3910
Epoch 53, CIFAR-10 Batch 1:  Loss: 33334.2539 | Validation Accuracy: 0.4024
Epoch 54, CIFAR-10 Batch 1:  Loss: 81361.0781 | Validation Accuracy: 0.3774
Epoch 55, CIFAR-10 Batch 1:  Loss: 35192.9258 | Validation Accuracy: 0.3952
Epoch 56, CIFAR-10 Batch 1:  Loss: 83238.9922 | Validation Accuracy: 0.3908
Epoch 57, CIFAR-10 Batch 1:  Loss: 41369.4219 | Validation Accuracy: 0.3924
Epoch 58, CIFAR-10 Batch 1:  Loss: 69064.1406 | Validation Accuracy: 0.3802
Epoch 59, CIFAR-10 Batch 1:  Loss: 18857.9004 | Validation Accuracy: 0.3884
Epoch 60, CIFAR-10 Batch 1:  Loss:  7755.1499 | Validation Accuracy: 0.4074
Epoch 61, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4134
Epoch 62, CIFAR-10 Batch 1:  Loss:  1161.6750 | Validation Accuracy: 0.4058
Epoch 63, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4140
Epoch 64, CIFAR-10 Batch 1:  Loss:  1369.6376 | Validation Accuracy: 0.4154
Epoch 65, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4088
Epoch 66, CIFAR-10 Batch 1:  Loss:  1813.5359 | Validation Accuracy: 0.3978
Epoch 67, CIFAR-10 Batch 1:  Loss: 14426.3457 | Validation Accuracy: 0.4028
Epoch 68, CIFAR-10 Batch 1:  Loss: 30638.9883 | Validation Accuracy: 0.3974
Epoch 69, CIFAR-10 Batch 1:  Loss: 14784.7725 | Validation Accuracy: 0.3930
Epoch 70, CIFAR-10 Batch 1:  Loss:  5965.3252 | Validation Accuracy: 0.3812
Epoch 71, CIFAR-10 Batch 1:  Loss:  7184.0688 | Validation Accuracy: 0.3980
Epoch 72, CIFAR-10 Batch 1:  Loss:   908.6090 | Validation Accuracy: 0.3894
Epoch 73, CIFAR-10 Batch 1:  Loss: 37624.5469 | Validation Accuracy: 0.3744
Epoch 74, CIFAR-10 Batch 1:  Loss:  7161.6313 | Validation Accuracy: 0.3826
Epoch 75, CIFAR-10 Batch 1:  Loss: 25535.7656 | Validation Accuracy: 0.3846
Epoch 76, CIFAR-10 Batch 1:  Loss:  4199.4624 | Validation Accuracy: 0.4108
Epoch 77, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4298
Epoch 78, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4274
Epoch 79, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4360
Epoch 80, CIFAR-10 Batch 1:  Loss:  1364.3500 | Validation Accuracy: 0.4214
Epoch 81, CIFAR-10 Batch 1:  Loss:  3793.6375 | Validation Accuracy: 0.4104
Epoch 82, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4138
Epoch 83, CIFAR-10 Batch 1:  Loss:  3199.5249 | Validation Accuracy: 0.4250
Epoch 84, CIFAR-10 Batch 1:  Loss:  1548.4563 | Validation Accuracy: 0.4204
Epoch 85, CIFAR-10 Batch 1:  Loss:  2886.1750 | Validation Accuracy: 0.4292
Epoch 86, CIFAR-10 Batch 1:  Loss:  8598.7627 | Validation Accuracy: 0.4296
Epoch 87, CIFAR-10 Batch 1:  Loss: 38606.6016 | Validation Accuracy: 0.4126
Epoch 88, CIFAR-10 Batch 1:  Loss:  1460.8563 | Validation Accuracy: 0.4178
Epoch 89, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4280
Epoch 90, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4174
Epoch 91, CIFAR-10 Batch 1:  Loss:  1331.5126 | Validation Accuracy: 0.4148
Epoch 92, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4244
Epoch 93, CIFAR-10 Batch 1:  Loss:    48.8625 | Validation Accuracy: 0.4350
Epoch 94, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4272
Epoch 95, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4274
Epoch 96, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4168
Epoch 97, CIFAR-10 Batch 1:  Loss:  7989.5752 | Validation Accuracy: 0.4110
Epoch 98, CIFAR-10 Batch 1:  Loss:  2754.9939 | Validation Accuracy: 0.4148
Epoch 99, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4124
Epoch 100, CIFAR-10 Batch 1:  Loss:   717.5187 | Validation Accuracy: 0.4158
Epoch 101, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4086
Epoch 102, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4026
Epoch 103, CIFAR-10 Batch 1:  Loss: 47135.2656 | Validation Accuracy: 0.3932
Epoch 104, CIFAR-10 Batch 1:  Loss: 16548.6074 | Validation Accuracy: 0.4016
Epoch 105, CIFAR-10 Batch 1:  Loss: 52077.7461 | Validation Accuracy: 0.3976
Epoch 106, CIFAR-10 Batch 1:  Loss: 12082.5000 | Validation Accuracy: 0.3992
Epoch 107, CIFAR-10 Batch 1:  Loss:  8538.6143 | Validation Accuracy: 0.4150
Epoch 108, CIFAR-10 Batch 1:  Loss:  3087.3313 | Validation Accuracy: 0.4182
Epoch 109, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4230
Epoch 110, CIFAR-10 Batch 1:  Loss:  2837.4375 | Validation Accuracy: 0.4330
Epoch 111, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4324
Epoch 112, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4396
Epoch 113, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4296
Epoch 114, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4220
Epoch 115, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4254
Epoch 116, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4182
Epoch 117, CIFAR-10 Batch 1:  Loss:  9306.0254 | Validation Accuracy: 0.4144
Epoch 118, CIFAR-10 Batch 1:  Loss: 11543.1250 | Validation Accuracy: 0.4106
Epoch 119, CIFAR-10 Batch 1:  Loss:  4012.5000 | Validation Accuracy: 0.3990
Epoch 120, CIFAR-10 Batch 1:  Loss: 14465.1191 | Validation Accuracy: 0.4078
Epoch 121, CIFAR-10 Batch 1:  Loss: 29612.6621 | Validation Accuracy: 0.3968
Epoch 122, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4042
Epoch 123, CIFAR-10 Batch 1:  Loss:  3834.3000 | Validation Accuracy: 0.4074
Epoch 124, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4256
Epoch 125, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4292
Epoch 126, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4444
Epoch 127, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4512
Epoch 128, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4430
Epoch 129, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4448
Epoch 130, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4462
Epoch 131, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4384
Epoch 132, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4446
Epoch 133, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4420
Epoch 134, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4448
Epoch 135, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4416
Epoch 136, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4308
Epoch 137, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4346
Epoch 138, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4520
Epoch 139, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4490
Epoch 140, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4420
Epoch 141, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4422
Epoch 142, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4528
Epoch 143, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4430
Epoch 144, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 145, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4516
Epoch 146, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4506
Epoch 147, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4510
Epoch 148, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 149, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4450
Epoch 150, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4484
Epoch 151, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4520
Epoch 152, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4486
Epoch 153, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4532
Epoch 154, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4534
Epoch 155, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4476
Epoch 156, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4516
Epoch 157, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4388
Epoch 158, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4496
Epoch 159, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4470
Epoch 160, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4416
Epoch 161, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4498
Epoch 162, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4386
Epoch 163, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4496
Epoch 164, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4518
Epoch 165, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4552
Epoch 166, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4510
Epoch 167, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4480
Epoch 168, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4448
Epoch 169, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4452
Epoch 170, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4470
Epoch 171, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4448
Epoch 172, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4472
Epoch 173, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4480
Epoch 174, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4488
Epoch 175, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4490
Epoch 176, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4376
Epoch 177, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4374
Epoch 178, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4464
Epoch 179, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4400
Epoch 180, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4404
Epoch 181, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4376
Epoch 182, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4480
Epoch 183, CIFAR-10 Batch 1:  Loss:  9163.1191 | Validation Accuracy: 0.4448
Epoch 184, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4420
Epoch 185, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4448
Epoch 186, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4468
Epoch 187, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4492
Epoch 188, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4488
Epoch 189, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 190, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4498
Epoch 191, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4438
Epoch 192, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4534
Epoch 193, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 194, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4540
Epoch 195, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 196, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4328
Epoch 197, CIFAR-10 Batch 1:  Loss:  2025.4250 | Validation Accuracy: 0.4490
Epoch 198, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4412
Epoch 199, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4446
Epoch 200, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4420
Epoch 201, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4416
Epoch 202, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4420
Epoch 203, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4444
Epoch 204, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4482
Epoch 205, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4498
Epoch 206, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4490
Epoch 207, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4464
Epoch 208, CIFAR-10 Batch 1:  Loss: 13780.2256 | Validation Accuracy: 0.4440
Epoch 209, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4436
Epoch 210, CIFAR-10 Batch 1:  Loss: 29577.2910 | Validation Accuracy: 0.4284
Epoch 211, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4436
Epoch 212, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4604
Epoch 213, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4590
Epoch 214, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4616
Epoch 215, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4508
Epoch 216, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4452
Epoch 217, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4490
Epoch 218, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4508
Epoch 219, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4662
Epoch 220, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4440
Epoch 221, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4606
Epoch 222, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4678
Epoch 223, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4596
Epoch 224, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4606
Epoch 225, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4642
Epoch 226, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4578
Epoch 227, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4542
Epoch 228, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4622
Epoch 229, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4612
Epoch 230, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4628
Epoch 231, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4608
Epoch 232, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4604
Epoch 233, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4532
Epoch 234, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4528
Epoch 235, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4578
Epoch 236, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4472
Epoch 237, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4588
Epoch 238, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4588
Epoch 239, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4566
Epoch 240, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4672
Epoch 241, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4652
Epoch 242, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4482
Epoch 243, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4402
Epoch 244, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4666
Epoch 245, CIFAR-10 Batch 1:  Loss:   835.6750 | Validation Accuracy: 0.4504
Epoch 246, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4658
Epoch 247, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4510
Epoch 248, CIFAR-10 Batch 1:  Loss:  4004.6875 | Validation Accuracy: 0.4474
Epoch 249, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4560
Epoch 250, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4562
Epoch 251, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4814
Epoch 252, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4524
Epoch 253, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4740
Epoch 254, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4652
Epoch 255, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4542
Epoch 256, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4670
Epoch 257, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4624
Epoch 258, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4656
Epoch 259, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4644
Epoch 260, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4620
Epoch 261, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4460
Epoch 262, CIFAR-10 Batch 1:  Loss:   174.8250 | Validation Accuracy: 0.4546
Epoch 263, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4604
Epoch 264, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4538
Epoch 265, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4716
Epoch 266, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4742
Epoch 267, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4674
Epoch 268, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4564
Epoch 269, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4602
Epoch 270, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4652
Epoch 271, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4418
Epoch 272, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4666
Epoch 273, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4712
Epoch 274, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4724
Epoch 275, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4706
Epoch 276, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4674
Epoch 277, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4592
Epoch 278, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4642
Epoch 279, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4598
Epoch 280, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4620
Epoch 281, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4618
Epoch 282, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4726
Epoch 283, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4672
Epoch 284, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4628
Epoch 285, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4762
Epoch 286, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4696
Epoch 287, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4752
Epoch 288, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4436
Epoch 289, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4390
Epoch 290, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4662
Epoch 291, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4668
Epoch 292, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4606
Epoch 293, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4614
Epoch 294, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4792
Epoch 295, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4742
Epoch 296, CIFAR-10 Batch 1:  Loss: 23855.9844 | Validation Accuracy: 0.4456
Epoch 297, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4642
Epoch 298, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4656
Epoch 299, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4732
Epoch 300, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4720
Epoch 301, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4770
Epoch 302, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4770
Epoch 303, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4708
Epoch 304, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4638
Epoch 305, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4738
Epoch 306, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4798
Epoch 307, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4818
Epoch 308, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4728
Epoch 309, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4562
Epoch 310, CIFAR-10 Batch 1:  Loss: 11695.0879 | Validation Accuracy: 0.4654
Epoch 311, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4794
Epoch 312, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4658
Epoch 313, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4590
Epoch 314, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4746
Epoch 315, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4644
Epoch 316, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4786
Epoch 317, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4690
Epoch 318, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4652
Epoch 319, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4718
Epoch 320, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4782
Epoch 321, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4814
Epoch 322, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4594
Epoch 323, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4530
Epoch 324, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4760
Epoch 325, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4708
Epoch 326, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4680
Epoch 327, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4810
Epoch 328, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4634
Epoch 329, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4700
Epoch 330, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4724
Epoch 331, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4748
Epoch 332, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4850
Epoch 333, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4850
Epoch 334, CIFAR-10 Batch 1:  Loss:  3731.2251 | Validation Accuracy: 0.4782
Epoch 335, CIFAR-10 Batch 1:  Loss:  5348.8813 | Validation Accuracy: 0.4922
Epoch 336, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4836
Epoch 337, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4874
Epoch 338, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4684
Epoch 339, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4782
Epoch 340, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4872
Epoch 341, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4846
Epoch 342, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4820
Epoch 343, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4704
Epoch 344, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4724
Epoch 345, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4826
Epoch 346, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4700
Epoch 347, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4642
Epoch 348, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4862
Epoch 349, CIFAR-10 Batch 1:  Loss:  1122.3750 | Validation Accuracy: 0.4900
Epoch 350, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4876
Epoch 351, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4660
Epoch 352, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4614
Epoch 353, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4806
Epoch 354, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4830
Epoch 355, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4772
Epoch 356, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4774
Epoch 357, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4726
Epoch 358, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4850
Epoch 359, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4720
Epoch 360, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4878
Epoch 361, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4800
Epoch 362, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4906
Epoch 363, CIFAR-10 Batch 1:  Loss:  1435.8313 | Validation Accuracy: 0.4890
Epoch 364, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4972
Epoch 365, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4802
Epoch 366, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4894
Epoch 367, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4858
Epoch 368, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4856
Epoch 369, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4898
Epoch 370, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4824
Epoch 371, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4862
Epoch 372, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4808
Epoch 373, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4864
Epoch 374, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4894
Epoch 375, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4888
Epoch 376, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4828
Epoch 377, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4790
Epoch 378, CIFAR-10 Batch 1:  Loss:  1153.4000 | Validation Accuracy: 0.4792
Epoch 379, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4858
Epoch 380, CIFAR-10 Batch 1:  Loss:  4494.3628 | Validation Accuracy: 0.4816
Epoch 381, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4910
Epoch 382, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4878
Epoch 383, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4866
Epoch 384, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4900
Epoch 385, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4912
Epoch 386, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4768
Epoch 387, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4954
Epoch 388, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4842
Epoch 389, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4870
Epoch 390, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4894
Epoch 391, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4932
Epoch 392, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4846
Epoch 393, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4678
Epoch 394, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4832
Epoch 395, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4846
Epoch 396, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4764
Epoch 397, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 398, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4844
Epoch 399, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4800
Epoch 400, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4814
Epoch 401, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5036
Epoch 402, CIFAR-10 Batch 1:  Loss:  4023.9062 | Validation Accuracy: 0.4812
Epoch 403, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4900
Epoch 404, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4916
Epoch 405, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4942
Epoch 406, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4746
Epoch 407, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4792
Epoch 408, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4868
Epoch 409, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4958
Epoch 410, CIFAR-10 Batch 1:  Loss:  7767.4688 | Validation Accuracy: 0.4816
Epoch 411, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4886
Epoch 412, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4868
Epoch 413, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4850
Epoch 414, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4928
Epoch 415, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4942
Epoch 416, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4862
Epoch 417, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4652
Epoch 418, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5004
Epoch 419, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4846
Epoch 420, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4950
Epoch 421, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4764
Epoch 422, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4888
Epoch 423, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4932
Epoch 424, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4842
Epoch 425, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4932
Epoch 426, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4924
Epoch 427, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4710
Epoch 428, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4820
Epoch 429, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4968
Epoch 430, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4884
Epoch 431, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4804
Epoch 432, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4880
Epoch 433, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4876
Epoch 434, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4832
Epoch 435, CIFAR-10 Batch 1:  Loss:  1403.6750 | Validation Accuracy: 0.4984
Epoch 436, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4888
Epoch 437, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4872
Epoch 438, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4840
Epoch 439, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4974
Epoch 440, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4914
Epoch 441, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4898
Epoch 442, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4760
Epoch 443, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4892
Epoch 444, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4978
Epoch 445, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4766
Epoch 446, CIFAR-10 Batch 1:  Loss:  4112.7061 | Validation Accuracy: 0.4852
Epoch 447, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4854
Epoch 448, CIFAR-10 Batch 1:  Loss: 14916.0439 | Validation Accuracy: 0.4816
Epoch 449, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4884
Epoch 450, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4928
Epoch 451, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4776
Epoch 452, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4756
Epoch 453, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4858
Epoch 454, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4936
Epoch 455, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4860
Epoch 456, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5008
Epoch 457, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4946
Epoch 458, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4970
Epoch 459, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4948
Epoch 460, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5012
Epoch 461, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4988
Epoch 462, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4960
Epoch 463, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4910
Epoch 464, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4998
Epoch 465, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4940
Epoch 466, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4952
Epoch 467, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4972
Epoch 468, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4944
Epoch 469, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4892
Epoch 470, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4944
Epoch 471, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4912
Epoch 472, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4986
Epoch 473, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4960
Epoch 474, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4882
Epoch 475, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4936
Epoch 476, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4782
Epoch 477, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4934
Epoch 478, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4754
Epoch 479, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4908
Epoch 480, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4908
Epoch 481, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4916
Epoch 482, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4906
Epoch 483, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4962
Epoch 484, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4848
Epoch 485, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4968
Epoch 486, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4818
Epoch 487, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4818
Epoch 488, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4874
Epoch 489, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4982
Epoch 490, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5052
Epoch 491, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4928
Epoch 492, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4950
Epoch 493, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5004
Epoch 494, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5042
Epoch 495, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4850
Epoch 496, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4966
Epoch 497, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4864
Epoch 498, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5048
Epoch 499, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 500, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5000
Epoch 501, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5008
Epoch 502, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5022
Epoch 503, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4958
Epoch 504, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4830
Epoch 505, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5078
Epoch 506, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4778
Epoch 507, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4876
Epoch 508, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4878
Epoch 509, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4876
Epoch 510, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4746
Epoch 511, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4756
Epoch 512, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4938
Epoch 513, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5118
Epoch 514, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5110
Epoch 515, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5036
Epoch 516, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4960
Epoch 517, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4990
Epoch 518, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4896
Epoch 519, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4864
Epoch 520, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4920
Epoch 521, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4904
Epoch 522, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4940
Epoch 523, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4886
Epoch 524, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5068
Epoch 525, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4958
Epoch 526, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4916
Epoch 527, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4994
Epoch 528, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4948
Epoch 529, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5102
Epoch 530, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5100
Epoch 531, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4982
Epoch 532, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5046
Epoch 533, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4896
Epoch 534, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4912
Epoch 535, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5100
Epoch 536, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5118
Epoch 537, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4946
Epoch 538, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4900
Epoch 539, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4908
Epoch 540, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4986
Epoch 541, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4982
Epoch 542, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4994
Epoch 543, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5010
Epoch 544, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5128
Epoch 545, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5018
Epoch 546, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5008
Epoch 547, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5072
Epoch 548, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5058
Epoch 549, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5090
Epoch 550, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 551, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5044
Epoch 552, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4996
Epoch 553, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5056
Epoch 554, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5106
Epoch 555, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5044
Epoch 556, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4990
Epoch 557, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5056
Epoch 558, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5058
Epoch 559, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5050
Epoch 560, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5096
Epoch 561, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5084
Epoch 562, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5074
Epoch 563, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5116
Epoch 564, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5086
Epoch 565, CIFAR-10 Batch 1:  Loss:  3122.5376 | Validation Accuracy: 0.4930
Epoch 566, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5034
Epoch 567, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4962
Epoch 568, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4922
Epoch 569, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4968
Epoch 570, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4912
Epoch 571, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4988
Epoch 572, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5084
Epoch 573, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5074
Epoch 574, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5062
Epoch 575, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 576, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5088
Epoch 577, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5112
Epoch 578, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5062
Epoch 579, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5100
Epoch 580, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5062
Epoch 581, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5076
Epoch 582, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5048
Epoch 583, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4984
Epoch 584, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5134
Epoch 585, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5004
Epoch 586, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4898
Epoch 587, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4950
Epoch 588, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4968
Epoch 589, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5088
Epoch 590, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5054
Epoch 591, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5058
Epoch 592, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5112
Epoch 593, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5052
Epoch 594, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5152
Epoch 595, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5010
Epoch 596, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5042
Epoch 597, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4998
Epoch 598, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5112
Epoch 599, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5146
Epoch 600, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5004

Fully Train the Model

Now that you got a good accuracy with a single CIFAR-10 batch, try it with all five batches.

In [30]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
save_model_path = './image_classification'

print('Training...')
with tf.Session() as sess:
    # Initializing the variables
    sess.run(tf.global_variables_initializer())
    
    # Training cycle
    for epoch in range(epochs):
        # Loop over all batches
        n_batches = 5
        for batch_i in range(1, n_batches + 1):
            for batch_features, batch_labels in helper.load_preprocess_training_batch(batch_i, batch_size):
                train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels)
            print('Epoch {:>2}, CIFAR-10 Batch {}:  '.format(epoch + 1, batch_i), end='')
            print_stats(sess, batch_features, batch_labels, cost, accuracy)
            
    # Save Model
    saver = tf.train.Saver()
    save_path = saver.save(sess, save_model_path)
Training...
Epoch  1, CIFAR-10 Batch 1:  Loss: 9956832.0000 | Validation Accuracy: 0.2082
Epoch  1, CIFAR-10 Batch 2:  Loss: 7191898.5000 | Validation Accuracy: 0.2162
Epoch  1, CIFAR-10 Batch 3:  Loss: 4221985.0000 | Validation Accuracy: 0.2330
Epoch  1, CIFAR-10 Batch 4:  Loss: 4074335.5000 | Validation Accuracy: 0.2652
Epoch  1, CIFAR-10 Batch 5:  Loss: 3937648.0000 | Validation Accuracy: 0.2662
Epoch  2, CIFAR-10 Batch 1:  Loss: 3354672.5000 | Validation Accuracy: 0.2770
Epoch  2, CIFAR-10 Batch 2:  Loss: 2727319.5000 | Validation Accuracy: 0.2904
Epoch  2, CIFAR-10 Batch 3:  Loss: 2040817.2500 | Validation Accuracy: 0.2858
Epoch  2, CIFAR-10 Batch 4:  Loss: 2341578.7500 | Validation Accuracy: 0.2930
Epoch  2, CIFAR-10 Batch 5:  Loss: 2579876.5000 | Validation Accuracy: 0.3094
Epoch  3, CIFAR-10 Batch 1:  Loss: 1891347.0000 | Validation Accuracy: 0.3220
Epoch  3, CIFAR-10 Batch 2:  Loss: 1933275.3750 | Validation Accuracy: 0.3086
Epoch  3, CIFAR-10 Batch 3:  Loss: 1289846.6250 | Validation Accuracy: 0.3030
Epoch  3, CIFAR-10 Batch 4:  Loss: 1467701.2500 | Validation Accuracy: 0.3184
Epoch  3, CIFAR-10 Batch 5:  Loss: 2057952.1250 | Validation Accuracy: 0.3252
Epoch  4, CIFAR-10 Batch 1:  Loss: 1444335.0000 | Validation Accuracy: 0.3390
Epoch  4, CIFAR-10 Batch 2:  Loss: 1666293.5000 | Validation Accuracy: 0.3276
Epoch  4, CIFAR-10 Batch 3:  Loss: 942368.1875 | Validation Accuracy: 0.3342
Epoch  4, CIFAR-10 Batch 4:  Loss: 992075.1250 | Validation Accuracy: 0.3254
Epoch  4, CIFAR-10 Batch 5:  Loss: 1529174.3750 | Validation Accuracy: 0.3240
Epoch  5, CIFAR-10 Batch 1:  Loss: 1289322.2500 | Validation Accuracy: 0.3528
Epoch  5, CIFAR-10 Batch 2:  Loss: 1464174.0000 | Validation Accuracy: 0.3550
Epoch  5, CIFAR-10 Batch 3:  Loss: 530781.0625 | Validation Accuracy: 0.3478
Epoch  5, CIFAR-10 Batch 4:  Loss: 767426.3750 | Validation Accuracy: 0.3380
Epoch  5, CIFAR-10 Batch 5:  Loss: 1248462.5000 | Validation Accuracy: 0.3416
Epoch  6, CIFAR-10 Batch 1:  Loss: 1044192.1875 | Validation Accuracy: 0.3592
Epoch  6, CIFAR-10 Batch 2:  Loss: 1135958.2500 | Validation Accuracy: 0.3612
Epoch  6, CIFAR-10 Batch 3:  Loss: 379192.1875 | Validation Accuracy: 0.3426
Epoch  6, CIFAR-10 Batch 4:  Loss: 655010.6250 | Validation Accuracy: 0.3594
Epoch  6, CIFAR-10 Batch 5:  Loss: 916134.1875 | Validation Accuracy: 0.3592
Epoch  7, CIFAR-10 Batch 1:  Loss: 941190.3750 | Validation Accuracy: 0.3782
Epoch  7, CIFAR-10 Batch 2:  Loss: 1070413.0000 | Validation Accuracy: 0.3600
Epoch  7, CIFAR-10 Batch 3:  Loss: 300293.3750 | Validation Accuracy: 0.3538
Epoch  7, CIFAR-10 Batch 4:  Loss: 529209.7500 | Validation Accuracy: 0.3698
Epoch  7, CIFAR-10 Batch 5:  Loss: 810232.2500 | Validation Accuracy: 0.3578
Epoch  8, CIFAR-10 Batch 1:  Loss: 874262.3750 | Validation Accuracy: 0.3796
Epoch  8, CIFAR-10 Batch 2:  Loss: 811665.7500 | Validation Accuracy: 0.3708
Epoch  8, CIFAR-10 Batch 3:  Loss: 181262.4844 | Validation Accuracy: 0.3704
Epoch  8, CIFAR-10 Batch 4:  Loss: 448394.5312 | Validation Accuracy: 0.3752
Epoch  8, CIFAR-10 Batch 5:  Loss: 750253.3125 | Validation Accuracy: 0.3784
Epoch  9, CIFAR-10 Batch 1:  Loss: 734779.0000 | Validation Accuracy: 0.3856
Epoch  9, CIFAR-10 Batch 2:  Loss: 662555.5625 | Validation Accuracy: 0.3922
Epoch  9, CIFAR-10 Batch 3:  Loss: 170513.9688 | Validation Accuracy: 0.3820
Epoch  9, CIFAR-10 Batch 4:  Loss: 378316.8750 | Validation Accuracy: 0.3674
Epoch  9, CIFAR-10 Batch 5:  Loss: 582423.5625 | Validation Accuracy: 0.3926
Epoch 10, CIFAR-10 Batch 1:  Loss: 610519.7500 | Validation Accuracy: 0.3998
Epoch 10, CIFAR-10 Batch 2:  Loss: 501700.4688 | Validation Accuracy: 0.3972
Epoch 10, CIFAR-10 Batch 3:  Loss: 153876.7969 | Validation Accuracy: 0.3890
Epoch 10, CIFAR-10 Batch 4:  Loss: 261544.5781 | Validation Accuracy: 0.3908
Epoch 10, CIFAR-10 Batch 5:  Loss: 441437.8125 | Validation Accuracy: 0.3988
Epoch 11, CIFAR-10 Batch 1:  Loss: 485362.2500 | Validation Accuracy: 0.3996
Epoch 11, CIFAR-10 Batch 2:  Loss: 386430.7500 | Validation Accuracy: 0.4072
Epoch 11, CIFAR-10 Batch 3:  Loss: 91166.1094 | Validation Accuracy: 0.3966
Epoch 11, CIFAR-10 Batch 4:  Loss: 220770.9844 | Validation Accuracy: 0.4034
Epoch 11, CIFAR-10 Batch 5:  Loss: 333682.1250 | Validation Accuracy: 0.4138
Epoch 12, CIFAR-10 Batch 1:  Loss: 377142.3750 | Validation Accuracy: 0.4104
Epoch 12, CIFAR-10 Batch 2:  Loss: 316922.9688 | Validation Accuracy: 0.4082
Epoch 12, CIFAR-10 Batch 3:  Loss: 84507.3281 | Validation Accuracy: 0.4022
Epoch 12, CIFAR-10 Batch 4:  Loss: 197603.2969 | Validation Accuracy: 0.4108
Epoch 12, CIFAR-10 Batch 5:  Loss: 265175.3125 | Validation Accuracy: 0.4192
Epoch 13, CIFAR-10 Batch 1:  Loss: 357307.4062 | Validation Accuracy: 0.4196
Epoch 13, CIFAR-10 Batch 2:  Loss: 253461.2188 | Validation Accuracy: 0.4148
Epoch 13, CIFAR-10 Batch 3:  Loss: 90482.9688 | Validation Accuracy: 0.4014
Epoch 13, CIFAR-10 Batch 4:  Loss: 171658.5156 | Validation Accuracy: 0.4228
Epoch 13, CIFAR-10 Batch 5:  Loss: 212295.9844 | Validation Accuracy: 0.4186
Epoch 14, CIFAR-10 Batch 1:  Loss: 324295.6875 | Validation Accuracy: 0.4234
Epoch 14, CIFAR-10 Batch 2:  Loss: 165296.7188 | Validation Accuracy: 0.4102
Epoch 14, CIFAR-10 Batch 3:  Loss: 66124.0547 | Validation Accuracy: 0.4060
Epoch 14, CIFAR-10 Batch 4:  Loss: 135533.3125 | Validation Accuracy: 0.4246
Epoch 14, CIFAR-10 Batch 5:  Loss: 170686.5781 | Validation Accuracy: 0.4258
Epoch 15, CIFAR-10 Batch 1:  Loss: 309562.8125 | Validation Accuracy: 0.4176
Epoch 15, CIFAR-10 Batch 2:  Loss: 153685.5000 | Validation Accuracy: 0.4084
Epoch 15, CIFAR-10 Batch 3:  Loss: 45315.7969 | Validation Accuracy: 0.4214
Epoch 15, CIFAR-10 Batch 4:  Loss: 109687.0859 | Validation Accuracy: 0.4302
Epoch 15, CIFAR-10 Batch 5:  Loss: 125645.1875 | Validation Accuracy: 0.4246
Epoch 16, CIFAR-10 Batch 1:  Loss: 291810.0625 | Validation Accuracy: 0.4240
Epoch 16, CIFAR-10 Batch 2:  Loss: 140452.6719 | Validation Accuracy: 0.4100
Epoch 16, CIFAR-10 Batch 3:  Loss: 35426.9805 | Validation Accuracy: 0.4284
Epoch 16, CIFAR-10 Batch 4:  Loss: 136007.1562 | Validation Accuracy: 0.4316
Epoch 16, CIFAR-10 Batch 5:  Loss: 131312.2969 | Validation Accuracy: 0.4268
Epoch 17, CIFAR-10 Batch 1:  Loss: 254823.9531 | Validation Accuracy: 0.4272
Epoch 17, CIFAR-10 Batch 2:  Loss: 127397.4062 | Validation Accuracy: 0.4094
Epoch 17, CIFAR-10 Batch 3:  Loss: 19328.8555 | Validation Accuracy: 0.4304
Epoch 17, CIFAR-10 Batch 4:  Loss: 84538.1250 | Validation Accuracy: 0.4364
Epoch 17, CIFAR-10 Batch 5:  Loss: 122042.7422 | Validation Accuracy: 0.4298
Epoch 18, CIFAR-10 Batch 1:  Loss: 209359.0781 | Validation Accuracy: 0.4322
Epoch 18, CIFAR-10 Batch 2:  Loss: 113406.4297 | Validation Accuracy: 0.4178
Epoch 18, CIFAR-10 Batch 3:  Loss: 13940.9219 | Validation Accuracy: 0.4352
Epoch 18, CIFAR-10 Batch 4:  Loss: 79685.4062 | Validation Accuracy: 0.4384
Epoch 18, CIFAR-10 Batch 5:  Loss: 98374.3125 | Validation Accuracy: 0.4402
Epoch 19, CIFAR-10 Batch 1:  Loss: 195032.2500 | Validation Accuracy: 0.4418
Epoch 19, CIFAR-10 Batch 2:  Loss: 113640.8672 | Validation Accuracy: 0.4186
Epoch 19, CIFAR-10 Batch 3:  Loss: 19572.1230 | Validation Accuracy: 0.4334
Epoch 19, CIFAR-10 Batch 4:  Loss: 56404.3320 | Validation Accuracy: 0.4364
Epoch 19, CIFAR-10 Batch 5:  Loss: 88312.4453 | Validation Accuracy: 0.4408
Epoch 20, CIFAR-10 Batch 1:  Loss: 160403.9219 | Validation Accuracy: 0.4434
Epoch 20, CIFAR-10 Batch 2:  Loss: 110474.8125 | Validation Accuracy: 0.4232
Epoch 20, CIFAR-10 Batch 3:  Loss: 10301.3311 | Validation Accuracy: 0.4410
Epoch 20, CIFAR-10 Batch 4:  Loss: 57310.4570 | Validation Accuracy: 0.4412
Epoch 20, CIFAR-10 Batch 5:  Loss: 91191.3672 | Validation Accuracy: 0.4476
Epoch 21, CIFAR-10 Batch 1:  Loss: 143712.5156 | Validation Accuracy: 0.4500
Epoch 21, CIFAR-10 Batch 2:  Loss: 107942.2266 | Validation Accuracy: 0.4222
Epoch 21, CIFAR-10 Batch 3:  Loss:  9477.9121 | Validation Accuracy: 0.4486
Epoch 21, CIFAR-10 Batch 4:  Loss: 40547.2812 | Validation Accuracy: 0.4398
Epoch 21, CIFAR-10 Batch 5:  Loss: 100842.7188 | Validation Accuracy: 0.4442
Epoch 22, CIFAR-10 Batch 1:  Loss: 127069.5547 | Validation Accuracy: 0.4532
Epoch 22, CIFAR-10 Batch 2:  Loss: 87754.8906 | Validation Accuracy: 0.4270
Epoch 22, CIFAR-10 Batch 3:  Loss: 10735.2285 | Validation Accuracy: 0.4494
Epoch 22, CIFAR-10 Batch 4:  Loss: 48641.1484 | Validation Accuracy: 0.4468
Epoch 22, CIFAR-10 Batch 5:  Loss: 69132.7266 | Validation Accuracy: 0.4550
Epoch 23, CIFAR-10 Batch 1:  Loss: 142133.4531 | Validation Accuracy: 0.4490
Epoch 23, CIFAR-10 Batch 2:  Loss: 77485.6953 | Validation Accuracy: 0.4272
Epoch 23, CIFAR-10 Batch 3:  Loss:  8780.2061 | Validation Accuracy: 0.4474
Epoch 23, CIFAR-10 Batch 4:  Loss: 24460.6602 | Validation Accuracy: 0.4516
Epoch 23, CIFAR-10 Batch 5:  Loss: 59939.5977 | Validation Accuracy: 0.4458
Epoch 24, CIFAR-10 Batch 1:  Loss: 111338.9141 | Validation Accuracy: 0.4544
Epoch 24, CIFAR-10 Batch 2:  Loss: 69918.3203 | Validation Accuracy: 0.4304
Epoch 24, CIFAR-10 Batch 3:  Loss:  8670.5840 | Validation Accuracy: 0.4412
Epoch 24, CIFAR-10 Batch 4:  Loss: 19188.0527 | Validation Accuracy: 0.4500
Epoch 24, CIFAR-10 Batch 5:  Loss: 43028.3281 | Validation Accuracy: 0.4486
Epoch 25, CIFAR-10 Batch 1:  Loss: 91742.7188 | Validation Accuracy: 0.4570
Epoch 25, CIFAR-10 Batch 2:  Loss: 51011.5703 | Validation Accuracy: 0.4298
Epoch 25, CIFAR-10 Batch 3:  Loss:  1907.2313 | Validation Accuracy: 0.4314
Epoch 25, CIFAR-10 Batch 4:  Loss: 29114.5391 | Validation Accuracy: 0.4520
Epoch 25, CIFAR-10 Batch 5:  Loss: 31401.4863 | Validation Accuracy: 0.4540
Epoch 26, CIFAR-10 Batch 1:  Loss: 79359.2578 | Validation Accuracy: 0.4682
Epoch 26, CIFAR-10 Batch 2:  Loss: 50222.8320 | Validation Accuracy: 0.4434
Epoch 26, CIFAR-10 Batch 3:  Loss:  6195.5591 | Validation Accuracy: 0.4370
Epoch 26, CIFAR-10 Batch 4:  Loss: 19264.5801 | Validation Accuracy: 0.4582
Epoch 26, CIFAR-10 Batch 5:  Loss: 36235.4219 | Validation Accuracy: 0.4526
Epoch 27, CIFAR-10 Batch 1:  Loss: 62535.0273 | Validation Accuracy: 0.4630
Epoch 27, CIFAR-10 Batch 2:  Loss: 56458.1484 | Validation Accuracy: 0.4454
Epoch 27, CIFAR-10 Batch 3:  Loss:  8937.6416 | Validation Accuracy: 0.4394
Epoch 27, CIFAR-10 Batch 4:  Loss: 30868.5508 | Validation Accuracy: 0.4440
Epoch 27, CIFAR-10 Batch 5:  Loss: 33234.6484 | Validation Accuracy: 0.4592
Epoch 28, CIFAR-10 Batch 1:  Loss: 58339.0156 | Validation Accuracy: 0.4636
Epoch 28, CIFAR-10 Batch 2:  Loss: 44563.5156 | Validation Accuracy: 0.4522
Epoch 28, CIFAR-10 Batch 3:  Loss:  4959.1499 | Validation Accuracy: 0.4432
Epoch 28, CIFAR-10 Batch 4:  Loss: 22333.0215 | Validation Accuracy: 0.4466
Epoch 28, CIFAR-10 Batch 5:  Loss: 34620.7422 | Validation Accuracy: 0.4706
Epoch 29, CIFAR-10 Batch 1:  Loss: 57990.4609 | Validation Accuracy: 0.4714
Epoch 29, CIFAR-10 Batch 2:  Loss: 44764.9648 | Validation Accuracy: 0.4578
Epoch 29, CIFAR-10 Batch 3:  Loss:  9182.0879 | Validation Accuracy: 0.4434
Epoch 29, CIFAR-10 Batch 4:  Loss: 25452.3008 | Validation Accuracy: 0.4570
Epoch 29, CIFAR-10 Batch 5:  Loss: 23520.0137 | Validation Accuracy: 0.4648
Epoch 30, CIFAR-10 Batch 1:  Loss: 40527.7188 | Validation Accuracy: 0.4764
Epoch 30, CIFAR-10 Batch 2:  Loss: 38206.9375 | Validation Accuracy: 0.4432
Epoch 30, CIFAR-10 Batch 3:  Loss:  5675.2217 | Validation Accuracy: 0.4480
Epoch 30, CIFAR-10 Batch 4:  Loss: 11610.2900 | Validation Accuracy: 0.4676
Epoch 30, CIFAR-10 Batch 5:  Loss: 20668.8496 | Validation Accuracy: 0.4714
Epoch 31, CIFAR-10 Batch 1:  Loss: 30701.8828 | Validation Accuracy: 0.4758
Epoch 31, CIFAR-10 Batch 2:  Loss: 39914.1406 | Validation Accuracy: 0.4400
Epoch 31, CIFAR-10 Batch 3:  Loss:  4022.2642 | Validation Accuracy: 0.4500
Epoch 31, CIFAR-10 Batch 4:  Loss:  4662.1797 | Validation Accuracy: 0.4662
Epoch 31, CIFAR-10 Batch 5:  Loss: 20298.1797 | Validation Accuracy: 0.4680
Epoch 32, CIFAR-10 Batch 1:  Loss: 33427.9023 | Validation Accuracy: 0.4690
Epoch 32, CIFAR-10 Batch 2:  Loss: 35837.1250 | Validation Accuracy: 0.4296
Epoch 32, CIFAR-10 Batch 3:  Loss:  3209.1157 | Validation Accuracy: 0.4592
Epoch 32, CIFAR-10 Batch 4:  Loss:  3134.0845 | Validation Accuracy: 0.4484
Epoch 32, CIFAR-10 Batch 5:  Loss:  8181.3223 | Validation Accuracy: 0.4716
Epoch 33, CIFAR-10 Batch 1:  Loss: 22996.8477 | Validation Accuracy: 0.4662
Epoch 33, CIFAR-10 Batch 2:  Loss: 33003.9375 | Validation Accuracy: 0.4434
Epoch 33, CIFAR-10 Batch 3:  Loss:  1230.5829 | Validation Accuracy: 0.4550
Epoch 33, CIFAR-10 Batch 4:  Loss:  2693.1846 | Validation Accuracy: 0.4548
Epoch 33, CIFAR-10 Batch 5:  Loss:  7689.9507 | Validation Accuracy: 0.4774
Epoch 34, CIFAR-10 Batch 1:  Loss: 18215.0996 | Validation Accuracy: 0.4652
Epoch 34, CIFAR-10 Batch 2:  Loss: 14955.1035 | Validation Accuracy: 0.4582
Epoch 34, CIFAR-10 Batch 3:  Loss:  2154.0688 | Validation Accuracy: 0.4536
Epoch 34, CIFAR-10 Batch 4:  Loss:  1196.9813 | Validation Accuracy: 0.4626
Epoch 34, CIFAR-10 Batch 5:  Loss:  4513.0596 | Validation Accuracy: 0.4794
Epoch 35, CIFAR-10 Batch 1:  Loss: 20914.8730 | Validation Accuracy: 0.4742
Epoch 35, CIFAR-10 Batch 2:  Loss:  6508.6406 | Validation Accuracy: 0.4658
Epoch 35, CIFAR-10 Batch 3:  Loss:  2377.2820 | Validation Accuracy: 0.4486
Epoch 35, CIFAR-10 Batch 4:  Loss:  1203.8063 | Validation Accuracy: 0.4694
Epoch 35, CIFAR-10 Batch 5:  Loss:  4289.7373 | Validation Accuracy: 0.4828
Epoch 36, CIFAR-10 Batch 1:  Loss: 23098.0547 | Validation Accuracy: 0.4772
Epoch 36, CIFAR-10 Batch 2:  Loss:  4924.0625 | Validation Accuracy: 0.4686
Epoch 36, CIFAR-10 Batch 3:  Loss:   684.4125 | Validation Accuracy: 0.4652
Epoch 36, CIFAR-10 Batch 4:  Loss:   200.9531 | Validation Accuracy: 0.4708
Epoch 36, CIFAR-10 Batch 5:  Loss:  4750.4565 | Validation Accuracy: 0.4860
Epoch 37, CIFAR-10 Batch 1:  Loss: 18942.4648 | Validation Accuracy: 0.4768
Epoch 37, CIFAR-10 Batch 2:  Loss:  6828.7695 | Validation Accuracy: 0.4672
Epoch 37, CIFAR-10 Batch 3:  Loss:  2939.5391 | Validation Accuracy: 0.4626
Epoch 37, CIFAR-10 Batch 4:  Loss:  2037.5500 | Validation Accuracy: 0.4720
Epoch 37, CIFAR-10 Batch 5:  Loss:  8116.4873 | Validation Accuracy: 0.4848
Epoch 38, CIFAR-10 Batch 1:  Loss: 22579.3574 | Validation Accuracy: 0.4766
Epoch 38, CIFAR-10 Batch 2:  Loss:  7577.7593 | Validation Accuracy: 0.4628
Epoch 38, CIFAR-10 Batch 3:  Loss:  2849.4812 | Validation Accuracy: 0.4632
Epoch 38, CIFAR-10 Batch 4:  Loss:  8553.1758 | Validation Accuracy: 0.4776
Epoch 38, CIFAR-10 Batch 5:  Loss:  2589.7437 | Validation Accuracy: 0.4856
Epoch 39, CIFAR-10 Batch 1:  Loss: 21141.1016 | Validation Accuracy: 0.4714
Epoch 39, CIFAR-10 Batch 2:  Loss:  3332.7141 | Validation Accuracy: 0.4590
Epoch 39, CIFAR-10 Batch 3:  Loss:  1577.1594 | Validation Accuracy: 0.4664
Epoch 39, CIFAR-10 Batch 4:  Loss:  1236.7219 | Validation Accuracy: 0.4718
Epoch 39, CIFAR-10 Batch 5:  Loss:  9015.5312 | Validation Accuracy: 0.4882
Epoch 40, CIFAR-10 Batch 1:  Loss:  6938.0239 | Validation Accuracy: 0.4834
Epoch 40, CIFAR-10 Batch 2:  Loss: 10409.1475 | Validation Accuracy: 0.4684
Epoch 40, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4762
Epoch 40, CIFAR-10 Batch 4:  Loss:  7553.7031 | Validation Accuracy: 0.4658
Epoch 40, CIFAR-10 Batch 5:  Loss:  1614.2219 | Validation Accuracy: 0.4958
Epoch 41, CIFAR-10 Batch 1:  Loss:  3860.3906 | Validation Accuracy: 0.4796
Epoch 41, CIFAR-10 Batch 2:  Loss:  5601.3511 | Validation Accuracy: 0.4628
Epoch 41, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4790
Epoch 41, CIFAR-10 Batch 4:  Loss: 16022.6123 | Validation Accuracy: 0.4590
Epoch 41, CIFAR-10 Batch 5:  Loss:  2508.8391 | Validation Accuracy: 0.4738
Epoch 42, CIFAR-10 Batch 1:  Loss:  8601.6250 | Validation Accuracy: 0.4756
Epoch 42, CIFAR-10 Batch 2:  Loss:  8046.1377 | Validation Accuracy: 0.4674
Epoch 42, CIFAR-10 Batch 3:  Loss:  1014.7266 | Validation Accuracy: 0.4740
Epoch 42, CIFAR-10 Batch 4:  Loss: 17885.6855 | Validation Accuracy: 0.4488
Epoch 42, CIFAR-10 Batch 5:  Loss:  2840.1965 | Validation Accuracy: 0.4762
Epoch 43, CIFAR-10 Batch 1:  Loss:  4038.9885 | Validation Accuracy: 0.4832
Epoch 43, CIFAR-10 Batch 2:  Loss: 10993.8535 | Validation Accuracy: 0.4808
Epoch 43, CIFAR-10 Batch 3:  Loss:  2105.8445 | Validation Accuracy: 0.4634
Epoch 43, CIFAR-10 Batch 4:  Loss: 17127.4121 | Validation Accuracy: 0.4384
Epoch 43, CIFAR-10 Batch 5:  Loss:  5054.1460 | Validation Accuracy: 0.4772
Epoch 44, CIFAR-10 Batch 1:  Loss:  1216.5328 | Validation Accuracy: 0.4952
Epoch 44, CIFAR-10 Batch 2:  Loss:  4180.0796 | Validation Accuracy: 0.4914
Epoch 44, CIFAR-10 Batch 3:  Loss:   508.8680 | Validation Accuracy: 0.4694
Epoch 44, CIFAR-10 Batch 4:  Loss:  1329.3375 | Validation Accuracy: 0.4516
Epoch 44, CIFAR-10 Batch 5:  Loss: 12335.0137 | Validation Accuracy: 0.4676
Epoch 45, CIFAR-10 Batch 1:  Loss:   687.1984 | Validation Accuracy: 0.4802
Epoch 45, CIFAR-10 Batch 2:  Loss:  6273.9009 | Validation Accuracy: 0.4644
Epoch 45, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4740
Epoch 45, CIFAR-10 Batch 4:  Loss:  2229.7344 | Validation Accuracy: 0.4526
Epoch 45, CIFAR-10 Batch 5:  Loss:  2893.5344 | Validation Accuracy: 0.4672
Epoch 46, CIFAR-10 Batch 1:  Loss:   565.7092 | Validation Accuracy: 0.4800
Epoch 46, CIFAR-10 Batch 2:  Loss:  3481.6228 | Validation Accuracy: 0.4744
Epoch 46, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4932
Epoch 46, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4570
Epoch 46, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4782
Epoch 47, CIFAR-10 Batch 1:  Loss:  2020.8798 | Validation Accuracy: 0.4862
Epoch 47, CIFAR-10 Batch 2:  Loss:   657.1719 | Validation Accuracy: 0.4798
Epoch 47, CIFAR-10 Batch 3:  Loss:   444.7969 | Validation Accuracy: 0.4932
Epoch 47, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4656
Epoch 47, CIFAR-10 Batch 5:  Loss:  1367.5797 | Validation Accuracy: 0.4836
Epoch 48, CIFAR-10 Batch 1:  Loss:  3049.2852 | Validation Accuracy: 0.4792
Epoch 48, CIFAR-10 Batch 2:  Loss:  1349.3812 | Validation Accuracy: 0.4912
Epoch 48, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4940
Epoch 48, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4800
Epoch 48, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4724
Epoch 49, CIFAR-10 Batch 1:  Loss: 13859.2891 | Validation Accuracy: 0.4842
Epoch 49, CIFAR-10 Batch 2:  Loss:   662.7750 | Validation Accuracy: 0.4874
Epoch 49, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4874
Epoch 49, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4898
Epoch 49, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4780
Epoch 50, CIFAR-10 Batch 1:  Loss:  8304.3047 | Validation Accuracy: 0.4830
Epoch 50, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4938
Epoch 50, CIFAR-10 Batch 3:  Loss:    66.1129 | Validation Accuracy: 0.4832
Epoch 50, CIFAR-10 Batch 4:  Loss:   785.9932 | Validation Accuracy: 0.4842
Epoch 50, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4828
Epoch 51, CIFAR-10 Batch 1:  Loss: 17319.4043 | Validation Accuracy: 0.4686
Epoch 51, CIFAR-10 Batch 2:  Loss:  2218.6516 | Validation Accuracy: 0.4916
Epoch 51, CIFAR-10 Batch 3:  Loss:     5.2906 | Validation Accuracy: 0.4768
Epoch 51, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4870
Epoch 51, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4856
Epoch 52, CIFAR-10 Batch 1:  Loss:  3964.4893 | Validation Accuracy: 0.4738
Epoch 52, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4906
Epoch 52, CIFAR-10 Batch 3:  Loss:  2728.5398 | Validation Accuracy: 0.4586
Epoch 52, CIFAR-10 Batch 4:  Loss:  1060.1039 | Validation Accuracy: 0.4912
Epoch 52, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4886
Epoch 53, CIFAR-10 Batch 1:  Loss:    96.0531 | Validation Accuracy: 0.4936
Epoch 53, CIFAR-10 Batch 2:  Loss:   471.2406 | Validation Accuracy: 0.4808
Epoch 53, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4788
Epoch 53, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4830
Epoch 53, CIFAR-10 Batch 5:  Loss:   221.9367 | Validation Accuracy: 0.4862
Epoch 54, CIFAR-10 Batch 1:  Loss:  1774.5931 | Validation Accuracy: 0.4898
Epoch 54, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4900
Epoch 54, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4730
Epoch 54, CIFAR-10 Batch 4:  Loss:  3944.5657 | Validation Accuracy: 0.4800
Epoch 54, CIFAR-10 Batch 5:  Loss:  1108.4879 | Validation Accuracy: 0.4950
Epoch 55, CIFAR-10 Batch 1:  Loss:   872.9467 | Validation Accuracy: 0.4878
Epoch 55, CIFAR-10 Batch 2:  Loss:   376.3594 | Validation Accuracy: 0.5002
Epoch 55, CIFAR-10 Batch 3:  Loss:  2639.3271 | Validation Accuracy: 0.4738
Epoch 55, CIFAR-10 Batch 4:  Loss:   460.4875 | Validation Accuracy: 0.4898
Epoch 55, CIFAR-10 Batch 5:  Loss:  3185.4209 | Validation Accuracy: 0.4948
Epoch 56, CIFAR-10 Batch 1:  Loss:  1267.5962 | Validation Accuracy: 0.4722
Epoch 56, CIFAR-10 Batch 2:  Loss:   318.2895 | Validation Accuracy: 0.4932
Epoch 56, CIFAR-10 Batch 3:  Loss:  1549.7556 | Validation Accuracy: 0.4776
Epoch 56, CIFAR-10 Batch 4:  Loss:  1172.3641 | Validation Accuracy: 0.4912
Epoch 56, CIFAR-10 Batch 5:  Loss:  4992.4072 | Validation Accuracy: 0.4982
Epoch 57, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4728
Epoch 57, CIFAR-10 Batch 2:  Loss:  2969.9983 | Validation Accuracy: 0.4838
Epoch 57, CIFAR-10 Batch 3:  Loss:   374.5020 | Validation Accuracy: 0.4872
Epoch 57, CIFAR-10 Batch 4:  Loss:  1511.6188 | Validation Accuracy: 0.4836
Epoch 57, CIFAR-10 Batch 5:  Loss:  3868.7368 | Validation Accuracy: 0.4982
Epoch 58, CIFAR-10 Batch 1:  Loss:  1505.1188 | Validation Accuracy: 0.4720
Epoch 58, CIFAR-10 Batch 2:  Loss:   719.6650 | Validation Accuracy: 0.4660
Epoch 58, CIFAR-10 Batch 3:  Loss:  2750.5312 | Validation Accuracy: 0.4792
Epoch 58, CIFAR-10 Batch 4:  Loss:  3297.2681 | Validation Accuracy: 0.4884
Epoch 58, CIFAR-10 Batch 5:  Loss:   644.8469 | Validation Accuracy: 0.4928
Epoch 59, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4870
Epoch 59, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4758
Epoch 59, CIFAR-10 Batch 3:  Loss:   528.9532 | Validation Accuracy: 0.4848
Epoch 59, CIFAR-10 Batch 4:  Loss:  3699.3064 | Validation Accuracy: 0.4914
Epoch 59, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4584
Epoch 60, CIFAR-10 Batch 1:  Loss:  1327.0579 | Validation Accuracy: 0.4954
Epoch 60, CIFAR-10 Batch 2:  Loss:  2133.4165 | Validation Accuracy: 0.4722
Epoch 60, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4990
Epoch 60, CIFAR-10 Batch 4:  Loss:  3212.0469 | Validation Accuracy: 0.4950
Epoch 60, CIFAR-10 Batch 5:  Loss:   851.2097 | Validation Accuracy: 0.4748
Epoch 61, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4922
Epoch 61, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4868
Epoch 61, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5058
Epoch 61, CIFAR-10 Batch 4:  Loss:   148.1789 | Validation Accuracy: 0.4970
Epoch 61, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4864
Epoch 62, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4820
Epoch 62, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4818
Epoch 62, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5006
Epoch 62, CIFAR-10 Batch 4:  Loss:   584.5594 | Validation Accuracy: 0.4830
Epoch 62, CIFAR-10 Batch 5:  Loss:    64.4969 | Validation Accuracy: 0.4956
Epoch 63, CIFAR-10 Batch 1:  Loss:   309.2953 | Validation Accuracy: 0.4798
Epoch 63, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4698
Epoch 63, CIFAR-10 Batch 3:  Loss:   704.3113 | Validation Accuracy: 0.4982
Epoch 63, CIFAR-10 Batch 4:  Loss:  1626.8855 | Validation Accuracy: 0.4684
Epoch 63, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4994
Epoch 64, CIFAR-10 Batch 1:  Loss:   329.0031 | Validation Accuracy: 0.4782
Epoch 64, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4736
Epoch 64, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4992
Epoch 64, CIFAR-10 Batch 4:  Loss:  2072.0813 | Validation Accuracy: 0.4672
Epoch 64, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5042
Epoch 65, CIFAR-10 Batch 1:  Loss:   131.1316 | Validation Accuracy: 0.4918
Epoch 65, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4748
Epoch 65, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4926
Epoch 65, CIFAR-10 Batch 4:  Loss:   537.4031 | Validation Accuracy: 0.4906
Epoch 65, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4956
Epoch 66, CIFAR-10 Batch 1:  Loss:  1969.1754 | Validation Accuracy: 0.4950
Epoch 66, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4654
Epoch 66, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4918
Epoch 66, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5066
Epoch 66, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5068
Epoch 67, CIFAR-10 Batch 1:  Loss:  2662.3047 | Validation Accuracy: 0.4956
Epoch 67, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4634
Epoch 67, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4952
Epoch 67, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5016
Epoch 67, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4990
Epoch 68, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4980
Epoch 68, CIFAR-10 Batch 2:  Loss:   474.6758 | Validation Accuracy: 0.4594
Epoch 68, CIFAR-10 Batch 3:  Loss:   697.7770 | Validation Accuracy: 0.4956
Epoch 68, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4988
Epoch 68, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4830
Epoch 69, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4934
Epoch 69, CIFAR-10 Batch 2:  Loss:   288.0305 | Validation Accuracy: 0.4562
Epoch 69, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4866
Epoch 69, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4958
Epoch 69, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4726
Epoch 70, CIFAR-10 Batch 1:  Loss:   740.8315 | Validation Accuracy: 0.4852
Epoch 70, CIFAR-10 Batch 2:  Loss:  1221.7266 | Validation Accuracy: 0.4618
Epoch 70, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4896
Epoch 70, CIFAR-10 Batch 4:  Loss:   356.7516 | Validation Accuracy: 0.5008
Epoch 70, CIFAR-10 Batch 5:  Loss:  1203.6367 | Validation Accuracy: 0.4702
Epoch 71, CIFAR-10 Batch 1:  Loss:   713.3879 | Validation Accuracy: 0.4824
Epoch 71, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4692
Epoch 71, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4794
Epoch 71, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4944
Epoch 71, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4662
Epoch 72, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4870
Epoch 72, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4682
Epoch 72, CIFAR-10 Batch 3:  Loss:   387.3570 | Validation Accuracy: 0.4786
Epoch 72, CIFAR-10 Batch 4:  Loss:    92.1152 | Validation Accuracy: 0.5004
Epoch 72, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4792
Epoch 73, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4736
Epoch 73, CIFAR-10 Batch 2:  Loss:  2351.6755 | Validation Accuracy: 0.4730
Epoch 73, CIFAR-10 Batch 3:  Loss:  1441.4062 | Validation Accuracy: 0.4902
Epoch 73, CIFAR-10 Batch 4:  Loss:  1686.6449 | Validation Accuracy: 0.4978
Epoch 73, CIFAR-10 Batch 5:  Loss:   578.6258 | Validation Accuracy: 0.4748
Epoch 74, CIFAR-10 Batch 1:  Loss:   946.8344 | Validation Accuracy: 0.4772
Epoch 74, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4872
Epoch 74, CIFAR-10 Batch 3:  Loss:  1140.4481 | Validation Accuracy: 0.4808
Epoch 74, CIFAR-10 Batch 4:  Loss:  2103.6172 | Validation Accuracy: 0.4936
Epoch 74, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 75, CIFAR-10 Batch 1:  Loss:     7.0420 | Validation Accuracy: 0.4844
Epoch 75, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4934
Epoch 75, CIFAR-10 Batch 3:  Loss:  3185.1108 | Validation Accuracy: 0.4886
Epoch 75, CIFAR-10 Batch 4:  Loss:  3614.0820 | Validation Accuracy: 0.4588
Epoch 75, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5064
Epoch 76, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4904
Epoch 76, CIFAR-10 Batch 2:  Loss:   944.0773 | Validation Accuracy: 0.4910
Epoch 76, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5036
Epoch 76, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5098
Epoch 76, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5118
Epoch 77, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5072
Epoch 77, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4836
Epoch 77, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5090
Epoch 77, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5084
Epoch 77, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 78, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4950
Epoch 78, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4838
Epoch 78, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5120
Epoch 78, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5062
Epoch 78, CIFAR-10 Batch 5:  Loss:  1943.6898 | Validation Accuracy: 0.4892
Epoch 79, CIFAR-10 Batch 1:  Loss:   571.1828 | Validation Accuracy: 0.5090
Epoch 79, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4868
Epoch 79, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5156
Epoch 79, CIFAR-10 Batch 4:  Loss:   458.2875 | Validation Accuracy: 0.4878
Epoch 79, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5040
Epoch 80, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5044
Epoch 80, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4986
Epoch 80, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5088
Epoch 80, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4956
Epoch 80, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5044
Epoch 81, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5126
Epoch 81, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5038
Epoch 81, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5018
Epoch 81, CIFAR-10 Batch 4:  Loss:    71.4973 | Validation Accuracy: 0.5038
Epoch 81, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5034
Epoch 82, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5084
Epoch 82, CIFAR-10 Batch 2:  Loss:  1104.2797 | Validation Accuracy: 0.5030
Epoch 82, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4960
Epoch 82, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.4984
Epoch 82, CIFAR-10 Batch 5:  Loss:  2934.8630 | Validation Accuracy: 0.4928
Epoch 83, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4998
Epoch 83, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4994
Epoch 83, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4910
Epoch 83, CIFAR-10 Batch 4:  Loss:   686.4617 | Validation Accuracy: 0.4858
Epoch 83, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4952
Epoch 84, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4932
Epoch 84, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5008
Epoch 84, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4786
Epoch 84, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5032
Epoch 84, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.4970
Epoch 85, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.4890
Epoch 85, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5078
Epoch 85, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4942
Epoch 85, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5052
Epoch 85, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5006
Epoch 86, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5022
Epoch 86, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5062
Epoch 86, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5014
Epoch 86, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5058
Epoch 86, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5146
Epoch 87, CIFAR-10 Batch 1:  Loss:   926.7906 | Validation Accuracy: 0.5016
Epoch 87, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 87, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5014
Epoch 87, CIFAR-10 Batch 4:  Loss:   287.0820 | Validation Accuracy: 0.5040
Epoch 87, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5106
Epoch 88, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5146
Epoch 88, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 88, CIFAR-10 Batch 3:  Loss:   315.9078 | Validation Accuracy: 0.5102
Epoch 88, CIFAR-10 Batch 4:  Loss:   670.0273 | Validation Accuracy: 0.5088
Epoch 88, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 89, CIFAR-10 Batch 1:  Loss:  1587.3622 | Validation Accuracy: 0.5096
Epoch 89, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4906
Epoch 89, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4988
Epoch 89, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5100
Epoch 89, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 90, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5092
Epoch 90, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5000
Epoch 90, CIFAR-10 Batch 3:  Loss:   154.2121 | Validation Accuracy: 0.4906
Epoch 90, CIFAR-10 Batch 4:  Loss:   777.2410 | Validation Accuracy: 0.5080
Epoch 90, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5108
Epoch 91, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5020
Epoch 91, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4958
Epoch 91, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4912
Epoch 91, CIFAR-10 Batch 4:  Loss:   505.3011 | Validation Accuracy: 0.5126
Epoch 91, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5182
Epoch 92, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5046
Epoch 92, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 92, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4960
Epoch 92, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5150
Epoch 92, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5182
Epoch 93, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5108
Epoch 93, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.4974
Epoch 93, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4948
Epoch 93, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5208
Epoch 93, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5070
Epoch 94, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5160
Epoch 94, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 94, CIFAR-10 Batch 3:  Loss:    64.7344 | Validation Accuracy: 0.5068
Epoch 94, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5180
Epoch 94, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5190
Epoch 95, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5136
Epoch 95, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5132
Epoch 95, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4996
Epoch 95, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5184
Epoch 95, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 96, CIFAR-10 Batch 1:  Loss:    93.3258 | Validation Accuracy: 0.5230
Epoch 96, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5030
Epoch 96, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5064
Epoch 96, CIFAR-10 Batch 4:  Loss:  2491.0537 | Validation Accuracy: 0.5126
Epoch 96, CIFAR-10 Batch 5:  Loss:    53.9516 | Validation Accuracy: 0.5196
Epoch 97, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5158
Epoch 97, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 97, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5090
Epoch 97, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5078
Epoch 97, CIFAR-10 Batch 5:  Loss:   606.4094 | Validation Accuracy: 0.5156
Epoch 98, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 98, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5020
Epoch 98, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 98, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5016
Epoch 98, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5148
Epoch 99, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5222
Epoch 99, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5066
Epoch 99, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5074
Epoch 99, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5066
Epoch 99, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5232
Epoch 100, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5140
Epoch 100, CIFAR-10 Batch 2:  Loss:  3767.6455 | Validation Accuracy: 0.5122
Epoch 100, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5120
Epoch 100, CIFAR-10 Batch 4:  Loss:   766.3258 | Validation Accuracy: 0.5078
Epoch 100, CIFAR-10 Batch 5:  Loss:  1462.6250 | Validation Accuracy: 0.5294
Epoch 101, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5202
Epoch 101, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5016
Epoch 101, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5136
Epoch 101, CIFAR-10 Batch 4:  Loss:  1163.4408 | Validation Accuracy: 0.5018
Epoch 101, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5264
Epoch 102, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5250
Epoch 102, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5112
Epoch 102, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5000
Epoch 102, CIFAR-10 Batch 4:  Loss:   193.9438 | Validation Accuracy: 0.5104
Epoch 102, CIFAR-10 Batch 5:  Loss:   902.9141 | Validation Accuracy: 0.5228
Epoch 103, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5270
Epoch 103, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5092
Epoch 103, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.4990
Epoch 103, CIFAR-10 Batch 4:  Loss:   570.6547 | Validation Accuracy: 0.5100
Epoch 103, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5162
Epoch 104, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5190
Epoch 104, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5104
Epoch 104, CIFAR-10 Batch 3:  Loss:   151.2119 | Validation Accuracy: 0.4856
Epoch 104, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5142
Epoch 104, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5270
Epoch 105, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5234
Epoch 105, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 105, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5102
Epoch 105, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 105, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5212
Epoch 106, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 106, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5142
Epoch 106, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5104
Epoch 106, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5138
Epoch 106, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5198
Epoch 107, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5196
Epoch 107, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5066
Epoch 107, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5138
Epoch 107, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5136
Epoch 107, CIFAR-10 Batch 5:  Loss:    15.6398 | Validation Accuracy: 0.5024
Epoch 108, CIFAR-10 Batch 1:  Loss:   160.9484 | Validation Accuracy: 0.5172
Epoch 108, CIFAR-10 Batch 2:  Loss:   318.7738 | Validation Accuracy: 0.5244
Epoch 108, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5236
Epoch 108, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5184
Epoch 108, CIFAR-10 Batch 5:  Loss:   997.6930 | Validation Accuracy: 0.5244
Epoch 109, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5108
Epoch 109, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5236
Epoch 109, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5116
Epoch 109, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5160
Epoch 109, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5190
Epoch 110, CIFAR-10 Batch 1:  Loss:   928.5251 | Validation Accuracy: 0.5172
Epoch 110, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5128
Epoch 110, CIFAR-10 Batch 3:  Loss:    21.8559 | Validation Accuracy: 0.5156
Epoch 110, CIFAR-10 Batch 4:  Loss:   352.3453 | Validation Accuracy: 0.5186
Epoch 110, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5254
Epoch 111, CIFAR-10 Batch 1:  Loss:   464.7919 | Validation Accuracy: 0.5122
Epoch 111, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5174
Epoch 111, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5238
Epoch 111, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5138
Epoch 111, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5332
Epoch 112, CIFAR-10 Batch 1:  Loss:  1038.1152 | Validation Accuracy: 0.5088
Epoch 112, CIFAR-10 Batch 2:  Loss:   215.8859 | Validation Accuracy: 0.5232
Epoch 112, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5210
Epoch 112, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5296
Epoch 112, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5266
Epoch 113, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5184
Epoch 113, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5204
Epoch 113, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5158
Epoch 113, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5160
Epoch 113, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5390
Epoch 114, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5176
Epoch 114, CIFAR-10 Batch 2:  Loss:   128.7961 | Validation Accuracy: 0.5192
Epoch 114, CIFAR-10 Batch 3:  Loss:   299.7625 | Validation Accuracy: 0.5162
Epoch 114, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5020
Epoch 114, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5310
Epoch 115, CIFAR-10 Batch 1:  Loss:  1520.7987 | Validation Accuracy: 0.5270
Epoch 115, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5078
Epoch 115, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5232
Epoch 115, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5088
Epoch 115, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 116, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5270
Epoch 116, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5152
Epoch 116, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5196
Epoch 116, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5200
Epoch 116, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5350
Epoch 117, CIFAR-10 Batch 1:  Loss:   133.5262 | Validation Accuracy: 0.5290
Epoch 117, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5280
Epoch 117, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5082
Epoch 117, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5172
Epoch 117, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5314
Epoch 118, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5280
Epoch 118, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5222
Epoch 118, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5124
Epoch 118, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 118, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5438
Epoch 119, CIFAR-10 Batch 1:  Loss:   131.8938 | Validation Accuracy: 0.5316
Epoch 119, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5148
Epoch 119, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5120
Epoch 119, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5196
Epoch 119, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5330
Epoch 120, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5314
Epoch 120, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5134
Epoch 120, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5080
Epoch 120, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5230
Epoch 120, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5256
Epoch 121, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5264
Epoch 121, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5194
Epoch 121, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5034
Epoch 121, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5288
Epoch 121, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5352
Epoch 122, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 122, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5054
Epoch 122, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5032
Epoch 122, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5272
Epoch 122, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 123, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5326
Epoch 123, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5140
Epoch 123, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5110
Epoch 123, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5302
Epoch 123, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5220
Epoch 124, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5272
Epoch 124, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5246
Epoch 124, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5174
Epoch 124, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5194
Epoch 124, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5318
Epoch 125, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5262
Epoch 125, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5300
Epoch 125, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5236
Epoch 125, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5250
Epoch 125, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5312
Epoch 126, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 126, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5150
Epoch 126, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5286
Epoch 126, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5234
Epoch 126, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 127, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5384
Epoch 127, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5214
Epoch 127, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5162
Epoch 127, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5254
Epoch 127, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5352
Epoch 128, CIFAR-10 Batch 1:  Loss:   604.6918 | Validation Accuracy: 0.5262
Epoch 128, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5266
Epoch 128, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5314
Epoch 128, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5156
Epoch 128, CIFAR-10 Batch 5:  Loss:    92.0521 | Validation Accuracy: 0.5292
Epoch 129, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5308
Epoch 129, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5314
Epoch 129, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5224
Epoch 129, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5266
Epoch 129, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5272
Epoch 130, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5266
Epoch 130, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5280
Epoch 130, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5234
Epoch 130, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5166
Epoch 130, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5306
Epoch 131, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 131, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5130
Epoch 131, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5262
Epoch 131, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5250
Epoch 131, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5280
Epoch 132, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5340
Epoch 132, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5296
Epoch 132, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5092
Epoch 132, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5270
Epoch 132, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5398
Epoch 133, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5322
Epoch 133, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5256
Epoch 133, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5276
Epoch 133, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5198
Epoch 133, CIFAR-10 Batch 5:  Loss:   363.9840 | Validation Accuracy: 0.5394
Epoch 134, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5308
Epoch 134, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5266
Epoch 134, CIFAR-10 Batch 3:  Loss:   469.6926 | Validation Accuracy: 0.5162
Epoch 134, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5260
Epoch 134, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5346
Epoch 135, CIFAR-10 Batch 1:  Loss:   586.3388 | Validation Accuracy: 0.5244
Epoch 135, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5188
Epoch 135, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5220
Epoch 135, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5192
Epoch 135, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5380
Epoch 136, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5312
Epoch 136, CIFAR-10 Batch 2:  Loss:   347.8141 | Validation Accuracy: 0.5236
Epoch 136, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5156
Epoch 136, CIFAR-10 Batch 4:  Loss:    65.4563 | Validation Accuracy: 0.5194
Epoch 136, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5236
Epoch 137, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5260
Epoch 137, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5232
Epoch 137, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5342
Epoch 137, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5308
Epoch 137, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5332
Epoch 138, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 138, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5168
Epoch 138, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5240
Epoch 138, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5286
Epoch 138, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5274
Epoch 139, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5348
Epoch 139, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5330
Epoch 139, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5190
Epoch 139, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5232
Epoch 139, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5312
Epoch 140, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 140, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5380
Epoch 140, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5286
Epoch 140, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5126
Epoch 140, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5330
Epoch 141, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5258
Epoch 141, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5390
Epoch 141, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5284
Epoch 141, CIFAR-10 Batch 4:  Loss:    36.2637 | Validation Accuracy: 0.5278
Epoch 141, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5326
Epoch 142, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5388
Epoch 142, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5294
Epoch 142, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5318
Epoch 142, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5256
Epoch 142, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5232
Epoch 143, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 143, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 143, CIFAR-10 Batch 3:  Loss:   257.9774 | Validation Accuracy: 0.5168
Epoch 143, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5284
Epoch 143, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 144, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 144, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5222
Epoch 144, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5254
Epoch 144, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5334
Epoch 144, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5270
Epoch 145, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5342
Epoch 145, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5328
Epoch 145, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5288
Epoch 145, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5226
Epoch 145, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5320
Epoch 146, CIFAR-10 Batch 1:  Loss:  4123.2080 | Validation Accuracy: 0.5416
Epoch 146, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 146, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5238
Epoch 146, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5274
Epoch 146, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5366
Epoch 147, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5400
Epoch 147, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5336
Epoch 147, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5338
Epoch 147, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5346
Epoch 147, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5348
Epoch 148, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5490
Epoch 148, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5444
Epoch 148, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5306
Epoch 148, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5348
Epoch 148, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5288
Epoch 149, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5472
Epoch 149, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5350
Epoch 149, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 149, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5342
Epoch 149, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5352
Epoch 150, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5464
Epoch 150, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5292
Epoch 150, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5350
Epoch 150, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5298
Epoch 150, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5248
Epoch 151, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5404
Epoch 151, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5434
Epoch 151, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5202
Epoch 151, CIFAR-10 Batch 4:  Loss:   986.8449 | Validation Accuracy: 0.5396
Epoch 151, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5440
Epoch 152, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5370
Epoch 152, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5302
Epoch 152, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5238
Epoch 152, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5204
Epoch 152, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5278
Epoch 153, CIFAR-10 Batch 1:  Loss:   702.0149 | Validation Accuracy: 0.5358
Epoch 153, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5382
Epoch 153, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 153, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 153, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5454
Epoch 154, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 154, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5456
Epoch 154, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5348
Epoch 154, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5316
Epoch 154, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 155, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5384
Epoch 155, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5376
Epoch 155, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5280
Epoch 155, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 155, CIFAR-10 Batch 5:  Loss:   558.2441 | Validation Accuracy: 0.5416
Epoch 156, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 156, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 156, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5436
Epoch 156, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5092
Epoch 156, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 157, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5480
Epoch 157, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5390
Epoch 157, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5416
Epoch 157, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5300
Epoch 157, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5404
Epoch 158, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 158, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5378
Epoch 158, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5252
Epoch 158, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5250
Epoch 158, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5428
Epoch 159, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 159, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5422
Epoch 159, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5426
Epoch 159, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 159, CIFAR-10 Batch 5:  Loss:   528.2016 | Validation Accuracy: 0.5284
Epoch 160, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 160, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5294
Epoch 160, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5352
Epoch 160, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5234
Epoch 160, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5492
Epoch 161, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5426
Epoch 161, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5302
Epoch 161, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5246
Epoch 161, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5354
Epoch 161, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 162, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5478
Epoch 162, CIFAR-10 Batch 2:  Loss:   473.4734 | Validation Accuracy: 0.5358
Epoch 162, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5230
Epoch 162, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5340
Epoch 162, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 163, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 163, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5466
Epoch 163, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5340
Epoch 163, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5208
Epoch 163, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5474
Epoch 164, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5398
Epoch 164, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5454
Epoch 164, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5404
Epoch 164, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5386
Epoch 164, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 165, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 165, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5474
Epoch 165, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5358
Epoch 165, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5398
Epoch 165, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 166, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 166, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5488
Epoch 166, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5350
Epoch 166, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5302
Epoch 166, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5462
Epoch 167, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5480
Epoch 167, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5390
Epoch 167, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5254
Epoch 167, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5374
Epoch 167, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 168, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5420
Epoch 168, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5328
Epoch 168, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 168, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5120
Epoch 168, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5350
Epoch 169, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 169, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 169, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5260
Epoch 169, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5338
Epoch 169, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5454
Epoch 170, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 170, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5472
Epoch 170, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5332
Epoch 170, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5372
Epoch 170, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5464
Epoch 171, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 171, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5326
Epoch 171, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5292
Epoch 171, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5268
Epoch 171, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 172, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 172, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5366
Epoch 172, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5344
Epoch 172, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5338
Epoch 172, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5384
Epoch 173, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5398
Epoch 173, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5340
Epoch 173, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5378
Epoch 173, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5328
Epoch 173, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 174, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5334
Epoch 174, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 174, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 174, CIFAR-10 Batch 4:  Loss:   978.9633 | Validation Accuracy: 0.5454
Epoch 174, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 175, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5400
Epoch 175, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 175, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5360
Epoch 175, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5256
Epoch 175, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5444
Epoch 176, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 176, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5416
Epoch 176, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5416
Epoch 176, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5282
Epoch 176, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5454
Epoch 177, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5436
Epoch 177, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5422
Epoch 177, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5380
Epoch 177, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5250
Epoch 177, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 178, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 178, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5490
Epoch 178, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5420
Epoch 178, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5268
Epoch 178, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5404
Epoch 179, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 179, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5434
Epoch 179, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 179, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5202
Epoch 179, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5420
Epoch 180, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5476
Epoch 180, CIFAR-10 Batch 2:  Loss:   996.8500 | Validation Accuracy: 0.5476
Epoch 180, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5436
Epoch 180, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5394
Epoch 180, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 181, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5434
Epoch 181, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 181, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5440
Epoch 181, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5334
Epoch 181, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5492
Epoch 182, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 182, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 182, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 182, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5422
Epoch 182, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 183, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 183, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5554
Epoch 183, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5356
Epoch 183, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5490
Epoch 183, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 184, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5464
Epoch 184, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 184, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5474
Epoch 184, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5174
Epoch 184, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5480
Epoch 185, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5580
Epoch 185, CIFAR-10 Batch 2:  Loss:   264.6831 | Validation Accuracy: 0.5384
Epoch 185, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5424
Epoch 185, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 185, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5422
Epoch 186, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5488
Epoch 186, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 186, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5372
Epoch 186, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5376
Epoch 186, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5332
Epoch 187, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5424
Epoch 187, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5558
Epoch 187, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5434
Epoch 187, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5260
Epoch 187, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5470
Epoch 188, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5500
Epoch 188, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5466
Epoch 188, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 188, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5382
Epoch 188, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 189, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 189, CIFAR-10 Batch 2:  Loss:   222.3711 | Validation Accuracy: 0.5564
Epoch 189, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5440
Epoch 189, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 189, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 190, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 190, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 190, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5478
Epoch 190, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 190, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 191, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 191, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 191, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5386
Epoch 191, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 191, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5440
Epoch 192, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5430
Epoch 192, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 192, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 192, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5322
Epoch 192, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 193, CIFAR-10 Batch 1:  Loss:   804.3051 | Validation Accuracy: 0.5458
Epoch 193, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5500
Epoch 193, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 193, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5440
Epoch 193, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 194, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5376
Epoch 194, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 194, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5416
Epoch 194, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5394
Epoch 194, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 195, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5430
Epoch 195, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 195, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 195, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5328
Epoch 195, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 196, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 196, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5542
Epoch 196, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 196, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 196, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 197, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5590
Epoch 197, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5590
Epoch 197, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5456
Epoch 197, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 197, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5478
Epoch 198, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5462
Epoch 198, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 198, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5408
Epoch 198, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5376
Epoch 198, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5456
Epoch 199, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5456
Epoch 199, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5560
Epoch 199, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 199, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5334
Epoch 199, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 200, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 200, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 200, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5410
Epoch 200, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5482
Epoch 200, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5290
Epoch 201, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5476
Epoch 201, CIFAR-10 Batch 2:  Loss:   165.2336 | Validation Accuracy: 0.5452
Epoch 201, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5466
Epoch 201, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5374
Epoch 201, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 202, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5552
Epoch 202, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 202, CIFAR-10 Batch 3:  Loss:   148.0971 | Validation Accuracy: 0.5440
Epoch 202, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5392
Epoch 202, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5510
Epoch 203, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 203, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 203, CIFAR-10 Batch 3:  Loss:   659.1633 | Validation Accuracy: 0.5524
Epoch 203, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 203, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 204, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5524
Epoch 204, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5594
Epoch 204, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5424
Epoch 204, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5470
Epoch 204, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5542
Epoch 205, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5438
Epoch 205, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5470
Epoch 205, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 205, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5354
Epoch 205, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5400
Epoch 206, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 206, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5538
Epoch 206, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5538
Epoch 206, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5376
Epoch 206, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5570
Epoch 207, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 207, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5572
Epoch 207, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 207, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 207, CIFAR-10 Batch 5:  Loss:   580.7924 | Validation Accuracy: 0.5518
Epoch 208, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 208, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5512
Epoch 208, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 208, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5336
Epoch 208, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 209, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5434
Epoch 209, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5596
Epoch 209, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5378
Epoch 209, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5496
Epoch 209, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 210, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5496
Epoch 210, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 210, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 210, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5402
Epoch 210, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 211, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5572
Epoch 211, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 211, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5438
Epoch 211, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 211, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5466
Epoch 212, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 212, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 212, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 212, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 212, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 213, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5406
Epoch 213, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 213, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5320
Epoch 213, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 213, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 214, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 214, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 214, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 214, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 214, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 215, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 215, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5444
Epoch 215, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 215, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5394
Epoch 215, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 216, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 216, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 216, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5530
Epoch 216, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5390
Epoch 216, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 217, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5510
Epoch 217, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 217, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 217, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5406
Epoch 217, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5360
Epoch 218, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5510
Epoch 218, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 218, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5556
Epoch 218, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 218, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 219, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 219, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 219, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 219, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5382
Epoch 219, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 220, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 220, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 220, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 220, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5482
Epoch 220, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5394
Epoch 221, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 221, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5628
Epoch 221, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 221, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 221, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 222, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 222, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5594
Epoch 222, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 222, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 222, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 223, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 223, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5572
Epoch 223, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5422
Epoch 223, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 223, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5466
Epoch 224, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5614
Epoch 224, CIFAR-10 Batch 2:  Loss:   860.6313 | Validation Accuracy: 0.5528
Epoch 224, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5584
Epoch 224, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5556
Epoch 224, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5564
Epoch 225, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 225, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 225, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 225, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5490
Epoch 225, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5474
Epoch 226, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5582
Epoch 226, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 226, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 226, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5412
Epoch 226, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5556
Epoch 227, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 227, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 227, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 227, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5572
Epoch 227, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 228, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5558
Epoch 228, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 228, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 228, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 228, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 229, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 229, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 229, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5558
Epoch 229, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 229, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5560
Epoch 230, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 230, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 230, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 230, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 230, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 231, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5538
Epoch 231, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 231, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5462
Epoch 231, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 231, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5364
Epoch 232, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 232, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 232, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 232, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 232, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5566
Epoch 233, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5598
Epoch 233, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 233, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5570
Epoch 233, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5472
Epoch 233, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 234, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5508
Epoch 234, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 234, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 234, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 234, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 235, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5570
Epoch 235, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 235, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5472
Epoch 235, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5362
Epoch 235, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 236, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 236, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 236, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5552
Epoch 236, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5542
Epoch 236, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5414
Epoch 237, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 237, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 237, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 237, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 237, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 238, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 238, CIFAR-10 Batch 2:  Loss:   426.9255 | Validation Accuracy: 0.5382
Epoch 238, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 238, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5530
Epoch 238, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5380
Epoch 239, CIFAR-10 Batch 1:  Loss:   438.1016 | Validation Accuracy: 0.5494
Epoch 239, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 239, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5492
Epoch 239, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5228
Epoch 239, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 240, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 240, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 240, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5480
Epoch 240, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5462
Epoch 240, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5512
Epoch 241, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 241, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 241, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 241, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 241, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 242, CIFAR-10 Batch 1:  Loss:   352.4898 | Validation Accuracy: 0.5554
Epoch 242, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 242, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5530
Epoch 242, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 242, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 243, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 243, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 243, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 243, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 243, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 244, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 244, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 244, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 244, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5576
Epoch 244, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5462
Epoch 245, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 245, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 245, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 245, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5400
Epoch 245, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5380
Epoch 246, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 246, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 246, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5554
Epoch 246, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 246, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 247, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 247, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 247, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5570
Epoch 247, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5488
Epoch 247, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5488
Epoch 248, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 248, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5614
Epoch 248, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5548
Epoch 248, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 248, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 249, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5614
Epoch 249, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 249, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5620
Epoch 249, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 249, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 250, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5630
Epoch 250, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 250, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 250, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5368
Epoch 250, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5448
Epoch 251, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 251, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 251, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5604
Epoch 251, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5458
Epoch 251, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 252, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5610
Epoch 252, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 252, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 252, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5490
Epoch 252, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 253, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 253, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5604
Epoch 253, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5610
Epoch 253, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5496
Epoch 253, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 254, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 254, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5488
Epoch 254, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5458
Epoch 254, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 254, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5450
Epoch 255, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 255, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 255, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 255, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 255, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 256, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 256, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 256, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 256, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 256, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 257, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 257, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 257, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5556
Epoch 257, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 257, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5428
Epoch 258, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 258, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 258, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5564
Epoch 258, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 258, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 259, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 259, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 259, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5576
Epoch 259, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5460
Epoch 259, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 260, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5610
Epoch 260, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5396
Epoch 260, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 260, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 260, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5424
Epoch 261, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 261, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 261, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 261, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5504
Epoch 261, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 262, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 262, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 262, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 262, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 262, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5492
Epoch 263, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5508
Epoch 263, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 263, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5512
Epoch 263, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 263, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5536
Epoch 264, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5600
Epoch 264, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 264, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 264, CIFAR-10 Batch 4:  Loss:   283.9031 | Validation Accuracy: 0.5538
Epoch 264, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5496
Epoch 265, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 265, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 265, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5514
Epoch 265, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 265, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5430
Epoch 266, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 266, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 266, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5484
Epoch 266, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 266, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 267, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 267, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5590
Epoch 267, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 267, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 267, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5520
Epoch 268, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 268, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 268, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5666
Epoch 268, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 268, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5582
Epoch 269, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 269, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5630
Epoch 269, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5580
Epoch 269, CIFAR-10 Batch 4:  Loss:   272.6441 | Validation Accuracy: 0.5472
Epoch 269, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5468
Epoch 270, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 270, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5628
Epoch 270, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5552
Epoch 270, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5496
Epoch 270, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 271, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 271, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5570
Epoch 271, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 271, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5538
Epoch 271, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 272, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 272, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5628
Epoch 272, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5508
Epoch 272, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5530
Epoch 272, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5436
Epoch 273, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5632
Epoch 273, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5554
Epoch 273, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 273, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 273, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 274, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 274, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 274, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 274, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 274, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 275, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5598
Epoch 275, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 275, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 275, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 275, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 276, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 276, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 276, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5442
Epoch 276, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5614
Epoch 276, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 277, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5544
Epoch 277, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 277, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5584
Epoch 277, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5392
Epoch 277, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5618
Epoch 278, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5576
Epoch 278, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 278, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 278, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 278, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5522
Epoch 279, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 279, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 279, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5566
Epoch 279, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 279, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5482
Epoch 280, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 280, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 280, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 280, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5598
Epoch 280, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5478
Epoch 281, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5502
Epoch 281, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 281, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5564
Epoch 281, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5594
Epoch 281, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 282, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 282, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 282, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 282, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5504
Epoch 282, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 283, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5618
Epoch 283, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 283, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5584
Epoch 283, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 283, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 284, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 284, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 284, CIFAR-10 Batch 3:  Loss:    84.2195 | Validation Accuracy: 0.5536
Epoch 284, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 284, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 285, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 285, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 285, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 285, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 285, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 286, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 286, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5722
Epoch 286, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 286, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 286, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5618
Epoch 287, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 287, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 287, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5564
Epoch 287, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 287, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5620
Epoch 288, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 288, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5630
Epoch 288, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 288, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 288, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 289, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 289, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 289, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 289, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5470
Epoch 289, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5576
Epoch 290, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 290, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 290, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 290, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5528
Epoch 290, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5556
Epoch 291, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 291, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 291, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 291, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5540
Epoch 291, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5566
Epoch 292, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 292, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 292, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 292, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 292, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5452
Epoch 293, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5596
Epoch 293, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 293, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 293, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5486
Epoch 293, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5482
Epoch 294, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5620
Epoch 294, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 294, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5572
Epoch 294, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 294, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 295, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5600
Epoch 295, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 295, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 295, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 295, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5518
Epoch 296, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 296, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 296, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5652
Epoch 296, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 296, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 297, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5630
Epoch 297, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 297, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 297, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5604
Epoch 297, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5418
Epoch 298, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5718
Epoch 298, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 298, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 298, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 298, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 299, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 299, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 299, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 299, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 299, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5546
Epoch 300, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 300, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5586
Epoch 300, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5576
Epoch 300, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5594
Epoch 300, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 301, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 301, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5668
Epoch 301, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5566
Epoch 301, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 301, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5426
Epoch 302, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5618
Epoch 302, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 302, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 302, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5582
Epoch 302, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5574
Epoch 303, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 303, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 303, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 303, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5560
Epoch 303, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5566
Epoch 304, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 304, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 304, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 304, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 304, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5560
Epoch 305, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 305, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 305, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 305, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5618
Epoch 305, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5500
Epoch 306, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 306, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 306, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 306, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 306, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 307, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 307, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 307, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 307, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 307, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 308, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 308, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 308, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 308, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 308, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5446
Epoch 309, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 309, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 309, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 309, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 309, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 310, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 310, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 310, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 310, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 310, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 311, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 311, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 311, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 311, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 311, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5526
Epoch 312, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 312, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 312, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 312, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 312, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 313, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 313, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 313, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 313, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5668
Epoch 313, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 314, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 314, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 314, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 314, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5584
Epoch 314, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 315, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5722
Epoch 315, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 315, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 315, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 315, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 316, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 316, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 316, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 316, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5626
Epoch 316, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 317, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 317, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 317, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 317, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 317, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 318, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 318, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 318, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 318, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5596
Epoch 318, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 319, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5598
Epoch 319, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5568
Epoch 319, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 319, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 319, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 320, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 320, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 320, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 320, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 320, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5610
Epoch 321, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 321, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 321, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 321, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 321, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 322, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 322, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 322, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 322, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 322, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 323, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 323, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 323, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 323, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 323, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 324, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5534
Epoch 324, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 324, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 324, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 324, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5666
Epoch 325, CIFAR-10 Batch 1:  Loss:   261.1820 | Validation Accuracy: 0.5748
Epoch 325, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 325, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 325, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 325, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 326, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 326, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 326, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 326, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5498
Epoch 326, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5590
Epoch 327, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 327, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 327, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 327, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 327, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5630
Epoch 328, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 328, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 328, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5592
Epoch 328, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 328, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 329, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 329, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 329, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 329, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 329, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 330, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 330, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 330, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 330, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 330, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 331, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 331, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 331, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 331, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 331, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 332, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 332, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 332, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 332, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5616
Epoch 332, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5722
Epoch 333, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 333, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 333, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 333, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 333, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 334, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 334, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 334, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 334, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 334, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 335, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 335, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 335, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 335, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 335, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5676
Epoch 336, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 336, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 336, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 336, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5768
Epoch 336, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5582
Epoch 337, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 337, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 337, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 337, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 337, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5620
Epoch 338, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5628
Epoch 338, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 338, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 338, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 338, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 339, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 339, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 339, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 339, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 339, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 340, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 340, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 340, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 340, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 340, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5668
Epoch 341, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 341, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 341, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 341, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 341, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 342, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 342, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 342, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 342, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 342, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 343, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 343, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 343, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5632
Epoch 343, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 343, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 344, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 344, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5652
Epoch 344, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 344, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 344, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 345, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 345, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 345, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 345, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 345, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 346, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 346, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5652
Epoch 346, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 346, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5604
Epoch 346, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 347, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 347, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 347, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 347, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 347, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 348, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5578
Epoch 348, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 348, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 348, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 348, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 349, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5646
Epoch 349, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5614
Epoch 349, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5606
Epoch 349, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 349, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 350, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 350, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 350, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 350, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 350, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 351, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 351, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 351, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 351, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 351, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 352, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 352, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 352, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5744
Epoch 352, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 352, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 353, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 353, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 353, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 353, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 353, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 354, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 354, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 354, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 354, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5668
Epoch 354, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5494
Epoch 355, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 355, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 355, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 355, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 355, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 356, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 356, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 356, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 356, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 356, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 357, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 357, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 357, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 357, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 357, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 358, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 358, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 358, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 358, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 358, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 359, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 359, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 359, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 359, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 359, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 360, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 360, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 360, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 360, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 360, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 361, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 361, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 361, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 361, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 361, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 362, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 362, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 362, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 362, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 362, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 363, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 363, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5688
Epoch 363, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 363, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 363, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 364, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 364, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 364, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 364, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 364, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 365, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5588
Epoch 365, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 365, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 365, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 365, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 366, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 366, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5768
Epoch 366, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 366, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 366, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 367, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5688
Epoch 367, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 367, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 367, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 367, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 368, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 368, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5506
Epoch 368, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 368, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 368, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 369, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 369, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 369, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 369, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5744
Epoch 369, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 370, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 370, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 370, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 370, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 370, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 371, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 371, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 371, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 371, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 371, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 372, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5636
Epoch 372, CIFAR-10 Batch 2:  Loss:   465.2211 | Validation Accuracy: 0.5708
Epoch 372, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 372, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 372, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 373, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 373, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 373, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 373, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 373, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 374, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 374, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5668
Epoch 374, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 374, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 374, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 375, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 375, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 375, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 375, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 375, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 376, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 376, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 376, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 376, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 376, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5638
Epoch 377, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 377, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 377, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 377, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 377, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 378, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 378, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 378, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 378, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 378, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 379, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 379, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5612
Epoch 379, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5560
Epoch 379, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5634
Epoch 379, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5640
Epoch 380, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 380, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5648
Epoch 380, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 380, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 380, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 381, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 381, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 381, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 381, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 381, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 382, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 382, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 382, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 382, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 382, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 383, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5718
Epoch 383, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 383, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 383, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 383, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 384, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 384, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 384, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 384, CIFAR-10 Batch 4:  Loss:   196.7754 | Validation Accuracy: 0.5706
Epoch 384, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 385, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 385, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 385, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 385, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 385, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 386, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 386, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 386, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5672
Epoch 386, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5666
Epoch 386, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 387, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 387, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 387, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 387, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 387, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5654
Epoch 388, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 388, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 388, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 388, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 388, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 389, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 389, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5718
Epoch 389, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5650
Epoch 389, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 389, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 390, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 390, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5622
Epoch 390, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 390, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 390, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 391, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 391, CIFAR-10 Batch 2:  Loss:   151.3515 | Validation Accuracy: 0.5724
Epoch 391, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 391, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 391, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 392, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 392, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 392, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 392, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 392, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 393, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 393, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 393, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 393, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 393, CIFAR-10 Batch 5:  Loss:    15.3077 | Validation Accuracy: 0.5726
Epoch 394, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 394, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 394, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 394, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 394, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 395, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 395, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 395, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 395, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 395, CIFAR-10 Batch 5:  Loss:   214.6339 | Validation Accuracy: 0.5572
Epoch 396, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 396, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 396, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 396, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5550
Epoch 396, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 397, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 397, CIFAR-10 Batch 2:  Loss:   557.1469 | Validation Accuracy: 0.5706
Epoch 397, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 397, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 397, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 398, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 398, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 398, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 398, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 398, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 399, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5930
Epoch 399, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 399, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 399, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 399, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 400, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 400, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 400, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 400, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 400, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 401, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 401, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 401, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 401, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 401, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 402, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 402, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 402, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 402, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 402, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5642
Epoch 403, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 403, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 403, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5624
Epoch 403, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 403, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 404, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 404, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 404, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5632
Epoch 404, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 404, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 405, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 405, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 405, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 405, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 405, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 406, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 406, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 406, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 406, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 406, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 407, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 407, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 407, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 407, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 407, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 408, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 408, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 408, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 408, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 408, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 409, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 409, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 409, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 409, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 409, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 410, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 410, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 410, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 410, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 410, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 411, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 411, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 411, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 411, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 411, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 412, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 412, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 412, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 412, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 412, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 413, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 413, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 413, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 413, CIFAR-10 Batch 4:  Loss:   298.5016 | Validation Accuracy: 0.5772
Epoch 413, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 414, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 414, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 414, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 414, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 414, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 415, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 415, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 415, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 415, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 415, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 416, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 416, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5936
Epoch 416, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 416, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 416, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 417, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 417, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 417, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 417, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5896
Epoch 417, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 418, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 418, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 418, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 418, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 418, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 419, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 419, CIFAR-10 Batch 2:  Loss:   133.0121 | Validation Accuracy: 0.5750
Epoch 419, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 419, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 419, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 420, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 420, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 420, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 420, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 420, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 421, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5656
Epoch 421, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 421, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 421, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 421, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 422, CIFAR-10 Batch 1:  Loss:    38.1316 | Validation Accuracy: 0.5836
Epoch 422, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5680
Epoch 422, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5632
Epoch 422, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 422, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 423, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 423, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5704
Epoch 423, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 423, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5694
Epoch 423, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 424, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5698
Epoch 424, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 424, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 424, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 424, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 425, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5744
Epoch 425, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 425, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 425, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 425, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 426, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 426, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 426, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 426, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 426, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 427, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 427, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 427, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5892
Epoch 427, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 427, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 428, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 428, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 428, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 428, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 428, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 429, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 429, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 429, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 429, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 429, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5582
Epoch 430, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 430, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 430, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 430, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 430, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5718
Epoch 431, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 431, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 431, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 431, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 431, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 432, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 432, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 432, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 432, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 432, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 433, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 433, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 433, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 433, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 433, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 434, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 434, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 434, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 434, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 434, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 435, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 435, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 435, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 435, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 435, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5692
Epoch 436, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 436, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 436, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5562
Epoch 436, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5744
Epoch 436, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5684
Epoch 437, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5718
Epoch 437, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 437, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 437, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 437, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5706
Epoch 438, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5532
Epoch 438, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 438, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 438, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 438, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 439, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 439, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 439, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 439, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 439, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 440, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 440, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 440, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 440, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 440, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 441, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5608
Epoch 441, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 441, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5658
Epoch 441, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 441, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 442, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 442, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 442, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 442, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5738
Epoch 442, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 443, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 443, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 443, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 443, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 443, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 444, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 444, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 444, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 444, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 444, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 445, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 445, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 445, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 445, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 445, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 446, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 446, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 446, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5662
Epoch 446, CIFAR-10 Batch 4:  Loss:    18.0859 | Validation Accuracy: 0.5752
Epoch 446, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 447, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 447, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 447, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5702
Epoch 447, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 447, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5674
Epoch 448, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 448, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 448, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 448, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 448, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 449, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 449, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 449, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 449, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 449, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 450, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 450, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 450, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 450, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 450, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 451, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5678
Epoch 451, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 451, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 451, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 451, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 452, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 452, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 452, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 452, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 452, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 453, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 453, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 453, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5768
Epoch 453, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 453, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 454, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 454, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 454, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 454, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 454, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 455, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 455, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 455, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 455, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 455, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 456, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 456, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 456, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5768
Epoch 456, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 456, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 457, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 457, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 457, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 457, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 457, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 458, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 458, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 458, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 458, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 458, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5720
Epoch 459, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 459, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 459, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 459, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 459, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 460, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 460, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 460, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 460, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 460, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 461, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 461, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 461, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 461, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 461, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 462, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 462, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 462, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 462, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5914
Epoch 462, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 463, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 463, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 463, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 463, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 463, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 464, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 464, CIFAR-10 Batch 2:  Loss:  1324.2480 | Validation Accuracy: 0.5752
Epoch 464, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 464, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 464, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 465, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 465, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 465, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 465, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 465, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 466, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 466, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 466, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 466, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 466, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 467, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 467, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 467, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 467, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 467, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 468, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 468, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 468, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 468, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 468, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 469, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 469, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 469, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 469, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 469, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 470, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 470, CIFAR-10 Batch 2:  Loss:   108.4684 | Validation Accuracy: 0.5772
Epoch 470, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 470, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 470, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 471, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 471, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 471, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 471, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 471, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5906
Epoch 472, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 472, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 472, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5686
Epoch 472, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 472, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 473, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 473, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 473, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 473, CIFAR-10 Batch 4:  Loss:   993.8922 | Validation Accuracy: 0.5770
Epoch 473, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 474, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 474, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5714
Epoch 474, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 474, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 474, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 475, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 475, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 475, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 475, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 475, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 476, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 476, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 476, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 476, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 476, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5732
Epoch 477, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 477, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 477, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 477, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 477, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 478, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 478, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 478, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5644
Epoch 478, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 478, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 479, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 479, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 479, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 479, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 479, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 480, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 480, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 480, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 480, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 480, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 481, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 481, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 481, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 481, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 481, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 482, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 482, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 482, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 482, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 482, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 483, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 483, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 483, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 483, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 483, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 484, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 484, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5892
Epoch 484, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 484, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 484, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 485, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5780
Epoch 485, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 485, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 485, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 485, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 486, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 486, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 486, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5762
Epoch 486, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 486, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 487, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 487, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 487, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5602
Epoch 487, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 487, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 488, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 488, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5600
Epoch 488, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 488, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 488, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 489, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 489, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 489, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 489, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 489, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 490, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 490, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 490, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 490, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 490, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 491, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 491, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 491, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 491, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 491, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 492, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 492, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 492, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 492, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 492, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5716
Epoch 493, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 493, CIFAR-10 Batch 2:  Loss:   157.3156 | Validation Accuracy: 0.5854
Epoch 493, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 493, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 493, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 494, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 494, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 494, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 494, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 494, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 495, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 495, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 495, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 495, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 495, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 496, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 496, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 496, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 496, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5910
Epoch 496, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 497, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5896
Epoch 497, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 497, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 497, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 497, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 498, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 498, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 498, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 498, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 498, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 499, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 499, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 499, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 499, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 499, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 500, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 500, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 500, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 500, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 500, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5670
Epoch 501, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 501, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 501, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 501, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5708
Epoch 501, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 502, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5884
Epoch 502, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 502, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 502, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 502, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 503, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 503, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 503, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 503, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 503, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 504, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5898
Epoch 504, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5900
Epoch 504, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 504, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 504, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 505, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 505, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 505, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 505, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 505, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 506, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 506, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 506, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 506, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 506, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5898
Epoch 507, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 507, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 507, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 507, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 507, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 508, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 508, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 508, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 508, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 508, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5690
Epoch 509, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 509, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 509, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5584
Epoch 509, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 509, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 510, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 510, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 510, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 510, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 510, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5896
Epoch 511, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 511, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 511, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5744
Epoch 511, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 511, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 512, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 512, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5760
Epoch 512, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 512, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 512, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 513, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 513, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 513, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 513, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 513, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5886
Epoch 514, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5834
Epoch 514, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 514, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 514, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5764
Epoch 514, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 515, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 515, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 515, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 515, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 515, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 516, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 516, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 516, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5742
Epoch 516, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 516, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 517, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 517, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 517, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 517, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 517, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 518, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5924
Epoch 518, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 518, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 518, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 518, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 519, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5910
Epoch 519, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 519, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 519, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5734
Epoch 519, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 520, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 520, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 520, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 520, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 520, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 521, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 521, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 521, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5726
Epoch 521, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 521, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 522, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 522, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 522, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 522, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 522, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 523, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 523, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 523, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5724
Epoch 523, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 523, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5950
Epoch 524, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 524, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 524, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 524, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 524, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 525, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 525, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 525, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5696
Epoch 525, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5752
Epoch 525, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 526, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5770
Epoch 526, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 526, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 526, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5918
Epoch 526, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 527, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5900
Epoch 527, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 527, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 527, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 527, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 528, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 528, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 528, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 528, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5934
Epoch 528, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 529, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 529, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 529, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 529, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 529, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 530, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 530, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 530, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 530, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 530, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 531, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5740
Epoch 531, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 531, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 531, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 531, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 532, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 532, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 532, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 532, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5666
Epoch 532, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5866
Epoch 533, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 533, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 533, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 533, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 533, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 534, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 534, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 534, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 534, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 534, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 535, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 535, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 535, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 535, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 535, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 536, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 536, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 536, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 536, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 536, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 537, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 537, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 537, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 537, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 537, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 538, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 538, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 538, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 538, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 538, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 539, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5884
Epoch 539, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 539, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5860
Epoch 539, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 539, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 540, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5922
Epoch 540, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 540, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 540, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 540, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 541, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 541, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 541, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5728
Epoch 541, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5892
Epoch 541, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5806
Epoch 542, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 542, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5886
Epoch 542, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 542, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5896
Epoch 542, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 543, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 543, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 543, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 543, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5960
Epoch 543, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 544, CIFAR-10 Batch 1:  Loss:    32.1133 | Validation Accuracy: 0.5876
Epoch 544, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 544, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5664
Epoch 544, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 544, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 545, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 545, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5948
Epoch 545, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 545, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 545, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5912
Epoch 546, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5918
Epoch 546, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5956
Epoch 546, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5936
Epoch 546, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 546, CIFAR-10 Batch 5:  Loss:   510.1130 | Validation Accuracy: 0.5630
Epoch 547, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 547, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 547, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5808
Epoch 547, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 547, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 548, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 548, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 548, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 548, CIFAR-10 Batch 4:  Loss:    21.5482 | Validation Accuracy: 0.5870
Epoch 548, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 549, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 549, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 549, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 549, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5942
Epoch 549, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 550, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5948
Epoch 550, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5908
Epoch 550, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 550, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 550, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5932
Epoch 551, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5932
Epoch 551, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 551, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 551, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 551, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 552, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 552, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 552, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 552, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 552, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 553, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5928
Epoch 553, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5932
Epoch 553, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 553, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 553, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 554, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5934
Epoch 554, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5946
Epoch 554, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.6006
Epoch 554, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5924
Epoch 554, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 555, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 555, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 555, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5898
Epoch 555, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5966
Epoch 555, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 556, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5756
Epoch 556, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 556, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 556, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 556, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5712
Epoch 557, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 557, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 557, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 557, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 557, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5956
Epoch 558, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5960
Epoch 558, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 558, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 558, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 558, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 559, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5962
Epoch 559, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 559, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 559, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5900
Epoch 559, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 560, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5754
Epoch 560, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 560, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 560, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5710
Epoch 560, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5932
Epoch 561, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 561, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5900
Epoch 561, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5884
Epoch 561, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5802
Epoch 561, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5700
Epoch 562, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5866
Epoch 562, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 562, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 562, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 562, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 563, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 563, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5880
Epoch 563, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 563, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 563, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5896
Epoch 564, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 564, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 564, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5910
Epoch 564, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 564, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5944
Epoch 565, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 565, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5918
Epoch 565, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 565, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 565, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5938
Epoch 566, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5940
Epoch 566, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 566, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 566, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5898
Epoch 566, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5892
Epoch 567, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 567, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5942
Epoch 567, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5916
Epoch 567, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 567, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5928
Epoch 568, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5812
Epoch 568, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5956
Epoch 568, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 568, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 568, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 569, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5772
Epoch 569, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 569, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 569, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 569, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 570, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 570, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 570, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5842
Epoch 570, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 570, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 571, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 571, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 571, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5820
Epoch 571, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5924
Epoch 571, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 572, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5746
Epoch 572, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5814
Epoch 572, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 572, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 572, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 573, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 573, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 573, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5854
Epoch 573, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 573, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5786
Epoch 574, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5934
Epoch 574, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5906
Epoch 574, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5916
Epoch 574, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.6000
Epoch 574, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 575, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 575, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 575, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5918
Epoch 575, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.6016
Epoch 575, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5866
Epoch 576, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 576, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5966
Epoch 576, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 576, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 576, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 577, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5938
Epoch 577, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5932
Epoch 577, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 577, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5810
Epoch 577, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5824
Epoch 578, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 578, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.6000
Epoch 578, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 578, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5924
Epoch 578, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5950
Epoch 579, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5888
Epoch 579, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5942
Epoch 579, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 579, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5838
Epoch 579, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 580, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5840
Epoch 580, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 580, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 580, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 580, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 581, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5906
Epoch 581, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 581, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5784
Epoch 581, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5736
Epoch 581, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 582, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5758
Epoch 582, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 582, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5682
Epoch 582, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 582, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5906
Epoch 583, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5964
Epoch 583, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5926
Epoch 583, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 583, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 583, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5858
Epoch 584, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5952
Epoch 584, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5918
Epoch 584, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5924
Epoch 584, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 584, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5886
Epoch 585, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5910
Epoch 585, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5952
Epoch 585, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 585, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5782
Epoch 585, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5796
Epoch 586, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5798
Epoch 586, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5950
Epoch 586, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 586, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5836
Epoch 586, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5816
Epoch 587, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 587, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5660
Epoch 587, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5766
Epoch 587, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5852
Epoch 587, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 588, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5890
Epoch 588, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5774
Epoch 588, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5794
Epoch 588, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5818
Epoch 588, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 589, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5964
Epoch 589, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 589, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5898
Epoch 589, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 589, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5788
Epoch 590, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5886
Epoch 590, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5776
Epoch 590, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5748
Epoch 590, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 590, CIFAR-10 Batch 5:  Loss:   438.3211 | Validation Accuracy: 0.5908
Epoch 591, CIFAR-10 Batch 1:  Loss:   210.7636 | Validation Accuracy: 0.5902
Epoch 591, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5778
Epoch 591, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5892
Epoch 591, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 591, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5828
Epoch 592, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 592, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5908
Epoch 592, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5750
Epoch 592, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5930
Epoch 592, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5804
Epoch 593, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 593, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5884
Epoch 593, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5874
Epoch 593, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5848
Epoch 593, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5930
Epoch 594, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5902
Epoch 594, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5908
Epoch 594, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5882
Epoch 594, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5850
Epoch 594, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5922
Epoch 595, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5894
Epoch 595, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5868
Epoch 595, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5822
Epoch 595, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5904
Epoch 595, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 596, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5876
Epoch 596, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 596, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 596, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5832
Epoch 596, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 597, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5920
Epoch 597, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 597, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5914
Epoch 597, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5846
Epoch 597, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5730
Epoch 598, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5792
Epoch 598, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5872
Epoch 598, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5878
Epoch 598, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5864
Epoch 598, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5862
Epoch 599, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5844
Epoch 599, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5856
Epoch 599, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5830
Epoch 599, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5910
Epoch 599, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5866
Epoch 600, CIFAR-10 Batch 1:  Loss:     0.0000 | Validation Accuracy: 0.5870
Epoch 600, CIFAR-10 Batch 2:  Loss:     0.0000 | Validation Accuracy: 0.5826
Epoch 600, CIFAR-10 Batch 3:  Loss:     0.0000 | Validation Accuracy: 0.5800
Epoch 600, CIFAR-10 Batch 4:  Loss:     0.0000 | Validation Accuracy: 0.5790
Epoch 600, CIFAR-10 Batch 5:  Loss:     0.0000 | Validation Accuracy: 0.5760

Checkpoint

The model has been saved to disk.

Test Model

Test your model against the test dataset. This will be your final accuracy. You should have an accuracy greater than 50%. If you don't, keep tweaking the model architecture and parameters.

In [33]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
%matplotlib inline
%config InlineBackend.figure_format = 'retina'

import tensorflow as tf
import pickle
import helper
import random

# Set batch size if not already set
try:
    if batch_size:
        pass
except NameError:
    batch_size = 64

save_model_path = './image_classification'
n_samples = 4
top_n_predictions = 3

def test_model():
    """
    Test the saved model against the test dataset
    """

    test_features, test_labels = pickle.load(open('preprocess_training.p', mode='rb'))
    loaded_graph = tf.Graph()

    with tf.Session(graph=loaded_graph) as sess:
        # Load model
        loader = tf.train.import_meta_graph(save_model_path + '.meta')
        loader.restore(sess, save_model_path)

        # Get Tensors from loaded model
        loaded_x = loaded_graph.get_tensor_by_name('x:0')
        loaded_y = loaded_graph.get_tensor_by_name('y:0')
        loaded_keep_prob = loaded_graph.get_tensor_by_name('keep_prob:0')
        loaded_logits = loaded_graph.get_tensor_by_name('logits:0')
        loaded_acc = loaded_graph.get_tensor_by_name('accuracy:0')
        
        # Get accuracy in batches for memory limitations
        test_batch_acc_total = 0
        test_batch_count = 0
        
        for train_feature_batch, train_label_batch in helper.batch_features_labels(test_features, test_labels, batch_size):
            test_batch_acc_total += sess.run(
                loaded_acc,
                feed_dict={loaded_x: train_feature_batch, loaded_y: train_label_batch, loaded_keep_prob: 1.0})
            test_batch_count += 1

        print('Testing Accuracy: {}\n'.format(test_batch_acc_total/test_batch_count))

        # Print Random Samples
        random_test_features, random_test_labels = tuple(zip(*random.sample(list(zip(test_features, test_labels)), n_samples)))
        random_test_predictions = sess.run(
            tf.nn.top_k(tf.nn.softmax(loaded_logits), top_n_predictions),
            feed_dict={loaded_x: random_test_features, loaded_y: random_test_labels, loaded_keep_prob: 1.0})
        helper.display_image_predictions(random_test_features, random_test_labels, random_test_predictions)


test_model()
Testing Accuracy: 0.5728515625

Why 50-70% Accuracy?

You might be wondering why you can't get an accuracy any higher. First things first, 50% isn't bad for a simple CNN. Pure guessing would get you 10% accuracy. However, you might notice people are getting scores well above 70%. That's because we haven't taught you all there is to know about neural networks. We still need to cover a few more techniques.

Submitting This Project

When submitting this project, make sure to run all the cells before saving the notebook. Save the notebook file as "dlnd_image_classification.ipynb" and save it as a HTML file under "File" -> "Download as". Include the "helper.py" and "problem_unittests.py" files in your submission.