machine-learning


What is happen when the number of file smaller than batch in HDF5


I have a hdf5 layer that read the information from the list.txt as
layer {
name: "data"
type: "HDF5Data"
top: "data"
top: "label"
include {
phase: TEST
}
hdf5_data_param {
source: "./list.txt"
batch_size: 4
shuffle: true
}
}
where list.txt contains two path files
/home/user/file1.h5
/home/user/file2.h5
while the batch size is 4. What is happen with above code? Can the data choose 4 files to feed the network?
You have two hdf5 files, but each file may contain more than a single training example. Thus, effectively, you may have far more than batch_size: 4 examples.
Caffe does not really cares about the actual number of training examples: when it finishes to process all the examples (aka "epoch") it simply starts over reading the samples again. Caffe cycles through all the samples until number of training/testing iteration is reached.

Related Links

Do you have any suggestions for a Machine Learning method that may actually learn to distinguish these two classes?
Classification with discrete label in Tensorflow
What does MSE value indicate for the accuracy and performance of prediction models?
Fuzzy logic vs AI vs Machine learning vs Deep learning
How can we classify when the covariance matrix instead of the mean vector that determines the classification result?
Document similarity: Vector embedding versus Tf-Idf performance?
Is there a valid reason why nn.CDivTable throws error when backward is called?
Genetic algorithm - shortest path in weighted graph
Different rewards for same state in reinforcement learning
What gives the logits this unexpected shape?
Gradient descent on linear regression not converging
When should I stop training my model?
Anova analysis for binary classification
Training a convolutional neural network by layer-wise
Caffe - How to imbalance Cifar10 data
Why not train for partial epochs?

Categories

HOME
multidimensional-array
graphite
authorization
userform
speech-recognition
binary
visual-studio-mac
etcd
q-learning
google-cloud-endpoints
apache-spark-2.0
spring-transactions
sorm
astyle
mupdf
video-processing
angularjs-ng-route
codecvt
redactor
jquery-gmap3
google-app-invites
twitter-streaming-api
greedy
gnome
bug-tracking
powerpoint-vba
ebcdic
white
protobuf-c
kafka-python
nexmo
tensorflow-serving
artoolkit
tablet
nsdate
psftp
thinktecture-ident-model
initializing
transitions
ngrx-effects
oracle-data-modeler
smtpclient
devexpress-wpf
marytts
fixture
spring-cloud-sleuth
keyword-search
sw-precache
simplemodal
slam
safe-browsing
case-sensitive
ucos
jquery-events
vorlon
suppress-warnings
ilmerge
kmip
blackberry-simulator
rgraph
ng-template
android-6.0.1
spsite
lg
velocity.js
opcode
jedit
avm2
elmah.mvc
tstringgrid
qubole
xmlpullparser
amdatu
dynamic-ip
order-of-operations
rgs
kiosk-mode
nxt-python
fast-esp
android-handlerthread
n-tier
linq-to-lucene
kendo-validator
divshot
agi
remotipart
xadisk
strtotime
scopes
visualtreehelper
continuations
iasyncresult
viewexpiredexception
wss-3.0
windows-2000
pvcs

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App