machine-learning


What is happen when the number of file smaller than batch in HDF5


I have a hdf5 layer that read the information from the list.txt as
layer {
name: "data"
type: "HDF5Data"
top: "data"
top: "label"
include {
phase: TEST
}
hdf5_data_param {
source: "./list.txt"
batch_size: 4
shuffle: true
}
}
where list.txt contains two path files
/home/user/file1.h5
/home/user/file2.h5
while the batch size is 4. What is happen with above code? Can the data choose 4 files to feed the network?
You have two hdf5 files, but each file may contain more than a single training example. Thus, effectively, you may have far more than batch_size: 4 examples.
Caffe does not really cares about the actual number of training examples: when it finishes to process all the examples (aka "epoch") it simply starts over reading the samples again. Caffe cycles through all the samples until number of training/testing iteration is reached.

Related Links

Text classification vs. Sentence classification [duplicate]
Regarding “number of parameters” in Neural network [closed]
Wrong classification to multiple classes with different fraction of classes
Regression or Classification? How to determine sample size?
What is the meaning of this NLP notation?
What is the difference between hyperplane and plane ? and why is hyperplane represented using eqn w^T+b=0 ?
Why does multiclass Logistic Regression give different results than choosing the most probable label in a OvR classifier?
What are problems of many hidden layers?
naive bayes classifier on continuous data (real valued data)
Why, in binary classification, would we map only from the input to the feature space?
Anomaly Detection vs Supervised Learning
SVMlight train data formatting
In NLP/probability/ML notation: what does a tilde over a letter mean?
LIBSVM overfitting
problems using GLM
Transductive SVM with Scikit-Learn

Categories

HOME
angular
processing
sails.js
powershell-v4.0
veins
fiware
entities
bloomberg
cakephp-3.0
speech-recognition
wlan
autofixture
pygtk
memcached
spring-transactions
crc32
css-modules
bpm
corba
sql-azure
libreoffice-base
drupal-modules
markup
gun
apprtcdemo
qtspim
apache-felix
xfce
apache-samza
miktex
bug-tracking
filepicker.io
avaya
u2
ipc
python-tesseract
rcp
sharethis
opensaml
cassandra-3.0
toml
fpu
3d-modelling
xilinx-edk
spring-cloud-sleuth
ektron
oclazyload
mapped-drive
multibox
autocorrect
zlib
http-status-code-415
enterprise-library-6
family-tree
wamp-protocol
invoke
generated
dependency-properties
google-url-shortener
powerview
munin
date-formatting
google-chrome-arc
canonical-link
motorola
knox-gateway
syncsort-dmx-h
mds
orchardcms-1.9
phpinfo
mime-mail
anonymity
pragma
ng-template
mongoose-web-server
execution-time
tablecellrenderer
max-heap
fody-propertychanged
apache-commons
beta-testing
xlet
unique-constraint
fswatch
certificatestore
reagent
eazfuscator
ncbi
cleartool
jquery-dynatree
file-attributes
componentone
navigationbar
networkcredentials
jform-designer
apparmor
bonjour
sandbox-solution
chaplinjs
countries
icommand
tandem
dynamic-language-runtime
customer-support
struts-config
glossary
google-ad-manager
dynamic-content
fibonacci-heap
juggernaut
iasyncresult
css-parsing
nsenumerator
comdlg32
laconica

Resources

Mobile Apps Dev
Database Users
javascript
java
csharp
php
android
MS Developer
developer works
python
ios
c
html
jquery
RDBMS discuss
Cloud Virtualization
Database Dev&Adm
javascript
java
csharp
php
python
android
jquery
ruby
ios
html
Mobile App
Mobile App
Mobile App