CKernel Class Reference


Detailed Description

The Kernel base class.

Non-mathematically spoken, a kernel is a function that given two input objects ${\bf x}$ and ${\bf x'}$ returns a score describing the similarity of the vectors. The score should be larger when the objects are more similar.

It can be defined as

\[ k({\bf x},{\bf x'})= \Phi_k({\bf x})\cdot \Phi_k({\bf x'}) \]

where $\Phi$ maps the objects into some potentially high dimensional feature space.

Apart from the input features, the base kernel takes only one argument (the size of the kernel cache) that is used to efficiently train kernel-machines like e.g. SVMs.

In case you would like to define your own kernel, you only have to define a new compute() function (and the kernel name via get_name() and the kernel type get_kernel_type()). A good example to look at is the GaussianKernel.

Definition at line 141 of file Kernel.h.

Inheritance diagram for CKernel:
Inheritance graph
[legend]

List of all members.

Public Member Functions

 CKernel ()
 CKernel (int32_t size)
 CKernel (CFeatures *l, CFeatures *r, int32_t size)
virtual ~CKernel ()
float64_t kernel (int32_t idx_a, int32_t idx_b)
void get_kernel_matrix (float64_t **dst, int32_t *m, int32_t *n)
template<class T >
T * get_kernel_matrix (int32_t &m, int32_t &n, T *target)
virtual bool init (CFeatures *lhs, CFeatures *rhs)
virtual bool set_normalizer (CKernelNormalizer *normalizer)
virtual CKernelNormalizerget_normalizer ()
virtual bool init_normalizer ()
virtual void cleanup ()
bool load (char *fname)
bool save (char *fname)
CFeaturesget_lhs ()
CFeaturesget_rhs ()
virtual int32_t get_num_vec_lhs ()
virtual int32_t get_num_vec_rhs ()
virtual bool has_features ()
bool lhs_equals_rhs ()
virtual void remove_lhs_and_rhs ()
virtual void remove_lhs ()
virtual void remove_rhs ()
 takes all necessary steps if the rhs is removed from kernel
virtual EKernelType get_kernel_type ()=0
virtual EFeatureType get_feature_type ()=0
virtual EFeatureClass get_feature_class ()=0
void set_cache_size (int32_t size)
int32_t get_cache_size ()
void list_kernel ()
bool has_property (EKernelProperty p)
virtual void clear_normal ()
virtual void add_to_normal (int32_t vector_idx, float64_t weight)
EOptimizationType get_optimization_type ()
virtual void set_optimization_type (EOptimizationType t)
bool get_is_initialized ()
virtual bool init_optimization (int32_t count, int32_t *IDX, float64_t *weights)
virtual bool delete_optimization ()
bool init_optimization_svm (CSVM *svm)
virtual float64_t compute_optimized (int32_t vector_idx)
virtual void compute_batch (int32_t num_vec, int32_t *vec_idx, float64_t *target, int32_t num_suppvec, int32_t *IDX, float64_t *alphas, float64_t factor=1.0)
float64_t get_combined_kernel_weight ()
void set_combined_kernel_weight (float64_t nw)
virtual int32_t get_num_subkernels ()
virtual void compute_by_subkernel (int32_t vector_idx, float64_t *subkernel_contrib)
virtual const float64_tget_subkernel_weights (int32_t &num_weights)
virtual void set_subkernel_weights (float64_t *weights, int32_t num_weights)

Protected Member Functions

void set_property (EKernelProperty p)
void unset_property (EKernelProperty p)
void set_is_initialized (bool p_init)
virtual float64_t compute (int32_t x, int32_t y)=0
int32_t compute_row_start (int64_t offs, int32_t n, bool symmetric)

Static Protected Member Functions

template<class T >
static void * get_kernel_matrix_helper (void *p)

Protected Attributes

int32_t cache_size
 cache_size in MB
KERNELCACHE_ELEMkernel_matrix
CFeatureslhs
 feature vectors to occur on left hand side
CFeaturesrhs
 feature vectors to occur on right hand side
int32_t num_lhs
 number of feature vectors on left hand side
int32_t num_rhs
 number of feature vectors on right hand side
float64_t combined_kernel_weight
bool optimization_initialized
EOptimizationType opt_type
uint64_t properties
CKernelNormalizernormalizer

Friends

class CVarianceKernelNormalizer
class CSqrtDiagKernelNormalizer
class CAvgDiagKernelNormalizer
class CRidgeKernelNormalizer
class CFirstElementKernelNormalizer
class CTanimotoKernelNormalizer
class CDiceKernelNormalizer

Constructor & Destructor Documentation

CKernel (  ) 

default constructor

Definition at line 37 of file Kernel.cpp.

CKernel ( int32_t  size  ) 

constructor

Parameters:
size cache size

Definition at line 49 of file Kernel.cpp.

CKernel ( CFeatures l,
CFeatures r,
int32_t  size 
)

constructor

Parameters:
l features for left-hand side
r features for right-hand side
size cache size

Definition at line 67 of file Kernel.cpp.

~CKernel (  )  [virtual]

Definition at line 84 of file Kernel.cpp.


Member Function Documentation

void add_to_normal ( int32_t  vector_idx,
float64_t  weight 
) [virtual]
void cleanup (  )  [virtual]
void clear_normal (  )  [virtual]

for optimizable kernels, i.e. kernels where the weight vector can be computed explicitly (if it fits into memory)

Reimplemented in CCombinedKernel, CCommUlongStringKernel, CCommWordStringKernel, CLinearByteKernel, CLinearKernel, CLinearStringKernel, CLinearWordKernel, CSparseLinearKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 445 of file Kernel.cpp.

virtual float64_t compute ( int32_t  x,
int32_t  y 
) [protected, pure virtual]
void compute_batch ( int32_t  num_vec,
int32_t *  vec_idx,
float64_t target,
int32_t  num_suppvec,
int32_t *  IDX,
float64_t alphas,
float64_t  factor = 1.0 
) [virtual]

computes output for a batch of examples in an optimized fashion (favorable if kernel supports it, i.e. has KP_BATCHEVALUATION. to the outputvector target (of length num_vec elements) the output for the examples enumerated in vec_idx are added. therefore make sure that it is initialized with ZERO. the following num_suppvec, IDX, alphas arguments are the number of support vectors, their indices and weights

Reimplemented in CCombinedKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 433 of file Kernel.cpp.

void compute_by_subkernel ( int32_t  vector_idx,
float64_t subkernel_contrib 
) [virtual]

compute by subkernel

Parameters:
vector_idx index
subkernel_contrib subkernel contribution

Reimplemented in CCombinedKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 455 of file Kernel.cpp.

float64_t compute_optimized ( int32_t  vector_idx  )  [virtual]

compute optimized

Parameters:
vector_idx index to compute
Returns:
optimized value at given index

Reimplemented in CCombinedKernel, CCommUlongStringKernel, CCommWordStringKernel, CLinearByteKernel, CLinearKernel, CLinearStringKernel, CLinearWordKernel, CSparseLinearKernel, CWeightedCommWordStringKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 427 of file Kernel.cpp.

int32_t compute_row_start ( int64_t  offs,
int32_t  n,
bool  symmetric 
) [protected]

compute row start offset for parallel kernel matrix computation

Parameters:
offs offset
n number of columns
symmetric whether matrix is symmetric

Definition at line 621 of file Kernel.h.

bool delete_optimization (  )  [virtual]
int32_t get_cache_size (  ) 

return the size of the kernel cache

Returns:
size of kernel cache

Definition at line 449 of file Kernel.h.

float64_t get_combined_kernel_weight (  ) 

get combined kernel weight

Returns:
combined kernel weight

Definition at line 540 of file Kernel.h.

virtual EFeatureClass get_feature_class (  )  [pure virtual]
virtual EFeatureType get_feature_type (  )  [pure virtual]
bool get_is_initialized (  ) 

check if optimization is initialized

Returns:
if optimization is initialized

Definition at line 491 of file Kernel.h.

T* get_kernel_matrix ( int32_t &  m,
int32_t &  n,
T *  target 
)

get kernel matrix real

Parameters:
m dimension m of matrix
n dimension n of matrix
target the kernel matrix
Returns:
the kernel matrix

Definition at line 209 of file Kernel.h.

void get_kernel_matrix ( float64_t **  dst,
int32_t *  m,
int32_t *  n 
)

get kernel matrix

Parameters:
dst destination where matrix will be stored
m dimension m of matrix
n dimension n of matrix

Definition at line 95 of file Kernel.cpp.

static void* get_kernel_matrix_helper ( void *  p  )  [static, protected]

helper for computing the kernel matrix in a parallel way

Parameters:
p thread parameters

Definition at line 639 of file Kernel.h.

virtual EKernelType get_kernel_type (  )  [pure virtual]
CFeatures* get_lhs (  ) 

get left-hand side of features used in kernel

Returns:
features of left-hand side

Definition at line 357 of file Kernel.h.

CKernelNormalizer * get_normalizer (  )  [virtual]

obtain the current kernel normalizer

Returns:
the kernel normalizer

Definition at line 163 of file Kernel.cpp.

int32_t get_num_subkernels (  )  [virtual]

get number of subkernels

Returns:
number of subkernels

Reimplemented in CCombinedKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 450 of file Kernel.cpp.

virtual int32_t get_num_vec_lhs (  )  [virtual]

get number of vectors of lhs features

Returns:
number of vectors of left-hand side

Reimplemented in CCustomKernel.

Definition at line 369 of file Kernel.h.

virtual int32_t get_num_vec_rhs (  )  [virtual]

get number of vectors of rhs features

Returns:
number of vectors of right-hand side

Reimplemented in CCustomKernel.

Definition at line 378 of file Kernel.h.

EOptimizationType get_optimization_type (  ) 

get optimization type

Returns:
optimization type

Definition at line 479 of file Kernel.h.

CFeatures* get_rhs (  ) 

get right-hand side of features used in kernel

Returns:
features of right-hand side

Definition at line 363 of file Kernel.h.

const float64_t * get_subkernel_weights ( int32_t &  num_weights  )  [virtual]

get subkernel weights

Parameters:
num_weights number of weights will be stored here
Returns:
subkernel weights

Reimplemented in CCombinedKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 461 of file Kernel.cpp.

virtual bool has_features (  )  [virtual]

test whether features have been assigned to lhs and rhs

Returns:
true if features are assigned

Reimplemented in CCombinedKernel, and CCustomKernel.

Definition at line 387 of file Kernel.h.

bool has_property ( EKernelProperty  p  ) 

check if kernel has given property

Parameters:
p kernel property
Returns:
if kernel has given property

Definition at line 461 of file Kernel.h.

bool init ( CFeatures lhs,
CFeatures rhs 
) [virtual]
bool init_normalizer (  )  [virtual]

initialize the current kernel normalizer

Returns:
if init was successful

Definition at line 169 of file Kernel.cpp.

bool init_optimization ( int32_t  count,
int32_t *  IDX,
float64_t weights 
) [virtual]

initialize optimization

Parameters:
count count
IDX index
weights weights
Returns:
if initializing was successful

Reimplemented in CCombinedKernel, CCommUlongStringKernel, CCommWordStringKernel, CLinearByteKernel, CLinearKernel, CLinearStringKernel, CLinearWordKernel, CSparseLinearKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 414 of file Kernel.cpp.

bool init_optimization_svm ( CSVM svm  ) 

initialize optimization

Parameters:
svm svm model
Returns:
if initializing was successful

Definition at line 474 of file Kernel.cpp.

float64_t kernel ( int32_t  idx_a,
int32_t  idx_b 
)

get kernel function for lhs feature vector a and rhs feature vector b

Parameters:
idx_a index of feature vector a
idx_b index of feature vector b
Returns:
computed kernel function

Definition at line 182 of file Kernel.h.

bool lhs_equals_rhs (  ) 

test whether features on lhs and rhs are the same

Returns:
true if features are the same

Definition at line 396 of file Kernel.h.

void list_kernel (  ) 

list kernel

Definition at line 253 of file Kernel.cpp.

bool load ( char *  fname  ) 

load the kernel matrix

Parameters:
fname filename to load from
Returns:
if loading was successful

Definition at line 181 of file Kernel.cpp.

void remove_lhs (  )  [virtual]

remove lhs from kernel

Reimplemented in CCombinedKernel, CCommUlongStringKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 230 of file Kernel.cpp.

void remove_lhs_and_rhs (  )  [virtual]

remove lhs and rhs from kernel

Reimplemented in CCombinedKernel.

Definition at line 216 of file Kernel.cpp.

void remove_rhs (  )  [virtual]

takes all necessary steps if the rhs is removed from kernel

remove rhs from kernel

Reimplemented in CCombinedKernel, and CCommUlongStringKernel.

Definition at line 242 of file Kernel.cpp.

bool save ( char *  fname  ) 

save kernel matrix

Parameters:
fname filename to save to
Returns:
if saving was successful

Definition at line 186 of file Kernel.cpp.

void set_cache_size ( int32_t  size  ) 

set the size of the kernel cache

Parameters:
size of kernel cache

Definition at line 439 of file Kernel.h.

void set_combined_kernel_weight ( float64_t  nw  ) 

set combined kernel weight

Parameters:
nw new combined kernel weight

Definition at line 546 of file Kernel.h.

void set_is_initialized ( bool  p_init  )  [protected]

set is initialized

Parameters:
p_init if optimization shall be set to initialized

Definition at line 600 of file Kernel.h.

bool set_normalizer ( CKernelNormalizer normalizer  )  [virtual]

set the current kernel normalizer

Returns:
if successful

Definition at line 154 of file Kernel.cpp.

virtual void set_optimization_type ( EOptimizationType  t  )  [virtual]

set optimization type

Parameters:
t optimization type to set

Reimplemented in CCombinedKernel.

Definition at line 485 of file Kernel.h.

void set_property ( EKernelProperty  p  )  [protected]

set property

Parameters:
p kernel property to set

Definition at line 582 of file Kernel.h.

void set_subkernel_weights ( float64_t weights,
int32_t  num_weights 
) [virtual]

set subkernel weights

Parameters:
weights subkernel weights
num_weights number of weights

Reimplemented in CCombinedKernel, CWeightedDegreePositionStringKernel, and CWeightedDegreeStringKernel.

Definition at line 467 of file Kernel.cpp.

void unset_property ( EKernelProperty  p  )  [protected]

unset property

Parameters:
p kernel property to unset

Definition at line 591 of file Kernel.h.


Friends And Related Function Documentation

friend class CAvgDiagKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 145 of file Kernel.h.

friend class CDiceKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 149 of file Kernel.h.

friend class CFirstElementKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 147 of file Kernel.h.

friend class CRidgeKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 146 of file Kernel.h.

friend class CSqrtDiagKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 144 of file Kernel.h.

friend class CTanimotoKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 148 of file Kernel.h.

friend class CVarianceKernelNormalizer [friend]

Reimplemented in CCommWordStringKernel.

Definition at line 143 of file Kernel.h.


Member Data Documentation

int32_t cache_size [protected]

cache_size in MB

Definition at line 738 of file Kernel.h.

combined kernel weight

Definition at line 757 of file Kernel.h.

this *COULD* store the whole kernel matrix usually not applicable / necessary to compute the whole matrix

Definition at line 744 of file Kernel.h.

CFeatures* lhs [protected]

feature vectors to occur on left hand side

Definition at line 747 of file Kernel.h.

normalize the kernel(i,j) function based on this normalization function

Definition at line 771 of file Kernel.h.

int32_t num_lhs [protected]

number of feature vectors on left hand side

Definition at line 752 of file Kernel.h.

int32_t num_rhs [protected]

number of feature vectors on right hand side

Definition at line 754 of file Kernel.h.

optimization type (currently FASTBUTMEMHUNGRY and SLOWBUTMEMEFFICIENT)

Definition at line 764 of file Kernel.h.

bool optimization_initialized [protected]

if optimization is initialized

Definition at line 760 of file Kernel.h.

uint64_t properties [protected]

kernel properties

Definition at line 767 of file Kernel.h.

CFeatures* rhs [protected]

feature vectors to occur on right hand side

Definition at line 749 of file Kernel.h.


The documentation for this class was generated from the following files:

SHOGUN Machine Learning Toolbox - Documentation