Package org.terracotta.offheapstore.storage

Class OffHeapBufferStorageEngine<K,V>

java.lang.Object

org.terracotta.offheapstore.storage.listener.AbstractListenableStorageEngine<K,V>

org.terracotta.offheapstore.storage.PortabilityBasedStorageEngine<K,V>

org.terracotta.offheapstore.storage.OffHeapBufferStorageEngine<K,V>

Type Parameters:

K - key type handled by this engine

V - value type handled by this engine

All Implemented Interfaces:

OffHeapStorageArea.Owner, BinaryStorageEngine, ListenableStorageEngine<K,V>, StorageEngine<K,V>

Direct Known Subclasses:

SerializableStorageEngine, StringStorageEngine

public class OffHeapBufferStorageEngine<K,V>
extends PortabilityBasedStorageEngine<K,V>
implements OffHeapStorageArea.Owner

A generic ByteBuffer based key/value store.

This storage engine implementation uses Portability instances to convert key/value instances in to ByteBuffers. The content of these ByteBuffers are then stored in slices of a single large data area.

Nested Class Summary

Nested classes/interfaces inherited from class org.terracotta.offheapstore.storage.PortabilityBasedStorageEngine

PortabilityBasedStorageEngine.CachedEncode<K,V>

Nested classes/interfaces inherited from interface org.terracotta.offheapstore.storage.StorageEngine

StorageEngine.Owner

Field Summary

Fields

Modifier and Type	Field	Description
private static int	DATA_OFFSET
private static int	HEADER_SIZE
private static int	KEY_HASH_OFFSET
private static int	KEY_LENGTH_OFFSET
protected StorageEngine.Owner	owner
protected OffHeapStorageArea	storageArea
private static int	VALUE_LENGTH_OFFSET

Fields inherited from class org.terracotta.offheapstore.storage.PortabilityBasedStorageEngine

keyPortability, valuePortability

Constructor Summary

Constructors

Constructor	Description
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim, float compressThreshold)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, float compressThreshold)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability)	Creates a storage engine using the given page source, and portabilities.
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim, float compressThreshold)
OffHeapBufferStorageEngine(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, float compressThreshold)

Method Summary

Modifier and Type	Method	Description
void	bind(StorageEngine.Owner m)
protected void	clearInternal()
static <K,V> Factory<OffHeapBufferStorageEngine<K,V>>	createFactory(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim)
static <K,V> Factory<OffHeapBufferStorageEngine<K,V>>	createFactory(PointerSize width, PageSource source, int initialPageSize, int maximalPageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim, float compressThreshold)
static <K,V> Factory<OffHeapBufferStorageEngine<K,V>>	createFactory(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim)
static <K,V> Factory<OffHeapBufferStorageEngine<K,V>>	createFactory(PointerSize width, PageSource source, int pageSize, Portability<? super K> keyPortability, Portability<? super V> valuePortability, boolean thief, boolean victim, float compressThreshold)
void	destroy()
java.util.Collection<java.lang.Long>	evictAtAddress(long address, boolean shrink)
protected void	free(long address)
long	getAllocatedMemory()	Returns a measure of the amount of memory allocated for this storage engine.
long	getDataSize()	Returns a measure of the total size of the keys and values stored in this storage engine.
protected WriteContext	getKeyWriteContext(long address)
long	getOccupiedMemory()	Returns a measure of the amount of memory consumed by this storage engine.
protected WriteContext	getValueWriteContext(long address)
long	getVitalMemory()	Returns a measure of the amount of vital memory allocated for this storage engine.
private WriteContext	getWriteContext(long address, int max)
boolean	isThief()
boolean	moved(long from, long to)
java.nio.ByteBuffer	readKeyBuffer(long address)
int	readKeyHash(long encoding)
java.nio.ByteBuffer	readValueBuffer(long address)
boolean	shrink()
int	sizeOf(long address)
java.lang.String	toString()
java.util.concurrent.locks.Lock	writeLock()
protected java.lang.Long	writeMappingBuffers(java.nio.ByteBuffer keyBuffer, java.nio.ByteBuffer valueBuffer, int hash)
protected java.lang.Long	writeMappingBuffersGathering(java.nio.ByteBuffer[] keyBuffers, java.nio.ByteBuffer[] valueBuffers, int hash)

Methods inherited from class org.terracotta.offheapstore.storage.PortabilityBasedStorageEngine

attachedMapping, clear, equalsBinaryKey, equalsKey, equalsValue, freeMapping, invalidateCache, readBinaryKey, readBinaryValue, readKey, readValue, writeBinaryMapping, writeBinaryMapping, writeMapping

Methods inherited from class org.terracotta.offheapstore.storage.listener.AbstractListenableStorageEngine

fireCleared, fireCopied, fireFreed, fireRecovered, fireWritten, hasListeners, hasRecoveryListeners, registerListener

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

KEY_HASH_OFFSET

private static final int KEY_HASH_OFFSET

See Also:

Constant Field Values

KEY_LENGTH_OFFSET

private static final int KEY_LENGTH_OFFSET

See Also:

Constant Field Values

VALUE_LENGTH_OFFSET

private static final int VALUE_LENGTH_OFFSET

See Also:

Constant Field Values

DATA_OFFSET

private static final int DATA_OFFSET

See Also:

Constant Field Values

HEADER_SIZE

private static final int HEADER_SIZE

See Also:

Constant Field Values

storageArea

protected final OffHeapStorageArea storageArea

owner

protected volatile StorageEngine.Owner owner

Constructor Detail

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int pageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability)

Creates a storage engine using the given page source, and portabilities.

Parameters:

width - int or long based engine

source - allocator used for storage allocation

pageSize - internal (constant) page size

keyPortability - key type portability

valuePortability - value type portability

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int pageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  float compressThreshold)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int initialPageSize,
                                  int maximalPageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int initialPageSize,
                                  int maximalPageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  float compressThreshold)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int pageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  boolean thief,
                                  boolean victim)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int pageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  boolean thief,
                                  boolean victim,
                                  float compressThreshold)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int initialPageSize,
                                  int maximalPageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  boolean thief,
                                  boolean victim)

OffHeapBufferStorageEngine

public OffHeapBufferStorageEngine(PointerSize width,
                                  PageSource source,
                                  int initialPageSize,
                                  int maximalPageSize,
                                  Portability<? super K> keyPortability,
                                  Portability<? super V> valuePortability,
                                  boolean thief,
                                  boolean victim,
                                  float compressThreshold)

Method Detail

createFactory

public static <K,V> Factory<OffHeapBufferStorageEngine<K,V>> createFactory(PointerSize width,
                                                                                       PageSource source,
                                                                                       int pageSize,
                                                                                       Portability<? super K> keyPortability,
                                                                                       Portability<? super V> valuePortability,
                                                                                       boolean thief,
                                                                                       boolean victim)

createFactory

public static <K,V> Factory<OffHeapBufferStorageEngine<K,V>> createFactory(PointerSize width,
                                                                                       PageSource source,
                                                                                       int pageSize,
                                                                                       Portability<? super K> keyPortability,
                                                                                       Portability<? super V> valuePortability,
                                                                                       boolean thief,
                                                                                       boolean victim,
                                                                                       float compressThreshold)

createFactory

public static <K,V> Factory<OffHeapBufferStorageEngine<K,V>> createFactory(PointerSize width,
                                                                                       PageSource source,
                                                                                       int initialPageSize,
                                                                                       int maximalPageSize,
                                                                                       Portability<? super K> keyPortability,
                                                                                       Portability<? super V> valuePortability,
                                                                                       boolean thief,
                                                                                       boolean victim)

createFactory

public static <K,V> Factory<OffHeapBufferStorageEngine<K,V>> createFactory(PointerSize width,
                                                                                       PageSource source,
                                                                                       int initialPageSize,
                                                                                       int maximalPageSize,
                                                                                       Portability<? super K> keyPortability,
                                                                                       Portability<? super V> valuePortability,
                                                                                       boolean thief,
                                                                                       boolean victim,
                                                                                       float compressThreshold)

clearInternal

protected void clearInternal()

Specified by:

clearInternal in class PortabilityBasedStorageEngine<K,V>

free

protected void free(long address)

Specified by:

free in class PortabilityBasedStorageEngine<K,V>

readKeyBuffer

public java.nio.ByteBuffer readKeyBuffer(long address)

Specified by:

readKeyBuffer in class PortabilityBasedStorageEngine<K,V>

getKeyWriteContext

protected WriteContext getKeyWriteContext(long address)

Specified by:

getKeyWriteContext in class PortabilityBasedStorageEngine<K,V>

readValueBuffer

public java.nio.ByteBuffer readValueBuffer(long address)

Specified by:

readValueBuffer in class PortabilityBasedStorageEngine<K,V>

getValueWriteContext

protected WriteContext getValueWriteContext(long address)

Specified by:

getValueWriteContext in class PortabilityBasedStorageEngine<K,V>

getWriteContext

private WriteContext getWriteContext(long address,
                                     int max)

writeMappingBuffers

protected java.lang.Long writeMappingBuffers(java.nio.ByteBuffer keyBuffer,
                                             java.nio.ByteBuffer valueBuffer,
                                             int hash)

Specified by:

writeMappingBuffers in class PortabilityBasedStorageEngine<K,V>

writeMappingBuffersGathering

protected java.lang.Long writeMappingBuffersGathering(java.nio.ByteBuffer[] keyBuffers,
                                                      java.nio.ByteBuffer[] valueBuffers,
                                                      int hash)

Overrides:

writeMappingBuffersGathering in class PortabilityBasedStorageEngine<K,V>

getAllocatedMemory

public long getAllocatedMemory()

Description copied from interface: StorageEngine

Returns a measure of the amount of memory allocated for this storage engine.

Specified by:

getAllocatedMemory in interface StorageEngine<K,V>

Returns:

memory allocated for this engine in bytes

getOccupiedMemory

public long getOccupiedMemory()

Description copied from interface: StorageEngine

Returns a measure of the amount of memory consumed by this storage engine.

Specified by:

getOccupiedMemory in interface StorageEngine<K,V>

Returns:

memory occupied by this engine in bytes

getVitalMemory

public long getVitalMemory()

Description copied from interface: StorageEngine

Returns a measure of the amount of vital memory allocated for this storage engine.

Specified by:

getVitalMemory in interface StorageEngine<K,V>

Returns:

vital memory allocated for this engine in bytes

getDataSize

public long getDataSize()

Description copied from interface: StorageEngine

Returns a measure of the total size of the keys and values stored in this storage engine.

Specified by:

getDataSize in interface StorageEngine<K,V>

Returns:

size of the stored keys and values in bytes

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

destroy

public void destroy()

Specified by:

destroy in interface StorageEngine<K,V>

shrink

public boolean shrink()

Specified by:

shrink in interface StorageEngine<K,V>

evictAtAddress

public java.util.Collection<java.lang.Long> evictAtAddress(long address,
                                                           boolean shrink)

Specified by:

evictAtAddress in interface OffHeapStorageArea.Owner

isThief

public boolean isThief()

Specified by:

isThief in interface OffHeapStorageArea.Owner

readKeyHash

public int readKeyHash(long encoding)

Specified by:

readKeyHash in interface BinaryStorageEngine

moved

public boolean moved(long from,
                     long to)

Specified by:

moved in interface OffHeapStorageArea.Owner

sizeOf

public int sizeOf(long address)

Specified by:

sizeOf in interface OffHeapStorageArea.Owner

bind

public void bind(StorageEngine.Owner m)

Specified by:

bind in interface StorageEngine<K,V>

writeLock

public java.util.concurrent.locks.Lock writeLock()

Specified by:

writeLock in interface OffHeapStorageArea.Owner