memory
MemoryCache
¶
Bases: BaseCache
MemoryCache is an in-memory cache that implements the BaseCache interface.
Attributes:
Name | Type | Description |
---|---|---|
cache |
dict
|
A dictionary to store the cache values. |
expires |
dict
|
A dictionary to store the expiration times of the cache values. |
zexpires |
dict
|
A dictionary to store the expiration times of the sorted set values. |
_expire_thread |
Thread
|
A thread that runs the _expire method. |
Source code in inference/core/cache/memory.py
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 |
|
__init__()
¶
Initializes a new instance of the MemoryCache class.
Source code in inference/core/cache/memory.py
21 22 23 24 25 26 27 28 29 30 31 |
|
get(key)
¶
Gets the value associated with the given key.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
key
|
str
|
The key to retrieve the value. |
required |
Returns:
Name | Type | Description |
---|---|---|
str |
The value associated with the key, or None if the key does not exist or is expired. |
Source code in inference/core/cache/memory.py
58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
|
set(key, value, expire=None)
¶
Sets a value for a given key with an optional expire time.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
key
|
str
|
The key to store the value. |
required |
value
|
str
|
The value to store. |
required |
expire
|
float
|
The time, in seconds, after which the key will expire. Defaults to None. |
None
|
Source code in inference/core/cache/memory.py
75 76 77 78 79 80 81 82 83 84 85 86 |
|
zadd(key, value, score, expire=None)
¶
Adds a member with the specified score to the sorted set stored at key.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
key
|
str
|
The key of the sorted set. |
required |
value
|
str
|
The value to add to the sorted set. |
required |
score
|
float
|
The score associated with the value. |
required |
expire
|
float
|
The time, in seconds, after which the key will expire. Defaults to None. |
None
|
Source code in inference/core/cache/memory.py
88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 |
|
zrangebyscore(key, min=-1, max=float('inf'), withscores=False)
¶
Retrieves a range of members from a sorted set.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
key
|
str
|
The key of the sorted set. |
required |
start
|
int
|
The starting score of the range. Defaults to -1. |
required |
stop
|
int
|
The ending score of the range. Defaults to float("inf"). |
required |
withscores
|
bool
|
Whether to return the scores along with the values. Defaults to False. |
False
|
Returns:
Name | Type | Description |
---|---|---|
list |
A list of values (or value-score pairs if withscores is True) in the specified score range. |
Source code in inference/core/cache/memory.py
104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 |
|
zremrangebyscore(key, min=-1, max=float('inf'))
¶
Removes all members in a sorted set within the given scores.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
key
|
str
|
The key of the sorted set. |
required |
start
|
int
|
The minimum score of the range. Defaults to -1. |
required |
stop
|
int
|
The maximum score of the range. Defaults to float("inf"). |
required |
Returns:
Name | Type | Description |
---|---|---|
int |
The number of members removed from the sorted set. |
Source code in inference/core/cache/memory.py
131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 |
|