Python实现的最近最少使用算法


Posted in Python onJuly 10, 2015

本文实例讲述了Python实现的最近最少使用算法。分享给大家供大家参考。具体如下:

# lrucache.py -- a simple LRU (Least-Recently-Used) cache class 
# Copyright 2004 Evan Prodromou <evan@bad.dynu.ca> 
# Licensed under the Academic Free License 2.1 
# Licensed for ftputil under the revised BSD license 
# with permission by the author, Evan Prodromou. Many 
# thanks, Evan! :-) 
# 
# The original file is available at 
# http://pypi.python.org/pypi/lrucache/0.2 . 
# arch-tag: LRU cache main module 
"""a simple LRU (Least-Recently-Used) cache module 
This module provides very simple LRU (Least-Recently-Used) cache 
functionality. 
An *in-memory cache* is useful for storing the results of an 
'expe\nsive' process (one that takes a lot of time or resources) for 
later re-use. Typical examples are accessing data from the filesystem, 
a database, or a network location. If you know you'll need to re-read 
the data again, it can help to keep it in a cache. 
You *can* use a Python dictionary as a cache for some purposes. 
However, if the results you're caching are large, or you have a lot of 
possible results, this can be impractical memory-wise. 
An *LRU cache*, on the other hand, only keeps _some_ of the results in 
memory, which keeps you from overusing resources. The cache is bounded 
by a maximum size; if you try to add more values to the cache, it will 
automatically discard the values that you haven't read or written to 
in the longest time. In other words, the least-recently-used items are 
discarded. [1]_ 
.. [1]: 'Discarded' here means 'removed from the cache'. 
"""
from __future__ import generators 
import time 
from heapq import heappush, heappop, heapify 
# the suffix after the hyphen denotes modifications by the 
# ftputil project with respect to the original version 
__version__ = "0.2-1"
__all__ = ['CacheKeyError', 'LRUCache', 'DEFAULT_SIZE'] 
__docformat__ = 'reStructuredText en'
DEFAULT_SIZE = 16
"""Default size of a new LRUCache object, if no 'size' argument is given."""
class CacheKeyError(KeyError): 
  """Error raised when cache requests fail 
  When a cache record is accessed which no longer exists (or never did), 
  this error is raised. To avoid it, you may want to check for the existence 
  of a cache record before reading or deleting it."""
  pass
class LRUCache(object): 
  """Least-Recently-Used (LRU) cache. 
  Instances of this class provide a least-recently-used (LRU) cache. They 
  emulate a Python mapping type. You can use an LRU cache more or less like 
  a Python dictionary, with the exception that objects you put into the 
  cache may be discarded before you take them out. 
  Some example usage:: 
  cache = LRUCache(32) # new cache 
  cache['foo'] = get_file_contents('foo') # or whatever 
  if 'foo' in cache: # if it's still in cache... 
    # use cached version 
    contents = cache['foo'] 
  else: 
    # recalculate 
    contents = get_file_contents('foo') 
    # store in cache for next time 
    cache['foo'] = contents 
  print cache.size # Maximum size 
  print len(cache) # 0 <= len(cache) <= cache.size 
  cache.size = 10 # Auto-shrink on size assignment 
  for i in range(50): # note: larger than cache size 
    cache[i] = i 
  if 0 not in cache: print 'Zero was discarded.' 
  if 42 in cache: 
    del cache[42] # Manual deletion 
  for j in cache:  # iterate (in LRU order) 
    print j, cache[j] # iterator produces keys, not values 
  """
  class __Node(object): 
    """Record of a cached value. Not for public consumption."""
    def __init__(self, key, obj, timestamp, sort_key): 
      object.__init__(self) 
      self.key = key 
      self.obj = obj 
      self.atime = timestamp 
      self.mtime = self.atime 
      self._sort_key = sort_key 
    def __cmp__(self, other): 
      return cmp(self._sort_key, other._sort_key) 
    def __repr__(self): 
      return "<%s %s => %s (%s)>" % \ 
          (self.__class__, self.key, self.obj, \ 
          time.asctime(time.localtime(self.atime))) 
  def __init__(self, size=DEFAULT_SIZE): 
    # Check arguments 
    if size <= 0: 
      raise ValueError, size 
    elif type(size) is not type(0): 
      raise TypeError, size 
    object.__init__(self) 
    self.__heap = [] 
    self.__dict = {} 
    """Maximum size of the cache. 
    If more than 'size' elements are added to the cache, 
    the least-recently-used ones will be discarded."""
    self.size = size 
    self.__counter = 0
  def _sort_key(self): 
    """Return a new integer value upon every call. 
    Cache nodes need a monotonically increasing time indicator. 
    time.time() and time.clock() don't guarantee this in a 
    platform-independent way. 
    """
    self.__counter += 1
    return self.__counter 
  def __len__(self): 
    return len(self.__heap) 
  def __contains__(self, key): 
    return self.__dict.has_key(key) 
  def __setitem__(self, key, obj): 
    if self.__dict.has_key(key): 
      node = self.__dict[key] 
      # update node object in-place 
      node.obj = obj 
      node.atime = time.time() 
      node.mtime = node.atime 
      node._sort_key = self._sort_key() 
      heapify(self.__heap) 
    else: 
      # size may have been reset, so we loop 
      while len(self.__heap) >= self.size: 
        lru = heappop(self.__heap) 
        del self.__dict[lru.key] 
      node = self.__Node(key, obj, time.time(), self._sort_key()) 
      self.__dict[key] = node 
      heappush(self.__heap, node) 
  def __getitem__(self, key): 
    if not self.__dict.has_key(key): 
      raise CacheKeyError(key) 
    else: 
      node = self.__dict[key] 
      # update node object in-place 
      node.atime = time.time() 
      node._sort_key = self._sort_key() 
      heapify(self.__heap) 
      return node.obj 
  def __delitem__(self, key): 
    if not self.__dict.has_key(key): 
      raise CacheKeyError(key) 
    else: 
      node = self.__dict[key] 
      del self.__dict[key] 
      self.__heap.remove(node) 
      heapify(self.__heap) 
      return node.obj 
  def __iter__(self): 
    copy = self.__heap[:] 
    while len(copy) > 0: 
      node = heappop(copy) 
      yield node.key 
    raise StopIteration 
  def __setattr__(self, name, value): 
    object.__setattr__(self, name, value) 
    # automagically shrink heap on resize 
    if name == 'size': 
      while len(self.__heap) > value: 
        lru = heappop(self.__heap) 
        del self.__dict[lru.key] 
  def __repr__(self): 
    return "<%s (%d elements)>" % (str(self.__class__), len(self.__heap)) 
  def mtime(self, key): 
    """Return the last modification time for the cache record with key. 
    May be useful for cache instances where the stored values can get 
    'stale', such as caching file or network resource contents."""
    if not self.__dict.has_key(key): 
      raise CacheKeyError(key) 
    else: 
      node = self.__dict[key] 
      return node.mtime 
if __name__ == "__main__": 
  cache = LRUCache(25) 
  print cache 
  for i in range(50): 
    cache[i] = str(i) 
  print cache 
  if 46 in cache: 
    print "46 in cache"
    del cache[46] 
  print cache 
  cache.size = 10
  print cache 
  cache[46] = '46'
  print cache 
  print len(cache) 
  for c in cache: 
    print c 
  print cache 
  print cache.mtime(46) 
  for c in cache: 
    print c

希望本文所述对大家的Python程序设计有所帮助。

Python 相关文章推荐
用Python实现斐波那契(Fibonacci)函数
Mar 25 Python
Python3调用微信企业号API发送文本消息代码示例
Nov 10 Python
django站点管理详解
Dec 12 Python
python 函数内部修改外部变量的方法
Dec 18 Python
Python3.4学习笔记之 idle 清屏扩展插件用法分析
Mar 01 Python
Python OpenCV利用笔记本摄像头实现人脸检测
Aug 20 Python
Python 批量刷博客园访问量脚本过程解析
Aug 30 Python
python实现上传文件到linux指定目录的方法
Jan 03 Python
python给图像加上mask,并提取mask区域实例
Jan 19 Python
PyTorch中model.zero_grad()和optimizer.zero_grad()用法
Jun 24 Python
python tqdm库的使用
Nov 30 Python
地图可视化神器kepler.gl python接口的使用方法
Dec 22 Python
Python导入oracle数据的方法
Jul 10 #Python
Python验证码识别的方法
Jul 10 #Python
Python实现大文件排序的方法
Jul 10 #Python
Python实现telnet服务器的方法
Jul 10 #Python
Python读写unicode文件的方法
Jul 10 #Python
Python实现提取谷歌音乐搜索结果的方法
Jul 10 #Python
python和bash统计CPU利用率的方法
Jul 10 #Python
You might like
收听短波不可能有声音清晰的品质吗
2021/03/01 无线电
几款免费开源的不用数据库的php的cms
2010/12/19 PHP
PHP5权威编程阅读学习笔记 附电子书下载
2012/07/05 PHP
浅析Dos下运行php.exe,出现没有找到php_mbstring.dll 错误的解决方法
2013/06/29 PHP
php新浪微博登录接口用法实例
2014/12/23 PHP
PHP PDOStatement::fetchColumn讲解
2019/01/31 PHP
json原理分析及实例介绍
2012/11/29 Javascript
详解JavaScript的表达式与运算符
2015/11/30 Javascript
jquery密码强度校验
2015/12/02 Javascript
谈谈PHP中相对路径的问题与绝对路径的使用
2016/08/16 Javascript
微信小程序通过api接口将json数据展现到小程序示例
2017/01/20 Javascript
JS表单数据验证的正则表达式(常用)
2017/02/18 Javascript
Easyui 去除jquery-easui tab页div自带滚动条的方法
2019/05/10 jQuery
利用vue-i18n实现多语言切换效果的方法
2019/06/19 Javascript
基于webpack4+vue-cli3项目实现换肤功能
2019/07/17 Javascript
JS精确判断数据类型代码实例
2019/12/18 Javascript
[00:37]2016完美“圣”典风云人物:AMS宣传片
2016/12/06 DOTA
Python Web框架Flask中使用七牛云存储实例
2015/02/08 Python
用virtualenv建立多个Python独立虚拟开发环境
2017/07/06 Python
python 协程中的迭代器,生成器原理及应用实例详解
2019/10/28 Python
Python 面向对象部分知识点小结
2020/03/09 Python
详解CSS3 用border写 空心三角箭头 (两种写法)
2017/09/29 HTML / CSS
诺心蛋糕官网:LE CAKE
2018/08/25 全球购物
零件设计自荐信范文
2013/11/27 职场文书
工地资料员岗位职责
2013/12/31 职场文书
大学生旷课检讨书
2014/01/22 职场文书
青春励志演讲稿
2014/04/29 职场文书
孝敬父母的演讲稿
2014/05/14 职场文书
运动会演讲稿50字
2014/08/25 职场文书
2014年管理人员工作总结
2014/12/01 职场文书
张思德观后感
2015/06/09 职场文书
大学副班长竞选稿
2015/11/21 职场文书
公安干警正风肃纪心得体会
2016/01/15 职场文书
mysql配置SSL证书登录的实现
2021/09/04 MySQL
Nginx实现会话保持的两种方式
2022/03/18 Servers
Vue+Flask实现图片传输功能
2022/04/01 Vue.js