支持区域的 MemoryCache?

Posted

技术标签:

【中文标题】支持区域的 MemoryCache?【英文标题】:MemoryCache with regions support? 【发布时间】:2012-02-18 16:37:33 【问题描述】:

我需要添加缓存功能并找到一个名为 MemoryCache 的新类。但是,我发现 MemoryCache 有点残废(我需要区域功能)。除其他事项外,我需要添加诸如 ClearAll(region) 之类的内容。作者做了很大的努力来保持这个类没有区域支持,代码如下:

if (regionName != null)

throw new NotSupportedException(R.RegionName_not_supported);

几乎每一种方法都能飞。 我没有看到一种简单的方法来覆盖这种行为。我能想到的添加区域支持的唯一方法是添加一个新类作为 MemoryCache 的包装器,而不是作为从 MemoryCache 继承的类。然后在这个新类中创建一个 Dictionary 并让每个方法“缓冲”区域调用。听起来很恶心和错误,但最终......

您知道将区域添加到 MemoryCache 的更好方法吗?

【问题讨论】:

有谁知道为什么?当我认为这需要 5 分钟完成时,这个该死的 MemoryCache 对象让我陷入了研究的困境! 这可能也很有趣codereview.stackexchange.com/questions/48148/… 【参考方案1】:

我知道您已经很久没有提出这个问题了,所以这并不是对您的真正答案,而是对未来读者的补充。

我还惊讶地发现 MemoryCache 的标准实现不支持区域。立即提供会很容易。因此,我决定将 MemoryCache 包装在我自己的简单类中,以提供我经常需要的功能。

我将我的代码附在此处,以便为有相同需求的其他人节省时间!

/// <summary>
/// =================================================================================================================
/// This is a static encapsulation of the Framework provided MemoryCache to make it easier to use.
/// - Keys can be of any type, not just strings.
/// - A typed Get method is provided for the common case where type of retrieved item actually is known.
/// - Exists method is provided.
/// - Except for the Set method with custom policy, some specific Set methods are also provided for convenience.
/// - One SetAbsolute method with remove callback is provided as an example.
///   The Set method can also be used for custom remove/update monitoring.
/// - Domain (or "region") functionality missing in default MemoryCache is provided.
///   This is very useful when adding items with identical keys but belonging to different domains.
///   Example: "Customer" with Id=1, and "Product" with Id=1
/// =================================================================================================================
/// </summary>
public static class MyCache

    private const string KeySeparator = "_";
    private const string DefaultDomain = "DefaultDomain";


    private static MemoryCache Cache
    
        get  return MemoryCache.Default; 
    

    // -----------------------------------------------------------------------------------------------------------------------------
    // The default instance of the MemoryCache is used.
    // Memory usage can be configured in standard config file.
    // -----------------------------------------------------------------------------------------------------------------------------
    // cacheMemoryLimitMegabytes:   The amount of maximum memory size to be used. Specified in megabytes. 
    //                              The default is zero, which indicates that the MemoryCache instance manages its own memory
    //                              based on the amount of memory that is installed on the computer. 
    // physicalMemoryPercentage:    The percentage of physical memory that the cache can use. It is specified as an integer value from 1 to 100. 
    //                              The default is zero, which indicates that the MemoryCache instance manages its own memory 
    //                              based on the amount of memory that is installed on the computer. 
    // pollingInterval:             The time interval after which the cache implementation compares the current memory load with the 
    //                              absolute and percentage-based memory limits that are set for the cache instance.
    //                              The default is two minutes.
    // -----------------------------------------------------------------------------------------------------------------------------
    //  <configuration>
    //    <system.runtime.caching>
    //      <memoryCache>
    //        <namedCaches>
    //          <add name="default" cacheMemoryLimitMegabytes="0" physicalMemoryPercentage="0" pollingInterval="00:02:00" />
    //        </namedCaches>
    //      </memoryCache>
    //    </system.runtime.caching>
    //  </configuration>
    // -----------------------------------------------------------------------------------------------------------------------------



    /// <summary>
    /// Store an object and let it stay in cache until manually removed.
    /// </summary>
    public static void SetPermanent(string key, object data, string domain = null)
    
        CacheItemPolicy policy = new CacheItemPolicy  ;
        Set(key, data, policy, domain);
    

    /// <summary>
    /// Store an object and let it stay in cache x minutes from write.
    /// </summary>
    public static void SetAbsolute(string key, object data, double minutes, string domain = null)
    
        CacheItemPolicy policy = new CacheItemPolicy  AbsoluteExpiration = DateTime.Now + TimeSpan.FromMinutes(minutes) ;
        Set(key, data, policy, domain);
    

    /// <summary>
    /// Store an object and let it stay in cache x minutes from write.
    /// callback is a method to be triggered when item is removed
    /// </summary>
    public static void SetAbsolute(string key, object data, double minutes, CacheEntryRemovedCallback callback, string domain = null)
    
        CacheItemPolicy policy = new CacheItemPolicy  AbsoluteExpiration = DateTime.Now + TimeSpan.FromMinutes(minutes), RemovedCallback = callback ;
        Set(key, data, policy, domain);
    

    /// <summary>
    /// Store an object and let it stay in cache x minutes from last write or read.
    /// </summary>
    public static void SetSliding(object key, object data, double minutes, string domain = null)
    
        CacheItemPolicy policy = new CacheItemPolicy  SlidingExpiration = TimeSpan.FromMinutes(minutes) ;
        Set(key, data, policy, domain);
    

    /// <summary>
    /// Store an item and let it stay in cache according to specified policy.
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="data">Object to store</param>
    /// <param name="policy">CacheItemPolicy</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    public static void Set(object key, object data, CacheItemPolicy policy, string domain = null)
    
        Cache.Add(CombinedKey(key, domain), data, policy);
    




    /// <summary>
    /// Get typed item from cache.
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    public static T Get<T>(object key, string domain = null)
    
        return (T)Get(key, domain);
    

    /// <summary>
    /// Get item from cache.
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    public static object Get(object key, string domain = null)
    
        return Cache.Get(CombinedKey(key, domain));
    

    /// <summary>
    /// Check if item exists in cache.
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    public static bool Exists(object key, string domain = null)
    
        return Cache[CombinedKey(key, domain)] != null;
    

    /// <summary>
    /// Remove item from cache.
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    public static void Remove(object key, string domain = null)
    
        Cache.Remove(CombinedKey(key, domain));
    



    #region Support Methods

    /// <summary>
    /// Parse domain from combinedKey.
    /// This method is exposed publicly because it can be useful in callback methods.
    /// The key property of the callback argument will in our case be the combinedKey.
    /// To be interpreted, it needs to be split into domain and key with these parse methods.
    /// </summary>
    public static string ParseDomain(string combinedKey)
    
        return combinedKey.Substring(0, combinedKey.IndexOf(KeySeparator));
    

    /// <summary>
    /// Parse key from combinedKey.
    /// This method is exposed publicly because it can be useful in callback methods.
    /// The key property of the callback argument will in our case be the combinedKey.
    /// To be interpreted, it needs to be split into domain and key with these parse methods.
    /// </summary>
    public static string ParseKey(string combinedKey)
    
        return combinedKey.Substring(combinedKey.IndexOf(KeySeparator) + KeySeparator.Length);
    

    /// <summary>
    /// Create a combined key from given values.
    /// The combined key is used when storing and retrieving from the inner MemoryCache instance.
    /// Example: Product_76
    /// </summary>
    /// <param name="key">Key within specified domain</param>
    /// <param name="domain">NULL will fallback to default domain</param>
    private static string CombinedKey(object key, string domain)
    
        return string.Format("012", string.IsNullOrEmpty(domain) ? DefaultDomain : domain, KeySeparator, key);
    

    #endregion


【讨论】:

通过 MemoryCache 枚举是低效的,因为它会暂时锁定整个缓存。此外,您的 Clear() 是线性搜索,因此线性缓存项的数量会变得更糟。这是一个更好的解决方案:***.com/a/22388943/220230 感谢您的关注。在给定的简单示例中,我现在删除了 Clear 方法以避免将其他人误入歧途。对于那些真正需要按地区手动删除的人,我参考给定的链接。【参考方案2】:

您可以只创建一个以上的 MemoryCache 实例,为您的数据的每个分区创建一个。

http://msdn.microsoft.com/en-us/library/system.runtime.caching.memorycache.aspx:

您可以创建 MemoryCache 类的多个实例,以便在同一个应用程序和同一个 AppDomain 实例中使用

【讨论】:

实例化所有这些新的 MemoryCache 实例的最佳位置在哪里?是否有可以管理所有这些实例的 MemoryCache 提供程序? @HenleyChiu 我认为基础库中没有任何内容。只需使用共享状态的标准方法,例如一个静态的、全局可见的ConcurrentDictionary<string, MemoryCache> 在某些情况下使用多个MemoryCache 实例可能会降低缓存的有效性。见:***.com/questions/8463962/… 使用 IMemoryCache 的依赖注入被设计为用作单例。【参考方案3】:

另一种方法是在 MemoryCache 周围实现一个包装器,它通过组合键和区域名称来实现区域,例如

public interface ICache 

...
    object Get(string key, string regionName = null);
...


public class MyCache : ICache

    private readonly MemoryCache cache

    public MyCache(MemoryCache cache)
    
        this.cache = cache.
    
...
    public object Get(string key, string regionName = null)
    
        var regionKey = RegionKey(key, regionName);

        return cache.Get(regionKey);
       

    private string RegionKey(string key, string regionName)
    
       // NB Implements region as a suffix, for prefix, swap order in the format
       return string.IsNullOrEmpty(regionName) ? key : string.Format("012", key, "::", regionName);
    
...

它并不完美,但适用于大多数用例。

我已经实现了它,它可以作为 NuGet 包使用:Meerkat.Caching

【讨论】:

【参考方案4】:

我最近才遇到这个问题。我知道这是一个老问题,但也许这对某些人有用。这是我对Thomas F. Abraham解决方案的迭代

namespace CLRTest

    using System;
    using System.Collections.Concurrent;
    using System.Diagnostics;
    using System.Globalization;
    using System.Linq;
    using System.Runtime.Caching;

    class Program
    
        static void Main(string[] args)
        
            CacheTester.TestCache();
        
    

    public class SignaledChangeEventArgs : EventArgs
    
        public string Name  get; private set; 
        public SignaledChangeEventArgs(string name = null)  this.Name = name; 
    

    /// <summary>
    /// Cache change monitor that allows an app to fire a change notification
    /// to all associated cache items.
    /// </summary>
    public class SignaledChangeMonitor : ChangeMonitor
    
        // Shared across all SignaledChangeMonitors in the AppDomain
        private static ConcurrentDictionary<string, EventHandler<SignaledChangeEventArgs>> ListenerLookup = 
            new ConcurrentDictionary<string, EventHandler<SignaledChangeEventArgs>>();

        private string _name;
        private string _key;
        private string _uniqueId = Guid.NewGuid().ToString("N", CultureInfo.InvariantCulture);

        public override string UniqueId
        
            get  return _uniqueId; 
        

        public SignaledChangeMonitor(string key, string name)
        
            _key = key;
            _name = name;
            // Register instance with the shared event
            ListenerLookup[_uniqueId] = OnSignalRaised;
            base.InitializationComplete();
        


        public static void Signal(string name = null)
        
            // Raise shared event to notify all subscribers
            foreach (var subscriber in ListenerLookup.ToList())
            
                subscriber.Value?.Invoke(null, new SignaledChangeEventArgs(name));
            
        

        protected override void Dispose(bool disposing)
        
            // Set delegate to null so it can't be accidentally called in Signal() while being disposed
            ListenerLookup[_uniqueId] = null;
            EventHandler<SignaledChangeEventArgs> outValue = null;
            ListenerLookup.TryRemove(_uniqueId, out outValue);
        

        private void OnSignalRaised(object sender, SignaledChangeEventArgs e)
        
            if (string.IsNullOrWhiteSpace(e.Name) || string.Compare(e.Name, _name, true) == 0)
            
                // Cache objects are obligated to remove entry upon change notification.
                base.OnChanged(null);
            
        
    

    public static class CacheTester
    
        private static Stopwatch _timer = new Stopwatch();

        public static void TestCache()
        
            MemoryCache cache = MemoryCache.Default;
            int size = (int)1e6;

            Start();
            for (int idx = 0; idx < size; idx++)
            
                cache.Add(idx.ToString(), "Value" + idx.ToString(), GetPolicy(idx, cache));
            
            long prevCnt = cache.GetCount();
            Stop($"Added    prevCnt items");

            Start();
            SignaledChangeMonitor.Signal("NamedData");
            Stop($"Removed  prevCnt - cache.GetCount() entries");
            prevCnt = cache.GetCount();

            Start();
            SignaledChangeMonitor.Signal();
            Stop($"Removed  prevCnt - cache.GetCount() entries");
        

        private static CacheItemPolicy GetPolicy(int idx, MemoryCache cache)
        
            string name = (idx % 10 == 0) ? "NamedData" : null;

            CacheItemPolicy cip = new CacheItemPolicy();
            cip.AbsoluteExpiration = System.DateTimeOffset.UtcNow.AddHours(1);
            var monitor = new SignaledChangeMonitor(idx.ToString(), name);
            cip.ChangeMonitors.Add(monitor);
            return cip;
        

        private static void Start()
        
            _timer.Start();
        

        private static void Stop(string msg = null)
        
            _timer.Stop();
            Console.WriteLine($"msg | _timer.Elapsed.TotalSeconds sec");
            _timer.Reset();
        
    

他的解决方案涉及使用事件来跟踪 ChangeMonitors。但是当条目数超过 10k 时,dispose 方法运行缓慢。我的猜测是这段代码SignaledChangeMonitor.Signaled -= OnSignalRaised 通过进行线性搜索从调用列表中删除了一个委托。因此,当您删除大量条目时,它会变得很慢。我决定使用 ConcurrentDictionary 而不是事件。希望处置变得更快。我进行了一些基本的性能测试,结果如下:

Added    10000 items | 0.027697 sec
Removed  1000 entries | 0.0040669 sec
Removed  9000 entries | 0.0105687 sec

Added    100000 items | 0.5065736 sec
Removed  10000 entries | 0.0338991 sec
Removed  90000 entries | 0.1418357 sec

Added    1000000 items | 6.5994546 sec
Removed  100000 entries | 0.4176233 sec
Removed  900000 entries | 1.2514225 sec

我不确定我的代码是否存在一些严重缺陷。我想知道是不是这样。

【讨论】:

以上是关于支持区域的 MemoryCache?的主要内容,如果未能解决你的问题,请参考以下文章

.NET Core 2.0迁移技巧之MemoryCache问题修复

Heroku 多区域支持

php操作memcache

php操作memcache

如何修复 aws 区域错误“ValueError:必须使用 SageMaker 支持的区域设置本地 AWS 配置”

通过 API 提供 BIM 360 区域支持