World Conquest Chronicles

World Conquest Chronicles

go-cache, v1.3

Posted on

The library that implements an in-memory cache with garbage collection in two modes: total (based on a full scan) and partial (based on expiration in Redis).

Improve support of interruption of garbage collection via a context, improve benchmarks, and perform refactoring.

Change Log

  • implementation of garbage collection:
    • improve support of interruption via a context:
      • pass a context to the gc.GC.Clean() method;
      • additional interruption via a context:
        • in the gc.TotalGC.Clean() method;
        • in the gc.PartialGC.Clean() method;
  • improve benchmarks:
    • add to benchmarks:
      • different storage sizes;
      • different expired percents;
    • stop at the end of each benchmark:
      • garbage collecting;
      • additional concurrent loading;
    • slow down additional concurrent loading;
  • refactoring:
    • extract from the gc.TotalGC.Clean() method:
      • the gc.TotalGC.handleIteration() method;
    • extract from the gc.PartialGC.Clean() method:
      • the gc.counter structure;
      • the gc.iterator structure.

Benchmarks

BenchmarkCacheGetting/Get/100-8                     30000000           454 ns/op          41 B/op          7 allocs/op
BenchmarkCacheGetting/Get/10000-8                   30000000           638 ns/op          42 B/op          7 allocs/op
BenchmarkCacheGetting/Get/1000000-8                 10000000          1583 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting/GetWithGC/100-8               30000000           403 ns/op          41 B/op          7 allocs/op
BenchmarkCacheGetting/GetWithGC/10000-8             30000000           515 ns/op          42 B/op          7 allocs/op
BenchmarkCacheGetting/GetWithGC/1000000-8           20000000           934 ns/op          44 B/op          7 allocs/op

With the total GC:

BenchmarkCacheGetting_withTotalGC/Get/100/0.01-8                        20000000           832 ns/op          94 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/100/0.20-8                        20000000           801 ns/op          89 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/100/0.30-8                        20000000           859 ns/op          90 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/100/0.99-8                        20000000           798 ns/op          88 B/op         10 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/10000/0.01-8                      10000000          1112 ns/op          94 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/10000/0.20-8                      10000000          1158 ns/op         107 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/10000/0.30-8                      20000000          1016 ns/op         103 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/10000/0.99-8                      30000000           466 ns/op          54 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/1000000/0.01-8                    10000000          1959 ns/op         114 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/1000000/0.20-8                    10000000          1685 ns/op          92 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/1000000/0.30-8                    10000000          1365 ns/op          76 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/Get/1000000/0.99-8                    20000000           664 ns/op          54 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/100/0.01-8                  20000000           793 ns/op          95 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/100/0.20-8                  20000000           794 ns/op          90 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/100/0.30-8                  20000000           833 ns/op          91 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/100/0.99-8                  20000000           660 ns/op          76 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/10000/0.01-8                20000000           981 ns/op          92 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/10000/0.20-8                20000000           947 ns/op         104 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/10000/0.30-8                20000000           937 ns/op         105 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/10000/0.99-8                30000000           530 ns/op          56 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/1000000/0.01-8              10000000          2000 ns/op         114 B/op          7 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/1000000/0.20-8              10000000          1859 ns/op          95 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/1000000/0.30-8              10000000          1428 ns/op          80 B/op          8 allocs/op
BenchmarkCacheGetting_withTotalGC/GetWithGC/1000000/0.99-8              20000000           686 ns/op          59 B/op          8 allocs/op

With the partial GC:

BenchmarkCacheGetting_withPartialGC/Get/100/0.01-8                      30000000           449 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/100/0.20-8                      30000000           433 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/100/0.30-8                      30000000           446 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/100/0.99-8                      20000000           895 ns/op         113 B/op         11 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/10000/0.01-8                    10000000          1564 ns/op         237 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/10000/0.20-8                    10000000          1807 ns/op         256 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/10000/0.30-8                    10000000          1473 ns/op         239 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/10000/0.99-8                    20000000           839 ns/op         130 B/op          8 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/1000000/0.01-8                   1000000         12194 ns/op        2462 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/1000000/0.20-8                   1000000         12829 ns/op        2540 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/1000000/0.30-8                   1000000         12532 ns/op        2413 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/Get/1000000/0.99-8                   1000000         11354 ns/op        2164 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/100/0.01-8                30000000           460 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/100/0.20-8                30000000           446 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/100/0.30-8                30000000           473 ns/op          46 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/100/0.99-8                20000000           978 ns/op         120 B/op         11 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/10000/0.01-8              10000000          1594 ns/op         243 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/10000/0.20-8              10000000          1554 ns/op         244 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/10000/0.30-8              10000000          1548 ns/op         240 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/10000/0.99-8              20000000           886 ns/op         134 B/op          8 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/1000000/0.01-8             1000000         15485 ns/op        3050 B/op          7 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/1000000/0.20-8              300000         37861 ns/op        7055 B/op          9 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/1000000/0.30-8              300000         49486 ns/op        8154 B/op          9 allocs/op
BenchmarkCacheGetting_withPartialGC/GetWithGC/1000000/0.99-8              200000         55579 ns/op        8959 B/op         13 allocs/op

Repository

Link: https://github.com/thewizardplusplus/go-cache/tree/v1.3.

Content: code.

License: MIT.