====== Bimodal Caching ====== ===== Participants ===== * Steven Lyons * Raju Rangaswami * Jason Liu * Leonardo Marmol * Ricardo Santana ===== Project Goals ===== Workload stability is not addressed in current caching policies. We need a new one. ===== Results ===== ==== Homes Trace ==== [[Results|Miss-rate Analysis]] [[Results (Multiple)|Miss-rate Analysis for Multiple Traces]] [[Results Derivatives|Derivatives of Miss-Rate Analysises]] [[Results Derivatives (Multiple)|Derivatives of Miss-Rate Analysises For Multiple Cache Sizes]] [[Results Levels|Ranking of Miss-Rate Derivatives]] [[Results Averaged|Miss-rate Analysis using Averages]] ==== Online and Web Traces ==== [[Casa Results|Miss Rate and Derivative Analysis of Casa Traces]] [[Ikki Results|Miss Rate and Derivative Analysis of Ikki Traces]] [[Madmax Results|Miss Rate and Derivative Analysis of Madmax Traces]] [[Topgun Results|Miss Rate and Derivative Analysis of Topgun Traces]] [[Online Results|Miss Rate and Derivative Analysis of Online Traces]] [[WebMail Results|Miss Rate and Derivative Analysis of WebMail Traces]] [[WebMail+Online Results|Miss Rate and Derivative Analysis of WebMail+Online Traces]] [[WebResearch Results|Miss Rate and Derivative Analysis of WebResearch Traces]] [[WebUsers Results|Miss Rate and Derivative Analysis of WebUsers Traces]] ==== Working Set ===== [[Working Set Sizes|Working Set Sizes]] ==== Cambridge Traces ==== [[HM Results|Analysis of HM Traces]] [[MDS Results|Analysis of MDS Traces]] [[PRN Results|Analysis of PRN Traces]] [[PROJ Results|Analysis of PROJ Traces]] [[PRXY Results|Analysis of PRXY Traces]] [[RSRCH Results|Analysis of RSRCH Traces]] [[SRC1 Results|Analysis of SRC1 Traces]] [[SRC2 Results|Analysis of SRC2 Traces]] [[STG Results|Analysis of STG Traces]] [[TS Results|Analysis of TS Trace]] [[USR Results|Analysis of USR Traces]] [[WDEV Results|Analysis of WDEV Traces]] [[WEB Results|Analysis of WEB Traces]] [[Special Results|Special Cases for Turning off Cache Replacement Policy]] ===== Summary Graphs ===== [[HM Summary|Summary of HM Traces]] [[MDS Summary|Summary of MDS Traces]] [[PRN Summary|Summary of PRN Traces]] [[PROJ Summary|Summary of PROJ Traces]] [[PRXY Summary|Summary of PRXY Traces]] [[RSRCH Summary|Summary of RSRCH Traces]] [[SRC1 Summary|Summary of SRC1 Traces]] [[SRC2 Summary|Summary of SRC2 Traces]] [[STG Summary|Summary of STG Traces]] [[TS Summary|Summary of TS Trace]] [[USR Summary|Summary of USR Traces]] [[WDEV Summary|Summary of WDEV Traces]] [[WEB Summary|Summary of WEB Traces]] ===== Ghost LRU ===== [[HM Set Phase|HM]] [[MDS Set Phase|MDS]] [[PRN Set Phase|PRN]] [[PROJ Set Phase|PROJ]] [[PRXY Set Phase|PRXY]] [[RSRCH Set Phase|RSRCH]] [[SRC1 Set Phase|SRC1]] [[SRC2 Set Phase|SRC2]] [[STG Set Phase|STG]] [[TS Set Phase|TS]] [[USR Set Phase|USR]] [[WDEV Set Phase|WDEV]] [[WEB Set Phase|WEB]] ===== Frequency Distribution ===== [[Freq Dist|Graphs]] ===== ARC Event Visualization ===== [[ARC Visual|Graphs]] ===== ARC and LARC Miss Visualization ===== [[ARC Miss Visual|Miss Graphs]] ===== Meetings ===== * 07/02/15: New plots; Updates on kernel module {{{{internal:projects:cp:cp070215.mp3|mp3}} * 06/30/15: Analysis discussion; new write-rate data {{{{internal:projects:cp:cp063015.mp3|mp3}} * 06/26/15: Updates on kernel module; Multi-level cache partitioning {{{{internal:projects:cp:cp062615.mp3|mp3}} * 06/23/15: Initial MARC-Adaptive numbers for FIU and MSR {{{{internal:projects:cp:cp062315.mp3|mp3}} * 06/19/15: Webusers deep-dive + module update {{{{internal:projects:cp:cp061915.mp3|mp3}} * 06/16/15: MSR OPT and OPT-F data {{{{internal:projects:cp:cp061615.mp3|mp3}} * 06/16/15: TBD {{{{internal:projects:cp:cp061615b.mp3|mp3}} * 06/12/15: A-U plots, motivation {{{{internal:projects:cp:cp061215.mp3|mp3}} * 06/09/15: Updates on OPT results and ARC analysis brainstorming {{{{internal:projects:cp:cp060915.mp3|mp3}} * 06/05/15: (Evening) Paper discussion (intro/motivation) {{{{internal:projects:cp:cp060515b.mp3|mp3}} * 06/05/15: Sensitivity data for sample size with mARC {{{{internal:projects:cp:cp060515.mp3|mp3}} * 06/02/15: Algorithm discussion {{{{internal:projects:cp:cp052215.mp3|mp3}} * 05/22/15: Module, analysis, and OPT discussion {{{{internal:projects:cp:cp052215.mp3|mp3}} * 05/15/15: Adaptive mARC -- new ideas {{{{internal:projects:cp:cp051515.mp3|mp3}} * 05/12/15: Brainstorming Adaptive with Giri{{{{internal:projects:cp:cp051215.mp3|mp3}} * 05/08/15: HotStorage final version plans (Ricardo delivers on Tuesday) + clarification of Oracle {{{{internal:projects:cp:cp050815.mp3|mp3}} * 05/05/15: HotStorage Final version plans and Discussion of Oracle Algorithm {{{{internal:projects:cp:cp050515.mp3|mp3}} * 04/24/15: HotStorage final version paper improvement plan {{{{internal:projects:cp:cp042415.mp3|mp3}} * 04/17/15: Making m-ARC fully adaptive! {{{{internal:projects:cp:cp041715.mp3|mp3}} * 04/14/15: Updates on m-ARC windowing and module {{{{internal:projects:cp:cp041415.mp3|mp3}} * 04/07/15: Updates on module {{{{internal:projects:cp:cp040715.mp3|mp3}} * 04/03/15: Updates on module, testbed, and m-ARC improvement plans {{{{internal:projects:cp:cp040315.mp3|mp3}} * 03/31/15: Full paper plans (storyline); kernel module status in development {{{{internal:projects:cp:cp033115.mp3|mp3}} * 03/27/15: Algorithm change plans and module implementation updates {{{{internal:projects:cp:cp032715.mp3|mp3}} * 03/24/15: ACM SOCC - submission plans and task list {{{{internal:projects:cp:cp032415.mp3|mp3}} * 03/20/15: ACM SOCC - submission plans and task list {{{{internal:projects:cp:cp032015.mp3|mp3}} * 03/16/15: HotStorage15 submission final tasks {{{{internal:projects:cp:cp031615.mp3|mp3}} * 03/06/15: HotStorage15 paper status and plans {{{{internal:projects:cp:cp030615.mp3|mp3}} * 03/05/15: HotStorage15 paper status and plans {{{{internal:projects:cp:cp030515.mp3|mp3}} * 03/03/15: HotStorage15 paper status and plans {{{{internal:projects:cp:cp030315.mp3|mp3}} * 02/27/15: HotStorage15 paper status and plans {{{{internal:projects:cp:cp022715.mp3|mp3}} * 02/24/15: TBD {{{{internal:projects:cp:cp022415.mp3|mp3}} * 02/13/15: TBD {{{{internal:projects:cp:cp021315.mp3|mp3}} * 02/10/15: TBD {{{{internal:projects:cp:cp021015.mp3|mp3}} * 02/06/15: TBD {{{{internal:projects:cp:cp020615.mp3|mp3}} * 01/27/15: TBD {{{{internal:projects:cp:cp012715.mp3|mp3}} * 01/23/15: New latency data discussion {{{{internal:projects:cp:cp012315.mp3|mp3}} * 01/20/15: Latency data {{{{internal:projects:cp:cp012015.mp3|mp3}} * 01/16/15: General updates {{{{internal:projects:cp:cp011615.mp3|mp3}} * 01/08/15: Updates and next steps for paper writing / data generation {{{{internal:projects:cp:cp010815.mp3|mp3}} * 12/19/14: Steven discussion of new ideas {{{{internal:projects:cp:cp121914.mp3|mp3}} * 12/16/14: Paper writing tasks {{{{internal:projects:cp:cp121614.mp3|mp3}} * 12/12/14: Cost model discussion {{{{internal:projects:cp:cp121214.mp3|mp3}} * 12/09/14: Santana overview (Koller joins in) {{{{internal:projects:cp:cp120914b.mp3|mp3}} * 12/09/14: Updates from Steven on the stats work and plots {{{{internal:projects:cp:cp120914.mp3|mp3}} * 12/02/14: Ricardo new plots; Steven/Andy on trace processing {{{{internal:projects:cp:cp120214.mp3|mp3}} * 11/14/14: Ricardo/Andy updates; Asana project management overview discussion {{{{internal:projects:cp:cp111414.mp3|mp3}} * 11/06/14: Paper outline (partial review) and writing plans {{{{internal:projects:cp:cp110614.mp3|mp3}} * 10/31/14: Ricardo's paper storyline and writing tasks {{{{internal:projects:cp:cp103114.mp3|mp3}} * 10/21/14: Steven updates {{{{internal:projects:cp:cp102414.mp3|mp3}} * 10/17/14: Andy Martinez introduction; Steven updates {{{{internal:projects:cp:cp101714.mp3|mp3}} * 10/10/14: Ricardo updates {{{{internal:projects:cp:cp101014.mp3|mp3}} * 10/03/14: Revisiting rules for bimodal caching {{{{internal:projects:cp:cp100314.mp3|mp3}} * 09/30/14: Updates on new data from Ricardo {{{{internal:projects:cp:cp093014.mp3|mp3}} * 09/29/14: Tabulation of motivation rules for Bimodal Caching {{{{internal:projects:cp:cp092914.mp3|mp3}} * 09/16/14: Progress status {{{{internal:projects:cp:cp091614.mp3|mp3}} * 09/09/14: Ricardo's new algorithm {{{{internal:projects:cp:cp090914.mp3|mp3}} * 09/05/14: Workload modeling introduction by Jason {{{{internal:projects:cp:cp090514.mp3|mp3}} * 09/02/14: New algorithm discussion {{{{internal:projects:cp:cp090214.mp3|mp3}} * 08/28/14: Discussion with Jason on workload modeling {{{{internal:projects:cp:cp082814.mp3|mp3}} * 08/26/14: (Steven, Jason) Modeling workloads and stability; entry/exit conditions for stability {{{{internal:projects:cp:cp082614.mp3|mp3}} * 08/21/14: (Ricardo) Outcome of miss/hit count variants not as good as original R-ARC {{{{internal:projects:cp:cp082114.mp3|mp3}} * 08/19/14: (Steven, Ricardo) Reducing False positive detection of stability {{{{internal:projects:cp:cp081914b.mp3|mp3}} * 08/19/14: (Ricardo) New data and plans {{{{internal:projects:cp:cp081914.mp3|mp3}} * 08/12/14: Stability metrics? Analyzing ARC events {{{{internal:projects:cp:cp081214.mp3|mp3}} * 08/08/14: Rank-based bimodal caching (brainstorming) {{{{internal:projects:cp:cp080814.mp3|mp3}} * 08/05/14: Motivation section (observations) {{{{internal:projects:cp:cp080514.mp3|mp3}} [[internal:projects:cp:whiteboard:start|(whiteboard)]] * 07/29/14: Reuse stability within a phase (data) {{{{internal:projects:cp:cp072914.mp3|mp3}} * 07/22/14: Motivating stability; phase detection techniques; writes vs. reads; etc. {{{{internal:projects:cp:cp072214.mp3|mp3}} * 07/15/14: New data for motivating bimodal arc {{{{internal:projects:cp:cp071514.mp3|mp3}} * 07/08/14: Bimodal arc data collection plans {{{{internal:projects:cp:cp070814.mp3|mp3}} * 07/01/14: New graphs and new directions with dynamic granularity and shadow ARC within Bimodal ARC {{{{internal:projects:cp:cp070114.mp3|mp3}} * 06/10/14: Examining warm-up data and initial review of paper draft; miss-rate seems buggy {{{{internal:projects:cp:cp061014.mp3|mp3}} * 06/06/14: Evaluating variants (always populate if space vs. not); next step: warming up caches {{{{internal:projects:cp:cp060614.mp3|mp3}} * 05/27/14: Initial ARC data -- how about enabling population if we have cache space? {{{{internal:projects:cp:cp052714.mp3|mp3}} * 04/29/14: (Steven) Paper storyine brainstorming {{{{internal:projects:cp:cp042914.mp3|mp3}} * 04/24/14: (Ricardo) New algorithms and paper outline! {{{{internal:projects:cp:cp042414.mp3|mp3}} * 04/22/14: Brainstorming and Recap of new algorithms {{{{internal:projects:cp:cp042214.mp3|mp3}} * 04/15/14: New data and algorithm {{{{internal:projects:cp:cp041514.mp3|mp3}} * 04/08/14: Data for miss/hit sequence lengths, sensitivity to fixed threshold {{{{internal:projects:cp:cp040814.mp3|mp3}} * 04/01/14: More data analysis and new algorithm? {{{{internal:projects:cp:cp040114.mp3|mp3}} * 03/25/14: Brainstorming and results from 15% fixed threshold; next step is to explore stability based trigger {{{{internal:projects:cp:cp032514.mp3|mp3}} * 03/18/14: Brainstorming ideas for working-set and cache usage modeling {{{{internal:projects:cp:cp031814b.mp3|mp3}} * 03/18/14: Initial results with coarse-grained threshold-based on/off for caching; plans for new experiments {{{{internal:projects:cp:cp031814.mp3|mp3}} * 03/11/14: Revisiting caching algorithm and new miss-rate data (multi-day) {{{{internal:projects:cp:cp031114.mp3|mp3}} * 03/04/14: 1GB = 16GB for miss-rates? Modeling working-sets and other things {{{{internal:projects:cp:cp030414.mp3|mp3}} * 02/25/14: 4GB caches with individual workloads is still high miss-rate for most; how does background I/O activity affect phase detection (e.g., pdflush and kjournald)? {{{{internal:projects:cp:cp022514.mp3|mp3}} * 02/11/14: Discussion of write-policies; Cache sizes for individual traces needs to be increased {{{{internal:projects:cp:cp021114.mp3|mp3}} * 02/04/14: Analyzing individual workloads instead of combined {{{{internal:projects:cp:cp020414.mp3|mp3}} * 01/30/14: New averaging discussion {{{{internal:projects:cp:cp013014.mp3|mp3}} * 01/28/14: Back to basics {{{{internal:projects:cp:cp012814.mp3|mp3}} * 01/21/14: Filtering derivative peaks and possible next steps {{{{internal:projects:cp:cp012114.mp3|mp3}} * 01/14/14: What are we missing in detecting phases? {{{{internal:projects:cp:cp011414.mp3|mp3}} * 01/07/14: More miss-rate histograms; detecting phases with derivative plots {{{{internal:projects:cp:cp010714.mp3|mp3}} * 01/03/14: Analyzing miss-rate histograms; defining averaging granularities for detecting phases {{{{internal:projects:cp:cp010314.mp3|mp3}} * 12/23/13: What is phase stability? {{{{internal:projects:cp:cp122313.mp3|mp3}} * 12/13/13: Updates on using new LRU simulator code, tuning cache size, averaging window size {{{{internal:projects:cp:cp121313.mp3|mp3}} * 12/04/13: Project goals revisited and bug finding {{{{internal:projects:cp:cp120413.mp3|mp3}} * 11/15/13: Project goal and current direction {{{{internal:projects:cp:cp111513.mp3|mp3}}