davidtran999 commited on
Commit
1aa0af9
·
verified ·
1 Parent(s): cca318f

Trigger rebuild: RAM optimization changes (batch_size=128, n_batch=2048, n_ctx=16384)

Browse files
Files changed (1) hide show
  1. RAM_OPTIMIZATION_TRIGGER.md +11 -0
RAM_OPTIMIZATION_TRIGGER.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # RAM Optimization Trigger
2
+ # This file triggers a rebuild to apply RAM optimization changes
3
+ # Timestamp: 2025-12-04 12:17:31
4
+
5
+ # Changes applied:
6
+ # - Embedding batch_size: 32 → 128
7
+ # - LLM n_batch: 512 → 2048
8
+ # - LLM n_ctx: 8192 → 16384
9
+ # - Documents retrieved: 8 → 15
10
+ # - Documents in context: 2 → 4
11
+ # - Snippet length: 300 → 500 chars