Trigger rebuild: RAM optimization changes (batch_size=128, n_batch=2048, n_ctx=16384)
Browse files- RAM_OPTIMIZATION_TRIGGER.md +11 -0
RAM_OPTIMIZATION_TRIGGER.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# RAM Optimization Trigger
|
| 2 |
+
# This file triggers a rebuild to apply RAM optimization changes
|
| 3 |
+
# Timestamp: 2025-12-04 12:17:31
|
| 4 |
+
|
| 5 |
+
# Changes applied:
|
| 6 |
+
# - Embedding batch_size: 32 → 128
|
| 7 |
+
# - LLM n_batch: 512 → 2048
|
| 8 |
+
# - LLM n_ctx: 8192 → 16384
|
| 9 |
+
# - Documents retrieved: 8 → 15
|
| 10 |
+
# - Documents in context: 2 → 4
|
| 11 |
+
# - Snippet length: 300 → 500 chars
|