feat(context): tambah context::shaping (port dari shortsend)

Perilaku should_shape/shape_messages tidak berubah, hanya sumber
penghitungan token yang sekarang lewat context::tokens (tiktoken-rs)
menggantikan heuristik char/3 bawaannya sendiri.
This commit is contained in:
asepharyana
2026-07-16 07:55:48 +07:00
parent ea0b498829
commit e080d9fc6b
7 changed files with 8 additions and 4 deletions
+1
View File
@@ -11,6 +11,7 @@
//! `TurnEvent::Compacted`.
pub mod dedup;
pub mod shaping;
pub mod squash;
pub mod tokens;
pub mod window;