Compare commits

..
8 Commits
Author SHA1 Message Date
semantic-release-bot 2596b357ec chore(release): 1.3.5 [skip ci]
## [1.3.5](https://github.com/asepharyana/mytheclipse/compare/v1.3.4...v1.3.5) (2026-08-28)

### Bug Fixes

* **cache:** honor sub-second Redis TTL via PSETEX + document clear() safety ([2c9367a](https://github.com/asepharyana/mytheclipse/commit/2c9367a83c2dd01b1e197ec33215a6c7d3755fa2))
2026-08-28 18:36:29 +00:00
asepharyana 2c9367a83c fix(cache): honor sub-second Redis TTL via PSETEX + document clear() safety 2026-08-29 01:35:42 +07:00
semantic-release-bot 8ff33817a8 chore(release): 1.3.4 [skip ci]
## [1.3.4](https://github.com/asepharyana/mytheclipse/compare/v1.3.3...v1.3.4) (2026-08-28)

### Bug Fixes

* **cache,storage:** harden cache bounds + atomic disk writes ([b6f138b](https://github.com/asepharyana/mytheclipse/commit/b6f138b90d67c9531b5a58993e8ec750e5eec57f))
2026-08-28 18:30:42 +00:00
asepharyana b6f138b90d fix(cache,storage): harden cache bounds + atomic disk writes
CI / Rustfmt (push) Canceled after 0s
CI / Clippy (push) Canceled after 0s
CI / Test (workspace all features) (push) Canceled after 0s
CI / Test (workspace default features) (push) Canceled after 0s
CI / Test (mytheclipse / bg only) (push) Canceled after 0s
CI / Test (mytheclipse / compute only) (push) Canceled after 0s
CI / Test (mytheclipse / io only) (push) Canceled after 0s
CI / Test (mytheclipse / lifecycle only) (push) Canceled after 0s
CI / Test (mytheclipse / observability only) (push) Canceled after 0s
CI / Test (mytheclipse / resiliency only) (push) Canceled after 0s
CI / Test (mytheclipse / traffic only) (push) Canceled after 0s
CI / Test (mytheclipse-cache / l2-redis) (push) Canceled after 0s
CI / Test (mytheclipse-cache / l1-moka) (push) Canceled after 0s
CI / Test (mytheclipse-cache / default) (push) Canceled after 0s
CI / Test (mytheclipse-config / default) (push) Canceled after 0s
CI / Test (mytheclipse-crypto / default) (push) Canceled after 0s
CI / Test (mytheclipse-event / amqp) (push) Canceled after 0s
CI / Test (mytheclipse-event / nats) (push) Canceled after 0s
CI / Test (mytheclipse-event / default (mem)) (push) Canceled after 0s
CI / Test (mytheclipse-storage / gcs) (push) Canceled after 0s
CI / Test (mytheclipse-storage / s3) (push) Canceled after 0s
CI / Test (mytheclipse-storage / default (local)) (push) Canceled after 0s
CI / Run mytheclipse example (push) Canceled after 0s
CI / Docs check (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-cache) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-config) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-crypto) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-event) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-storage) (push) Canceled after 0s
Release / Semantic Release (push) Canceled after 0s
- cache: guard MokaL1::new(0) with panic; add MemoryCache::with_max_entries
  bounded LRU eviction (oldest evicted past cap) + docs warning about
  unbounded default growth. Verifies moka treats max_capacity=0 as a
  permanent no-insert sentinel.
- storage: make LocalFileStorage::put atomic via temp-file + fsync + rename;
  cleans up temp on write failure; no leftover .tmp-* on disk after success.

Tests: 17 cache tests (incl bounded_cache_evicts_oldest, zero_max_panics),
6 storage tests (incl put_leaves_no_temp_file). Full workspace: clippy 0
warnings, all tests green.
2026-08-29 01:29:40 +07:00
semantic-release-bot 4027d3eb17 chore(release): 1.3.3 [skip ci]
## [1.3.3](https://github.com/asepharyana/mytheclipse/compare/v1.3.2...v1.3.3) (2026-08-28)

### Bug Fixes

* **publish:** trim mytheclipse keywords to 5 to satisfy crates.io limit ([5f1e3ac](https://github.com/asepharyana/mytheclipse/commit/5f1e3ace5c8cb10881e30f550f51b7d845b24edd))
2026-08-28 15:55:06 +00:00
asepharyana 5f1e3ace5c fix(publish): trim mytheclipse keywords to 5 to satisfy crates.io limit
crates.io rejects crates with more than 5 keywords (HTTP 400 'expected at
most 5 keywords per crate'), which broke every 'Publish to crates.io'
workflow run. Reduced the mytheclipse crate's keywords from 12 to the 5
most representative (async, concurrency, resiliency, circuit-breaker,
observability).
2026-08-28 22:53:59 +07:00
semantic-release-bot 0f2b776bb8 chore(release): 1.3.2 [skip ci]
## [1.3.2](https://github.com/asepharyana/mytheclipse/compare/v1.3.1...v1.3.2) (2026-08-28)

### Bug Fixes

* **ci:** gate cache & storage crate doctests behind their features ([5717f8a](https://github.com/asepharyana/mytheclipse/commit/5717f8aaaae34cb66cdbfc31f4982c93816ee5a3))
2026-08-28 15:50:48 +00:00
asepharyana 5717f8aaaa fix(ci): gate cache & storage crate doctests behind their features
CI / Rustfmt (push) Canceled after 0s
CI / Clippy (push) Canceled after 0s
CI / Test (workspace all features) (push) Canceled after 0s
CI / Test (workspace default features) (push) Canceled after 0s
CI / Test (mytheclipse / bg only) (push) Canceled after 0s
CI / Test (mytheclipse / compute only) (push) Canceled after 0s
CI / Test (mytheclipse / io only) (push) Canceled after 0s
CI / Test (mytheclipse / lifecycle only) (push) Canceled after 0s
CI / Test (mytheclipse / observability only) (push) Canceled after 0s
CI / Test (mytheclipse / resiliency only) (push) Canceled after 0s
CI / Test (mytheclipse / traffic only) (push) Canceled after 0s
CI / Test (mytheclipse-cache / l2-redis) (push) Canceled after 0s
CI / Test (mytheclipse-cache / l1-moka) (push) Canceled after 0s
CI / Test (mytheclipse-cache / default) (push) Canceled after 0s
CI / Test (mytheclipse-config / default) (push) Canceled after 0s
CI / Test (mytheclipse-crypto / default) (push) Canceled after 0s
CI / Test (mytheclipse-event / amqp) (push) Canceled after 0s
CI / Test (mytheclipse-event / nats) (push) Canceled after 0s
CI / Test (mytheclipse-event / default (mem)) (push) Canceled after 0s
CI / Test (mytheclipse-storage / gcs) (push) Canceled after 0s
CI / Test (mytheclipse-storage / s3) (push) Canceled after 0s
CI / Test (mytheclipse-storage / default (local)) (push) Canceled after 0s
CI / Run mytheclipse example (push) Canceled after 0s
CI / Docs check (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-cache) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-config) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-crypto) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-event) (push) Canceled after 0s
CI / Cargo package dry-run (mytheclipse-storage) (push) Canceled after 0s
Release / Semantic Release (push) Canceled after 0s
Same E0432 class as mytheclipse-event: the crate-root doctests referenced
feature-gated types that are absent in reduced-feature test builds flagged by
the CI matrix.

- mytheclipse-cache: example used MemoryCache (l1-memory) plus
  MultiLayerCache/CacheAside (cache-aside); the l1-moka and l2-redis builds
  (which don't enable cache-aside) failed the doctest. Gated the body behind
  all(l1-memory, cache-aside) with a no-op fallback.
- mytheclipse-storage: example used LocalFileStorage (local feature); the
  gcs and s3 builds failed the doctest. Gated the body behind the local
  feature with a no-op fallback.

Examples remain compile-checked & runnable under default features.
2026-08-28 22:49:39 +07:00
17 changed files with 551 additions and 34 deletions
+28
View File
@@ -1,3 +1,31 @@
## [1.3.5](https://github.com/asepharyana/mytheclipse/compare/v1.3.4...v1.3.5) (2026-08-28)
### Bug Fixes
* **cache:** honor sub-second Redis TTL via PSETEX + document clear() safety ([2c9367a](https://github.com/asepharyana/mytheclipse/commit/2c9367a83c2dd01b1e197ec33215a6c7d3755fa2))
## [1.3.4](https://github.com/asepharyana/mytheclipse/compare/v1.3.3...v1.3.4) (2026-08-28)
### Bug Fixes
* **cache,storage:** harden cache bounds + atomic disk writes ([b6f138b](https://github.com/asepharyana/mytheclipse/commit/b6f138b90d67c9531b5a58993e8ec750e5eec57f))
## [1.3.3](https://github.com/asepharyana/mytheclipse/compare/v1.3.2...v1.3.3) (2026-08-28)
### Bug Fixes
* **publish:** trim mytheclipse keywords to 5 to satisfy crates.io limit ([5f1e3ac](https://github.com/asepharyana/mytheclipse/commit/5f1e3ace5c8cb10881e30f550f51b7d845b24edd))
## [1.3.2](https://github.com/asepharyana/mytheclipse/compare/v1.3.1...v1.3.2) (2026-08-28)
### Bug Fixes
* **ci:** gate cache & storage crate doctests behind their features ([5717f8a](https://github.com/asepharyana/mytheclipse/commit/5717f8aaaae34cb66cdbfc31f4982c93816ee5a3))
## [1.3.1](https://github.com/asepharyana/mytheclipse/compare/v1.3.0...v1.3.1) (2026-08-28)
Generated
+6 -6
View File
@@ -2539,7 +2539,7 @@ dependencies = [
[[package]]
name = "mytheclipse"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"num_cpus",
"rand 0.8.8",
@@ -2551,7 +2551,7 @@ dependencies = [
[[package]]
name = "mytheclipse-cache"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"async-trait",
"moka",
@@ -2564,7 +2564,7 @@ dependencies = [
[[package]]
name = "mytheclipse-config"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"dotenvy",
"notify",
@@ -2579,7 +2579,7 @@ dependencies = [
[[package]]
name = "mytheclipse-crypto"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"aead",
"aes-gcm",
@@ -2596,7 +2596,7 @@ dependencies = [
[[package]]
name = "mytheclipse-event"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"async-nats",
"async-trait",
@@ -2612,7 +2612,7 @@ dependencies = [
[[package]]
name = "mytheclipse-storage"
version = "1.3.1"
version = "1.3.5"
dependencies = [
"async-trait",
"aws-config",
File diff suppressed because one or more lines are too long
+1 -1
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse-cache"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
+6 -1
View File
@@ -17,9 +17,12 @@
//!
//! ## Example
//!
//! Multi-layer + cache-aside composition (default features):
//!
//! ```no_run
//! use mytheclipse_cache::{Cache, MemoryCache, MultiLayerCache, CacheAside};
//! # #[cfg(all(feature = "l1-memory", feature = "cache-aside"))]
//! # async fn run() {
//! use mytheclipse_cache::{Cache, MemoryCache, MultiLayerCache, CacheAside};
//! let l1 = MemoryCache::new();
//! let l2 = MemoryCache::new(); // in a real app: a RedisCache
//! let cache = MultiLayerCache::new(l1, l2);
@@ -34,6 +37,8 @@
//! );
//! let _v = aside.get("orders:42").await.unwrap();
//! # }
//! # #[cfg(not(all(feature = "l1-memory", feature = "cache-aside")))]
//! # fn run() {}
//! ```
#![forbid(unsafe_code)]
+86 -8
View File
@@ -4,7 +4,7 @@
//! Entries are lazily expired on access by comparing against `Instant`; a
//! monotonic clock keeps TTLs robust against wall-clock discontinuities.
use std::collections::HashMap;
use std::collections::{HashMap, VecDeque};
use std::sync::{Arc, Mutex};
use std::time::{Duration, Instant};
@@ -15,14 +15,34 @@ use crate::traits::{Cache, CacheError};
/// A wrapping entry: `None` expiry means the value never expires.
type Entry = (Vec<u8>, Option<Instant>);
/// An in-process [`Cache`] implementation for L1 caching.
#[derive(Clone, Default)]
/// An in-process [`Cache`] for L1 caching.
///
/// Default instance is **unbounded** — it grows until the process runs out of
/// memory. For memory-constrained workloads, use [`MemoryCache::with_max_entries`]
/// to install a simple LRU-style cap: when the cap is exceeded, the oldest
/// (least-recently-inserted) entry is evicted.
#[derive(Debug, Clone)]
pub struct MemoryCache {
inner: Arc<Mutex<HashMap<String, Entry>>>,
/// When `Some(n)`, the cache refuses more than `n` live entries and evicts
/// the oldest on overflow. `None` = unbounded (legacy default).
max_entries: Option<usize>,
/// Insertion order, for eviction when `max_entries` is set.
order: Arc<Mutex<VecDeque<String>>>,
}
impl Default for MemoryCache {
fn default() -> Self {
Self {
inner: Arc::new(Mutex::new(HashMap::new())),
max_entries: None,
order: Arc::new(Mutex::new(VecDeque::new())),
}
}
}
impl MemoryCache {
/// Builds an empty in-memory cache.
/// Builds an empty in-memory cache (unbounded by default).
pub fn new() -> Self {
Self::default()
}
@@ -32,6 +52,23 @@ impl MemoryCache {
self.inner.lock().unwrap().reserve(capacity);
self
}
/// Installs a bounded LRU-style cap. When the cache exceeds `max`, the
/// oldest (least-recently-inserted) entry is evicted on each `set`.
///
/// This is the recommended constructor for production L1 caches: a
/// [`MemoryCache::new()`] (unbounded) left unmanaged can grow without bound
/// and exhaust process memory.
pub fn with_max_entries(mut self, max: usize) -> Self {
assert!(max > 0, "mytheclipse-cache: with_max_entries must be > 0");
self.max_entries = Some(max);
self
}
/// The configured max entries, if any.
pub fn max_entries(&self) -> Option<usize> {
self.max_entries
}
}
#[async_trait]
@@ -41,6 +78,7 @@ impl Cache for MemoryCache {
match map.get(key) {
Some((value, Some(expires))) if *expires <= Instant::now() => {
map.remove(key);
self.remove_order(key);
Ok(None)
}
Some((value, _)) => Ok(Some(value.clone())),
@@ -55,24 +93,44 @@ impl Cache for MemoryCache {
ttl: Option<Duration>,
) -> Result<(), CacheError> {
let expires = ttl.map(|d| Instant::now() + d);
self.inner
.lock()
.unwrap()
.insert(key.to_string(), (value, expires));
let mut map = self.inner.lock().unwrap();
let is_new = !map.contains_key(key);
map.insert(key.to_string(), (value, expires));
if is_new {
let mut order = self.order.lock().unwrap();
order.push_back(key.to_string());
if let Some(cap) = self.max_entries {
while order.len() > cap {
if let Some(oldest) = order.pop_front() {
map.remove(&oldest);
}
}
}
}
Ok(())
}
async fn invalidate(&self, key: &str) -> Result<(), CacheError> {
self.inner.lock().unwrap().remove(key);
self.remove_order(key);
Ok(())
}
async fn clear(&self) -> Result<(), CacheError> {
self.inner.lock().unwrap().clear();
self.order.lock().unwrap().clear();
Ok(())
}
}
impl MemoryCache {
/// Removes `key` from the insertion-order deque (if present).
fn remove_order(&self, key: &str) {
let mut order = self.order.lock().unwrap();
order.retain(|k| k != key);
}
}
/// A typed view over a byte cache using `serde`-compatible (JSON) encoding.
///
/// Only enabled with the `cache-aside` feature, which pulls in `serde`.
@@ -158,6 +216,26 @@ mod tests {
assert_eq!(c.get("b").await.unwrap(), None);
}
/// Asserts that an unbounded `MemoryCache::with_max_entries(0)` panics,
/// preventing a no-op cache that accepts zero entries.
#[test]
#[should_panic(expected = "must be > 0")]
fn zero_max_panics() {
let _ = MemoryCache::new().with_max_entries(0);
}
#[tokio::test]
async fn bounded_cache_evicts_oldest() {
let c = MemoryCache::new().with_max_entries(2);
c.set("a", b"1".to_vec(), None).await.unwrap();
c.set("b", b"2".to_vec(), None).await.unwrap();
c.set("c", b"3".to_vec(), None).await.unwrap();
// "a" (oldest) should have been evicted.
assert_eq!(c.get("a").await.unwrap(), None);
assert_eq!(c.get("b").await.unwrap(), Some(b"2".to_vec()));
assert_eq!(c.get("c").await.unwrap(), Some(b"3".to_vec()));
}
#[cfg(feature = "cache-aside")]
#[tokio::test]
async fn typed_cache_roundtrip() {
+26 -2
View File
@@ -19,7 +19,22 @@ pub struct MokaL1 {
impl MokaL1 {
/// Builds a Moka cache with `max_capacity` entries and an optional default
/// `ttl`.
///
/// # Panics
///
/// Panics if `max_capacity` is `0`. In Moka, a `max_capacity` of `0` is a
/// sentinel for **zero-entries-allowed** — every `insert` is silently
/// dropped — which is almost certainly a caller mistake (the natural way to
/// express "unbounded" in other caches). Pass `1..=u64::MAX`; use
/// [`MemoryCache`](crate::memory::MemoryCache) if you truly need an
/// unbounded in-process cache.
pub fn new(max_capacity: u64, ttl: Option<Duration>) -> Self {
assert!(
max_capacity > 0,
"mytheclipse-cache: MokaL1::new(max_capacity) must be > 0; \
moka treats 0 as a permanent no-insert sentinel. \
Use MemoryCache for an unbounded cache."
);
let mut builder = MokaCache::builder().max_capacity(max_capacity);
if let Some(ttl) = ttl {
builder = builder.time_to_live(ttl);
@@ -36,14 +51,15 @@ impl Cache for MokaL1 {
Ok(self.inner.get(key).await)
}
/// Inserts `value`, using the cache's configured TTL policy. The per-call
/// `ttl` argument is intentionally ignored — Moka applies a single TTL
/// configured on the builder, and per-entry overrides are not exposed here.
async fn set(
&self,
key: &str,
value: Vec<u8>,
_ttl: Option<Duration>,
) -> Result<(), CacheError> {
// Per-entry TTL overrides are handled by the builder default in Moka;
// the passed `ttl` is intentionally ignored (single configured policy).
self.inner.insert(key.to_string(), value).await;
Ok(())
}
@@ -83,6 +99,14 @@ mod tests {
assert_eq!(c.get("b").await.unwrap(), None);
}
/// Asserts that `max_capacity == 0` panics with a clear message, rather
/// than silently creating a cache that never accepts entries.
#[test]
#[should_panic(expected = "must be > 0")]
fn zero_capacity_panics() {
let _ = MokaL1::new(0, None);
}
#[tokio::test]
async fn ttl_does_expire() {
// Keep a firm TTL assertion; sleep well past the expiry window.
+19 -5
View File
@@ -69,8 +69,18 @@ impl Cache for RedisCache {
let k = self.key(key);
match ttl {
Some(ttl) => {
let secs = ttl.as_secs().max(1);
let result: Result<(), RedisError> = c.set_ex(&k, value, secs).await;
// Use millisecond precision (PSETEX) so sub-second TTLs are
// honored faithfully. Previously `set_ex(seconds.max(1))`
// rounded anything < 1s up to 1s, silently changing expiry
// semantics for short-lived cache entries.
let ms = ttl.as_millis();
if ms == 0 {
return Err(CacheError::Key(
"ttl of 0ms not allowed — pass None to store permanently".into(),
));
}
let ms = ms as u64;
let result: Result<(), RedisError> = c.pset_ex(&k, value, ms).await;
result.map_err(map_err)
}
None => {
@@ -88,9 +98,13 @@ impl Cache for RedisCache {
}
async fn clear(&self) -> Result<(), CacheError> {
// Deliberately does nothing: `FLUSHALL`/`FLUSHDB` are dangerous on a
// shared instance. Consumers should scope keys under a prefix and call
// `invalidate` for the keys they own.
// Deliberately does nothing: a blind `FLUSHDB`/`FLUSHALL` on a shared
// Redis instance would destroy keys owned by other consumers.
// Consumers that need a true wipe must either (a) use a dedicated Redis
// DB / namespace prefix they own exclusively, or (b) call
// `invalidate` per-key for the keys they manage.
//
// See: https://redis.io/commands/flushdb/ (no key-scoping)
Ok(())
}
}
File diff suppressed because one or more lines are too long
+1 -1
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse-config"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
+1 -1
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse-crypto"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
+1 -1
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse-event"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
File diff suppressed because one or more lines are too long
+1 -1
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse-storage"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
+10 -3
View File
@@ -15,15 +15,22 @@
//!
//! ## Example
//!
//! ```
//! use mytheclipse_storage::{LocalFileStorage, StorageDriver, bytes_stream, read_to_vec};
//! # #[tokio::main] async fn main() {
//! Local disk storage (`local` feature, default):
//!
//! ```no_run
//! use mytheclipse_storage::{StorageDriver, bytes_stream, read_to_vec};
//! # #[cfg(feature = "local")]
//! # #[tokio::main]
//! # async fn main() {
//! use mytheclipse_storage::LocalFileStorage;
//! # let dir = tempfile::tempdir().unwrap();
//! let storage = LocalFileStorage::new(dir.path());
//! storage.put("hello.txt", bytes_stream(b"hi".to_vec())).await.unwrap();
//! let data = read_to_vec(storage.get("hello.txt").await.unwrap()).await.unwrap();
//! assert_eq!(data, b"hi");
//! # }
//! # #[cfg(not(feature = "local"))]
//! # fn main() {}
//! ```
pub mod traits;
+42 -2
View File
@@ -22,6 +22,11 @@ impl LocalFileStorage {
Self { root: root.into() }
}
/// Returns the root directory path.
pub fn root(&self) -> &std::path::Path {
&self.root
}
fn resolve(&self, path: &str) -> Result<PathBuf, StorageError> {
let rel = Path::new(path.trim_start_matches('/'));
for component in rel.components() {
@@ -52,14 +57,30 @@ impl StorageDriver for LocalFileStorage {
if let Some(parent) = full.parent() {
tokio::fs::create_dir_all(parent)
.await
.map_err(|e| StorageError::Io(e.to_string()))?;
.map_err(|e| StorageError::Io(e.to_string()))?
}
let mut file = tokio::fs::File::create(&full)
// Write to a sibling temp file then atomically rename. On POSIX this is
// atomic, so a crash mid-write leaves *either* the previous file *or*
// the complete new file — never a half-written truncated object.
// Use a PID-unguarded temp name and clean it up if anything fails.
let tmp = full.with_extension(format!(".tmp-{}", std::process::id()));
let mut file = tokio::fs::File::create(&tmp)
.await
.map_err(|e| StorageError::Io(e.to_string()))?;
let written = tokio::io::copy(&mut data, &mut file)
.await
.map_err(|e| {
let _ = std::fs::remove_file(&tmp);
StorageError::Io(e.to_string())
})?;
// Ensure durability: flush to OS, fsync, then rename.
tokio::fs::File::open(&tmp)
.await
.map_err(|e| StorageError::Io(e.to_string()))?
.sync_all()
.await
.map_err(|e| StorageError::Io(e.to_string()))?;
std::fs::rename(&tmp, &full).map_err(|e| StorageError::Io(e.to_string()))?;
Ok(written)
}
@@ -162,4 +183,23 @@ mod tests {
.unwrap_err();
assert!(matches!(err, StorageError::InvalidPath(_)));
}
/// Verifies the atomic-write contract: after a successful `put`, the temp
/// file must not linger on disk.
#[tokio::test]
async fn put_leaves_no_temp_file() {
let (storage, _dir) = driver();
storage
.put("clean.txt", bytes_stream(b"data".to_vec()))
.await
.unwrap();
// No `*.tmp-*` files should remain in the root after a clean write.
let leftover: Vec<_> = std::fs::read_dir(storage.root())
.unwrap()
.filter_map(|e| e.ok())
.map(|e| e.file_name())
.filter(|n| n.to_string_lossy().contains(".tmp-"))
.collect();
assert!(leftover.is_empty(), "temp files left behind: {leftover:?}");
}
}
+2 -2
View File
@@ -1,6 +1,6 @@
[package]
name = "mytheclipse"
version = "1.3.1"
version = "1.3.5"
edition = "2021"
rust-version = "1.75"
license = "MIT OR Apache-2.0"
@@ -10,7 +10,7 @@ documentation = "https://docs.rs/mytheclipse"
authors = ["asepharyana <superaseph@gmail.com>"]
description = "Resource-aware abstractions for async I/O, heavy compute, background queue management, resiliency, traffic control, lifecycle, and observability."
readme = "README.md"
keywords = ["async", "concurrency", "rayon", "tokio", "resource-management", "resiliency", "retry", "circuit-breaker", "rate-limit", "observability", "cron", "shutdown"]
keywords = ["async", "concurrency", "resiliency", "circuit-breaker", "observability"]
categories = ["asynchronous", "concurrency", "rust-patterns"]
[dependencies]