AWG-only policy also selected a competing end-to-end plugin, so compatible external links could still have no compatible encrypted data channel. Carrier changes replaced tunnel state and status selected counters from different engines. Use one internal WireGuard plugin and a separate DataCarrier contract for external capabilities/lifecycle. Keep the logical link, keys, handshake, interface and counter epoch across policy, fallback and direct/relay changes. Control/discovery transport selection and membership remain independent. Share the bounded per-neighbour UDP WireGuard engine between ordinary WG and Amnezia masking. Encrypt the relay envelope inside the outer hop channel with fresh pair keys/PSK. Remove duplicate WG key/device code and the TCP/TLS inner cipher. TLS carries opaque internal WireGuard frames. Refuse missing native transports instead of letting default iroh impersonate their protocol names. Probe the actual authenticated carrier, independently of the shared IP tunnel; failed local probe submissions count as loss too. Apply the vendored iroh interface exclusion to actual direct candidates, not just public discovery records. Exclude overlay subnets from introductions and propagate the actual owned interface name, including kernel-assigned utun names, to every carrier. Production logs showed paths through the overlay itself. This removes a recursive transport path; it does not establish the historical cause of the reported 100 GB absolute counter. Exit-node traffic is also real peer IP traffic even when local applications are idle. Hide inner cipher choices/handshake clutter in CLI and tray. Report external routes, readiness and actionable policy/version failures. Count original IP packets only when their ciphertext is accepted by the logical transport, including queued packets' exact unpadded lengths. Exclude physical probes and keepalives. Export counter epochs; sum per-peer rate deltas and discard stale histories so joins/restarts cannot turn old totals into fresh traffic. Status also prints exact IP byte totals for comparison with the tray. Coordinated upgrade: data ALPN 6, internal wireguard-e2e capability v4, wg/awg v2, QUIC carrier v1, TLS v2, local IPC v23. Control ALPN 8, device/network identity derivation, signed records and saved network choices stay unchanged. Keep the historical wg-quic key store; transactionally import missing keys from wg then awg without replacing canonical keys. Forget removes legacy copies too, on the blocking pool, to prevent resurrection after restart. Preserve historic cipher options as shared settings, rejecting contradictory values. Validation on Linux in the Nix development shell: - cargo fmt --all -- --check - cargo clippy --locked --workspace --all-targets -- -D warnings - cargo test --locked --workspace --all-targets (562 passed, 3 ignored) The inherited service socket/secret/group environment overrides were removed for isolated CLI process tests. A new carrier test initially raced the first peer announcement; its deadline polling now waits for a peer row explicitly. Real loopback endpoints, membership, SQLite, WG/AWG/TLS encryption and memory TUNs cover mixed-carrier relaying and one smoltcp TCP connection surviving relay/direct/policy changes and a dropped transmission. Counter tests check exact plaintext lengths, refused sends, epochs, joins and stale histories. Public DHT, privileged kernel and manual benchmark tests remain ignored; macOS/Windows native TUNs, desktop GUI and WAN/DPI behavior were not run.
178 lines
6.0 KiB
Rust
178 lines
6.0 KiB
Rust
//! Scenario 2: several agents find each other, authenticate for real and
|
|
//! exchange distinguishable messages.
|
|
|
|
#![allow(clippy::unwrap_used, clippy::expect_used, clippy::panic)]
|
|
|
|
use std::collections::HashSet;
|
|
use std::sync::Arc;
|
|
|
|
use tsunagi::agent::Event;
|
|
use tsunagi::dataplane::TestCapabilityPlugin;
|
|
use tsunagi::discovery::SharedMemoryDiscovery;
|
|
use tsunagi::proto::ControlMessage;
|
|
use tsunagi::testing::{TestAgent, network, wait_event, wait_for_peers, wait_until};
|
|
|
|
#[tokio::test]
|
|
async fn four_agents_form_a_mesh_and_exchange_distinguishable_messages() {
|
|
let discovery = SharedMemoryDiscovery::new();
|
|
let (name, secret) = network("mesh-of-four");
|
|
|
|
let mut agents = Vec::new();
|
|
for index in 0..4 {
|
|
let hostname = format!("host-{index}");
|
|
agents.push(
|
|
TestAgent::spawn_with(move |cfg| cfg.with_hostname(hostname), &discovery)
|
|
.await
|
|
.unwrap(),
|
|
);
|
|
}
|
|
|
|
let mut network_ids = HashSet::new();
|
|
for agent in &agents {
|
|
network_ids.insert(agent.agent.join_network(&name, &secret).await.unwrap());
|
|
}
|
|
assert_eq!(network_ids.len(), 1, "one deterministic network space");
|
|
let network_id = network_ids.into_iter().next().unwrap();
|
|
|
|
// Full mesh: every agent must end up with the other three.
|
|
for agent in &agents {
|
|
wait_for_peers(&agent.agent, network_id, 3).await;
|
|
}
|
|
|
|
// Each peer announced its own hostname, so sessions are distinguishable.
|
|
// A peer counts as connected as soon as its session is authenticated, which
|
|
// can be a round before its announcement carrying the hostname arrives, so
|
|
// this waits for the hostnames rather than reading them straight away.
|
|
let hostnames: HashSet<String> = wait_until("three distinct peer hostnames", || async {
|
|
let status = agents[0].agent.network_status(network_id).await.ok()?;
|
|
let hostnames: HashSet<String> = status
|
|
.peers
|
|
.iter()
|
|
.filter_map(|peer| peer.hostname.clone())
|
|
.collect();
|
|
(hostnames.len() >= 3).then_some(hostnames)
|
|
})
|
|
.await;
|
|
assert_eq!(
|
|
hostnames.len(),
|
|
3,
|
|
"three distinct hostnames: {hostnames:?}"
|
|
);
|
|
|
|
// Distinguishable request/response: each peer echoes its own sequence.
|
|
let mut events = agents[0].agent.subscribe();
|
|
for (index, peer) in agents.iter().skip(1).enumerate() {
|
|
agents[0]
|
|
.agent
|
|
.send(
|
|
network_id,
|
|
peer.agent.endpoint_id(),
|
|
ControlMessage::Ping {
|
|
seq: index as u64 + 1,
|
|
payload: format!("to-{index}").into_bytes(),
|
|
},
|
|
)
|
|
.await
|
|
.unwrap();
|
|
}
|
|
|
|
let mut seen = HashSet::new();
|
|
while seen.len() < 3 {
|
|
let (peer, seq, payload) = wait_event(&mut events, |event| match event {
|
|
Event::MessageReceived {
|
|
network,
|
|
peer,
|
|
message: ControlMessage::Pong { seq, payload },
|
|
} if *network == network_id => Some((*peer, *seq, payload.clone())),
|
|
_ => None,
|
|
})
|
|
.await;
|
|
assert_eq!(payload, format!("to-{}", seq - 1).into_bytes());
|
|
seen.insert(peer);
|
|
}
|
|
assert_eq!(seen.len(), 3);
|
|
|
|
for agent in agents {
|
|
agent.agent.shutdown().await;
|
|
}
|
|
}
|
|
|
|
#[tokio::test]
|
|
async fn a_late_joiner_is_picked_up_by_the_existing_members() {
|
|
let discovery = SharedMemoryDiscovery::new();
|
|
let (name, secret) = network("late-joiner");
|
|
|
|
let first = TestAgent::spawn(&discovery).await.unwrap();
|
|
let network_id = first.agent.join_network(&name, &secret).await.unwrap();
|
|
|
|
// Nobody else is there yet. That is "nobody found so far", not proof that
|
|
// the network is empty, and the agent is ready regardless.
|
|
let status = first.agent.network_status(network_id).await.unwrap();
|
|
assert!(status.peers.is_empty());
|
|
|
|
let second = TestAgent::spawn(&discovery).await.unwrap();
|
|
second.agent.join_network(&name, &secret).await.unwrap();
|
|
|
|
wait_for_peers(&first.agent, network_id, 1).await;
|
|
wait_for_peers(&second.agent, network_id, 1).await;
|
|
|
|
first.agent.shutdown().await;
|
|
second.agent.shutdown().await;
|
|
}
|
|
|
|
#[tokio::test]
|
|
async fn opaque_plugin_capabilities_cross_the_control_plane() {
|
|
let discovery = SharedMemoryDiscovery::new();
|
|
let (name, secret) = network("capabilities");
|
|
|
|
// An explicitly test-only capability: nothing here advertises WireGuard.
|
|
let plugin_a = Arc::new(TestCapabilityPlugin::new("test-ip", b"payload-a".to_vec()));
|
|
let plugin_b = Arc::new(TestCapabilityPlugin::new("test-ip", b"payload-b".to_vec()));
|
|
|
|
let a = TestAgent::spawn_with(
|
|
{
|
|
let plugin = Arc::clone(&plugin_a);
|
|
move |cfg| cfg.with_tunnel(plugin)
|
|
},
|
|
&discovery,
|
|
)
|
|
.await
|
|
.unwrap();
|
|
let b = TestAgent::spawn_with(
|
|
{
|
|
let plugin = Arc::clone(&plugin_b);
|
|
move |cfg| cfg.with_tunnel(plugin)
|
|
},
|
|
&discovery,
|
|
)
|
|
.await
|
|
.unwrap();
|
|
|
|
let network_id = a.agent.join_network(&name, &secret).await.unwrap();
|
|
b.agent.join_network(&name, &secret).await.unwrap();
|
|
wait_for_peers(&a.agent, network_id, 1).await;
|
|
|
|
let observed = wait_until("plugin a sees b's capability", || {
|
|
let plugin = Arc::clone(&plugin_a);
|
|
async move {
|
|
let seen = plugin.observed();
|
|
if seen.is_empty() { None } else { Some(seen) }
|
|
}
|
|
})
|
|
.await;
|
|
|
|
let (seen_network, seen_peer, capability) = &observed[0];
|
|
assert_eq!(*seen_network, network_id);
|
|
assert_eq!(*seen_peer, b.agent.endpoint_id());
|
|
assert_eq!(capability.protocol, "test-ip");
|
|
assert_eq!(capability.data, b"payload-b".to_vec());
|
|
assert!(capability.enabled);
|
|
|
|
// The core carried the payload without interpreting it.
|
|
let status = a.agent.network_status(network_id).await.unwrap();
|
|
assert_eq!(status.peers[0].capabilities[0].data, b"payload-b".to_vec());
|
|
|
|
a.agent.shutdown().await;
|
|
b.agent.shutdown().await;
|
|
}
|