Case
aiosendspin -> SendspinKit
Start the server first, then the client. The server uses aiosendspin's allow_unencrypted mode to test clients that do not yet support the required Noise handshake. This mode is outside the spec and sends traffic without encryption. The test can be removed once all tracked implementations support the Noise handshake.
Server
aiosendspin
Client
SendspinKit
Status
Passed
PCM hashes match exactly
Server activation
Initial server/activate
What the aiosendspin server's own adapter recorded for its first server/activate on this connection, reported as sent. The case fails when none was sent, when its activities are not unique values from playback and pairing, or when it omits active_roles. Nothing else in it is checked against the specification: which activities and roles the matched PSK allows is not judged. A recording that cannot be read as that message is shown whole and not judged either.
Server group state
Every group/update after activation
What the aiosendspin server's own adapter recorded for each group/update it sent after its first server/activate on this connection, in order and reported as sent. The case fails when none followed, or when in any of them playback_state is not playing or stopped, or group_id or group_name is missing or not a string. How soon the first followed is not judged, because the specification says promptly and gives no bound, so one sent at any point in the case counts. Whether a change to a field produced a further message is not judged either. A recording of anything other than that message is shown whole and fails the case as a harness gap.
1 of 3
2 of 3
3 of 3
Inspection
Summaries, logs, and builds
Matrix result
RAW{
"case_dir": "artifacts/results/data/macos__server-initiated-legacy-unencrypted__aiosendspin__to__SendspinKit",
"client_exit_code": 0,
"client_impl": "SendspinKit",
"reason": "PCM hashes match exactly",
"scenario_id": "server-initiated-legacy-unencrypted",
"scenario_revision": 6,
"server_exit_code": 0,
"server_impl": "aiosendspin",
"status": "passed",
"unsupported": false
}Server summary (JSON)
RAW{
"activation": {
"payload": {
"active_roles": [
"player@v1"
],
"activities": [
"playback"
]
},
"type": "server/activate"
},
"audio": {
"bit_depth": 16,
"channels": 1,
"clip_seconds": 5.0,
"duration_seconds": 5.0,
"fixture": "/Users/runner/work/conformance/conformance/repos/sendspin-cli/tests/fixtures/almost_silent.flac",
"frame_alignment_samples": null,
"frame_count": 40000,
"sample_rate": 8000,
"sent_audio_chunk_count": 200,
"sent_codec_header_sha256": null,
"sent_encoded_byte_count": 80000,
"sent_encoded_sha256": "b3481a3f75dea856a961e7842d12f8344c7147b3925f9f0b67c5445700bd4cf2",
"source_flac_sha256": "8fdda8244e318c63cd8b699fe461cd7cdddbb729327a0ba00d1bfdbe2192fe17",
"source_pcm_sha256": "9d447b5b270bc99b45bb9a616937e436c941ca56c477f9cbe16a93275a6b059e",
"trimmed_source_frames": 0
},
"availability_trace": [
{
"available": true,
"type": "client/state"
},
{
"phase": "sending",
"roles": [
"player"
],
"type": "stream/start"
},
{
"phase": "sent",
"roles": [
"player"
],
"type": "stream/start"
},
{
"available": true,
"type": "client/state"
},
{
"available": true,
"type": "client/state"
}
],
"client": {
"active_roles": [],
"client_id": "tU1Esni2EmRehX3Habvj2ab9UJ9CiTNFUrKb0wTimyM",
"name": "SendspinKit-client",
"supported_roles": [
"player@v1"
]
},
"discovery_method": "registry_fallback",
"group_updates": [
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "stopped"
},
"type": "group/update"
},
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "playing"
},
"type": "group/update"
},
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "stopped"
},
"type": "group/update"
}
],
"implementation": "aiosendspin",
"initiator_role": "server",
"peer_hello": {
"payload": {
"device_info": {
"manufacturer": "Apple",
"product_name": "Mac",
"software_version": "Version 26.6.2 (Build 25G83)"
},
"name": "SendspinKit-client",
"player@v1_support": {
"buffer_capacity": 960000,
"supported_formats": [
{
"bit_depth": 16,
"channels": 1,
"codec": "pcm",
"sample_rate": 8000
}
]
},
"supported_pair_methods": {
"pairing_psk": {
"locations": [
"operator"
]
}
},
"supported_roles": [
"player@v1"
],
"unpaired_access": {
"enabled": true
}
},
"type": "client/hello"
},
"preferred_codec": "pcm",
"role": "server",
"scenario_id": "server-initiated-legacy-unencrypted",
"server_id": "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I",
"server_name": "aiosendspin server",
"status": "ok",
"stream": {
"bit_depth": 16,
"channels": 1,
"codec": "pcm",
"codec_header": null,
"sample_rate": 8000
},
"time_exchange": [
{
"payload": {
"client_transmitted": 1331775606
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1331775606,
"server_received": 1331776106,
"server_transmitted": 1331776548
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1331867507
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1331867507,
"server_received": 1331868019,
"server_transmitted": 1331868198
},
"type": "server/time"
},
{
"type": "other-sent"
},
{
"payload": {
"client_transmitted": 1332887885
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1332887885,
"server_received": 1332888871,
"server_transmitted": 1332889307
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1333973918
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1333973918,
"server_received": 1333974961,
"server_transmitted": 1333975270
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1335029221
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1335029221,
"server_received": 1335030177,
"server_transmitted": 1335030522
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1336092218
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1336092218,
"server_received": 1336093418,
"server_transmitted": 1336094019
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1337140768
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1337140768,
"server_received": 1337141448,
"server_transmitted": 1337141764
},
"type": "server/time"
},
{
"type": "other-sent"
}
]
}Server log
RAWINFO:aiosendspin.server.server:Starting Sendspin server on port 19100
INFO:aiosendspin.server.server:Sendspin server started successfully on 127.0.0.1:19100
WARNING:aiosendspin.server.server:No IP addresses available for mDNS advertising. Clients may not be able to discover this server. Consider specifying addresses manually via advertise_addresses.
WARNING:aiosendspin.server.connection.tU1Esni2EmRehX3Habvj2ab9UJ9CiTNFUrKb0wTimyM:WebSocket closed, close_code=1006
{
"activation": {
"payload": {
"active_roles": [
"player@v1"
],
"activities": [
"playback"
]
},
"type": "server/activate"
},
"audio": {
"bit_depth": 16,
"channels": 1,
"clip_seconds": 5.0,
"duration_seconds": 5.0,
"fixture": "/Users/runner/work/conformance/conformance/repos/sendspin-cli/tests/fixtures/almost_silent.flac",
"frame_alignment_samples": null,
"frame_count": 40000,
"sample_rate": 8000,
"sent_audio_chunk_count": 200,
"sent_codec_header_sha256": null,
"sent_encoded_byte_count": 80000,
"sent_encoded_sha256": "b3481a3f75dea856a961e7842d12f8344c7147b3925f9f0b67c5445700bd4cf2",
"source_flac_sha256": "8fdda8244e318c63cd8b699fe461cd7cdddbb729327a0ba00d1bfdbe2192fe17",
"source_pcm_sha256": "9d447b5b270bc99b45bb9a616937e436c941ca56c477f9cbe16a93275a6b059e",
"trimmed_source_frames": 0
},
"availability_trace": [
{
"available": true,
"type": "client/state"
},
{
"phase": "sending",
"roles": [
"player"
],
"type": "stream/start"
},
{
"phase": "sent",
"roles": [
"player"
],
"type": "stream/start"
},
{
"available": true,
"type": "client/state"
},
{
"available": true,
"type": "client/state"
}
],
"client": {
"active_roles": [],
"client_id": "tU1Esni2EmRehX3Habvj2ab9UJ9CiTNFUrKb0wTimyM",
"name": "SendspinKit-client",
"supported_roles": [
"player@v1"
]
},
"discovery_method": "registry_fallback",
"group_updates": [
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "stopped"
},
"type": "group/update"
},
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "playing"
},
"type": "group/update"
},
{
"payload": {
"group_id": "6d2473bb-c6cd-4451-94d6-cebc41da34ac",
"group_name": "SendspinKit-client",
"playback_state": "stopped"
},
"type": "group/update"
}
],
"implementation": "aiosendspin",
"initiator_role": "server",
"peer_hello": {
"payload": {
"device_info": {
"manufacturer": "Apple",
"product_name": "Mac",
"software_version": "Version 26.6.2 (Build 25G83)"
},
"name": "SendspinKit-client",
"player@v1_support": {
"buffer_capacity": 960000,
"supported_formats": [
{
"bit_depth": 16,
"channels": 1,
"codec": "pcm",
"sample_rate": 8000
}
]
},
"supported_pair_methods": {
"pairing_psk": {
"locations": [
"operator"
]
}
},
"supported_roles": [
"player@v1"
],
"unpaired_access": {
"enabled": true
}
},
"type": "client/hello"
},
"preferred_codec": "pcm",
"role": "server",
"scenario_id": "server-initiated-legacy-unencrypted",
"server_id": "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I",
"server_name": "aiosendspin server",
"status": "ok",
"stream": {
"bit_depth": 16,
"channels": 1,
"codec": "pcm",
"codec_header": null,
"sample_rate": 8000
},
"time_exchange": [
{
"payload": {
"client_transmitted": 1331775606
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1331775606,
"server_received": 1331776106,
"server_transmitted": 1331776548
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1331867507
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1331867507,
"server_received": 1331868019,
"server_transmitted": 1331868198
},
"type": "server/time"
},
{
"type": "other-sent"
},
{
"payload": {
"client_transmitted": 1332887885
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1332887885,
"server_received": 1332888871,
"server_transmitted": 1332889307
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1333973918
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1333973918,
"server_received": 1333974961,
"server_transmitted": 1333975270
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1335029221
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1335029221,
"server_received": 1335030177,
"server_transmitted": 1335030522
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1336092218
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1336092218,
"server_received": 1336093418,
"server_transmitted": 1336094019
},
"type": "server/time"
},
{
"payload": {
"client_transmitted": 1337140768
},
"type": "client/time"
},
{
"payload": {
"client_transmitted": 1337140768,
"server_received": 1337141448,
"server_transmitted": 1337141764
},
"type": "server/time"
},
{
"type": "other-sent"
}
]
}
Client summary (JSON)
RAW{
"audio": {
"audio_chunk_count": 200,
"received_pcm_sha256": "9d447b5b270bc99b45bb9a616937e436c941ca56c477f9cbe16a93275a6b059e",
"received_sample_count": 40000
},
"client_id": "SendspinKit-client-id",
"client_name": "SendspinKit-client",
"implementation": "SendspinKit",
"initiator_role": "server",
"peer_hello": {
"payload": {
"name": "aiosendspin server",
"server_id": "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I"
},
"type": "server/hello"
},
"preferred_codec": "pcm",
"role": "client",
"scenario_id": "server-initiated-legacy-unencrypted",
"server": {
"name": "aiosendspin server",
"server_id": "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I"
},
"status": "ok",
"stream": {
"bit_depth": 16,
"channels": 1,
"codec": "pcm",
"codec_header": null,
"sample_rate": 8000
}
}Client log
RAW[ADAPTER] Listening for server connection on ws://127.0.0.1:20100/sendspin
[ADAPTER] Connected to server: aiosendspin server
[ADAPTER] Stream started: pcm 8000Hz 1ch 16bit
[ADAPTER] Stream ended
[ADAPTER] Transport receive error: POSIXErrorCode(rawValue: 89): Operation canceled
{
"audio" : {
"audio_chunk_count" : 200,
"received_pcm_sha256" : "9d447b5b270bc99b45bb9a616937e436c941ca56c477f9cbe16a93275a6b059e",
"received_sample_count" : 40000
},
"client_id" : "SendspinKit-client-id",
"client_name" : "SendspinKit-client",
"implementation" : "SendspinKit",
"initiator_role" : "server",
"peer_hello" : {
"payload" : {
"name" : "aiosendspin server",
"server_id" : "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I"
},
"type" : "server\/hello"
},
"preferred_codec" : "pcm",
"role" : "client",
"scenario_id" : "server-initiated-legacy-unencrypted",
"server" : {
"name" : "aiosendspin server",
"server_id" : "dsIlKLOY1OqUfE4ig1m3id0r6yr2D5_3R-FJLQZI30I"
},
"status" : "ok",
"stream" : {
"bit_depth" : 16,
"channels" : 1,
"codec" : "pcm",
"codec_header" : null,
"sample_rate" : 8000
}
}
[ADAPTER] Summary written to artifacts/results/data/macos__server-initiated-legacy-unencrypted__aiosendspin__to__SendspinKit/client-summary.json
Server build log · python-adapters · built · 0.24s
RAW.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/audio_transformers.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/capabilities.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/events.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/group.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/types.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/player/v1.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/registry.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/scheduled_state.py'... Listing 'src/conformance/_vendor/aiosendspin/server/roles/source'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/source/__init__.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/source/events.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/source/stream.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/source/v1.py'... Listing 'src/conformance/_vendor/aiosendspin/server/roles/visualizer'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/__init__.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/features.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/group.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/packing.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/types.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer/v1.py'... Listing 'src/conformance/_vendor/aiosendspin/server/roles/visualizer_draft_r1'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer_draft_r1/__init__.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer_draft_r1/features.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer_draft_r1/packing.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/roles/visualizer_draft_r1/role.py'... Compiling 'src/conformance/_vendor/aiosendspin/server/server.py'... Compiling 'src/conformance/_vendor/aiosendspin/util.py'... Listing 'src/conformance/adapters'... Compiling 'src/conformance/adapters/__init__.py'... Compiling 'src/conformance/adapters/_aiosendspin_pairing.py'... Compiling 'src/conformance/adapters/_aiosendspin_protocol_evidence.py'... Compiling 'src/conformance/adapters/aiosendspin_client.py'... Compiling 'src/conformance/adapters/aiosendspin_server.py'... Compiling 'src/conformance/adapters/placeholder.py'... Compiling 'src/conformance/cli.py'... Compiling 'src/conformance/flac.py'... Compiling 'src/conformance/merge.py'... Compiling 'src/conformance/pcm.py'... Compiling 'src/conformance/registry.py'... Listing 'src/conformance/validator'... Compiling 'src/conformance/validator/__init__.py'... Compiling 'src/conformance/validator/checks.py'... Compiling 'src/conformance/validator/cli.py'... Compiling 'src/conformance/validator/code_pairing.py'... Compiling 'src/conformance/validator/code_pairing_checks.py'... Compiling 'src/conformance/validator/discovery.py'... Compiling 'src/conformance/validator/findings.py'... Compiling 'src/conformance/validator/noncompliance_refs.py'... Compiling 'src/conformance/validator/prompter.py'... Compiling 'src/conformance/validator/recorder.py'... Compiling 'src/conformance/validator/report.py'... Compiling 'src/conformance/validator/session.py'... Compiling 'src/conformance/validator/storage.py'... Compiling 'src/conformance/validator/suite_checks.py'... Compiling 'src/conformance/validator/suites.py'... Listing 'src/sendspin_conformance.egg-info'... Listing 'scripts'... Compiling 'scripts/detect_regressions.py'... Compiling 'scripts/merge_results.py'... Compiling 'scripts/run_all.py'... Compiling 'scripts/setup_repositories.py'... Compiling 'scripts/setup_workspace.py'... Compiling 'scripts/vendor_aiosendspin.py'...
Client build log · SendspinKit-client · built · 44.96s
RAWdspinKit DiscoveredServer.swift [73/110] Compiling SendspinKit ServerDiscovery.swift [74/110] Compiling SendspinKit Log.swift [75/110] Compiling SendspinKit ActivateMessages.swift [76/110] Compiling SendspinKit ArtworkModels.swift [77/110] Compiling SendspinKit AudioCodec.swift [78/110] Compiling SendspinKit AudioFormatSpec.swift [79/110] Compiling SendspinKit BinaryMessage.swift [80/110] Compiling SendspinKit ClientRole.swift [81/110] Compiling SendspinKit ClientStateMessages.swift [82/110] Compiling SendspinKit CommandMessages.swift [83/110] Compiling SendspinKit GoodbyeMessage.swift [84/110] Compiling SendspinKit HelloMessages.swift [85/110] Compiling SendspinKit InitMessages.swift [86/110] Compiling SendspinKit LeaveMessage.swift [87/110] Compiling SendspinKit PairingMessages.swift [88/110] Compiling SendspinKit SendspinMessage.swift [89/110] Compiling SendspinKit ServerStateMessages.swift [90/110] Compiling SendspinKit StreamMessages.swift [91/110] Compiling SendspinKit TimeMessages.swift [92/110] Compiling SendspinKit VisualizerBinaryPayload.swift [93/110] Compiling SendspinKit SaturatingArithmetic.swift [94/110] Compiling SendspinKit SendspinKit.swift [95/110] Compiling SendspinKit ClockSyncProtocol.swift [96/110] Compiling SendspinKit ClockSynchronizer.swift [97/110] Compiling SendspinKit MonotonicClock.swift [98/110] Compiling SendspinKit SendspinTimeFilter.swift [99/110] Compiling SendspinKit TimeFilterSnapshot.swift [100/110] Compiling SendspinKit FrameInbox.swift [101/110] Compiling SendspinKit NWWebSocketTransport.swift [102/110] Compiling SendspinKit NoiseChannel.swift [103/110] Compiling SendspinKit NoiseSessionEstablisher.swift [104/110] Compiling SendspinKit SendspinEncoding.swift [105/110] Compiling SendspinKit SendspinTransport.swift [106/110] Compiling SendspinKit TransportError.swift [107/110] Compiling SendspinKit WatermarkedSink.swift [108/112] Compiling ConformanceSendspinKitClient main.swift [109/112] Emitting module ConformanceSendspinKitClient [109/112] Write Objects.LinkFileList [110/112] Linking ConformanceSendspinKitClient [111/112] Applying ConformanceSendspinKitClient Build complete! (32.67s) Fetching https://github.com/sbooth/ogg-binary-xcframework.git Fetching https://github.com/sbooth/flac-binary-xcframework.git [1/23] Fetching ogg-binary-xcframework [24/55] Fetching ogg-binary-xcframework, flac-binary-xcframework Fetched https://github.com/sbooth/flac-binary-xcframework.git from cache (0.68s) Fetched https://github.com/sbooth/ogg-binary-xcframework.git from cache (0.69s) Fetching https://github.com/jedisct1/swift-sodium.git [1/5013] Fetching swift-sodium Fetched https://github.com/jedisct1/swift-sodium.git from cache (4.94s) Creating working copy for https://github.com/sbooth/ogg-binary-xcframework.git Creating working copy for https://github.com/jedisct1/swift-sodium.git Creating working copy for https://github.com/sbooth/flac-binary-xcframework.git Working copy of https://github.com/sbooth/flac-binary-xcframework.git resolved at 0.2.0 Working copy of https://github.com/sbooth/ogg-binary-xcframework.git resolved at 0.1.3 Working copy of https://github.com/jedisct1/swift-sodium.git resolved at 0.9.1 Downloading binary artifact https://github.com/sbooth/flac-binary-xcframework/releases/download/0.2.0/FLAC.xcframework.zip Downloading binary artifact https://github.com/sbooth/ogg-binary-xcframework/releases/download/0.1.3/ogg.xcframework.zip [15516/618747] Downloading https://github.com/sbooth/ogg-binary-xcframework/releases/download/0.1.3/ogg.xcframework.zip [80803/4541165] Downloading https://github.com/sbooth/ogg-binary-xcframework/releases/download/0.1.3/ogg.xcframework.zip, https://github.com/sbooth/flac-binary-xcframework/releases/download/0.2.0/FLAC.xcframework.zip Downloaded https://github.com/sbooth/ogg-binary-xcframework/releases/download/0.1.3/ogg.xcframework.zip (0.52s) Downloaded https://github.com/sbooth/flac-binary-xcframework/releases/download/0.2.0/FLAC.xcframework.zip (0.71s)