Skip to content

Initial rstream logic #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
alanbchristie merged 61 commits into from
May 21, 2025
Merged

Initial rstream logic #1

alanbchristie merged 61 commits into from
May 21, 2025

Conversation

@alanbchristie
Copy link
Collaborator

@alanbchristie alanbchristie commented May 21, 2025

  • Able to connect and consume from rstream socket
  • Handles disconnections and basic idle handling
  • Adds message offset and rstream timestamp to the outbound message
  • Adds discussion of historical events
  • Adds memcached Pod container (for WS connection UUIDs)

Alan Christie added 30 commits April 25, 2025 12:05
feat: Initial attempt at stream-based websocket logic
e3b7419
feat: Partial work on stream
d13aca2
fix: Now awaits _consume()
39455f3
fix: Better log and load balancer mode
30434b7
fix: Better log
048b00f
fix: Avoid create stream, and use of decoder
d634608
fix: Messages now sent through socket (and attempt to stop consumer)
79d7b87
fix: Now closes consumer (when stopped)
5c7c115
feat: Better (?) shutdown
3455e53
fix: Msg now sent as string (still locking up)
7eb6fb7
fix: Experiment with timestamp offset
bc819ba
build: Add python-dateutil
436668b
fix: Initial support for stream headers (offset specification)
294e7d0
fix: Log offset specification
446fa00
build: Fix dateutil package
7aaa55c
fix: Fix BAD_REQUEST
8c3e270
fix: Adjust log (offset and timestamp)
2ca05e2
feat: Event stream now inserts offset and timestamp to generated mess…
ab9f872 
…ages
fix: Properties now at the end of the string and in maps using ess_ p…
5aecfd7 
…refix
fix: Log header values
4373ac6
feat: Attempt of fix msg transmission
d510ede
fix: Revert changes
24fe596
fix: Attempt to fix timestamp from datetime
6a9a6c5
fix: Attempt to handle StreamDoesNotExist
706037b
feat: Faster handling of missing streams
a22c807
feat: Attempt to append offset and timestamp message
c11a673
feat: Attempt to detect encoding
9e0424f
fix: Attempt to fix message
2439331
fix: Remove msg type/encoding display
efe780b
fix: Another attempt at message decoding
41b8f05
Alan Christie added 28 commits May 1, 2025 19:36
feat: Adds keys to json string (if used)
9a74b41
feat: Better ESS properties in protobuf string
e427e08
feat: Reduce log (no offset/timestamp)
c552086
docs: Doc tweak
2ce019f
docs: Doc tweak (headers)
afef082
fix: Better close for websockets (close rather than exception)
6472635
style: Log tweak
bfe81e2
style: Slimmer logging
a45ace4
style: Remove some log
98b8899
feat: Initial memcached logic
fa50a8f
fix: Fix deployment typos
17d9715
fix: Use of KeepaliveOpts and memcached initialised on startup
de186f1
fix: Better log location (memcached)
388ebe0
fix: Attempt to detect change of ES UUID
f577dc4
ci: Remove unused variable
cd203cc
style: Logging changes
20c8f04
style: Another log tweak
3046835
fix: Correct the memcache key value (unique to socket)
8dd5568
ci: Update memcached configuration
6ea3f37
fix: Fix undefined variable
8df2b7f
fix: Removed confusing global variables
96194a9
fix: Fix messages and correct byte to string comparison
64e1936
style: Logging corrections
69e20de
style: More logging adjustments
2a5b1ba
fix: Fix decode of None
90f343d
fix: Fix uuid4() to string
98614e8
style: Log tweak
c298640
fix: Handle RuntimeError closing socket
0a9fad2
@alanbchristie alanbchristie merged commit 0992de5 into main May 21, 2025
2 checks passed
@alanbchristie alanbchristie deleted the sc-3299-rstream branch May 21, 2025 21:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@alanbchristie