-
Notifications
You must be signed in to change notification settings - Fork 22
Description
Hi @novakov-alexey,
Now that the reunification of Flink 1 and 2 is complete, I’m opening this ticket to discuss the serializers we wrote for our needs and that we can share here.
These serializers are in production on our side and have been running for several months.
Serializers missing in Flink:
java.time.ZoneIdjava.time.ZoneOffsetjava.time.ZonedDateTimejava.time.OffsetDateTime
Serializers for the Scala standard library:
scala.concurrent.duration.Duration&scala.concurrent.duration.FiniteDurationscala.Enumerationscala.math.Ordering& subclasses (required for sorted sets)
Serializers for Scala mutable collections:
scala.collection.mutable.ArrayDequescala.collection.mutable.Buffer&scala.collection.mutable.ArrayBufferscala.collection.mutable.Queuescala.collection.mutable.Map&scala.collection.mutable.HashMapscala.collection.mutable.Set&scala.collection.mutable.HashSetscala.collection.mutable.SortedSet&scala.collection.mutable.TreeSet
In fact, pretty much the only thing missing is SortedMap, which we apparently don’t use in our state.
So, let me know which serializers you’re interested in and which ones you want first. I think I’ll have less time to devote to this, but I’ll try to add them progressively.
Of course, all of this is up for discussion, and just because we implemented it a certain way internally doesn’t mean we can’t do better here.