Reverse engineering the storage format for an undocumented database
1–10 of 10 posts
Re: Reverse engineering the storage format for an undocumented database
#2Re: Reverse engineering the storage format for an undocumented database
#3I love this new trend of reverse engineering, amplified by AI. Been doing numerous projects like this myself.
Re: Reverse engineering the storage format for an undocumented database
#4during developing Kafka search tool, it have to support many kind of decode formats ( such as Avro + schemaRegistry, protobuf, ConnectJson(json with schema), and so on ). it recommend a type of deserializer by looking at the leading bytes. After user select final decision, it is ok if error occurs during first data deserialize, But many case it’s not occurred error, just pass through with plausibly wrong parsed data. So my solution was display 10 pre decoded sample to user, and make user select one deserializer by eye.
ConnectJson is reliable, because it has data and schema embedded in every message ( but large ). In my case using schema-registry, server1 has schema no 10, and server2 has schema no 10 but it’s different. I make a mistake select wrong server 2, data parsing is progressed but plausibly wrong data It took me a long time to find and correct some thing wrong.
Re: Reverse engineering the storage format for an undocumented database
#5Re: Reverse engineering the storage format for an undocumented database
#6Where does the KOD key come from? Can it be recovered by reverse engineering CronosPro?
Re: Reverse engineering the storage format for an undocumented database
#7Re: Reverse engineering the storage format for an undocumented database
#8the cronospro format sounds painful. did you consider asking the vendor for the spec, or was the reverse engineering half the fun?
But of course it was a fun process and very satisfying when the normalizer actually started to work.
Re: Reverse engineering the storage format for an undocumented database
#9Where does the KOD key come from? Can it be recovered by reverse engineering CronosPro?