C# complete dynamic deserializer to dictionary

[Jan-Heapster]

Hey all! Wanna use MsgPack in my AppProject. I have to handle very differtent packages, so i wanted to code a deserializer, that unpacks the msgPack to a c# Dictionary. If i have the dictionary i will check out to which function of my Server the package is adressed to (e.g. Login, general communication, ...).

My actual code looks like this:

public void Deserialize(byte[] rawMessage) {

        Dictionary<MessagePackObject, MessagePackObject> mpoDict = MessagePackSerializer.Create<Dictionary<MessagePackObject, MessagePackObject>>().Unpack(new MemoryStream(rawMessage));
        Dictionary<String, MessagePackObject> dict = mpoDict.ToDictionary(kv => (String)kv.Key, kv => kv.Value);
        MessagePackObject theValue;

        if (dict.TryGetValue("error", out theValue))
        {
            var error = (String)theValue;
        }
        else if (dict.TryGetValue("engine", out theValue))
        {
            var engine = (String)theValue;
            if(engine.Equals("@LOGIN")){Server.Client.Handler.LoginHandler(dict)}
            else if(engine.Equals("@REGISTER")){Server.Client.Handler.LoginHandler(dict)}
            else if(engine.Equals("@MESSAGE")){Server.Client.Handler.LoginHandler(dict)}
            else if(engine.Equals("@LOGOUT")){Server.Client.Handler.LoginHandler(dict)}
            else{Server.Clinet.Handler.ErrorHandler.throwError("Unrecognized Engine")}
        }
    }

some part of this seems to be not working, i get always errorstuff. Can someone help?

[Jan-Heapster]

Changed handler adressing, but still doesnt work for me.

public void Deserialize(byte[] rawMessage) {

    Dictionary<MessagePackObject, MessagePackObject> mpoDict = MessagePackSerializer.Create<Dictionary<MessagePackObject, MessagePackObject>>().Unpack(new MemoryStream(rawMessage));
    Dictionary<String, MessagePackObject> dict = mpoDict.ToDictionary(kv => (String)kv.Key, kv => kv.Value);
    MessagePackObject theValue;

    if (dict.TryGetValue("error", out theValue))
    {
        var error = (String)theValue;
    }
    else if (dict.TryGetValue("engine", out theValue))
    {
        var engine = (String)theValue;
        if(engine.Equals("@LOGIN")){Server.Client.Handler.LoginHandler(dict)}
        else if(engine.Equals("@REGISTER")){Server.Client.Handler.RegisterHandler(dict)}
        else if(engine.Equals("@MESSAGE")){Server.Client.Handler.MessageHandler(dict)}
        else if(engine.Equals("@LOGOUT")){Server.Client.Handler.LogoutHandler(dict)}
        else{Server.Clinet.Handler.ErrorHandler.throwError("Unrecognized Engine")}
    }
}

[yfakariya]

Could you use MessagePackObjectDictionary to represents dynamic message? Its built-in serializer now can handle nested dynamic element, so it might solve your problem.

MessagePackObjectDictionary mpoDict = MessagePackSerializer.Create<MessagePackObjectDictionary>().Unpack(new MemoryStream(rawMessage));
// or, you can simply do as following:
// var mpoDict = Unpacking.UnpackDictionary(rawData).Value;

[Jan-Heapster]

thanks for the fast reply :)
Seems to work for me :) but i dont really like the try and Error thing :(

[yfakariya]

Do you say that you want to ensure exact solution, or hope to improve documents in the first place? If former, please tell me expected & actual issue you faced. If latter, I will be happy if you told me what content did you like to see.
As a first step of latter, I updated wiki to publish sample codes.

[Jan-Heapster]

Something like a package header would be awesome, so that the package destination can be instantly assigned and the payload transmitted to the class, which is working with it, so you can avoid the try&error stuff

[yfakariya]

I might misunderstand what the 'try&error' means. Do you mean that an ability to embed a kind of 'type hint' in the packed bytes to reduce hand-made detection of actual type like if statements in your code?

[Jan-Heapster]

yeah exactly all the if statements are problematic. The app is managed with a massresponse servernetwork, but this network don't have unlimited CPU, too. So creating the dict, gettin one var of it, "try&error" it out, till you find what you are looking for or sorting it out, cause of malformed package.

[Jan-Heapster]

Then transmit to the subengine, which evaluates the rest of the package etc. etc.

[Jan-Heapster]

it would be more useful to have a so called package header, which don't need the creation of a dict and so on. So data can be evaluated in few less steps and cpu&RAM would be saved. I do not want to work with googlestuff but if you are interested in packageheaders, there is a extension called protobuf supporting exact these headers. Is it implementable here?

[yfakariya]

I see. I'll study the extension of protobuf and tuckle to dynamic type with existing msgpack ext types.

[Jan-Heapster]

nice. We would really like to use your Packageformat in our App :)

[yfakariya]

@Jan-Heapster

I've written the spec draft. Would you review it? https://gist.github.com/yfakariya/fb6d5c66fa4d8a82346b

[Jan-Heapster]

Hey!

I am goin to take a detailed look on it tomorrow.
But i am very happy about to hear that you are still engaged.

CYU tomorrow

Am 11.01.2015 um 15:08 schrieb Yusuke Fujiwara:

@Jan-Heapster https://github.com/Jan-Heapster

I've written the spec draft. Would you review it?
https://gist.github.com/yfakariya/fb6d5c66fa4d8a82346b

—
Reply to this email directly or view it on GitHub
#47 (comment).

Jan Weber / Backenddeveloper
Jan@Invitu.de mailto:Jan@Invitu.de/ + 49 1573 64 14 294

heapsterDev
http://www.invitu.de