U bhV<@sdZddlmZddlZddlZddlZddlZddlmZddl m Z ddl m Z ddl mZmZmZmZmZdd lmZdd lmZmZd Zed d gZeddgZejdrddZnejZej Z!e"ej#$ddZ%eddZ&e e'feffddZ(e!fddZ)ddZ*GdddZ+e+Z,e,j-Z-e,j.Z.e,j/Z/e,j0Z0dd Z1d!d"Z2d#d$Z3d%d&Z4d'd(Z5d)d*Z6e2e5e3e6e,7d+e8Z9e9fd,d-Z:e9fd.d/Z;e;ed0D]\Zfe=qd3d1d2Z?dS)4zSerialization utilities.) annotationsN) namedtuple)contextmanagerBytesIO)ContentDisallowed DecodeError EncodeErrorSerializerNotInstalledreraise) entrypoints) bytes_to_str str_to_bytes)pickleloadsdumpsregister unregisterbinaryz ascii-8bitapplication/datazapplication/textjavacCst||dS)Nr)codecs getdecoder)tZcodingr7/tmp/pip-unpacked-wheel-earovzxb/kombu/serialization.py_decodesrZPICKLE_PROTOCOLcodec) content_typecontent_encodingencoderc cs^z dVWnN|k r Yn:|k rX}zt|||tdW5d}~XYnXdS)N)r sysexc_info)wrapperincludeexcludeexcrrr_reraise_errors%s  r*cCs |t|SNr)sloadrrr pickle_loads0sr.cCs|r|d|dS|S)Nz ()r)firstsecondrrrparenthesize_alias5sr2c@sdeZdZdZddZdddZddZd d Zd d Zd dZ dddZ dde fddZ ddZ dS)SerializerRegistryz2The registry keeps track of serialization methods.cCs6i|_i|_d|_d|_d|_t|_i|_i|_dSr+) _encoders _decoders_default_encode_default_content_type_default_content_encodingset_disabled_content_types type_to_name name_to_type)selfrrr__init__<szSerializerRegistry.__init__utf-8cCs<|rt||||j|<|r$||j|<||j|<||j|<dS)aRegister a new encoder/decoder. Arguments: --------- name (str): A convenience name for the serialization method. encoder (callable): A method that will be passed a python data structure and should return a string representing the serialized data. If :const:`None`, then only a decoder will be registered. Encoding will not be possible. decoder (Callable): A method that will be passed a string representing serialized data and should return a python data structure. If :const:`None`, then only an encoder will be registered. Decoding will not be possible. content_type (str): The mime-type describing the serialized structure. content_encoding (str): The content encoding (character set) that the `decoder` method will be returning. Will usually be `utf-8`, `us-ascii`, or `binary`. N)rr4r5r;r<)r=namer"decoderr r!rrrrFs   zSerializerRegistry.registercCs"d|kr|j|}|j|dSN/)r<r:discardr=r@rrrenablehs zSerializerRegistry.enablecCs"d|kr|j|}|j|dSrB)r<r:addrErrrdisablems zSerializerRegistry.disablecCsnzF|j|}|j|d|j|d|j|d|j|dWn"tk rhtd|YnXdS)aUnregister registered encoder/decoder. Arguments: --------- name (str): Registered serialization method name. Raises ------ SerializerNotInstalled: If a serializer by that name cannot be found. N!No encoder/decoder installed for )r<r5popr4r;KeyErrorr )r=r@r rrrrrs  zSerializerRegistry.unregistercCsBz|j|\|_|_|_Wn"tk r<td|YnXdS)aSet the default serialization method used by this library. Arguments: --------- name (str): The name of the registered serialization method. For example, `json` (default), `pickle`, `yaml`, `msgpack`, or any custom methods registered using :meth:`register`. Raises ------ SerializerNotInstalled: If the serialization method requested is not available. No encoder installed for N)r4r7r8r6rKr rErrr_set_default_serializers z*SerializerRegistry._set_default_serializerNc Cs|dkrt|S|r.|j|s.td||sFt|trFdd|fS|st|trttdd| d}W5QRXdd|fS|r|j|\}}}n|j }|j }|j }tt||}W5QRX|||fS) aEncode data. Serialize a data structure into a string suitable for sending as an AMQP message body. Arguments: --------- data (List, Dict, str): The message data to send. serializer (str): An optional string representing the serialization method you want the data marshalled into. (For example, `json`, `raw`, or `pickle`). If :const:`None` (default), then json will be used, unless `data` is a :class:`str` or :class:`unicode` object. In this latter case, no serialization occurs as it would be unnecessary. Note that if `serializer` is specified, then that serialization method will be used even if a :class:`str` or :class:`unicode` object is passed in. Returns ------- Tuple[str, str, str]: A three-item tuple containing the content type (e.g., `application/json`), content encoding, (e.g., `utf-8`) and a string containing the serialized data. Raises ------ SerializerNotInstalled: If the serialization method requested is not available. rawrLrrrr(r?z text/plain) raw_encoder4getr isinstancebytesstrr*r encoder6r7r8)r=data serializerpayloadr r!r"rrrrs*"    zSerializerRegistry.dumpsFc Cs|r t|nd}|dk r6||krP||krP||dn||jkrP|sP||d|pVd}|r|j|}|rtt||W5QRSQRX|tkrt |t sttt ||W5QRSQRX|S)aDecode serialized data. Deserialize a data stream as serialized using `dumps` based on `content_type`. Arguments: --------- data (bytes, buffer, str): The message data to deserialize. content_type (str): The content-type of the data. (e.g., `application/json`). content_encoding (str): The content-encoding of the data. (e.g., `utf-8`, `binary`, or `us-ascii`). accept (Set): List of content-types to accept. Raises ------ ContentDisallowed: If the content-type is not accepted. Returns ------- Any: The unserialized data. rNZ untrusteddisabledr?) r_for_untrusted_contentr:lowerr5rQr*r SKIP_DECODErRrTr)r=rVr r!acceptforceZ_trusted_contentdecoderrrrs,      zSerializerRegistry.loadsc Cs td|t|j|||S)Nz-Refusing to deserialize {} content of type {})rformatr2r;rQ)r=ctypewhyrrrrZs z)SerializerRegistry._for_untrusted_content)r?)N)__name__ __module__ __qualname____doc__r>rrFrHrrMrTRUSTED_CONTENTrrZrrrrr39s " C 1r3c CsHd}|}t|tr:d}ttdd||}W5QRXnd}|||fS)zSpecial case serializer.rr?rrOr)rRrTr*r rU)rVr rXr!rrrrP!s rPcCs(ddlm}tjd|j|jddddS)z2Register a encoder/decoder for JSON serialization.r)jsonrhzapplication/jsonr?r r!N)Z kombu.utilsrhregistryrrr)_jsonrrr register_json.s  rlc CsVz$ddl}tjd|j|jdddWn,tk rPdd}tdd|dYnXdS) zRegister a encoder/decoder for YAML serialization. It is slower than JSON, but allows for more data types to be serialized. Useful if you need to send data such as dates rNyamlzapplication/x-yamlr?ric_s tddS)zRaise SerializerNotInstalled. Used in case a client receives a yaml message, but yaml isn't installed. z9No decoder installed for YAML. Install the PyYAML libraryNr argskwargsrrr not_availableEsz$register_yaml..not_available)rmrjrZ safe_dumpZ safe_load ImportError)rmrrrrr register_yaml7s rtcCs tt|Sr+)r.rr,rrrunpicklePsrvcCs&tjfdd}tjd|tddddS)zpRegister pickle serializer. The fastest serialization method, but restricts you to python clients. cSs ||tdS)N)protocol)pickle_protocol)objZdumperrrr pickle_dumpsZsz%register_pickle..pickle_dumpsrzapplication/x-python-serializerriN)rrrjrrv)rzrrrregister_pickleTs  r{c sd}}zPddl}|jdkrFddlmmfdd}fdd}nd d }|}}Wn(ttfk rd d }|}}YnXtjd ||ddddS)zZRegister msgpack serializer. See Also -------- https://msgpack.org/. Nr)rrpackbunpackbcs |ddS)NT) use_bin_typerru)r}rrpackoszregister_msgpack..packcs |ddS)NF)rNrru)r~rrunpackrsz register_msgpack..unpackc_s tddS)Nz(msgpack requires msgpack-python >= 0.4.0rnrorrrversion_mismatchusz*register_msgpack..version_mismatchc_s tddS)NzKNo decoder installed for msgpack. Please install the msgpack-python libraryrnrorrrrrzsz'register_msgpack..not_availablemsgpackzapplication/x-msgpackrri)rversionr}r~rs ValueErrorrjr)rrrrrrrr|rregister_msgpackbs&   rrhc CsP|tkrdddgn|}|dk rL|D](}zt|Wq"tk rHYq"Xq"dS)zEnable serializers that are considered to be unsafe. Note: ---- Will enable ``pickle``, ``yaml`` and ``msgpack`` by default, but you can also specify a list of serializers (by name or content type) to enable. rrmrN)NOTSETrjrFrK)choiceschoicerrrenable_insecure_serializerss rcCsH|tkrdgn|}tjD]}t|q|dk rD|D]}t|q4dS)aJDisable untrusted serializers. Will disable all serializers except ``json`` or you can specify a list of deserializers to allow. Note: ---- Producers will still be able to serialize data in these formats, but consumers will not accept incoming data using the untrusted content types. rhN)rrjr5rHrF)allowedr@rrrdisable_insecure_serializerss   rzkombu.serializersc sfs tjn|dk rbzfdd|DWStk r`}ztd|jdW5d}~XYnX|S)zReplace aliases of content_types with full names from registry. Raises ------ SerializerNotInstalled: If the serialization method requested is not available. Ncs h|]}d|kr|n|qS)rCr).0nr<rr sz)prepare_accept_content..rIr)rjr<rKr rp)Z content_typesr<errrprepare_accept_contentsr)N)@rf __future__rrosrr$ collectionsr contextlibrior exceptionsrr r r r Z utils.compatr Zutils.encodingrr__all__ frozensetr\rgplatform startswithrr_r-Z pickle_loadintenvironrQrxr Exceptionr*r.r2r3rjrrrrrPrlrtrvr{rrMobjectrrreprpr@rrrrrsf           b  %