PyTokenizer_FromString
===========================

実装
---------------------------

.. code-block:: c

    struct tok_state *
    PyTokenizer_FromString(const char *str, int exec_input)
    {
        struct tok_state *tok = tok_new();
        if (tok == NULL)
            return NULL;
        str = decode_str(str, exec_input, tok);
        if (str == NULL) {
            PyTokenizer_Free(tok);
            return NULL;
        }

        /* XXX: constify members. */
        tok->buf = tok->cur = tok->end = tok->inp = (char*)str;
        return tok;
    }

引数
---------------------------

- 

戻り値
---------------------------

- 

内容
---------------------------

- 

.. toctree::
   :maxdepth: 1
   :caption: 呼び出し関数: