32. Python Language Services

Python provides a number of modules to assist in working with the Python language. These modules support tokenizing, parsing, syntax analysis, bytecode disassembly, and various other facilities.

These modules include:

• 32.1. parser — Access Python parse trees
  • 32.1.1. Creating ST Objects
    • expr()
    • suite()
    • sequence2st()
    • tuple2st()
  • 32.1.2. Converting ST Objects
    • st2list()
    • st2tuple()
    • compilest()
  • 32.1.3. Queries on ST Objects
    • isexpr()
    • issuite()
  • 32.1.4. Exceptions and Error Handling
    • ParserError
  • 32.1.5. ST Objects
    • STType
    • ST.compile()
    • ST.isexpr()
    • ST.issuite()
    • ST.tolist()
    • ST.totuple()
  • 32.1.6. Example: Emulation of compile()
• 32.2. ast — Abstract Syntax Trees
  • 32.2.1. Node classes
    • AST
      • AST._fields
      • AST.lineno
      • AST.col_offset
  • 32.2.2. Abstract Grammar
  • 32.2.3. ast Helpers
    • parse()
    • literal_eval()
    • get_docstring()
    • fix_missing_locations()
    • increment_lineno()
    • copy_location()
    • iter_fields()
    • iter_child_nodes()
    • walk()
    • NodeVisitor
      • NodeVisitor.visit()
      • NodeVisitor.generic_visit()
    • NodeTransformer
    • dump()
• 32.3. symtable — Access to the compiler’s symbol tables
  • 32.3.1. Generating Symbol Tables
    • symtable()
  • 32.3.2. Examining Symbol Tables
    • SymbolTable
      • SymbolTable.get_type()
      • SymbolTable.get_id()
      • SymbolTable.get_name()
      • SymbolTable.get_lineno()
      • SymbolTable.is_optimized()
      • SymbolTable.is_nested()
      • SymbolTable.has_children()
      • SymbolTable.has_exec()
      • SymbolTable.has_import_star()
      • SymbolTable.get_identifiers()
      • SymbolTable.lookup()
      • SymbolTable.get_symbols()
      • SymbolTable.get_children()
    • Function
      • Function.get_parameters()
      • Function.get_locals()
      • Function.get_globals()
      • Function.get_frees()
    • Class
      • Class.get_methods()
    • Symbol
      • Symbol.get_name()
      • Symbol.is_referenced()
      • Symbol.is_imported()
      • Symbol.is_parameter()
      • Symbol.is_global()
      • Symbol.is_declared_global()
      • Symbol.is_local()
      • Symbol.is_free()
      • Symbol.is_assigned()
      • Symbol.is_namespace()
      • Symbol.get_namespaces()
      • Symbol.get_namespace()
• 32.4. symbol — Constants used with Python parse trees
  • sym_name
• 32.5. token — Constants used with Python parse trees
  • tok_name
  • ISTERMINAL()
  • ISNONTERMINAL()
  • ISEOF()
  • ENDMARKER
  • NAME
  • NUMBER
  • STRING
  • NEWLINE
  • INDENT
  • DEDENT
  • LPAR
  • RPAR
  • LSQB
  • RSQB
  • COLON
  • COMMA
  • SEMI
  • PLUS
  • MINUS
  • STAR
  • SLASH
  • VBAR
  • AMPER
  • LESS
  • GREATER
  • EQUAL
  • DOT
  • PERCENT
  • BACKQUOTE
  • LBRACE
  • RBRACE
  • EQEQUAL
  • NOTEQUAL
  • LESSEQUAL
  • GREATEREQUAL
  • TILDE
  • CIRCUMFLEX
  • LEFTSHIFT
  • RIGHTSHIFT
  • DOUBLESTAR
  • PLUSEQUAL
  • MINEQUAL
  • STAREQUAL
  • SLASHEQUAL
  • PERCENTEQUAL
  • AMPEREQUAL
  • VBAREQUAL
  • CIRCUMFLEXEQUAL
  • LEFTSHIFTEQUAL
  • RIGHTSHIFTEQUAL
  • DOUBLESTAREQUAL
  • DOUBLESLASH
  • DOUBLESLASHEQUAL
  • AT
  • OP
  • ERRORTOKEN
  • N_TOKENS
  • NT_OFFSET
• 32.6. keyword — Testing for Python keywords
  • iskeyword()
  • kwlist
• 32.7. tokenize — Tokenizer for Python source
  • generate_tokens()
  • tokenize()
  • COMMENT
  • NL
  • untokenize()
  • TokenError
• 32.8. tabnanny — Detection of ambiguous indentation
  • check()
  • verbose
  • filename_only
  • NannyNag
  • process_tokens()
• 32.9. pyclbr — Python class browser support
  • readmodule()
  • readmodule_ex()
  • 32.9.1. Class Objects
    • Class.module
    • Class.name
    • Class.super
    • Class.methods
    • Class.file
    • Class.lineno
  • 32.9.2. Function Objects
    • Function.module
    • Function.name
    • Function.file
    • Function.lineno
• 32.10. py_compile — Compile Python source files
  • PyCompileError
  • compile()
  • main()
• 32.11. compileall — Byte-compile Python libraries
  • 32.11.1. Command-line use
  • 32.11.2. Public functions
    • compile_dir()
    • compile_file()
    • compile_path()
• 32.12. dis — Disassembler for Python bytecode
  • dis()
  • distb()
  • disassemble()
  • disco()
  • findlinestarts()
  • findlabels()
  • opname
  • opmap
  • cmp_op
  • hasconst
  • hasfree
  • hasname
  • hasjrel
  • hasjabs
  • haslocal
  • hascompare
  • 32.12.1. Python Bytecode Instructions
• 32.13. pickletools — Tools for pickle developers
  • dis()
  • genops()
  • optimize()