17. Interprocess Communication and Networking

The modules described in this chapter provide mechanisms for different processes to communicate.

Some modules only work for two processes that are on the same machine, e.g. signal and subprocess. Other modules support networking protocols that two or more processes can use to communicate across machines.

The list of modules described in this chapter is:

• 17.1. subprocess — Subprocess management
  • 17.1.1. Using the subprocess Module
    • call()
    • check_call()
    • check_output()
    • PIPE
    • STDOUT
    • CalledProcessError
      • CalledProcessError.returncode
      • CalledProcessError.cmd
      • CalledProcessError.output
    • 17.1.1.1. Frequently Used Arguments
    • 17.1.1.2. Popen Constructor
      • Popen
    • 17.1.1.3. Exceptions
    • 17.1.1.4. Security
  • 17.1.2. Popen Objects
    • Popen.poll()
    • Popen.wait()
    • Popen.communicate()
    • Popen.send_signal()
    • Popen.terminate()
    • Popen.kill()
    • Popen.stdin
    • Popen.stdout
    • Popen.stderr
    • Popen.pid
    • Popen.returncode
  • 17.1.3. Windows Popen Helpers
    • STARTUPINFO
      • STARTUPINFO.dwFlags
      • STARTUPINFO.hStdInput
      • STARTUPINFO.hStdOutput
      • STARTUPINFO.hStdError
      • STARTUPINFO.wShowWindow
    • 17.1.3.1. Constants
      • STD_INPUT_HANDLE
      • STD_OUTPUT_HANDLE
      • STD_ERROR_HANDLE
      • SW_HIDE
      • STARTF_USESTDHANDLES
      • STARTF_USESHOWWINDOW
      • CREATE_NEW_CONSOLE
      • CREATE_NEW_PROCESS_GROUP
  • 17.1.4. Replacing Older Functions with the subprocess Module
    • 17.1.4.1. Replacing /bin/sh shell backquote
    • 17.1.4.2. Replacing shell pipeline
    • 17.1.4.3. Replacing os.system()
    • 17.1.4.4. Replacing the os.spawn family
    • 17.1.4.5. Replacing os.popen(), os.popen2(), os.popen3()
    • 17.1.4.6. Replacing functions from the popen2 module
  • 17.1.5. Notes
    • 17.1.5.1. Converting an argument sequence to a string on Windows
• 17.2. socket — Low-level networking interface
  • error
  • herror
  • gaierror
  • timeout
  • AF_UNIX
  • AF_INET
  • AF_INET6
  • SOCK_STREAM
  • SOCK_DGRAM
  • SOCK_RAW
  • SOCK_RDM
  • SOCK_SEQPACKET
  • SOMAXCONN
  • has_ipv6
  • create_connection()
  • getaddrinfo()
  • getfqdn()
  • gethostbyname()
  • gethostbyname_ex()
  • gethostname()
  • gethostbyaddr()
  • getnameinfo()
  • getprotobyname()
  • getservbyname()
  • getservbyport()
  • socket()
  • socketpair()
  • fromfd()
  • ntohl()
  • ntohs()
  • htonl()
  • htons()
  • inet_aton()
  • inet_ntoa()
  • inet_pton()
  • inet_ntop()
  • getdefaulttimeout()
  • setdefaulttimeout()
  • SocketType
  • 17.2.1. Socket Objects
    • socket.accept()
    • socket.bind()
    • socket.close()
    • socket.connect()
    • socket.connect_ex()
    • socket.fileno()
    • socket.getpeername()
    • socket.getsockname()
    • socket.getsockopt()
    • socket.ioctl()
    • socket.listen()
    • socket.makefile()
    • socket.recv()
    • socket.recvfrom()
    • socket.recvfrom_into()
    • socket.recv_into()
    • socket.send()
    • socket.sendall()
    • socket.sendto()
    • socket.setblocking()
    • socket.settimeout()
    • socket.gettimeout()
    • socket.setsockopt()
    • socket.shutdown()
    • socket.family
    • socket.type
    • socket.proto
  • 17.2.2. Example
• 17.3. ssl — TLS/SSL wrapper for socket objects
  • 17.3.1. Functions, Constants, and Exceptions
    • SSLError
      • SSLError.library
      • SSLError.reason
    • SSLZeroReturnError
    • SSLWantReadError
    • SSLWantWriteError
    • SSLSyscallError
    • SSLEOFError
    • CertificateError
    • 17.3.1.1. Socket creation
      • wrap_socket()
    • 17.3.1.2. Context creation
      • create_default_context()
      • _https_verify_certificates()
    • 17.3.1.3. Random generation
      • RAND_status()
      • RAND_egd()
      • RAND_add()
    • 17.3.1.4. Certificate handling
      • match_hostname()
      • cert_time_to_seconds()
      • get_server_certificate()
      • DER_cert_to_PEM_cert()
      • PEM_cert_to_DER_cert()
      • get_default_verify_paths()
      • enum_certificates()
      • enum_crls()
    • 17.3.1.5. Constants
      • CERT_NONE
      • CERT_OPTIONAL
      • CERT_REQUIRED
      • VERIFY_DEFAULT
      • VERIFY_CRL_CHECK_LEAF
      • VERIFY_CRL_CHECK_CHAIN
      • VERIFY_X509_STRICT
      • VERIFY_X509_TRUSTED_FIRST
      • PROTOCOL_TLS
      • PROTOCOL_SSLv23
      • PROTOCOL_SSLv2
      • PROTOCOL_SSLv3
      • PROTOCOL_TLSv1
      • PROTOCOL_TLSv1_1
      • PROTOCOL_TLSv1_2
      • OP_ALL
      • OP_NO_SSLv2
      • OP_NO_SSLv3
      • OP_NO_TLSv1
      • OP_NO_TLSv1_1
      • OP_NO_TLSv1_2
      • OP_NO_TLSv1_3
      • OP_CIPHER_SERVER_PREFERENCE
      • OP_SINGLE_DH_USE
      • OP_SINGLE_ECDH_USE
      • OP_ENABLE_MIDDLEBOX_COMPAT
      • OP_NO_COMPRESSION
      • HAS_ALPN
      • HAS_ECDH
      • HAS_SNI
      • HAS_NPN
      • HAS_TLSv1_3
      • CHANNEL_BINDING_TYPES
      • OPENSSL_VERSION
      • OPENSSL_VERSION_INFO
      • OPENSSL_VERSION_NUMBER
      • ALERT_DESCRIPTION_HANDSHAKE_FAILURE
      • ALERT_DESCRIPTION_INTERNAL_ERROR
      • Purpose.SERVER_AUTH
      • Purpose.CLIENT_AUTH
  • 17.3.2. SSL Sockets
    • SSLSocket.do_handshake()
    • SSLSocket.getpeercert()
    • SSLSocket.cipher()
    • SSLSocket.compression()
    • SSLSocket.get_channel_binding()
    • SSLSocket.selected_alpn_protocol()
    • SSLSocket.selected_npn_protocol()
    • SSLSocket.unwrap()
    • SSLSocket.version()
    • SSLSocket.context
  • 17.3.3. SSL Contexts
    • SSLContext
    • SSLContext.cert_store_stats()
    • SSLContext.load_cert_chain()
    • SSLContext.load_default_certs()
    • SSLContext.load_verify_locations()
    • SSLContext.get_ca_certs()
    • SSLContext.set_default_verify_paths()
    • SSLContext.set_ciphers()
    • SSLContext.set_alpn_protocols()
    • SSLContext.set_npn_protocols()
    • SSLContext.set_servername_callback()
    • SSLContext.load_dh_params()
    • SSLContext.set_ecdh_curve()
    • SSLContext.wrap_socket()
    • SSLContext.session_stats()
    • SSLContext.check_hostname
    • SSLContext.options
    • SSLContext.protocol
    • SSLContext.verify_flags
    • SSLContext.verify_mode
  • 17.3.4. Certificates
    • 17.3.4.1. Certificate chains
    • 17.3.4.2. CA certificates
    • 17.3.4.3. Combined key and certificate
    • 17.3.4.4. Self-signed certificates
  • 17.3.5. Examples
    • 17.3.5.1. Testing for SSL support
    • 17.3.5.2. Client-side operation
    • 17.3.5.3. Server-side operation
  • 17.3.6. Notes on non-blocking sockets
  • 17.3.7. Security considerations
    • 17.3.7.1. Best defaults
    • 17.3.7.2. Manual settings
      • 17.3.7.2.1. Verifying certificates
      • 17.3.7.2.2. Protocol versions
      • 17.3.7.2.3. Cipher selection
    • 17.3.7.3. Multi-processing
  • 17.3.8. LibreSSL support
• 17.4. signal — Set handlers for asynchronous events
  • SIG_DFL
  • SIG_IGN
  • CTRL_C_EVENT
  • CTRL_BREAK_EVENT
  • NSIG
  • ITIMER_REAL
  • ITIMER_VIRTUAL
  • ITIMER_PROF
  • ItimerError
  • alarm()
  • getsignal()
  • pause()
  • setitimer()
  • getitimer()
  • set_wakeup_fd()
  • siginterrupt()
  • signal()
  • 17.4.1. Example
• 17.5. popen2 — Subprocesses with accessible I/O streams
  • popen2()
  • popen3()
  • popen4()
  • Popen3
  • Popen4
  • 17.5.1. Popen3 and Popen4 Objects
    • Popen3.poll()
    • Popen3.wait()
    • Popen3.fromchild
    • Popen3.tochild
    • Popen3.childerr
    • Popen3.pid
  • 17.5.2. Flow Control Issues
• 17.6. asyncore — Asynchronous socket handler
  • loop()
  • dispatcher
    • dispatcher.handle_read()
    • dispatcher.handle_write()
    • dispatcher.handle_expt()
    • dispatcher.handle_connect()
    • dispatcher.handle_close()
    • dispatcher.handle_error()
    • dispatcher.handle_accept()
    • dispatcher.readable()
    • dispatcher.writable()
    • dispatcher.create_socket()
    • dispatcher.connect()
    • dispatcher.send()
    • dispatcher.recv()
    • dispatcher.listen()
    • dispatcher.bind()
    • dispatcher.accept()
    • dispatcher.close()
  • dispatcher_with_send
  • file_dispatcher
  • file_wrapper
  • 17.6.1. asyncore Example basic HTTP client
  • 17.6.2. asyncore Example basic echo server
• 17.7. asynchat — Asynchronous socket command/response handler
  • async_chat
    • async_chat.ac_in_buffer_size
    • async_chat.ac_out_buffer_size
  • async_chat.close_when_done()
  • async_chat.collect_incoming_data()
  • async_chat.discard_buffers()
  • async_chat.found_terminator()
  • async_chat.get_terminator()
  • async_chat.push()
  • async_chat.push_with_producer()
  • async_chat.set_terminator()
  • 17.7.1. asynchat - Auxiliary Classes
    • fifo
      • fifo.is_empty()
      • fifo.first()
      • fifo.push()
      • fifo.pop()
  • 17.7.2. asynchat Example