进程,线程,协程,异步IO知识点
Posted dev0ps
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了进程,线程,协程,异步IO知识点相关的知识,希望对你有一定的参考价值。
进程: qq 要以一个整体的形式暴露给操作系统管理,里面包含对各种资源的调用,内存的管理,网络接口的调用等。。。
对各种资源管理的集合 就可以成为 进程
线程: 是操作系统最小的调度单位, 是一串指令的集合
进程 要操作cpu , 必须要先创建一个线程 ,
all the threads in a process have the same view of the memory
所有在同一个进程里的线程是共享同一块内存空间的
A thread线程 is an execution执行 context上下文, which is all the information a CPU needs to execute a stream of instructions.
线程就是cpu执行时所需要的
Suppose you‘re reading a book, and you want to take a break right now, but you want to be able to come back and resume reading from the exact point where you stopped. One way to achieve that is by jotting down the page number, line number, and word number. So your execution context for reading a book is these 3 numbers.
假设
If you have a roommate, and she‘s using the same technique, she can take the book while you‘re not using it, and resume reading from where she stopped. Then you can take it back, and resume it from where you were.
Threads work in the same way. A CPU is giving you the 幻觉illusion that it‘s doing multiple多 computations运算 at the same time. It does that by spending花费 a bit点 of time on each computation运算. It can do that because it has an execution context for each computation. Just like you can share a book with your friend, many tasks can share a CPU.
On a more technical level, an execution context (therefore a thread) consists组合 of the values of the CPU‘s registers 寄存器.
Last: threads are different from 进程processes. A thread is a context of execution, while a process is a bunch一簇,一堆 of resources资源 associated相关的 with a computation. A process can have one or many threads.
Clarification: the resources associated with a process include memory pages (all the threads in a process have the same view of the memory), file descriptors (e.g., open sockets), and security credentials (e.g., the ID of the user who started the process).
什么是进程(process)?
An executing instance of a program is called a process.
Each process provides the resources needed to execute a program.
A process has a virtual虚拟 address space, executable code,
open handles to system objects, a security context,
a unique唯一的 process进程标识符,pid identifier, environment variables,
a priority 优先级类class, minimum and maximum working set sizes,
and at least至少 one thread线程 of execution.
Each process is started with a single thread,
often called the primary主 thread, but can create additional额外的
threads from any of its threads.
进程与线程的区别?
Threads share the address space of the process that created it; processes have their own address space.
线程共享内存空间,进程的内存是独立的
Threads have direct access to the data segment of its process; processes have their own copy of the data segment of the parent process.
Threads can directly communicate with other threads of its process; processes must use interprocess communication to communicate with sibling processes.
同一个进程的线程之间可以直接交流,两个进程想通信,必须通过一个中间代理来实现
New threads are easily created; new processes require duplication of the parent process.
创建新线程很简单, 创建新进程需要对其父进程进行一次克隆
Threads can exercise considerable control over threads of the same process; processes can only exercise control over child processes.
一个线程可以控制和操作同一进程里的其他线程,但是进程只能操作子进程
线程 内存共享
线程同时修改同一份数据时必须加锁,mutex互斥锁
递归锁
def run(n):
print(‘run thread...‘)
for i in range(10):
t = threading.Thread(target=run, args=(n,))
t.setDaemon(True)
t.start()
print ‘master is done....‘
守护线程(slave) 服务与非守护线程(master)
进程 至少包含一个线程
queue
解耦,使程序直接实现松耦合,
提高处理效率 ,
FIFO = first in first out
LIFO = last in first out
io 操作不占用cpu
计算占用cpu , 1+1
python多线程 不适合cpu密集操作型的任务,适合io操作密集型的任务
multiprocess
Queue Pipe 只是实现进程间数据的传递
Manager 实现了进程间数据的共享,即多个进程可以修改同一份数据
IO 多路复用
以上是关于进程,线程,协程,异步IO知识点的主要内容,如果未能解决你的问题,请参考以下文章
python---爬虫相关性能(各个异步模块的使用,和自定义异步IO模块)
Python异步IO之协程:从yield from到async的使用
# 进程/线程/协程 # IO:同步/异步/阻塞/非阻塞 # greenlet gevent # 事件驱动与异步IO # SelectPollEpoll异步IO 以及selectors模块 # (示