Streaming media technology transmits vast data through networks, and users' visiting streaming media server features randomness and uncertainty. In order to offer highly effective services for the customers, the design of system structure must be rational, and the resources such as CPU, memory, I/O bus and so on must be allocated reasonably. This paper adopts buffer and thread pool to analyze and improve these problems. The simulation results prove that it is completely proper to construct a moderate scale streaming media server.