The heat first comes off the CPU and GPU, which sit below a metal plate and a layer of TIM (aka Thermal Interface Material).
Both PC building and maintenance involves some not-so-obvious traps ...