I started pumping the day after my baby was born.
After about 4 weeks, but only because breastfeeding was going so well and the HV spooked me that I'd ruin it. I'd definitely start sooner next time to share the workload sooner!!
I started 2 days after I gave birth to make my baby get used to both breast and the bottle