I know hostels don't work for everyone, but I stayed in Cairo for $8 a night in one.
It was clean and safe, located in the center of Cairo.