You should have three different Calculated shipping costs.
Canada
USA
Custom (not including N&S America nor USA).
Then you can hit Worldwide below that. Do not specify in that section.
The problem is defaults. N&S America will override USA. Worldwide will override Custom including USA. Which makes the shipping for our biggest market higher than necessary.