@garethr Heh!
Depending on how many of these files change with each build, subsequent deployments should speed up. (Since behind the scenes only modified assets are propagated to the CDN).
Of course, your site generation speed will be more in the hands of whatever you are doing there.