I've removed this from {{delete}} and {{MediaWiki Sites}} and I re-marked them for translation. Looks like they still work, and the translated versions of translatable pages that transclude them looks correctly after purging.
Am I missing anything?
Or can it really be removed from any template that is marked for translation and uses translation-aware transclusion?