This is a problem with the server configuration, and how it tells the browser to cache the HTML files used as template partials.
Understanding Browser Caching
You are attempting to do $templateCache.remove(..) and $templateCache.removeAll() which is not going to work, because the templates haven't been loaded yet, or the browser will just reload them using the cached version.
You need to check the network history in the browser to ensure that the server is handling HTML requests correctly. Send the header settings for caching that you expected. For each partial, there should be a 302 (not modified) response. When the HTML file has changed then the server should send the new modified one to the browser.
The other problem is your default cache duration on the server might be too long. This tells the browser how often it should check the server to send new versions of the HTML file. You might want to reduce this duration to 1 hour.
Most web servers are pre-configured to assume a file with the extension .html will never change and is static. So the default settings are to have the browser cache those files for as a long as possible.
You might want to rename those files to something like .ahtml and use that as your partial file names. There shouldn't be any pre-defined configuration to force cashing of those file types.
Understanding $templateCache
This is a very simple cache service in AngularJS. If the URL is not found in memory it is loaded from the server. The next time that partial is needed while the app is running the memory version is used. The usage of this server has nothing to do with server/browser caching.
Templates The Right Way
It's a best practice to create a single JavaScript file that contains all the partial templates the application will need. This JS file will call the $templateCache service and add those templates. This improves the startup performance of your application, and removes the problem of dealing with server/browser caching.
There are several grunt tasks that can do this.
https://www.npmjs.com/package/grunt-angular-templates
https://github.com/karlgoldstein/grunt-html2js
Combine this will a JavaScript minifier and concat all your JS into a single file, and you're well on your way.