How to send large file using Spring REST multipart in chunks (REST client)

Question

I am using spring REST to write a client which will upload a file to DB. Following is the server side controller code which I can not change :

@RequestMapping(method = RequestMethod.POST)
public ResponseEntity<UploadResponseDto> uploadFile(@RequestParam("file") MultipartFile file) throws IOException {

    String contentType =  file.getContentType();
    if ( contentType == null || !contentType.equalsIgnoreCase(APPLICATION_OCTET_STREAM)) {
        contentType = APPLICATION_OCTET_STREAM;
    }
    GridFSFile gridFSFile = gridFsTemplate.store(file.getInputStream(), file.getOriginalFilename(), contentType);

    MultiValueMap<String, String> headers = new LinkedMultiValueMap<>();
    String fileLocation = linkTo(FileAttachmentController.class).slash(gridFSFile.getId()).toUri().toString();
    headers.add(LOCATION, fileLocation);
    UploadResponseDto uploadResponseDto = new UploadResponseDto(file.getOriginalFilename(), fileLocation);
    return new ResponseEntity<>(uploadResponseDto, headers, HttpStatus.CREATED);
}

And my client side code for sending file is :

SimpleClientHttpRequestFactory factory = new SimpleClientHttpRequestFactory();
    factory.setBufferRequestBody(false);
    RestTemplate restTemplate = new RestTemplate(factory);

    HttpHeaders headers = new HttpHeaders();
    headers.set(HttpHeaders.AUTHORIZATION, "Bearer " + token);
    headers.set("Accept", "application/json");
    headers.setContentType(MediaType.MULTIPART_FORM_DATA);

    File file = new File(fileToUpload);
    MultiValueMap<String, Object> data = new LinkedMultiValueMap<String, Object>();
    ByteArrayResource resource = new ByteArrayResource(
        Files.readAllBytes(Paths.get(fileToUpload))) {
        @Override
        public String getFilename() {
            return file.getName();
        }
    };
    data.add("file", resource);
    HttpEntity<MultiValueMap<String, Object>> requestEntity = new HttpEntity<MultiValueMap<String, Object>>(
        data, headers);
    ResponseEntity<Map> apiResponse = null;

    apiResponse = restTemplate.exchange(
        "http://{end_point_url}",
        HttpMethod.POST, requestEntity, Map.class);

But when I use this code to send lets say 50 MB file, it throws "413 Request entity too large error"

Can somebody please help me out on how to send a large file in chunks?

Thanks & Regards, Vikas Gite

your server is capable of accepting how much chunk at a time?this is spring boot? — Tnadev
– Tnadev, Commented Oct 4, 2017 at 7:07
Yes. I have property multipartMaxFileSize. But even though it is set to 50, I am still getting error for files less than 20MB size. — Vikas Gite
– Vikas Gite, Commented Oct 4, 2017 at 7:14
Possible duplicate of Increase HTTP Post maxPostSize in Spring Boot — Jay
– Jay, Commented Oct 4, 2017 at 9:13
@VikasGite Were you able to send the file as chunks using Springtemplate? If yes, kindly point me to the code examples? — TuneIt
– TuneIt, Commented Feb 26, 2020 at 23:20

Kalaiselvan · Accepted Answer · 2018-01-11 03:50:20Z

1

You can specify a size of the upload file by using

org.springframework.web.multipart.commons.CommonsMultipartResolver

@Bean(name = "multipartResolver")
public CommonsMultipartResolver multipartResolver() {
    CommonsMultipartResolver multipartResolver = new CommonsMultipartResolver();
    multipartResolver.setMaxUploadSize(54525952); //...specify your size of file  (20971520 - 20 MB) (54525952 - 52 MB)
    return multipartResolver;
}

edited Jan 11, 2018 at 3:50

answered Oct 4, 2017 at 5:29

Kalaiselvan

2,1441 gold badge19 silver badges31 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Kalaiselvan Over a year ago

add this in your existing bean creation file or a file which extends from WebMvcConfigurerAdapter

Vikas Gite Over a year ago

Still it did not solved my problem. 413 is thrown by the server.

Vikas Gite Over a year ago

I am afraid, changing the size to 50MB has also not solved my error. I am trying to upload 17MB file here.Is my code correct? What do you think? Will it send in chunks?

Kalaiselvan Over a year ago

cool @VikasGite may be you missed something in a spring configuration and without seeing the full code how I can able to tell anything?

Tnadev · Accepted Answer · 2017-10-04 07:19:56Z

0

Update

Okay so you have set multipartMaxFileSize, but along with this you also need to set max request size if you have a single file that's greater than 10MB

Seems you are using Spring 4.x

So config goes like

spring.http.multipart.maxFileSize
spring.http.multipart.maxRequestSize

Official Source

Depricated: By default SimpleClientHttpRequestFactory buffers the request body internally.

Make it false

SimpleClientHttpRequestFactory factory = new SimpleClientHttpRequestFactory();
factory.setBufferRequestBody(false);

Source

edited Oct 4, 2017 at 7:19

answered Oct 4, 2017 at 5:31

Tnadev

10.2k7 gold badges68 silver badges74 bronze badges

1 Comment

Vikas Gite Over a year ago

Both maxFileSize and maxRequestSize are already set. Sorry I mentioned only one in previous comment.

Collectives™ on Stack Overflow

How to send large file using Spring REST multipart in chunks (REST client)

2 Answers 2

4 Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related