Skip to main content
edited tags
Link
Jeff Schaller
  • 68.8k
  • 35
  • 122
  • 267
Post Reopened by phk, techraf, Stephen Kitt, Kusalananda, CommunityBot
deleted 24 characters in body
Source Link
user34720
user34720

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files: codigos.txt, a file with the ids, dates.txt, a file with the dates and cookies.txt the file with the cookie that I need to do the request.

  1. codigos.txt: it's a file with the ids;
  2. dates.txt: it's a file with the dates;
  3. cookies.txt: it's the file with the cookie that I need to do the request.

What I want to do is: to save the response from mywebsite.com for each url, using the contents of my files.

  • Save the response from mywebsite.com for each url, using my files to do so.

Problems:

  1. How do I do to use information coming from two files?
  2. The url is cut at the '&' (even when I put the quotes). Example:

request made to http://mywebsite.com/teste?id=1

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files:

  1. codigos.txt: it's a file with the ids;
  2. dates.txt: it's a file with the dates;
  3. cookies.txt: it's the file with the cookie that I need to do the request.

What I want to do is:

  • Save the response from mywebsite.com for each url, using my files to do so.

Problems:

  1. How do I do to use information coming from two files?
  2. The url is cut at the '&' (even when I put the quotes). Example:

request made to http://mywebsite.com/teste?id=1

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files: codigos.txt, a file with the ids, dates.txt, a file with the dates and cookies.txt the file with the cookie that I need to do the request.

What I want to do is to save the response from mywebsite.com for each url, using the contents of my files.

Problems:

  1. How do I do to use information coming from two files?
  2. The url is cut at the '&' (even when I put the quotes). Example:

request made to http://mywebsite.com/teste?id=1

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

added 584 characters in body
Source Link

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files:

  1. codigos.txt: it's a file with the ids;
  2. dates.txt: it's a file with the dates;
  3. cookies.txt: it's the file with the cookie that I need to do the request.

What I want to do is:

  • Save the response from mywebsite.com for each url, using my files to do so.

Problems:

  1. How do I do to use information coming from two files?
  2. The url is cut at the '&' (even when I put the quotes). Example:

is being cut at the '&' (even when I put the quotes).request made to http://mywebsite.com/teste?id=1

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files:

  1. codigos.txt: it's a file with the ids;
  2. dates.txt: it's a file with the dates;
  3. cookies.txt: it's the file with the cookie that I need to do the request.

What I want to do is:

  • Save the response from mywebsite.com for each url, using my files to do so.

Problems:

  1. How do I do to use information coming from two files?
  2. The url

is being cut at the '&' (even when I put the quotes).

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

I want to use parallel in this example:

cat codigos.txt | parallel -j 10 "wget http://mywebsite.com/teste?id={}&x=&date=01/01/2017" --load-cookies=cookies.txt

I have three files:

  1. codigos.txt: it's a file with the ids;
  2. dates.txt: it's a file with the dates;
  3. cookies.txt: it's the file with the cookie that I need to do the request.

What I want to do is:

  • Save the response from mywebsite.com for each url, using my files to do so.

Problems:

  1. How do I do to use information coming from two files?
  2. The url is cut at the '&' (even when I put the quotes). Example:

request made to http://mywebsite.com/teste?id=1

As this example (but without put the space or cut because of the '&'):

cat abc-file | parallel -a - -a def-file echo

reference: https://www.gnu.org/software/parallel/parallel_tutorial.html

added 584 characters in body
Source Link
Loading
Post Closed as "Needs details or clarity" by DopeGhoti, GAD3R, mdpc, Satō Katsura, G-Man Says 'Reinstate Monica'
Source Link
Loading