Questions tagged [http]
All about programs and services that use the Hypertext Transfer Protocol.
320 questions
1
vote
1
answer
237
views
curl replacement for (continuous) form-upload of piped (audio) data
For the transcription of audio recordings, I use the following command:
fish -c 'echo $fish_pid > ~/.kill_pid;exec arecord -f cd' | \
curl --url https://api.openai.com/v1/audio/transcriptions \
...
- 130
0
votes
1
answer
52
views
httpie: how to --form POST a file read from a pipe?
cat some_file | http --form POST $url file@-
fails with error
file@-': [Errno 2] No such file or directory: '-'
How am I supposed to specify reading file contents from a pipe with httpie?
Docs at ...
- 130
0
votes
0
answers
212
views
Grafana on Debian 11 system: curl http://localhost:3000 --> connection refused
I have a really hard time with my Grafana on a Debian 11 system. The server seems to be running fine in principle, but I cannot reach it. This happened after I did apt-get upgrade and update on the ...
- 113
0
votes
2
answers
127
views
Mount single remote file over HTTP for local playback
Using Debian 12 VM.
Is there any way to mount in the filesystem, a singular remote file (typically media, e.g. mkv) accessed via HTTP/S path?
I've tried various solutions:
rclone - won't mount a ...
- 29
0
votes
1
answer
308
views
Bash HTTP image receiver server curl 55 broken pipe error
I'm new to writing bash scripts and mostly using chatgpt to get templates right now. I am trying to create a simple netcat based http server which receives and stores .png files. I have a second ...
- 1
1
vote
0
answers
158
views
http/https monitoring from terminal with top-like interface
I'm looking for a network monitor in a top-like interface, but I would like to be able to inspect all requests / responses, not just the IP addresses that are being connected to. I've found several ...
0
votes
1
answer
43
views
Use wget to retrieve Supplemental Data from Science dot org
I'm building a pipeline in Snakemake to analyse some data. One of the data files I'm using is provided as supplemental data as part of this publication. The paper is behind a paywall, but I've ...
- 245
1
vote
0
answers
114
views
ERR_HTTP2_COMPRESSION_ERROR while downloading a file
I am using libwebsockets C++ library for my http server.
I can download a file using API with postman
Response Headers content-type: application/zip content-length: 107627
cache-control: no-store ...
- 11
0
votes
0
answers
271
views
How to diagnose why I can't access some URLs but not others from a Linux machine
I'm running openSUSE (Tumbleweed), which has worked fine for ages. After running sudo zypper DUP a few weeks ago (and since) suddenly there's a network issue with only some URLs.
The ones I can't ...
- 123
-1
votes
1
answer
202
views
http header Content-Disposition missing in response for file serving in libwebsockets api
I am using libwebsockets library for https server implementation.
Here is the code to serve a file via HTTPS, But I receive HTTPS response without header variable
Content-Disposition:attachment; ...
- 11
1
vote
1
answer
133
views
Why is my web server serving HTTPS content on port 80?
Apache webserver on Rocky Linux 9, with SSL certs obtained from LetsEncrypt. This is the config of a specific virtual host "myvhost", but the problem arises for all vhosts on my server:
/etc/...
- 32.4k
0
votes
1
answer
2k
views
Simple systemd socket activation from HTTP request
I want to use systemd socket activation to start a service whenever an HTTP request is received on the listening socket. The incoming message is not important and can be discarded by systemd or the ...
- 207
0
votes
1
answer
157
views
Bot crawling getting 301/redirects instead of 404 so it's hiding from fail2ban. How is it getting 301 intead of 404?
I have fail2ban setup and it's working great for most scanning. It triggers off any 4xx in the nginx error log. However, note the following bot scan. Somehow THIS bot is triggering my server to return ...
- 103
0
votes
2
answers
144
views
ProxyPass return 404, but one name OK
Good day to all. I'll give you an example, I tried it
There are 2 entries for BalanceMember in /etc/hosts. Of course, don’t look at these virtual machines, it’s a black box. All requests return to 404 ...
- 13
0
votes
0
answers
175
views
ufw rule supposed to block traffic but iptables allows it
As a test I wanted to temporarily block access to my website. So, I deleted http/https rules using ufw delete command. ufw is set to default deny incoming. The only remaining rule is the one allowing ...
- 179
0
votes
1
answer
490
views
Debian (and ubuntu) having throubles in downloading apt-get updates if I use https
As stated in the previous question: How can i force apt-get or apt to use only https connections
deb https://deb.debian.org/debian bookworm main
deb https://security.debian.org/debian-security ...
- 3,104
0
votes
0
answers
126
views
why do I have requests from inside apache server with source ports 80 and 443
On one machine, I have a web server running (apache) and responding on ports 80 and 443. On this machine, I have a firewall (shorewall) that blocks everything except what I authorize, and I therefore ...
- 43
0
votes
0
answers
835
views
How to stream local audio to HTTP
How can I set up a HTTP audio streaming server that I can access on http://localhost:8080 without specialized software or configuration on the local side? (the remote side, which streams the audio, ...
- 460
0
votes
1
answer
346
views
what should be the format of http logs of a proxy?
In this specific case I am using fabio and nginx and apache http proxy that just proxies requests to destinations.
Both the "Combined Log Format" and "Common Log Format" do not ...
- 970
0
votes
1
answer
74
views
Http outperformed Http2 ,why, please help me to figure out?
I'm currently conducting performance testing on my NGINX web server container and I'm encountering some unexpected results. My tests show that HTTP performance is outperforming HTTP/2, despite SSL and ...
- 1
1
vote
1
answer
3k
views
UEFI HTTP Boot clarity?
I'm interested in learning more about UEFI HTTPBoot and setting it up for my
LAN as a netboot option, but the details are notably sparse. The best docs I've
found are Suse Docs for
configuring an HTTP ...
- 113
0
votes
1
answer
3k
views
A simple command-line utility to show HTTP request/responses on a specific port
I have a simple API that listens on http://localhost:5000 and I have the Nginx as a reverse proxy that listens on https://example.com.
I have configured Nginx to send headers to my API:
location /
...
- 841
1
vote
2
answers
2k
views
UEFI HTTP boot only: GRUB2 used a mysterious HTTP agent "UefiHttpBoot/1.0" to load initrd and failed to completely read large initrd
I was using GRUB for UEFI PXE boot or UEFI HTTP boot of a Linux Live OS (made by Ubuntu Focal or Bionic or Jammy). I used the same grub.cfg for both methods. It worked well under UEFI PXE boot, but ...
- 632
0
votes
1
answer
4k
views
HTTP version for CURL command on server and docker image
When I'm doing a CURL call curl https://example.com from a docker container, I got the error curl: (92) HTTP/2 stream 0 was not closed cleanly: HTTP_1_1_REQUIRED (err 13). But when I'm running the ...
- 27
0
votes
0
answers
428
views
Unable to parse HTTP packet using netfilter hooks in kernel module
I am trying to parse HTTP packets using netfilter hooks in my kernel module. I came across this code snippet on How to print data from TCP packets which I modified to make it build. However, I am ...
- 101
-2
votes
1
answer
113
views
Is the concept of file permission only applicable when access is via shell?
So in Linux we have a concept of file permission. There are three classes: user, group, and others, and there are three types of permissions: read, write, and execute.
Now consider this. You are on a ...
- 224
3
votes
1
answer
995
views
How do you fetch a large file over http in parallel?
Question:
Since HTTP supports resuming at an offset, are there any tools (or existing options for commands like wget or curl) that will launch multiple threads to fetch the file in parallel with ...
- 535
2
votes
1
answer
1k
views
Some secret service is taking over port 80... I can't identify which one?
I have an nginx service that resides on ports 80 and 443 and has done som for years. Yesterday I suddenly just got a plain text page with a 404 page not found message
Headers:
HTTP/2 404
content-type: ...
- 215
0
votes
0
answers
378
views
Error Trying to load http url using curl
I am beginner. I am trying to load HTTP URL using curl in my Ubuntu terminal.
The command I am using is
curl -L 'http://google.com'
But instead of getting source code. I am getting below error
curl: ...
1
vote
0
answers
136
views
apache2 crit error file util_ldap.c, line 85, assertion "0" failed
I have simple webservice with one index.html file with hello world
And I'm trying to make this website accessible only with LDAP authentication, but when I trying to access website errors start occur....
- 111
0
votes
2
answers
227
views
why iptables commands yield seemingly contradictory results on my embeded Linux?
I'm running an Embedded Linux system, whose kernel is 3.18.21, with some applications on top it on MIPS. When I run iptables & ip6tables on the Linux, such as the following:
iptables -A INPUT -p ...
- 233
0
votes
0
answers
733
views
How to redirect all http traffic to Burp Suite?
How to redirect all HTTP requests to Burb Suite?
I am using a Ubuntu OS running on VM installed on my macOS machine, and I have tried the following IPTables commands to do that, without success:
sudo ...
- 3
0
votes
1
answer
692
views
How does it works the "HTTP 101 Protocols Switching" in a client server communication?
I'm developing a web site that is served by the web server NGINX installed on a Linux platform. One of the service provided by the web site is base on a WebSocket backend server.
To be more specific ...
- 690
1
vote
1
answer
12k
views
Curl returning with no response and does not wait for `wait=x seconds`
I call an async service that takes ~80 seconds to respond. I run:
curl -v -X POST https://hostname.com/service/v2/predict \
-H 'x-api-key: somekey' \
-H 'x-request-id: longfiles' \
-H "...
- 5,585
1
vote
0
answers
77
views
Has the target of a HTTP CONNECT tunnel to be reachable from both client and proxy?
I am trying to tunnel ssh via HTTP. My apache virtual host config looks as follows:
<VirtualHost *:443>
ServerName proxy.example.org
ProxyRequests On
AllowCONNECT 22
<Proxy *&...
- 11
0
votes
1
answer
163
views
How to define HTTP_PROXY uppercase as http_proxy lowercase in macos?
How to define HTTP_PROXY uppercase as http_proxy lowercase in macos?
Is there a way to set HTTP_PROXY to work similarly as http_proxy?
- 3
1
vote
0
answers
2k
views
Upload file to SFTP directly from HTTP using cURL
I am struggling with uploading a file to an SFTP from a URL. All steps work independently but when I combine them they seem to be split into two separate tasks, downloading the file and then ...
0
votes
1
answer
2k
views
Intercept and edit http requests on the fly
Is there a tool that'll let me programatically inspect and edit http requests being emitted from my box on the fly?
I'm hoping to create the ability to access mirrors of commonly downloaded files when ...
- 105
1
vote
2
answers
534
views
Print output of httpie command, then pipe to grep
how can I print output of httpie request then pipe to grep to check if request has succeeded or failed?
http --print=hb POST http://localhost:8080 | grep -c "HTTP/1.1 200" && echo &...
- 113
0
votes
1
answer
874
views
how to make sure the proxy works or not in macOS iterm
Now I am set the proxy in .zshrc like this:
alias proxy='export all_proxy=socks5://127.0.0.1:7890'
and check using the env command in terminal, shows the proxy env value like this:
all_proxy=socks5://...
- 791
0
votes
1
answer
45
views
How do I set up my raspberry pi so that I can connect to its ip address via a domain
Let me explain what I want to happen.
I have an http server program that displays a website every time I connect to my raspberry pi's ip address on port 8080. But this only works on my current network....
- 35
0
votes
0
answers
456
views
firewalld not blocking http and https access
I am running a httpd container on this machine, but http or https aren't enabled on firewalld. But I can still access the website from another machine that is on the same network. Why is this behavior?...
1
vote
2
answers
3k
views
Curl Parallel requests using links source file
I have this script to go through a list of URLs and the check return codes using Curl.
Links file goes like this:
https://link1/...
https://link2/...
https://link200/...
(...)
The script:
INDEX=0
DIR=...
- 455
0
votes
1
answer
498
views
Server responses with IP Address instead of host name
I have a Backend which is used as a REST API. When I make a request to the server (GET https://subdomain.server.com/users/all) I get this response from the server:
GET https://87.69.152.36/users/all
...
- 1
1
vote
0
answers
3k
views
why could access url using curl but faild in the google chrome broswer
I am config the localhost url in the nginx on macOS like this:
➜ nginx git:(master) cat conf.d/reddwarf-admin.conf
server {
listen 8083;
server_name admin.reddwarf.com;
...
- 791
1
vote
1
answer
712
views
Streaming audio files over HTTP with Media Player Daemon fails - 'Not found'
I'm trying to set up a simple MPD instance to stream audio files over HTTP. What I'd like to be able to do is put in a URL in my browser, which will stream the audio file - as simple as possible.
I've ...
- 11
0
votes
0
answers
320
views
since when CentOS has a welcome page with the default http server
On my network, I have many CentOS VMs with various versions dating from very recently to 10-15 years ago. For some of them I don't have credentials but I want to check if I should keep them by the ...
- 101
0
votes
1
answer
487
views
How to obtain data from a site that uses javascript?
What I want is to query metallum to obtain a plain list of songs that contain x word, let's say spider, so the query for the browser would be https://www.metal-archives.com/search?searchString=spider&...
- 51
0
votes
1
answer
2k
views
Open URL as if with browser from command line
I am having roughly the same problem as in this question, where the problem is, there is a certain URL that, when called in the browser, will download a file, but when called from the command line ...
- 137
1
vote
3
answers
28k
views
Return status code and body in curl
Is it possible to use curl to call a REST service (POST method) and get:
The HTTP status code.
The response body.
Other information like headers, methods, etc. are not relevant for my use case and ...
- 113