我试图从一个bash变量中动态地设置用户代理。但看起来这并不是那么直接。
由于如果标头值包含空格,则需要将标头括在单引号中,因此我们无法避免用户代理标头使用单引号,但如果这样做,变量将不会被计算,如果我们将其替换为双引号,ua字符串中的空格将会造成很多混乱。
推荐的方法是在curl命令之外创建所有的头、数据、cookie变量,并在一次操作中使用它。但是,这是否意味着我们永远不能在curl命令中单独设置用户代理变量?
下面给出了我现在尝试使用的命令,
curl --proxy localhost:8000 -m 1 --retry 0 -i -s -S -b cookie.jar -c cookie.jar -X POST "https://myhost:51512/id?val=${id}" -H 'user-agent: Mozilla/5.0 (iPad; U; CPU OS 3_2_1 like Mac OS X; en-us) AppleWebKit/531.21.10 (KHTML, like Gecko) Mobile/7B405'至
linux_ua="Mozilla/5.0 (Unknown; Linux) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/v1.0.0 Safari/537.1"
my_user_agent=$linux_ua
curl --proxy localhost:8000 -m 1 --retry 0 -i -s -S -b cookie.jar -c cookie.jar -X POST "https://myhost:51512/id?val=${id}" -H '${user_agent}'发布于 2018-02-22 02:53:16
单引号只是shell语法,用于防止字符串中的任何类型的扩展;它们不是标题本身的一部分。在这种情况下,使用双引号也同样有效。
curl ... -H "user-agent: Mozilla/5.0 (iPad; U; CPU OS 3_2_1 like Mac OS X; en-us) AppleWebKit/531.21.10 (KHTML, like Gecko) Mobile/7B405"将用户代理存储在一个变量中很简单:
ua="user-agent: Mozilla/5.0 (iPad; U; CPU OS 3_2_1 like Mac OS X; en-us) AppleWebKit/531.21.10 (KHTML, like Gecko) Mobile/7B405"
curl ... -H "$ua"在这里,您必须使用双引号来展开$ua的值;使用curl ... -H '$ua'将发送由3个字符组成的字符串$ua作为标题。
发布于 2018-10-08 18:02:40
你在Bash中遇到了word splitting的特殊问题,BashFAQ/050在这个问题上有很好的例子。
您可以运行以下脚本来调查该行为。
#!/usr/bin/env bash
#
# a script for the demonstration of word splitting
set -ex
url='localhost:8080/get' # docker run --rm -p 8080:80 kennethreitz/httpbin
user_agent='Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1'
curl_opts_with_quote="--user-agent '${user_agent}'"
curl_opts_without_quote="--user-agent ${user_agent}"
curl -H 'Accept: application/json' $curl_opts_with_quote $url
curl -H 'Accept: application/json' $curl_opts_without_quote $url
curl_opts_array=(--user-agent "${user_agent}")
curl -H 'Accept: application/json' "${curl_opts_array[@]}" $url输出
请注意,输出行开始于从httpbin返回的+和User-Agent。
+ url=localhost:8080/get
+ user_agent='Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1'
+ curl_opts_with_quote='--user-agent '\''Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1'\'''
+ curl_opts_without_quote='--user-agent Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1'
+ curl -H 'Accept: application/json' --user-agent ''\''Mozilla/5.0' '(Windows' NT '5.1;' 'rv:2.0.1)' Gecko/20100101 'Firefox/4.0.1'\''' localhost:8080/get
curl: (6) Could not resolve host: (Windows
curl: (6) Could not resolve host: NT
curl: (6) Could not resolve host: 5.1;
curl: (3) Port number ended with '.'
curl: (6) Could not resolve host: Gecko
curl: (6) Could not resolve host: Firefox
{
"args": {},
"headers": {
"Accept": "application/json",
"Host": "localhost:8080",
"User-Agent": "'Mozilla/5.0"
},
"origin": "172.30.5.9",
"url": "http://localhost:8080/get"
}
+ curl -H 'Accept: application/json' --user-agent Mozilla/5.0 '(Windows' NT '5.1;' 'rv:2.0.1)' Gecko/20100101 Firefox/4.0.1 localhost:8080/get
curl: (6) Could not resolve host: (Windows
curl: (6) Could not resolve host: NT
curl: (6) Could not resolve host: 5.1;
curl: (3) Port number ended with '.'
curl: (6) Could not resolve host: Gecko
curl: (6) Could not resolve host: Firefox
{
"args": {},
"headers": {
"Accept": "application/json",
"Host": "localhost:8080",
"User-Agent": "Mozilla/5.0"
},
"origin": "172.30.5.9",
"url": "http://localhost:8080/get"
}
+ curl_opts_array=(--user-agent "${user_agent}")
+ curl -H 'Accept: application/json' --user-agent 'Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1' localhost:8080/get
{
"args": {},
"headers": {
"Accept": "application/json",
"Host": "localhost:8080",
"User-Agent": "Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1"
},
"origin": "172.30.5.9",
"url": "http://localhost:8080/get"
}https://stackoverflow.com/questions/48913266
复制相似问题