blocks|key|3937960|text|FTPLib是用Python语言实现的，而你的"DOS脚本“实际上是一个调用编译命令的脚本。执行此命令可能比解释Python代码更快。如果它对你来说太慢了，我建议使用subprocess+module从Python中调用DOS命令。|type|unstyled|depth|inlineStyleRanges|entityRanges|offset|length|data|3937961|entityMap|0|LINK|mutability|MUTABLE|url|http://docs.python.org/library/subprocess.html^0|2B|H|0|0^^$0|@$1|2|3|4|5|6|7|L|8|@]|9|@$A|M|B|N|1|O]]|C|$]]|$1|D|3|-4|5|6|7|P|8|@]|9|@]|C|$]]]|E|$F|$5|G|H|I|C|$J|K]]]]

FTPLib is implemented in Python whereas your "DOS Script" is actually a script which calls a compiled command. Executing this command is probably faster than interpreting Python code. If it is too slow for you, I suggest to call the DOS command from Python using the <a href="http://docs.python.org/library/subprocess.html" rel="nofollow noreferrer">subprocess module</a>.

blocks|key|718321|text|速度问题可能出在您的代码中。FTPlib的速度不会慢10倍。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|718322|entityMap^0|0^^$0|@$1|2|3|4|5|6|7|D|8|@]|9|@]|A|$]]|$1|B|3|-4|5|6|7|E|8|@]|9|@]|A|$]]]|C|$]]

The speed problem is probably in your code. FTPlib is not 10 times slower.

blocks|key|718429|text|定义块大小和ftp连接的storbinary，这样你将获得比FTP+Filezilla快1.5-3.0倍的连接速度:)|type|unstyled|depth|inlineStyleRanges|entityRanges|data|718430|from+ftplib+import+FTP

USER+=+"Your_user_id"
PASS+=+"Your_password"
PORT+=+21
SERVER+=+'ftp.billionuploads.com'+#use+FTP+server+name+here

ftp+=+FTP()
ftp.connect(SERVER,+PORT)
ftp.login(USER,+PASS)

try:
++++file+=+open(r'C:\Python27\1.jpg','rb')
++++ftp.storbinary('STOR+'+%2B+'1.jpg',+file,102400)+#here+we+store+file+in+100kb+blocksize
++++ftp.quit()
++++file.close()
++++print+"File+transfered"
except:
++++print+"Error+in+File+transfering"|code-block|syntax|javascript|718431|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|I|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|J|8|@]|9|@]|A|$E|F]]|$1|G|3|-4|5|6|7|K|8|@]|9|@]|A|$]]]|H|$]]

define blocksize along with storbinary of ftp connection,so you will get 1.5-3.0x more faster connection than FTP Filezilla :)

<pre><code>from ftplib import FTP

USER = "Your_user_id"
PASS = "Your_password"
PORT = 21
SERVER = 'ftp.billionuploads.com' #use FTP server name here

ftp = FTP()
ftp.connect(SERVER, PORT)
ftp.login(USER, PASS)

try:
 file = open(r'C:\Python27\1.jpg','rb')
 ftp.storbinary('STOR ' + '1.jpg', file,102400) #here we store file in 100kb blocksize
 ftp.quit()
 file.close()
 print "File transfered"
except:
 print "Error in File transfering"
</code></pre>

blocks|key|1225856|text|FTPlib可能不是最干净的Python+API，我不认为它运行起来比DOS+shell脚本慢十倍。|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1225857|除非你不提供任何代码比较，例如你的shell和你的python代码片段批处理dl+5000文件，我看不出我们能如何帮助你。|1225858|entityMap^0|0|0^^$0|@$1|2|3|4|5|6|7|F|8|@]|9|@]|A|$]]|$1|B|3|C|5|6|7|G|8|@]|9|@]|A|$]]|$1|D|3|-4|5|6|7|H|8|@]|9|@]|A|$]]]|E|$]]

FTPlib may not be the cleanest Python API, I don't think it so bad that it run ten times slower than a DOS shell script.

Unless you do not provide any code to compare, e.g you shell and you python snippet to batch dl 5000 files, I can't see how we can help you.

blocks|key|1225948|text|更大的块大小并不总是最优的。例如，通过有线网络将相同的167MB文件上传到相同的FTP服务器，对于不同的块大小，以秒为单位：|type|unstyled|depth|inlineStyleRanges|entityRanges|data|1225949|Blocksize++Time
102400+++++++40
+51200+++++++30
+25600+++++++28
+32768+++++++30
+24576+++++++31
+19200+++++++34
+16384+++++++61
+12800++++++144|code-block|syntax|javascript|1225950|在此配置中，最佳值约为32768+(4x8192)。|1225951|但如果我使用无线网络，我会得到这样的结果：|1225952|Blocksize++Time
204800+++++++78
102400+++++++76
+51200+++++++79
+25600+++++++76
+32768+++++++89
+24576+++++++86
+19200+++++++75
+16384++++++166
+12800++++++178
default+++++223|1225953|在这种情况下，有几个最佳块大小的值，它们都不同于32768。|1225954|entityMap^0|0|0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|Q|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|R|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|S|8|@]|9|@]|A|$]]|$1|I|3|J|5|6|7|T|8|@]|9|@]|A|$]]|$1|K|3|L|5|D|7|U|8|@]|9|@]|A|$E|F]]|$1|M|3|N|5|6|7|V|8|@]|9|@]|A|$]]|$1|O|3|-4|5|6|7|W|8|@]|9|@]|A|$]]]|P|$]]

Bigger blocksize is not always the optimum.
For example uploading the same 167 MB file through wired network to same FTP server I got following times in seconds for various blocksizes:

<pre><code>Blocksize Time
102400 40
 51200 30
 25600 28
 32768 30
 24576 31
 19200 34
 16384 61
 12800 144
</code></pre>

In this configuration the optimum was around 32768 (4x8192).

But if I used wireless instead, I got these times:

<pre><code>Blocksize Time
204800 78
102400 76
 51200 79
 25600 76
 32768 89
 24576 86
 19200 75
 16384 166
 12800 178
default 223
</code></pre>

In this case there were several optimum blocksize values, all different from 32768.

blocks|key|4781384|text|import+ftplib
import+time
ftp+=+ftplib.FTP("localhost",+"mph")
t0+=+time.time()
with+open('big.gz.sav',+'wb')+as+f:
++++ftp.retrbinary('RETR+'+%2B+'/Temp/big.gz',+f.write)
t1+=+time.time()
ftp.close()
ftp+=+ftplib.FTP("localhost",+"mph")
t2+=+time.time()
ftp.retrbinary('RETR+'+%2B+'/Temp/big.gz',+lambda+x:+x)
t3+=+time.time()
print+"saving+file:+%25f+to+%25f:+%25f+delta"+%25+(t0,+t1,+t1+-+t0)
print+"not+saving+file:+%25f+to+%25f:+%25f+delta"+%25+(t2,+t3,+t3+-+t2)|type|code-block|depth|inlineStyleRanges|entityRanges|data|syntax|javascript|4781385|所以，也许不是10倍。但我在一台笔记本电脑上保存文件的速度都在160秒以上，笔记本电脑的核心i7为1.8+all，运行Windows7的内存为8+8GB+(应该有点夸张)，而本地客户端的速度为100秒。如果不保存文件，我就不到70岁了。|unstyled|4781386|我之所以来问这个问题，是因为我在mac上看到ftplib的性能很慢(一旦我再次访问那台机器，我就会再次运行这个测试)。虽然在这种情况下使用异步写入可能是一个好主意，但在真实的网络上，我怀疑这会带来更少的收益。|4781387|entityMap^0|0|0|0^^$0|@$1|2|3|4|5|6|7|K|8|@]|9|@]|A|$B|C]]|$1|D|3|E|5|F|7|L|8|@]|9|@]|A|$]]|$1|G|3|H|5|F|7|M|8|@]|9|@]|A|$]]|$1|I|3|-4|5|F|7|N|8|@]|9|@]|A|$]]]|J|$]]

<pre><code>import ftplib
import time
ftp = ftplib.FTP("localhost", "mph")
t0 = time.time()
with open('big.gz.sav', 'wb') as f:
 ftp.retrbinary('RETR ' + '/Temp/big.gz', f.write)
t1 = time.time()
ftp.close()
ftp = ftplib.FTP("localhost", "mph")
t2 = time.time()
ftp.retrbinary('RETR ' + '/Temp/big.gz', lambda x: x)
t3 = time.time()
print "saving file: %f to %f: %f delta" % (t0, t1, t1 - t0)
print "not saving file: %f to %f: %f delta" % (t2, t3, t3 - t2)
</code></pre>

So, maybe not 10x. But my runs of this saving a file are all above 160s on a laptop with a core 1.8Ghz core i7 and 8GB of ram (should be overkill) running Windows 7. A native client does it at 100s. Without the file save I'm just under 70s.

I came to this question because I've seen slow performance with ftplib on a mac (I'll rerun this test again once I have access to that machine again). While going async with the writes might be a good idea in this case, on a real network I suspect that would be far less of a gain.

blocks|key|3938074|text|禁用ftplib并通过Msdos执行ftp|type|unstyled|depth|inlineStyleRanges|entityRanges|data|3938075|os.system('FTP+-v+-i+-s:C:\\ndfd\\wgrib2\\ftpscript.txt')|code-block|syntax|javascript|3938076|ftpscript.txt内幕|3938077|open+example.com
username
password
!:---+FTP+commands+below+here+---
lcd+c:\MyLocalDirectory
cd++public_html/MyRemoteDirectory
binary
mput+"*.*"
disconnect
bye|3938078|entityMap^0|0|0|0|0^^$0|@$1|2|3|4|5|6|7|M|8|@]|9|@]|A|$]]|$1|B|3|C|5|D|7|N|8|@]|9|@]|A|$E|F]]|$1|G|3|H|5|6|7|O|8|@]|9|@]|A|$]]|$1|I|3|J|5|D|7|P|8|@]|9|@]|A|$E|F]]|$1|K|3|-4|5|6|7|Q|8|@]|9|@]|A|$]]]|L|$]]

disable ftplib and execute ftp via Msdos

<pre><code>os.system('FTP -v -i -s:C:\\ndfd\\wgrib2\\ftpscript.txt')
</code></pre>

inside ftpscript.txt

<pre><code>open example.com
username
password
!:--- FTP commands below here ---
lcd c:\MyLocalDirectory
cd public_html/MyRemoteDirectory
binary
mput "*.*"
disconnect
bye
</code></pre>

I have been playing around with Python's FTP library and am starting to think that it is too slow as compared to using a script file in DOS? I run sessions where I download thousands of data files (I think I have over 8 million right now). My observation is that the download process seems to take five to ten times as long in Python than it does as compared to using the ftp commands in the DOS shell.

Since I don't want anyone to fix my code I have not included any. I am more interested in understanding if my observation is valid or if I need to tinker more with the arguments.

Python's FTPLib too slow?

翻译质量差，导致语言生硬或混乱。

没有提供实际的解决方法或示例。

解答不清晰，无法理解或解决问题。

页面排版不美观，阅读体验差。

文章

问答

视频

教程

学习中心

腾讯云实验室

直播

竞赛

腾讯云代码分析专区

腾讯iOA零信任安全管理系统专区

腾讯云架构师技术同盟交流圈

腾讯云数据库专区

腾讯云智能顾问专区

腾讯云原生专区

腾讯混元专区

腾讯云TCE专区

腾讯云Lighthouse专区

腾讯云HAI专区

腾讯云Edgeone专区

腾讯云存储专区

腾讯云智能专区

腾讯轻联专区 

腾讯云开发专区

TAPD专区

腾讯轻量云游戏服专区

EdgeOne AI 安全实战专区

腾讯云最具价值专家

腾讯云架构师技术同盟

腾讯云创作之星

腾讯云开发者先锋

腾讯云代码助手

云原生构建

TAPD 敏捷项目管理

Cloud Studio

SDK中心

API中心

命令行工具

涵盖代码开发、场景应用、自动测试全流程，助你从零构建专属AI助手

一站式MCP教程库，解锁AI应用新玩法

聚焦“写作效率、视觉美观与运行性能”三方面进行全面升级，为您提供更高效、稳定的创作环境

社区富文本&Markdown编辑器全新改版上线，欢迎大家体验!

诚挚邀请您参与本次调研，分享您的真实使用感受与建议。您的反馈至关重要，感谢您的支持与参与！

社区新版编辑器体验调研

我一直在使用Python的FTP库，我开始认为它比在DOS中使用脚本文件太慢了？我运行下载数千个数据文件的会话(我想我现在有800多万个)。我的观察是，与在DOS shell中使用ftp命令相比，在Python中下载过程似乎花费了五到十倍的时间。因为我不想让任何人修复我的代码，所以我没有包含任何代码。我更感兴趣的是了解我的观察结果是否有效，或者我是否需要对论点进行更多的修改。

问Python的FTPLib太慢了？
EN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Python的FTPLib太慢了？EN

回答 7

Stack Overflow用户

Stack Overflow用户

Stack Overflow用户

社区

活动

圈层

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问Python的FTPLib太慢了？
EN