我正在读取office 365邮件帐户的收件箱并下载其附件(txt文件)。它在小于2MB的小文件上工作得很好,但当我尝试处理20MB的文件时,它真的很慢。我在两台不同的机器(Linux和Windows)上测试代码,速度是一样的,真的很慢。
String user = "mail@mail.com";
String password = "mypassword";
try{
boolean foundSites = false;
// Get a Properties object
Properties properties = new Properties();
properties.put("mail.imaps.host", host);
properties.put("mail.imaps.port", port);
properties.put("mail.imaps.starttls.enable", SSL);
//properties.put("mail.imap.fetchsize", "1000000");
Session emailSession = Session.getDefaultInstance(properties);
//create the POP3 store object and connect with the pop server
Store store = emailSession.getStore("imaps");
store.connect(host, user, password);
//create the folder object and open it
Folder emailFolder = store.getFolder("INBOX");
emailFolder.open(Folder.READ_ONLY);
// retrieve the messages from the folder in an array and print it
Message[] messages = emailFolder.getMessages();
System.out.println("messages.length---" + messages.length);
LocalDateTime now = LocalDateTime.now();
int year = now.getYear();
int month = now.getMonthValue();
int day = now.getDayOfMonth();
for (int i = messages.length - 1; i >= 0; i--) {
Message message = messages[i];
Calendar cal = Calendar.getInstance();
cal.setTime(message.getReceivedDate());
int yearMessage = cal.get(Calendar.YEAR);
int monthMessage = cal.get(Calendar.MONTH) + 1;
int dayMessage = cal.get(Calendar.DAY_OF_MONTH);
if(year == yearMessage && month == monthMessage && day == dayMessage)
{
//The real code is doing this with 20 Subjects (20 emails)
if(message.getSubject().equalsIgnoreCase("Integration - Site Info") && foundSites != true)
{
System.out.println("found Integration - Site Info");
Multipart multipart = (Multipart) message.getContent();
List<File> attachments = new ArrayList<>();
for (int j = 0; j < multipart.getCount(); j++) {
BodyPart bodyPart = multipart.getBodyPart(j);
if(Part.ATTACHMENT.equalsIgnoreCase(bodyPart.getDisposition()))
{
InputStream is = bodyPart.getInputStream();
File f = new File("./attachments/"
+ "sites_"+Integer.toString(day)+"-"+Integer.toString(month)+"-"+Integer.toString(year)+".csv");
FileOutputStream fos = new FileOutputStream(f);
byte[] buf = new byte[4096];
int bytesRead;
while((bytesRead = is.read(buf))!=-1) {
fos.write(buf, 0, bytesRead);
}
fos.close();
attachments.add(f);
foundSites = true;
break;
}
}
}
}
if(foundSites)
{
break;
}
} catch (Exception e) {
System.out.println(e);
}我可以创建线程,但是有没有其他选择呢?
顺便说一句:我尝试使用python编写代码,速度有了显着提高。
======================================更新1:
我对saveFile方法进行了更改,代码简化了很多,但下载速度仍然是每秒10KB。
MimeBodyPart bodyPart = (MimeBodyPart) multipart.getBodyPart(j);
if(Part.ATTACHMENT.equalsIgnoreCase(bodyPart.getDisposition()))
{
bodyPart.saveFile("./attachments/"
+ "sites_"+Integer.toString(day)+"-"+Integer.toString(month)+"-"+Integer.toString(year)+".csv");我还使用了分析器,结果如下:


发布于 2017-03-10 07:40:31
修复这些common mistakes。
通过使用MimeBodyPart.saveFile保存附件来简化代码。
由于您使用的是"imaps“协议,而不是"imap”协议,因此应将mail.imaps.fetchsize属性设置为足够大的值,以获得所需的性能,而不会使用超出所需的内存。或者将mail.imaps.partialfetch设置为false,如果你不关心你使用了多少内存,并且你确信你总会有足够的内存。
https://stackoverflow.com/questions/42707340
复制相似问题