[Bioc-devel] download stats

Obenchain, Valerie Valerie.Obenchain at RoswellPark.org
Tue Aug 8 05:31:58 CEST 2017


These are now fixed.

The problem started when I downsized the EC2 instance the download stats run on from t2.medium to t2.small. The machine was I/O bound and the scripts did not have enough time to complete before the next one started.

The 't' family of instances run on shared hardware and it's well documented that they are burstable wrt CPU usage. In general, IOPs are determined by the size and type of EBS back-end storage so I did not expect to see a difference in IOPs when changing the instance type (EBS back-end was untouched). After some digging, it appears AWS is also limiting disk I/O for this family because it is a shared instance. Network throughput is throttled in a manner similar to how they throttle CPU usage. So in this case it looks like it's the instance type and not the back-end storage causing the problem.

AWS is ambiguous about network throughput for the 't' family stating only High, Medium and Low instead of providing numbers. Finding the right combination of minimal but sufficient resources can be a challenge. The download stats should once again have the resources they need. Sorry for any inconvenience this switch around caused.

Valerie


On 08/04/2017 10:28 AM, Obenchain, Valerie wrote:

Download stats have not updated for some time. I'm looking into this and hope to have it sorted out soon.

Valerie


This email message may contain legally privileged and/or confidential information.  If you are not the intended recipient(s), or the employee or agent responsible for the delivery of this message to the intended recipient(s), you are hereby notified that any disclosure, copying, distribution, or use of this email message is prohibited.  If you have received this message in error, please notify the sender immediately by e-mail and delete this email message from your computer. Thank you.
        [[alternative HTML version deleted]]

_______________________________________________
Bioc-devel at r-project.org<mailto:Bioc-devel at r-project.org> mailing list
https://stat.ethz.ch/mailman/listinfo/bioc-devel





This email message may contain legally privileged and/or confidential information.  If you are not the intended recipient(s), or the employee or agent responsible for the delivery of this message to the intended recipient(s), you are hereby notified that any disclosure, copying, distribution, or use of this email message is prohibited.  If you have received this message in error, please notify the sender immediately by e-mail and delete this email message from your computer. Thank you.
	[[alternative HTML version deleted]]



More information about the Bioc-devel mailing list