Amazon's Cloud Computing | Forex Factory

Options

Permalinks
Print Thread

Similar Threads

All computing is predictive modelling - My Journal 1 reply

Idea for optimization: mutually accessible distributed computing cluster 2 replies

Please explain the limits of an EA's computing abilities 11 replies

Low Latency Computing? 6 replies

Bulk optimization: Need cloud computing or powerful server 5 replies

Amazon's Cloud Computing

  • #1
  • First Post: Jun 30, 2009 9:10am Jun 30, 2009 9:10am
I'm thinking of using Amazon's cloud computing service as an alternative to using a VPS. Has anyone here have any experience with that service?
  • #2
  • Jun 30, 2009 1:17pm Jun 30, 2009 1:17pm
I haven't done anything, but this post may be of value http://www.maxdama.com/2008/08/amazon-ec2-re-test.html.

I'm using Linode, and the server has been running for almost 3 months with no problems, if that helps.
The breaking of a wave cannot explain the whole sea.
  • #3
  • Jun 30, 2009 2:30pm Jun 30, 2009 2:30pm
Hey Ronald,
I have thought about switching over as well , but I am not sure I find the price agreeable. If I remember correctly, you have to pay per memory hour, for bandwidth, and disk usage.

I think as far as dependability, the thing is suppose to be rock solid.
Makin my way, the only way I know how...
  • #4
  • Jun 30, 2009 3:10pm Jun 30, 2009 3:10pm
It can't be that bad.

Hours in a month: 730.484398 (731)

Windows server: $0.125/hour
Cost per month: $91.38
Cost per year: $1096.56
Three years: $3289.68

If we go the bulk route:

1 Year reserved server
Cost per month: $49.01
Cost per year: $588.16
Three years: $1764.48

3 Year reserved server:
Cost per month: $35.82
Cost per year: $429.83
Three Years: $1289.48
  • #5
  • Jun 30, 2009 4:17pm Jun 30, 2009 4:17pm
Yeah, it looks like there is value going bulk. When I was looking, I was looking at the single machine, which does not seem to be economical.
Makin my way, the only way I know how...
  • #6
  • Jun 30, 2009 4:20pm Jun 30, 2009 4:20pm
Quoting Ronald Raygun
I'm thinking of using Amazon's cloud computing service as an alternative to using a VPS. Has anyone here have any experience with that service?
hi Ronald,

Are you using Amazon over VPS due to cost or reliability? Wondering because FXCM is thinking about offering VPS and I am curious to know if there was any advantage to Amazon over VPS providers in general.

-Jason
  • #7
  • Jun 30, 2009 4:50pm Jun 30, 2009 4:50pm
Ronald, I was looking at the offerings and you need to remember to calculate the bandwidth usage. For me, the usage is pretty low, probably around 40 gigs per month which i think is only a few bucks per month. Its strictly for trading so my biggest bandwidth is from RDP'ing, trading, and the occasional FTP session.
Makin my way, the only way I know how...
  • #8
  • Jul 1, 2009 8:09am Jul 1, 2009 8:09am
Quoting Jason Rogers
hi Ronald,

Are you using Amazon over VPS due to cost or reliability? Wondering because FXCM is thinking about offering VPS and I am curious to know if there was any advantage to Amazon over VPS providers in general.

-Jason
Let me explain how my hardware was set up (it's currently off because I'm trading for a bank).

I have a private datacenter in my house (closet). Each closet has 7 intel atom motherboards, all clustered together to form one computer. They can independently run things like my NN, and my EAs. Those closets are also each collecting tick data for me. So I have tick data in triplicate, which has allowed me to maintain a very clean and accurate tick database for awhile.

There are three such closets in the United States, and they each have their own internet connection, independent of the building it's located in. All three are in communication continuously, and I can afford for two of those three to fail and still continue to trade as normal.

Should all three closets fail, I have a backup laptop which will liquidate all of my accounts over a cell-phone internet connection.

Whenever any one of my closets or systems fail, I get a warning e-mail sent to my blackberry. I can then decide whether or not to stop trading.

In the year and a half I've been trading live, the greatest problem I've had was only one closet fail. It restarted itself automatically over the weekend and was back up and running the following sunday.

Quoting husky_1
Ronald, I was looking at the offerings and you need to remember to calculate the bandwidth usage. For me, the usage is pretty low, probably around 40 gigs per month which i think is only a few bucks per month. Its strictly for trading so my biggest bandwidth is from RDP'ing, trading, and the occasional FTP session.
Shouldn't be that bad. I'll run one of my NNs this weekend and see how much time it takes to train (using my computers: 28 hours), and the the coming week, I'll figure out how long it takes to calculate one tick (my computers: 3-5 seconds). If I can get that NN to process a new tick within 1/10th of a second, then I'll put it in live.
  • #9
  • Jul 3, 2009 7:53pm Jul 3, 2009 7:53pm
why not go with mosso.com instead?
  • #10
  • Jul 4, 2009 7:44pm Jul 4, 2009 7:44pm
Ok, I've spent about $50.00 on Amazon's AWS, and here's what I have to say:

The short answer: It's great

The long answer:

Metatrader 4 is not designed to be a multi-threaded application. What this means simply is that it can only use one core of a computer. I have a particular EA on metatrader which I have never been able to backtest the entire 6 month period I set for it because it simply uses up all of the available memory in metatrader. The $189 billion EA I posted is not of the entire six months as the report says, it only goes from January to late March (the 20th or so). Even though I had the compute power (4 cores), I had to have another application in there constantly emptying the metatrader journal and that slowed everything down.

However

When I put up some of my optimizers which can do multi cores, the thing was blazing fast. What takes my personal super computer (intel quad core +8gb ram + 4 nvidia graphics cards) a weekend took Amazon's xlarge EC2 6 hrs.


I'm looking around for other supercomputing single core systems similar to Amazon's EC2 but will finally allow me to complete the damn backtest.
  • #11
  • Aug 7, 2013 4:58am Aug 7, 2013 4:58am
Please note that the prices of spot instances are low and it's preferable to have a small than a micro instance (micro instances have only 600 Mb of RAM). Spot instances however will be stopped if the bid price if lower than the current instance price, so the bid price has to be carefully chosen.
  • #12
  • Sep 23, 2013 3:32pm Sep 23, 2013 3:32pm
Quoting Ronald Raygun
Ok, I've spent about $50.00 on Amazon's AWS, and here's what I have to say: The short answer: It's great The long answer: Metatrader 4 is not designed to be a multi-threaded application. What this means simply is that it can only use one core of a computer. I have a particular EA on metatrader which I have never been able to backtest the entire 6 month period I set for it because it simply uses up all of the available memory in metatrader. The $189 billion EA I posted is not of the entire six months as the report says, it only goes from January...
@ronald*raygun, I have few questions. What is the Best cloud computing vendor for Trading. Also provide the price details.
  • #13
  • Sep 29, 2013 11:19pm Sep 29, 2013 11:19pm
Quoting skann29
{quote} @ronald*raygun, I have few questions. What is the Best cloud computing vendor for Trading. Also provide the price details.

it's dependence on your budget and EA , if your using super scalp then get a VPS in brokers Data center ,for normal trading as long Less than 200 ms ping time should be fine
Mohan
  • #14
  • Edited 9:51pm Oct 12, 2013 6:12pm | Edited 9:51pm
Quoting skann29
{quote} @ronald*raygun, I have few questions. What is the Best cloud computing vendor for Trading. Also provide the price details.
None. Cloud computing has inherent latency problems compared with individual dedicated servers. If you want the absolute best, you lease rack space at ideally the same datacenter as the execution server you are working against.

[edit]

You wanted price. Here it is: I'm paying just shy of $15,000 / month for my network of colocated servers and full time admins to manage them 24/7.
  • #15
  • Last Post: Oct 24, 2016 6:11am Oct 24, 2016 6:11am
Quoting nquental
Please note that the prices of spot instances are low and it's preferable to have a small than a micro instance (micro instances have only 600 Mb of RAM). Spot instances however will be stopped if the bid price if lower than the current instance price, so the bid price has to be carefully chosen.
I have a question regarding those spot instances as I'm considering booking one for some backtesting ... in the case of interrupting an mt4 Backtest due to drop under the spot's bid price, will the Backtest properly resume?
0 traders viewing now