• Home
  • Forums
  • Trades
  • News
  • Calendar
  • Market
  • Brokers
  • Login
  • Join
  • User/Email: Password:
  • 5:26pm
Menu
  • Forums
  • Trades
  • News
  • Calendar
  • Market
  • Brokers
  • Login
  • Join
  • 5:26pm
Sister Sites
  • Metals Mine
  • Energy EXCH
  • Crypto Craft

Options

Bookmark Thread

First Page First Unread Last Page Last Post

Print Thread

Similar Threads

Curve Fitting: The Ultimate Conundrum 17 replies

EA Backtesting and Curve Fitting Concern 2 replies

(curve)-fitting and overfitting, good examples wanted 0 replies

why curve fitting doesn't work? 23 replies

"curve fitting" or just improving?? 5 replies

  • Trading Discussion
  • /
  • Reply to Thread
  • Subscribe
Tags: is this curve fitting? check these results out...
Cancel

is this curve fitting? check these results out...

  • Post #1
  • Quote
  • First Post: Mar 29, 2013 5:51am Mar 29, 2013 5:51am
  •  ABoulfoul
  • | Joined Oct 2009 | Status: Member | 85 Posts
hi,

i have a simple system which uses 3 variables: the period of a simple moving average and the size and direction of the previous bar. it yields the following results over 18 FX pairs aggregated over 10 years (after spreads are accounted for):

number of trades: 45,273
profit factor: 1.07
sharpe ratio: 3.0

i have modified the period of the moving average as well as the size variable and the results don't differ drastically between tests (lowest PF was 1.04, highest PF was 1.09, lowest SR was 2.5, highest SR was 3.1). what is worrying me is that a low profit factor coupled with a high sharpe ratio is usually associated with curve-fitted results. however, the shape of the equity curve is too tempting...

can anyone offer advice?
  • Post #2
  • Quote
  • Mar 29, 2013 7:34am Mar 29, 2013 7:34am
  •  candero
  • | Joined Jan 2013 | Status: Gone for a while | 189 Posts
Hi, on what platform did you conduct the tests? MT?
 
 
  • Post #3
  • Quote
  • Mar 29, 2013 8:10am Mar 29, 2013 8:10am
  •  pickers
  • | Joined Mar 2010 | Status: Member | 58 Posts
holy cow! you have found the holy grail!

as long as the EA is based on looking backwards for trade direction and not looking forward, the results should be fine. Why dont you try forward testing. You should be able to tell if the forward testing mimics backtest results.
 
 
  • Post #4
  • Quote
  • Mar 29, 2013 11:13am Mar 29, 2013 11:13am
  •  ABoulfoul
  • | Joined Oct 2009 | Status: Member | 85 Posts
Quoting candero
Disliked
Hi, on what platform did you conduct the tests? MT?
Ignored
i use a set of R scripts that i've developed over time to run my tests - a lot easier to deal with than MT if you don't use custom indicators.
 
 
  • Post #5
  • Quote
  • Mar 29, 2013 4:52pm Mar 29, 2013 4:52pm
  •  candero
  • | Joined Jan 2013 | Status: Gone for a while | 189 Posts
Quoting ABoulfoul
Disliked
i use a set of R scripts that i've developed over time to run my tests - a lot easier to deal with than MT if you don't use custom indicators.
Ignored
Interesting! If it were MT, those results would have been clearly way off.

In your place I would turn to other backtesting platform, reliable one unlike MT, and confirm the results. Forward testing is an option, but it takes time and a few errors can occur.
 
 
  • Post #6
  • Quote
  • Last Post: Apr 2, 2013 2:19pm Apr 2, 2013 2:19pm
  •  FXEZ
  • Joined Jan 2007 | Status: developing... | 970 Posts
Quoting ABoulfoul
Disliked
i use a set of R scripts that i've developed over time to run my tests - a lot easier to deal with than MT if you don't use custom indicators.
Ignored
According to your stats that is 250 trades per year or just over 1 trade per day. I hope this wasn't modeled on 1 day bars or higher or the results would be highly suspect. I'd check and recheck data snooping. It is very easy to unintentionally look at future data in R. A simple thing like the bar direction being shifted forward 1 period would produce results that would stay about the same even when changing the other 2 parameters.
 
 
  • Trading Discussion
  • /
  • is this curve fitting? check these results out...
  • Reply to Thread
0 traders viewing now
Top of Page
  • Facebook
  • Twitter
About FF
  • Mission
  • Products
  • User Guide
  • Media Kit
  • Blog
  • Contact
FF Products
  • Forums
  • Trades
  • Calendar
  • News
  • Market
  • Brokers
  • Trade Explorer
FF Website
  • Homepage
  • Search
  • Members
  • Report a Bug
Follow FF
  • Facebook
  • Twitter

FF Sister Sites:

  • Metals Mine
  • Energy EXCH
  • Crypto Craft

Forex Factory® is a brand of Fair Economy, Inc.

Terms of Service / ©2023