#018: HOW I SPENT TOO MUCH TIME WITH 3D OPTIMIZATION CHARTS
Download FREE resources to boost your trading
SOTR images-05-Emini min.png
SOTR images-06-STU min.png
SOTR images-08-TMI.png
SOTR images-07-SFB min.png
SOTR images-02 v4.png
SOTR images-09-v3.png
SOTR images-03-MSA min.png
SOTR images-01-v3.png
SOTR images-10-Checklist.png
SOTR images-04-Adaptrade builder min.png
Automated trading strategies that work!

© 2015-2018 SystemsOnTheRoad.com. All Rights Reserved  | Contact | About Me | Privacy Policy

  • LinkedIn Social Icon
  • Twitter Social Icon
  • Instagram Social Icon

DISCLAIMER:  Futures trading systems and commodity trading bear a high degree of risk. People can and do lose money.
Hypothetical results have many inherent limitations. Past performance does not guarantee future results. 

 

ACTUAL RESULTS SHOULD BE VIEWED WITH CAUTION, BECAUSE PAST PERFORMANCE IS NOT NECESSARILY INDICATIVE OF FUTURE RESULTS. HYPOTHETICAL PERFORMANCE RESULTS HAVE MANY INHERENT LIMITATIONS, SOME OF WHICH ARE DESCRIBED BELOW. NO REPRESENTATION IS BEING MADE THAT ANY ACCOUNT WILL OR IS LIKELY TO ACHIEVE PROFITS OR LOSSES SIMILAR TO THOSE SHOWN. IN FACT, THERE ARE FREQUENTLY SHARP DIFFERENCES BETWEEN HYPOTHETICAL PERFORMANCE RESULTS AND THE ACTUAL RESULTS SUBSEQUENTLY ACHIEVED BY ANY PARTICULAR TRADING PROGRAM. ONE OF THE LIMITATIONS OF HYPOTHETICAL PERFORMANCE RESULTS IS THAT THEY ARE GENERALLY PREPARED WITH THE BENEFIT OF HINDSIGHT. IN ADDITION, HYPOTHETICAL TRADING DOES NOT INVOLVE FINANCIAL RISK, AND NO HYPOTHETICAL TRADING RECORD CAN COMPLETELY ACCOUNT FOR THE IMPACT OF FINANCIAL RISK IN ACTUAL TRADING. FOR EXAMPLE, THE ABILITY TO WITHSTAND LOSSES OR ADHERE TO A PARTICULAR TRADING PROGRAM IN SPITE OF TRADING LOSSES ARE MATERIAL POINTS WHICH CAN ALSO ADVERSELY AFFECT ACTUAL TRADING RESULTS. THERE ARE NUMEROUS OTHER FACTORS RELATED TO THE MARKETS IN GENERAL OR TO THE IMPLEMENTATION OF ANY SPECIFIC TRADING PROGRAM WHICH CANNOT BE FULLY ACCOUNTED FOR IN THE PREPARATION OF HYPOTHETICAL PERFORMANCE RESULTS AND ALL OF WHICH CAN ADVERSELY AFFECT ACTUAL TRADING RESULTS.

OUR NEW PLACE

I'm a paragraph. Click here to add your own text and edit me. Let your users get to know you.

#018: HOW I SPENT TOO MUCH TIME WITH 3D OPTIMIZATION CHARTS

Some traders ask me if I use 3D optimization charts for my own trading. Do I have good experience with this tool? Would I recommend it for robust ATS development? The answers are quite simple: NO!


I have spent a lot of time with it, so I can explain it more in detail (luckily I have never actually started using it for my ATS development).


First, let's make a small recapitulation - what exactly is the 3D optimization chart? It is a simple visual aid that helps us to find global optimal values instead of just local ones.


The local optimum is a combination of 2 parameters that gives us the best results within a specified range, no matter how well surrounding parameters work.


The global optimum is a combination of 2 parameters that gives us positive results within a particular parameters combination of both variables, but gives us also stable and quality results for all surrounding parameter combinations. The more combination surrounding the “central” parameter set work, the better.


The main advantage is that the whole concept seems to be simple, logic and robust and is practically easy to grasp, with a nice visual interpretation.


On the other side, the biggest disadvantage is that you can use this concept only for optimization of 2 parameters (there are certain tweaks how to use this concept also for other parameters, but then its basic simpleness fades away).

 

Let's take a look at a simple example - a simple model of a breakout strategy which uses the close price of x-bars back increased by 3x ATR with a certain period as a starting point.
Exit at the end of the day.

 

The simplified model can look like this:


Buy next bar at ( Close[BarsBack] + 3 * ATR(ATRperiod) ) Stop;
Setexitonclose;

 

We want to see what are the optimal parameters for BarsBack and ATRperiod parameters. For a start, we use the range 1-10 for both parameters (in reality, we would use another range, but for the sake of this example let’s use 1-10 values) and create a simple, easily visually interpreted 3D chart that will display NET PROFIT for all combinations.

 

 

As you can see on the chart, the best values from this range would be 10 (ATRperiod) - 1 (Barsback) combination. We can consider this combination to be the local optimum - and, most probably, it can be just a result of over-optimization.

 

On the other side, the 5-3 combination looks more like the global optimum, as also the surrounding combinations have similar results as the 5-3 combination. We skip the point that the global optimum should be much more extensive; we use this as a simple example.

 

Until this point everything is alright.

 

So where is the problem?

 

The problem is high instability of this approach.

 

As a full-time ATS trader, I spend a lot of time comparing different approaches and methods. I have also spent a lot of time with 3D optimization. I have found out, as well as other users, quite tempting the simplicity of this concept. Roughly a year ago I performed a really extensive series of tests that took me one month of really intensive work. The reason behind all this work was to find global optimum parameters for a lot of breakout models in different time slots using 3D optimization chart.

 

Example:

 

BREAKOUT MODEL A: Searching global optima in 2003–2005, 2006–2008, 2009–2011, 2012–2014.

 

BREAKOUT MODEL B: Searching global optima in 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014.

 

etc.

 

The objective of the test was to determine how much the global optima change during each test period. 

 

The conclusions were shocking. From previous, less intensive tests, I knew that the parameters obtained this way are not stable. However, this through test showed me that the instability can be enormous. For example - in many cases the best global optimum for one time slot was almost the worst possible to the next one. The global optima has incredibly changed - if I use the 3D chart mentioned above, for one year it would recommend the global optima as 9-9 and for the next year 2-2 (in the opposite corner).

 

This instability, tested across a range of markets, breakout models and time-frames, definitely reassured me that the 3D optimization charts method is not for me. Therefore, I am not using it for my own trading at all.

 

Of course, for some one you the 3D optimization can work better (remember, there is no dogma in trading), but this concept is not for me.

 

Happy Trading!

 

Tomas

 

 

 

Please reload

Author: Tom Nesnidal (more about me
Join 15 000+
LinkedIn Followers
Join 5 000+
Twitter Followers
Get Social With Tom
  • Black LinkedIn Icon
  • Black Twitter Icon
  • Black Instagram Icon
  • Black RSS Icon
What others are saying

"Tomas is one of the most creative traders I know. He is able to generate unique trading ideas and elegant solutions to system development challenges."

Andrew Swanscott, BetterSystemTrader.com

"Tomas has been a professional trader for more than a decade and I have had the privilege of monitoring his accounts in action since 2006. His systems are performing as some of the best I have ever monitored and executed. I have been in the trading industry since 2002 and worked with many developers from all over the world. Tomas is definitely the one to consider."

Martin Lembak,

Systems Trading Expert,

MFRM, CAIA 

"Tomas is a professional trader, who for the last 10 years has specialized in developing trading systems. We have been tracking his trading systems for about 5 years and they generally show very robust, stable and above average performance. Striker is pleased to work with someone like him - a real professional with enthusiasm and deep knowledge of trading."

William Galwas, President Of Striker Securities, Inc 

"Personal consultation with Tom helped me to re-evaluate the complexity of my robustness testing and optimization processes. Plus, it has helped me with a specific plan on how to take things forward. It has given me some great ideas on how to avoid overfitting and make my testing more robust and provided tips on low hanging fruit in terms of the best markets to trade for intraday/short-term breakouts."

Craig Peters,

semi-advanced trader,

United Kingdom 

"Tom's approach to Automated Trading Strategies design, tests of robustness and portfolio diversification is really unique. He has been a professional trader for many years and the depth of his understanding of Breakout strategies and Market Internals is hard to find elsewhere."

Antonin Fisher,

Hedge Fund Manager,

Czech Republic 

"Tom´s systems and trading approach do really work and can bring good, stable and reasonable returns. I can highly recommend him as a teacher."

David Hruby,

Trader, Czech Republic 

"Tomas is truly an inspiring mentor and great trader with a positive life attitude. He has got very deep understanding of markets, breakout strategies, robustness testing procedures, and Market Internals."

Jan Lesanovsky,

Client, United Kingdom 

"As an experienced trader, I used Tomas´s consultation to get more clarity on best-practise robustness testing procedures, risk management, and portfolio management. He was quickly able to help me refine my current trading and system development approaches, and pointed me to really practical measures that I could implement immediately. I found Tomas to be not only extremely knowledgeable but very helpful and a great teacher. This has given me more confidence in developing robust strategies that work, and I would recommend his mentoring as extremely valuable for any systems trader."

Trevor West,

advanced trader, Australia 

The author of this trading blog has been featured on: