 Methodology
 Open Access
 Published:
Encoding candlesticks as images for pattern classification using convolutional neural networks
Financial Innovation volume 6, Article number: 26 (2020)
Abstract
Candlestick charts display the high, low, opening, and closing prices in a specific period. Candlestick patterns emerge because human actions and reactions are patterned and continuously replicate. These patterns capture information on the candles. According to Thomas Bulkowski’s Encyclopedia of Candlestick Charts, there are 103 candlestick patterns. Traders use these patterns to determine when to enter and exit. Candlestick pattern classification approaches take the hard work out of visually identifying these patterns. To highlight its capabilities, we propose a twosteps approach to recognize candlestick patterns automatically. The first step uses the Gramian Angular Field (GAF) to encode the time series as different types of images. The second step uses the Convolutional Neural Network (CNN) with the GAF images to learn eight critical kinds of candlestick patterns. In this paper, we call the approach GAFCNN. In the experiments, our approach can identify the eight types of candlestick patterns with 90.7% average accuracy automatically in realworld data, outperforming the LSTM model.
Introduction
Financial market forecasts are critical research topics in commercial finance and information engineering. For example, the topics are predicting fluctuations or volatility forecasts for futures indices (Kou et al. 2014). Market prices are susceptible to the expected psychological impact of the overall market. These prices are possible to develop predictive models of financial demand through particular preprocessing and complex model architectures.
Many tools are existing to help people predict stock price fluctuations and futures indices already (Ding et al. 2015). For example, these tools are the neural networks, fuzzy timeseries analysis, genetic algorithms, classification trees, statistical regression models, and support vector machines. However, these machine learning models are generic techniques and used for forecasting. They unusually combine with financial expertise (Kou et al. 2014). Because the average person pursues profit in any transaction, the predictions of such models are not accurate enough for realworld operations. Investment forecasts and model predictions tend to have significant gaps, and investors are more inclined to find a good entry and exit point rather than merely predicting prices. Many studies focus on the accuracy of numerical predictions (Saad et al. 1998; Refenes and Holt 2001; Pantazopoulos et al. 1998; Dhar and Chou 2001; Cao and Tay 2003; Song and Chissom 1993), but investors only concern with the time of entry and exit (i.e., how much profit space they have). In other words, rather than blindly using machine learning or deep learning architecture to pursue unrealistic lowrisk, highaccuracy profit models, it is better to combine these directly with a basic knowledge of transactions to create a reliable, applicable model (Ding et al. 2015; Hall 2002).
Candlestick pattern recognition is an essential tool for determining market conditions (Marshall et al. 2006). To make trading decisions, traders often make judgments based on muchcomplicated information, such as technical indicators, news, and candlestick patterns. Thus, candlestick pattern recognition is a crucial support for individual transactions (Bulkowski 2012). Candlestick pattern recognition helps traders determine the current asset price in the market and establish whether the current buying pressure will continue or whether the current selling pressure will reverse. This information, along with other sources, assists traders to predict the future. Concerning price trends, the Morning Star and the Evening Star are examples of price reversal signals commonly. Candlestick pattern recognition requires a deliberate analysis of trader expertise rather than pure numerical analysis. This recognition requires traders to make visual judgments on images.
The Convolutional Neural Network (CNN) model is wellsuited to image recognition (Ranzato et al. 2008). CNN can update its convolution kernel by backward propagation and train the appropriate weights to extract excellent image features. The correlation between traits and images uses to help models make correct judgments. Further, the type of neural network suitable for image identification needs to carry out through a twodimensional convolution. Principally, the financial timeseries data representing uses a onedimensional array. Therefore, we need to find a way to convert the timeseries data into a consistent matrix form.
However, our datasets are always dynamic, and patterns in them are changing. Hence, we need to feature engineering to extract specific timeseries features. For example, space transformation models are kinds of feature engineering. There are including Singular Value Decomposition (SVD), distance metric learning, Nyström methods, and Distance Metric Learning (DML) approach (Li et al. 2020). The process of Singular Value Decomposition (SVD) uses for investigation of the data. In these methods, linear algebra uses to construct a data matrix out of the collected data and to extract intrinsic features of that matrix. It is to separate elements that are similar between each subject and features that differentiate the items.
Instances with different labels are intertwined and often linearly inseparable. This issue brings new challenges to the CNN approach (Li et al. 2020; Aziz et al. 2018). The CNN approach considers unsuitable for directly encoding the timeseries data as image pixels (Gamboa 2017). Hence, we need a method for transforming time series data into images.
The Gramian Angular Field (GAF) has the following advantages:
 1.
The GAF provides a way to preserve temporal dependency since time increases as the position moves from topleft to bottomright.
 2.
The GAF contains temporal correlations because the Gramian Angular represents the relative correlation by superposition and difference of directions for the time interval.
 3.
The primary diagonal of the Gramian Angular Field matrix is the particular case.
 4.
The diagonal of the Gramian Angular Field matrix contains the original value and angular information.
 5.
From the main diagonal, we can reconstruct the time series from the highlevel features learned by the deep neural network.
Hence, we use the Gramian Angular Field (GAF) to encode the timeseries data (Wang and Oates 2015) from a onedimensional timeseries array to the twodimensional convolutional timeseries matrix. The encoding data can improve the performance of the neural network in the twodimensional convolutional timeseries significantly. When the CNN model uses the GAF encoding as input, the LeNet (LeCun et al. 1995) architecture can achieve outstanding results naively.
Therefore, we design a GAFbased CNN to emulate the trader to identify candlestick pattern characteristics in an experiment. We call our approach GAFCNN. First, we use the Geometric Brownian Motion (GBM) model to simulate a volume of price data. According to Zhiguo, we set the same parameters to set the price, and its volatility is close to the real data (He 2008). Second, we choose eight candlestick patterns from The Major Candlestick Signals (Bigalow 2014). These eight types of pointers are Morning Star, Bullish Engulfing, Hammer, Shooting Star, Evening Star, Bearish Engulfing, Hanging Man, and Inverted Hammer. The difference between these eight candlesticks signals is subtle and will challenge a traditional CNN model.
To improve the traditional CNN model, we use the GAFCNN to train the GBM simulation data. Our model produces outstanding performance in the simulation data. We also use real data to verify the viability of our GAFCNN in the realworld. We expect that GAFCNN enables the computer to look at the candlestick patterns with as much nuance as a trader. The results show a near92% accuracy for the GBM simulation data. We use 20102017 historical data of the currency exchange rate for Euro (EUR) to US dollar (USD) to test our GAFCNN model. The experimental results achieve a 90.70% accuracy. The simulation and experimental results show that GAFCNN is suitable for shape identification in financial trading. Although this paper uses only eight of the most classicaltype indicators, various morphological extensions that can be made based on GAFCNN are feasible, such as the Whead Mbottom. We want to establish a financial vision field through this paper making computers can recognize candlestick as a human has seen.
The remainder of this paper organizes as follows. “Preliminary” section provides a review of the literature, and “Methodology” section presents our methodology. “Results” section shows the result of our experiments. “Discussion” section describes the discussion of “Results” section. “Conclusions” section is the conclusion of our study, and “Workflows” section is the overall workflow of our experimental framework.
Preliminary
Candlestick
Japanese start using technical analysis to trade rice in the 17th century (Wagner and Matheny 1994). While this early version of technical analysis is different from the US version initiated by Charles Dow around 1900. Many of their guiding principles are similar. In this version, price action is more important than news and earnings. All happened information reflects in the price already. Buyers and sellers move markets based on expectations and emotions. The actual price may not reflect the underlying value. According to Steve Nison, candlestick charting first appears sometime after 1850 (Nison 2001). Much of the credit for candlestick development and mapping goes to a legendary rice trader named Honma from the town of Sakata (Tudela 2008). His original ideas are likely modified and refined over many years of trading, eventually resulting in the system of candlestick charting used today.
Figure 1 is the structure of a candlestick. The unit is the bar, which draws on the opening, high, low, and closing prices (OHLC) for a specified period. The realbody is the price difference between the opening and closing prices. The upper shadow is the price difference between the highest price and the realbody, and the lower shadow is the price difference between the lowest price and the realbody. The period of a bar can be arbitrarily customized, usually depending on the length of the transaction. If the open price is higher than the close price, the realbody is rendered in black, indicating that the price is falling during this time. If the close price is higher than the open price, the realbody is white, indicating that the price is rising during this time. If the close price is equal to the opening price, the realbody will be just a (horizontal) line.
From the above, the candlestick helps investors filter out much of the price noise. The bar only records the different price information of OHLC per unit time. When we put together multiple bar charts, we get a continuous market information map. Unique shapes call as a pattern.
Researchers focus on the topic of candlesticks for many years (Nison 2001). Many patterns use to identify trends summarized, such as trend continuation indicators or reversal indicators. Candlestick analysis is an approach to getting started with trading. However, some people think it is challenging to observe the trend by observing the candlestick. It cannot use as an indicator to predict direction (Goo et al. 2007). Human begins to systematize the patterns generated from the candlesticks. They evolve into technical indicators of the system to form the candlestick patterns gradually. The indicators are also including the Average True Range (ATR), Relative Strength Index (RSI), Moving Average (MA), Moving Average Convergence and Divergence (MACD), Stochastic Oscillator (KD) (Taylor and Allen 1992) and so on.
Convolutional neural networks (CNN)
CNN models take advantage of the spatial properties of the data. According to Fukushima and Miyake, they propose a Neocognitron model. The model considers inspiring CNNs from the computational perspective generally (Fukushima and Miyake 1982). Neocognitron is a neural network designed to simulate the human visual cortex (Fukushima and Miyake 1982), which consists of two types of layers. The first type is the feature extractor layers, and the second type is the structured connection layers. The feature extractor layers, also named Slayers, simulate the cell in the primary visual cortex and help human beings to perform feature extraction. The structured connection layers, also named Clayers, affect the complex cell in the higher pathway of the visual cortex, provide the model with its shifted invariant property.
The two most essential components of CNN are the convolutional layer and the pooling (Pool) layer. Figure 2 shows that the convolutional layer implements the convolutional operation, which extracts image features by computing the inner product of an input image matrix and a kernel matrix. The number of channels of the input image and kernel matrix must be the same. For example, if the input image is a redgreenblue (RGB) color space, then the depth of the kernel matrix must be three; otherwise, the kernel matrix cannot capture the information between different color spaces. The pooling layer, also called the subsampling layer, is mainly in charge of simplifying the task. Figure 3 shows that the pooling layer only retains part of the data after the convolutional layer. It reduces the number of significant features extracted by the convolutional layer and refines the remaining features.
Only with these two components can the convolutional model be used to imitate human vision. In practical applications, the CNN model usually combines the convolutional layer and the pooling layer. The convolutional layer often extracts a significant number of features, and most of the elements may be noise, which could lead to the model learning in the wrong direction, also known as overfitting. Furthermore, the fullyconnected layers connect at the end of the sequence usually. The function of the fullyconnected layer organizes the extracted features processed by the convolutional and pooling layers. The correlation between the extracted features learns in this layer.
Although the pooling layer can reduce the occurrence of overfitting after convolution, it is inappropriate to use after the fullyconnected layer. The other widely recognized regularization technique, called dropout, designs to solve this issue. The dropout technique randomly drops neurons with a specific probability, and the dropped neurons are not involved in the forwarding and backward computation. This idea directly limits the model’s learning; the model can only update its parameters subject to the remaining neurons in each epoch.
The most general classic modern CNN model, LeNet inspires by Neocognitron and the concept of backpropagation (LeCun et al. 1995). The potential of the modern convolution architecture can be seen in LeNet (LeCun and et al. 2015), consisting of a convolution layer, a subsampling layer, and a full connection (FC) layer (Wang et al. 2017). Figure 4 shows the LeNet model. As the concept of the rectified linear unit (ReLU) and drop out are presented in recent years, a new convolutionbased model, AlexNet, proposed by Alex Krizhevsky and Hinton (Krizhevsky et al. 2012), appeared and beat the previous champion of the ImageNet Challenge, with 10M labeled highresolution images and 10,000+ object categories.
CNN for patterns classification
Human beings are visual creatures. The eyes are the most compact structure of all the sensory organs, and the visual intelligence of the human brain is rich in content. Exercise, behavior, and thinking activities all use visual sensory data as their most significant source of information. The more flexible and talented we become, the more we rely on visual intelligence. What general business and decisionmakers desire after the analysis is not the data itself, but the value. Therefore, data analyses must be intuitive. In this way, the visualization of financial data more readily accept: decisionmakers can see the story and interpret the data more efficiently.
Although visualization analysis can benefit decisionmakers, many traditional statistical or machine learning methods for predicting currency movements use quantitative models. These methods do not consider visualization. We attempt to make good use of the advantages of display and comprehensively enhance the efficiency of intelligence analysis. For example, most traders use charts to analyze and predict currency movement trends, which carry apparent economic benefits. However, in this visualization, the analysis is artificial. We aim to teach machines to achieve the interpretation of visual information like a human brain. We then hope to use the tool to analyze robust financial data visually.
The CNN models use in pattern and image recognition problems widely. In these applications, the best possible accuracy has achieved using CNNs. For example, the CNN models have achieved a accuracy of 99.77% using the Modified National Institute of Standards and Technology (MNIST) database of handwritten digits (Ciregan et al. 2012), a accuracy of 97.47% with the New York University Object Recognition Benchmark (NORB) dataset of 3D objects, and a accuracy of 97.6% on over 5,600 images of more than ten objects. The CNN models not only give the best performance compared to other detection algorithms but also outperform humans in such cases as classifying objects into finegrained categories, such as particular breeds of dogs or species of bird. The two main reasons for choosing a CNN model to predict currency movements are as follows:
 1.
The CNN models are good at detecting patterns in images, such as lines. We expect that this property can use to detect trends in trading charts.
 2.
The CNN models can detect relationships among images that humans cannot find easily. The structure of neural networks can help detect complicated relationships among features.
Gramian angular field (GAF)
GAF is a novel timeseries encoding method proposed by Wang and Oates (Wang and Oates 2015), which represents time series data in a polar coordinate system and uses various operations to convert these angles into symmetry matrix. Gramian Angular Summation Field (GASF) is a kind of GAF using the cosine function. Each element of the GASF matrix is the cosine of the summation of angles.
Our first step to making a GAF matrix is to normalize the given time series data X into values between [0,1]. The following equation shows the simple linear normalization method, where notation \(\widetilde {x}_{i}\) represents the normalized data.
After normalization, our second step is to represent the normalized time series data in the polar coordinate system. The following two equations show how to get the angles and radius from the rescaled time series data.
Finally, we sum the angles and use the cosine function to make the GASF by the following equation:
The GASF has two essential properties. First, the mapping function from the normalized time series data to GASF is bijective when ϕ∈[0,π]. In other words, normalize data to [0,1] can transform the GASF back into normalized time series data by the diagonal elements. Second, in contrast to Cartesian coordinates, the polar coordinates preserve absolute temporal relations.
Methodology
This section begins with the overall experiment design, then illustrates the method of label creation, GAFCNN model, feature selection, and neural architecture searching, respectively.
Experiment design
Considering realworld data lacking and complexity, it starts with simulation data to ensure GAFCNN model work and progress feature selection and neural architecture search. Further, it will adopt in the empirical research on realworld data.
The simulation data are including the 2000 training data, 400 validation data, and 500 testing data from the Geometric Brownian Motion (GBM) model. Furthermore, we use EUR/USD 1minute price data from January 1, 2010, to January 1, 2018, to label the realworld data, including 1000 training data, 200 validation data, and 350 testing data.
Illustration of label creation
We select eight of the most classic candlestick patterns based on a classic candlestick patterns textbook, The Major Candlesticks Signals, as our training target. The eight candlestick patterns we chose are Morning Star, Bullish Engulfing, Hammer, Shooting Star, Evening Star, Bearish Engulfing, Hanging Man, and Inverted Hammer. All of these patterns are reversal patterns, which capture whether the price is going to change. The first four patterns detect the price from downtrend to uptrend, and the last four patterns detect the opposite. We illustrate Morning Star and Evening Star as examples below.
The Morning Star pattern detects a price changing from a downtrend to an uptrend. The description of this pattern has three stages. First, a downtrend must be confirmed, which means the whole market has an absence of confidence. Second, the depressed atmosphere results in a big black bar. After a calm day, the third bar is a big white bar, which indicates that the investors expect the confidence of the market to reverse. Figure 5 shows the main appearance and rules of Morning Star in detail.
The Evening Star pattern detects the price changing from an uptrend to a downtrend. The description of this pattern also has three stages. First, an uptrend must be confirmed, which means the whole market is in a specific situation. Second, good days end with a big white bar. After a calm day, the third bar becomes a big black bar. These indicate that the investors expect the confidence of the market to reverse. Figure 6 shows the main appearance and rules of Evening Star in detail, and Fig. 7 shows the difference between Morning Star and Evening Star patterns.
The definition of our label bases on the rules given in The Major Candlesticks Signals, as shown in Figs. 5 and 6. The downtrend and uptrend define from regression. If the slope is higher or lower enough, the trend is confirmed. The definition of slope in our implementation is as follows, Fig. 8 has the entire illustration:
 1.
The slope value computes from the closing price among 7 bars.
 2.
Move a bar window to get another slope value.
 3.
Keep collecting positive and negative slope until 50 units, respectively.
 4.
If the current slope is over the 70th percentile of the group, then it will be defined as a positive or negative trend.
We must note that the other pattern rules are slightly different between the simulation and the real data. The rules from the simulation data are similar to the book. Nevertheless, the number of samples is insufficient in realworld data because of the strictness of the rules. Hence, we relax the rules to obtain sufficient data slightly. For example, the Bullish Engulfing pattern requires the opening price of the last bar to be lower than the closing price of the previous bar. If this rule is too strict, we relax the condition such that the opening price of the last bar only needs to be less than or equal to half of the real body of the previous bar.
GAFCNN
We propose a twostep approach and call it the GAFCNN model. The first set is the Gramian Angular Summation Field (GASF) timeseries encoding, and the second step is the Convolutional Neural Networks (CNN) model. In the first step, we encode time series data based on opening, high, low, and closing prices (OHLC) to GASF matrices with the window size set to 10. After this step, the shape of the data matrices will be (10,10,4). In the second step, we train this 3d matrices data with the CNN model. The architecture of our second step’s CNN model is similar to LeNet, including two convolutional layers with 16 kernels and one fullyconnected layer with 128 dense. Figure 20 illustrates the entire experimental architecture, and Table 1 shows the parameters used in our GAFCNN model.
Features selection
According to the previous section, the candlestick patterns cannot judge from a single value such as closing or opening price. Therefore, we need to combine opening, high, low, and closing prices (OHLC) and make the data features more reasonable. In order to close to humans have seen, we consider using the upper shadow, lower shadow, and realbody, which are more intuitive features for humans. Figures 9 and 10 are based on different features respectively of the Morning Star and Bearish Engulfing patterns through
 1.
the opening, high, low, and closing prices (OHLC); and
 2.
the closing price, upper shadow, lower shadow, and realbody (CULR).
Figures 9 and 10 show the visualization of the GASF matrix in two kinds transformation rules. Figure 10 shows more capable of extracting distinctive features observed than Fig. 9. Because the differences between the opening, high, low, and closing prices (OHLC) are generally small, resulting in high similarity among these four GASF matrices. If the model has too much repetitive information, this repeat information will reduce the convolutional model’s effectiveness in learning critical features. Hence, we process the data into the features of the second transformation rule (CULR). When we use this transformation rule, the four features are not similar and pop out the significant 2D features in the GASF matrix. From another perspective, this is a more intuitive approach that aligns with the observations of traders. Therefore, we design our experiments using
 1.
the opening, high, low, closing prices (OHLC); and
 2.
the closing prices, upper shadow, lower shadow, realbody (CYLR) features
in the simulation data. The better results are later applied to the realworld data.
Neural architecture searching
The GAFCNN model works well with the simple neural architecture, two convolutional layers with 16 kernels, and one fullyconnected layer with 128 denses. The maxpooling layer, which uses general picture classification, calculates the maximum value for each patch of the feature map usually. In other words, it may bring benefits about calculating costsaving, but truncate the characteristics of the time series, which means discard information of data. Therefore, we design an experiment using a maxpooling layer or not in simulation data. Figure 11 illustrates where to use the maxpooling or not.
Results
Baseline
Previous research on the candlestick with deep learning is about trading strategy but lack of pattern classification. It is hard to find the result from other studies to compare the GAFCNN model, so we chose the Long ShortTerm Memory model (LSTM) for reliable comparison since it is a standard method to accomplish the time series classification or regression tasks in the current year. Our goal is to achieve or surpass the performance of the LSTM model. The architecture used in this study include two hidden layer size of 128 LSTM layer and follow by a 128 dense layer (Smirnov and Nguifo 2018). More detail comparisons will discuss in “Simulation results” section and “Empirical results” section.
Simulation results
Figure 12 shows the result comparing between different features and neural architectures mention in “Methodology” section. Each experiment searches 100 times to find out the best model and predict testing data.
The GAFCNN model without the maxpooling layer can achieve 92.42% accuracy, which is better than the LSTM model 88.96% accuracy in both feature sets. Figures 13 and 14 respectively show the confusion matrix of GAFCNN model without maxpooling layer and with the different feature sets:
 1.
the opening, high, low, closing prices (OHLC); and
 2.
the closing prices, upper shadow, lower shadow, realbody (CULR).
The result of using (2) closing, upper shadow, lower shadow, and realbody (CULR) can achieve 92.42% average accuracy. If we focus on the result from class 1 to class 8, then the performance is 95.43% accuracy on average.
Figures 15 and 16 show the confusion matrix of LSTM model with two feature sets respectively. The accuracy of using (1) opening, high, low, closing prices (OHLC) is 88.58% on average, and using (2) closing, upper shadow, lower shadow, realbody (CULR) is 88.96% on average.
To explore more about the model training process, a comparison of the first 50 epochs under different conditions would help to realize the rate of convergence. Figure 17 and 18 depict the difference of both feature sets and using maxpooling or not respectively.
Empirical results
EUR/USD 1minute price data from January 1, 2010, to January 1, 2018, are used in our real data framework, including 1000 training data, 200 validation data, and 350 testing data. Therefore, we used two times as much data in training set for class 0, which is the noisy data for the other classes. The purpose of this is to help the model clearly distinguish the patterns and increase the robustness.
Based on the results of the simulation data, we chose to use closing, upper shadow, lower shadow, and realbody (CULR) as our feature set, and to exclude the pooling layers in our model. Figure 19 shows the confusion matrix of the realworld framework. The GAFCNN model achieves 90.7% accuracy on average in realworld data.
Discussion
Simulation results
First of all, Fig. 12 shows that using (2) closing prices, upper shadow, lower shadow, a realbody (CULR) feature set can significantly improve the accuracy in the GAFCNN model than using (1) the opening, high, low, closing prices (OHLC) feature set. In Fig. 17, the training process also converges significantly faster in the first 50 epochs, and end up with higher accuracy. This result is intuitive that this feature set is more close to trader way, observing the characteristics of the candlestick.
Secondly, the model also converges faster when using (2) without maxpooling layer than (1) with the maxpooling layer in Fig. 18. In Fig. 12, the GAFCNN model without the maxpooling layer can achieve higher accuracy and lower loss value in both feature sets. The result can explain that the dependency on time series data contains many essential features. The complete timeseries information will be truncated after the processing of the maxpooling layer, making it harder for the convolutional model to capture more detail features.
Lastly, the GAFCNN model works well in both simulation and realworld framework. It achieves 90.7% accuracy on average in realworld data. Besides, our results show that class 0, which is the other class, has reduced precision and recall. The class does not affect the usability of the framework because, although class 0 does not perform well, as long as the accuracy of the other classes is high enough, the cost of misclassification is small.
Empirical results
The result in Fig. 19 shows that GAFCNN can achieve 90.7% on average in the realworld data, outperforming the result of LSTM model. Therefore, our experimental results show that the GAF and the CNN framework are wellsuited for candlestick pattern recognition for both simulation and realworld trading data.
Conclusions
Candlestick pattern recognition is an indicator that traders often judge with news, fundamentals, and technical indicators. However, even today, most traders decide by using their vision and experience. Although many people have directly drawn up rules to find patterns, the process is too cumbersome and hard to judge without the provision of soft scores. To better align with how traders identify patterns, we chose to use the twodimensional CNN model. We used the GAF time series encoding with the traditional CNN model Because of the direct use of images to train leads to underfit. We use GAFCNN to process the GBM simulation and EUR/USD real word experiments.
In the simulation framework, we use eight candlestick patterns to test how the maxpooling layer and feature sets impact our model. The results indicate the following:
 1.
The maxpooling layer is terrible for the GAFCNN model. We think that the time series are truncated and lead to the loss of practical information.
 2.
Using the feature set of closing price, upper shadow, lower shadow, and realbody (CULR) is better than using the simple feature set of opening, high, low, and closing prices (OHLC).
The model achieved an average accuracy of 92.42% in simulation data. Although the 0 class is prone to misclassification, the model is still available for practical work as long as the main pattern resolutions and recall are high enough.
In the realworld framework, we use the same model for the EUR/USD per minute data from January 1, 2010, to January 1, 2018 retraining, including 1000 training data, 200 validation data, and 350 testing data. The model obtained 90.7% average accuracy, outperforming the LSTM model. In realworld data, class 0 has more false positives than other types, but the main kind of recall is a certain extent. It can be considered a more conservative model. Finally, because the difference between these eight indicators is tiny, GAFCNN has to extract subtle features. Now we only use the eight main candlestick patterns. Furthermore, future work could apply GAFCNN to more candlestick patterns or technical indicators, such as Whead Mbottom. Thus, the entire architecture in finance candlestick, and the extensibility of the models is enormous.
Workflows
In this study, we find that the Convolutional Neural Network model can detect financial time series data effectively, and our research workflow is as follows:
 1.
Our experiments adopt simulation, and realworld framework, where the simulation data generates from Geometric Brownian Motion model and the real data is EUR/USD per minute data from January 1, 2010, to January 1, 2018.
 2.
Eight candlestick labels reference from The Major Candlestick Signals.
 3.
Use opening, high, low, and closing prices (OHLC) or closing, upper shadow, lower shadow, and realbody (CULR) feature sets. The data in this stage is still a 10 by 4 matrix, where 4 represents the features.
 4.
Encode time series data by Gramian Angular Summation Field. The data will become 10 by 10 by 4 in this stage.
 5.
Each framework of training, validation, and testing is with the Convolutional Neural Network model.
The first step is each experiment test in the simulation framework, then apply the result of feature sets and neural architectures to the realworld framework. In all experiments, the convolution model use only two convolutional layers with 16 kernels and one fullyconnected layer with 128 denses. All these processes illustrate in Fig. 20.
Availability of data and materials
We provide an open source (https://github.com/pecu/Series2GAF) Series2GAF which can be used to transform time series into Gramian Angular Field.
Abbreviations
 ATR:

Average true range
 CDRs:

Correction detection rates
 CNN:

Convolutional neural network
 EUR:

European dollar
 FC:

Full connection layer
 GAF:

Gramian angular field
 GASF:

Gramian angular summation field
 GBM:

Geometric brownian motion
 KD:

Stochastic oscillator
 LSTM:

Long shortterm memory
 MA:

Moving average
 MACD:

Moving average convergence and divergence
 MNIST:

Modified National Institute of standards and technology
 NORB:

York University object recognition benchmark
 OHLC:

Opening, high, low, and closing prices
 CULR:

Closing prices, upper shadow, lower shadow, realbody
 Pool:

Pooling layer
 RSI:

Relative strength
 USD:

United States dollar
References
Aziz, R, Verma C, Srivastava N (2018) Artificial neural network classification of high dimensional data with novel optimization approach of dimension reduction. Ann Data Sci 5:615–635.
Bigalow, SW (2014) The Major Candlesticks Signals. The Candlestick Forum LLC, Conroe.
Bulkowski, TN (2012) Encyclopedia of candlestick charts, Vol. 332. Wiley, Hoboken.
Cao, LJ, Tay FEH (2003) Support vector machine with adaptive parameters in financial time series forecasting. IEEE Trans Neural Netw 14:1506–1518.
Ciregan, D, Meier U, Schmidhuber J (2012) Multicolumn deep neural networks for image classification In: 2012 IEEE conference on computer vision and pattern recognition.. IEEE. https://doi.org/10.1109/cvpr.2012.6248110.
Ding, X, Zhang Y, Liu T, Duan J (2015) Deep learning for eventdriven stock prediction In: Twentyfourth international joint conference on artificial intelligence.
Dhar, V, Chou D (2001) A comparison of nonlinear methods for predicting earnings surprises and returns. IEEE Trans Neural Netw 12:907–921.
Fukushima, K, Miyake S (1982) Neocognitron: A selforganizing neural network model for a mechanism of visual pattern recognition In: Competition and cooperation in neural nets, 267–285.. Springer.
Gamboa, JCB (2017) Deep learning for timeseries analysis. arXiv preprint arXiv:1701.01887.
Goo, Y, Chen D, Chang Y, et al. (2007) The application of japanese candlestick trading strategies in taiwan. Invest Manag Financ Innov 4:49–79.
Hall, SC (2002) Predicting financial distress. J Financ Serv Professionals 56:12.
He, Z (2008) Optimal executive compensation when firm size follows geometric brownian motion. Rev Financ Stud 22:859–892.
Kou, G, Peng Y, Wang G (2014) Evaluation of clustering algorithms for financial risk analysis using mcdm methods. Inf Sci 275:1–12.
Krizhevsky, A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks In: Advances in neural information processing systems, 1097–1105.
LeCun, y, Bengio Y, et al. (1995) Convolutional networks for images, speech, and time series. Handb Brain Theory Neural Netw 3361:1995.
LeCun, Y, et al. (2015) Lenet5, convolutional neural networks:20. http://yann.lecun.com/exdb/lenet. Accessed 30 Apr 2019.
Li, T, Kou G, Peng Y, Shi Y (2020) Classifying With Adaptive HyperSpheres: An Incremental Classifier Based on Competitive Learning. IEEE Trans Syst Man Cybern Syst 50(4):1218–1229.
Li, T, Kou G, Peng Y (2020) Improving malicious urls detection via feature engineering: Linear and nonlinear space transformation methods. Inf Syst 91:101494. https://doi.org/10.1016/j.is.2020.101494.
Marshall, BR, Young MR, Rose LC (2006) Candlestick technical trading strategies: Can they create value for investors?. J Bank Finance 30:2303–2323.
Nison, S (2001) Japanese candlestick charting techniques: a contemporary guide to the ancient investment techniques of the Far East. Penguin, Westminster.
Pantazopoulos, KN, Tsoukalas LH, Bourbakis NG, Brun MJ, Houstis EN (1998) Financial prediction and trading strategies using neurofuzzy approaches. IEEE Trans Syst Man Cybern B Cybern 28:520–531.
Ranzato, M, Boureau YL, LeCun Y (2008) Sparse feature learning for deep belief networks In: Advances in neural information processing systems, 1185–1192.
Refenes, AP, Holt WT (2001) Forecasting volatility with neural regression: A contribution to model adequacy. IEEE Trans Neural Netw 12:850–864.
Saad, EW, Prokhorov DV, Wunsch DC (1998) Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks. IEEE Trans Neural Netw 9:1456–1470.
Smirnov, D, Nguifo EM (2018) Time series classification with recurrent neural networks. Adv Analytics Learn Temporal Data:8.
Song, Q, Chissom BS (1993) Fuzzy time series and its models. Fuzzy Sets Syst 54:269–277.
Taylor, MP, Allen H (1992) The use of technical analysis in the foreign exchange market. J Int Money Finance 11:304–314.
Tudela, F (2008) The Secret Code of Japanese Candlesticks, Vol. 402. Wiley.
Wagner, GS, Matheny BL (1994) Trading applications of Japanese candlestick charting, Vol. 38. Wiley.
Wang, Z, Oates T (2015) Encoding time series as images for visual inspection and classification using tiled convolutional neural networks In: Workshops at the TwentyNinth AAAI Conference on Artificial Intelligence.
Wang, H, Raj B, Xing EP (2017) On the origin of deep learning. arXiv preprint arXiv:1702.07800.
Acknowledgements
Thanks to Prof. Jane YungJen Hsu for constructive discussion and great support.
Funding
JunHao Chen and YunCheng Tsai are supported in part by the Ministry of Science and Technology of Taiwan under grant 1082218E002050.
Author information
Authors and Affiliations
Contributions
YunCheng Tsai conceived of the presented idea. JunHao Chen developed the theory and performed the computations. YunCheng Tsai and JunHao Chen verified the analytical methods. All authors discussed the results and contributed to the final manuscript. Both authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
JunHao Chen and YunCheng Tsai declare that we have no significant competing financial, professional or personal interests that might have influenced the performance or presentation of the work described in this manuscript.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Chen, JH., Tsai, YC. Encoding candlesticks as images for pattern classification using convolutional neural networks. Financ Innov 6, 26 (2020). https://doi.org/10.1186/s40854020001870
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40854020001870
Keywords
 Convolutional Neural Networks (CNN)
 Gramian Angular Field (GAF)
 Candlestick
 Patterns Classification
 TimeSeries
 Financial Vision