# Data Management

How to manage data in the cycles app for analysis

# Integrated Datafeeds

The cycle toolbox has integrated external data-sources for end-of-day datasets. It includes major global stocks, market indices, crypto-currencies and forex data.

### **Stock market data** 

The market type ID to get major global stocks and indices datasets is **YFI**. Use Yahoo Finance for symbol search.

For weekly data add -W to the symbol.

Example symbols are:

<div id="bkmrk-symbol-name-cycle-to"><div><div><div><figure class="wp-block-table is-style-stripes"><table style="width: 100%; height: 76px;"><tbody><tr style="height: 19px;"><td style="height: 19px; width: 24.9383%;">**Symbol**</td><td style="height: 19px; width: 25.0617%;">**Name**</td><td style="height: 19px; width: 25.0617%;">**Cycle Tools Symbol ID**</td><td style="height: 19px; width: 25.0617%;">**Link**</td></tr><tr style="height: 19px;"><td style="height: 19px; width: 24.9383%;">^GSPC</td><td style="height: 19px; width: 25.0617%;">S&amp;P 500 Index</td><td style="height: 19px; width: 25.0617%;">^GSPC:YFI</td><td style="height: 19px; width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/%5EGSPC:YFI)</td></tr><tr style="height: 19px;"><td style="height: 19px; width: 24.9383%;">^GSPC-W</td><td style="height: 19px; width: 25.0617%;">S&amp;P 500 Index Weekly</td><td style="height: 19px; width: 25.0617%;">^GSPC-W:YFI</td><td style="height: 19px; width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/%5EGSPC-W:YFI)</td></tr><tr style="height: 19px;"><td style="height: 19px; width: 24.9383%;">CL=F</td><td style="height: 19px; width: 25.0617%;">Oil</td><td style="height: 19px; width: 25.0617%;">CL=F:YFI</td><td style="height: 19px; width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/CL=F:YFI)</td></tr><tr style="height: 19px;"><td style="height: 19px; width: 24.9383%;">ES=F</td><td style="height: 19px; width: 25.0617%;">E Mini Futures</td><td style="height: 19px; width: 25.0617%;">ES=F:YFI</td><td style="height: 19px; width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/ES=F:YFI)</td></tr><tr><td style="width: 24.9383%;">DX-Y.NYB-W</td><td style="width: 25.0617%;">US Dollar Index Weekly</td><td style="width: 25.0617%;">DX-Y.NYB-W:YFI</td><td style="width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/DX-Y.NYB-W:YFI)</td></tr><tr><td style="width: 24.9383%;">GBPUSD=X</td><td style="width: 25.0617%;">GBP/USD Currency in USD</td><td style="width: 25.0617%;">GBPUSD=X:YFI</td><td style="width: 25.0617%;">[Open](https://cycle.tools/cyclescanner/GBPUSD=x:YFI)</td></tr></tbody></table>

</figure><div><div>---

<div aria-hidden="true"> </div></div></div></div></div></div></div>### **Crypto-currency datasets**

The market type ID to get crypto datasets is **CDS**.   
Generic symbol format is: \[FromSymbol\]-\[ToSymbol\]-\[Exchange\]  
Short usage is: \[Symbol\] – in this case ToSymbol is USD and the exchange is CCCAGG index <sup>\*</sup>.

Example symbols are:

<div id="bkmrk-symbol-name-cycle-to-0"><div><figure class="wp-block-table is-style-stripes"><table><tbody><tr><td>**Symbol**</td><td>**Name**</td><td>**Cycle Tools Symbol ID**</td><td>**Link**</td></tr><tr><td>ETH</td><td>Ethereum USD</td><td>ETH:CDS</td><td>[Open](https://cycle.tools/cyclescanner/ETH:CDS)</td></tr><tr><td>BTC</td><td>Bitcoin USD</td><td>BTC:CDS</td><td>[Open](https://cycle.tools/cyclescanner/BTC:CDS)</td></tr><tr><td>LTC</td><td>Litecoin USD</td><td>LTC:CDS</td><td>[Open](https://cycle.tools/cyclescanner/LTC:CDS)</td></tr><tr><td>BTC-EUR-CCCAGG</td><td>Bitcoin EUR</td><td>BTC-EUR-CCCAGG:CDS</td><td>[Open](https://cycle.tools/cyclescanner/BTC-EUR-CCCAGG:CDS)</td></tr><tr><td>ETH-JPY-COINBASE</td><td>Etheruem JPY at Coinbase</td><td>ETH-JPY-COINBASE:CDS</td><td>[Open](https://cycle.tools/cyclescanner/ETH-JPY-COINBASE:CDS)</td></tr></tbody></table>

</figure><div><div><div aria-hidden="true"> </div>---

<div aria-hidden="true"></div></div></div></div></div>### **Managed Forex datasets**

The market type ID to get managed forex currency pairs is **FX**.   
Generic symbol format is: \[FromSymbol\]\[ToSymbol\]

<div id="bkmrk-symbol-name-cycle-to-1"><div><figure class="wp-block-table is-style-stripes"><table><tbody><tr><td>**Symbol**</td><td>**Name**</td><td>**Cycle Tools Symbol ID**</td><td>**Link**</td></tr><tr><td>EURUSD</td><td>EUR USD</td><td>EURUSD:FX</td><td>[Open](https://cycle.tools/cyclescanner/EURUSD:FX)</td></tr><tr><td>USDJPY</td><td>USD JPY</td><td>USDJPY:FX</td><td>[Open](https://cycle.tools/cyclescanner/USDJPY:FX)</td></tr><tr><td>EURGBP</td><td>EUR GBP</td><td>EURGBP:FX</td><td>[Open](https://cycle.tools/cyclescanner/EURGBP:FX)</td></tr></tbody></table>

</figure><div aria-hidden="true"> </div>---

<div aria-hidden="true"></div></div></div>### **Economic datasets** (FRED)

Access to the economic data services of the Economic Research Division of the Federal Reserve Bank of St. Louis. The market type ID to get FRED data is **FDS**.   
  
Online symbol search via FRED: [https://fred.stlouisfed.org/](https://fred.stlouisfed.org/)

Example symbols are:

<div id="bkmrk-symbol-name-cycle-to-2"><div><figure class="wp-block-table is-style-stripes"><table><tbody><tr><td>**Symbol**</td><td>**Name**</td><td>**Cycle Tools Symbol ID**</td><td>**Link**</td></tr><tr><td>VIXCLS</td><td>CBOE Volatility Index</td><td>VIXCLS:FDS</td><td>[Open](https://cycle.tools/cyclescanner/VIXCLS:FDS)</td></tr><tr><td>VXDCLS</td><td>DJIA Volatility Index</td><td>VXDCLS:FDS</td><td>[Open](https://cycle.tools/cyclescanner/VXDCLS:FDS)</td></tr><tr><td>T5YIFR</td><td>5-Year Forward Inflation Expectation Rate</td><td>T5YIFR:FDS</td><td>[Open](https://cycle.tools/cyclescanner/T5YIFR:FDS)</td></tr><tr><td>STLFSI2-W</td><td>St. Louis Fed Financial Stress Index (Weekly)  
[More dataset details](https://fredblog.stlouisfed.org/2020/03/the-st-louis-feds-financial-stress-index-version-2-0/)</td><td>STLFSI2-W:FDS</td><td>[Open](https://cycle.tools/cyclescanner/STLFSI2-W:FDS)</td></tr></tbody></table>

</figure><div aria-hidden="true"> </div>---

<div aria-hidden="true"></div></div></div>### **Quandl datasets**

The market type ID to get free quandl datasets is **QDS**.   
Generic symbol format to load free quandl data via the time series API:   
\[Quandl database code\]-\[Quandl dataset code\]-\[column\]-\[collapse\]  
  
\[column\] (optional)  
Ensure that you pick that correct column number. The column number is different for each dataset.

\[collapse\] (optional):

<table id="bkmrk-nonedailyweeklymonth"><tbody><tr><td>none  
daily  
weekly  
monthly  
quarterly  
annual</td><td>Change the sampling frequency of the returned data. Default is `<span class="cm-s-neo">none</span>`; i.e., data is returned in its original granularity.</td></tr></tbody></table>

Example symbols are:

<div id="bkmrk-database-symbol-name"><div><figure class="wp-block-table is-style-stripes"><table><tbody><tr><td style="width: 171px;">**Database-Symbol**</td><td style="width: 382px;">**Name**</td><td style="width: 203px;">**Cycle Tools Symbol ID**</td><td style="width: 53px;">**Link**</td></tr><tr><td style="width: 171px;">CHRIS-EUREX\_FDAX1-4</td><td style="width: 382px;">DAX Futures, Continuous Contract #1 (FDAX1) (Front Month), EUREX, Settle</td><td style="width: 203px;">CHRIS-EUREX\_FDAX1-4:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/CHRIS-EUREX_FDAX1-4:QDS)</td></tr><tr><td style="width: 171px;">FSE-VOW3\_X</td><td style="width: 382px;">Volkswagen AG, Stock Price, Frankfurt Stock Exchange</td><td style="width: 203px;">FSE-VOW3\_X:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/FSE-VOW3_X:QDS)</td></tr><tr><td style="width: 171px;">BSE-Sensex</td><td style="width: 382px;">Bombay Stock Exchange – SENSEX Index</td><td style="width: 203px;">BSE-Sensex:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/BSE-SENSEX:QDS)</td></tr><tr><td style="width: 171px;">LBMA-Gold-2</td><td style="width: 382px;">Gold London Fixing USD PM (London Bullion Market Association)  
[More dataset details](https://www.quandl.com/data/LBMA/GOLD-Gold-Price-London-Fixing)</td><td style="width: 203px;">LBMA-Gold-2:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/LBMA-Gold-2:QDS)</td></tr><tr><td style="width: 171px;">LBMA-Gold-2-weekly</td><td style="width: 382px;">Gold London Fixing USD PM weekly data</td><td style="width: 203px;">LBMA-Gold-2-weekly:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/LBMA-Gold-2-weekly:QDS)</td></tr><tr><td style="width: 171px;">LBMA-Gold-4</td><td style="width: 382px;">Gold London Fixing GBP PM (London Bullion Market Association)  
[More dataset details](https://www.quandl.com/data/LBMA/GOLD-Gold-Price-London-Fixing)</td><td style="width: 203px;">LBMA-Gold-4:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/LBMA-Gold-4:QDS)</td></tr><tr><td style="width: 171px;">LBMA-Silver-3</td><td style="width: 382px;">Silver London Fixing EUR (London Bullion Market Association)   
[More dataset details](https://www.quandl.com/data/LBMA/SILVER-Silver-Price-London-Fixing)</td><td style="width: 203px;">LBMA-Silver-3:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/LBMA-Silver-3:QDS)</td></tr><tr><td style="width: 171px;">ECB-EURJPY-1</td><td style="width: 382px;">EUR vs JPY Exchange Rate (European Central Bank)  
[More dataset details](https://www.quandl.com/data/ECB/EURJPY-EUR-vs-JPY-Foreign-Exchange-Reference-Rate)</td><td style="width: 203px;">ECB-EURJPY:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/ECB-EURJPY:QDS)</td></tr><tr><td style="width: 171px;">CHRIS-ICE\_CC5-4</td><td style="width: 382px;">Cocoa Futures, Continuous Contract (Settle)  
[More dataset details](https://www.quandl.com/data/CHRIS/ICE_CC1-Cocoa-Futures-Continuous-Contract)</td><td style="width: 203px;">CHRIS-ICE\_CC5-4:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/CHRIS-ICE_CC5-4:QDS)</td></tr><tr><td style="width: 171px;">CHRIS-ICE\_B1-4</td><td style="width: 382px;">Brent Crude Futures, Continuous Contract (Settle)  
[More dataset details ](https://www.quandl.com/data/CHRIS/ICE_B1-Brent-Crude-Futures-Continuous-Contract)</td><td style="width: 203px;">CHRIS-ICE\_B1-4:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/CHRIS-ICE_B1-4:QDS)</td></tr><tr><td style="width: 171px;">CHRIS-ICE\_B1-4-weekly</td><td style="width: 382px;">Brent Crude Futures, Continuous Contract (Settle) - weekly</td><td style="width: 203px;">CHRIS-ICE\_B1-4-weekly:QDS</td><td style="width: 53px;">[Open](https://cycle.tools/cyclescanner/CHRIS-ICE_B1-4-weekly:QDS)</td></tr></tbody></table>

</figure></div></div><span style="font-size: 8pt;">\*) Data is sourced from CryptoCompare. If no exchange is specified the CCCAGG index data will be returned. The Crypto Coin Comparison Aggregated Index (“CCCAGG”) refers to the real-time index calculation methodology, the purpose of which is to show the best price estimation for crypto traders and investors to value their portfolio at any time. It aggregates transaction data of over 70 exchanges,using 24 hour volume weighted average. The CCCAGG is calculated for each crypto coin in eachcurrency it is trading in. </span><span style="font-size: 8pt;">We provide the data from CryptoCompare to the community based on their license without any additional change or charge (for research, software/applicationdevelopment, portfolio valuation, etc.), and is under the Creative Commons Attribution-NonCommercial3.0 Unported (CC BY-NC 3.0) license ( https://creativecommons.org/licenses/by-nc/3.0/ ).</span>

# Upload your own data

You can upload your own datasets as CSV files and save them in the cycles app. A CSV ("comma-separated values") file is a delimited text file that uses a comma to separate values.

<p class="callout success">You can always manage (add, remove, update) your own saved data-sets in the settings area:  
[https://cycle.tools/settings/datasets](https://cycle.tools/settings/datasets)</p>

To upload new data series, go to the Settings -&gt; MyDatasets area and click "Upload New".

You need to ensure the right format of your text file. The first line always needs to include the header "time, value" indicating each following line has a text for the date/time and a numeric value (e.g. close).

---

#####  

##### EOD

```C
 time, value
 2019-04-11, 80.01
 2019-04-12, 82.1
```

<p class="callout info">Use the [attached file eod\_upload\_test.csv](https://docs.cycle.tools/attachments/8) shown in the navigation panel as template with daily data.</p>

---

#####  

##### Intraday

```C
time, value
2019-04-11 13:01, 2301
2019-04-12 13:02, 2320
```

<p class="callout info">Please see and test the [attached file](https://docs.cycle.tools/attachments/7) (eurusd-1h-example.csv) shown in the navigation panel as template with 1h intraday data for the EURUSD.</p>

---

#####  

##### Generic date formats

<div id="bkmrk-%5Byy%5Dyy-mm-ddyyyymmdd"><div><small> \[yy\]yy-mm-dd  
yyyymmdd</small></div></div><div id="bkmrk--0"></div>