submitted by jtimperio to DataHoarder [link] [comments]
Intro:In my exploration of the world of big data and I became curious about tick data. Unfortunately, market data is almost always behind a paywall or de-sampled to the point of uselessness. After discovering the Dukascopy API, I knew I wanted to make this data available for all in a more accessible format. Over the course of a few months, I downloaded, cleaned, parsed, and compressed over a decade of Forex tick data on 37 currency pairs and commodities. Today I am happy to finally release the final result of my work to the DataHoarder community!
Download Links:Warning: I have rented a seedbox for the next 3 months from seedbox.io but I have been having some issues. If you have any issues with the torrent please leave a comment. Also, PLEASE SEED when you are done. This is quite a large data set and I can only push so much data on my own.
Torrent File: https://drive.google.com/file/d/18ymZWeFLJK7FggK_iiWZ-TxgWIVdJVvv/view?usp=sharingCompanion Blog Post: https://www.driftinginrecursion.com/post/dukascopy_opensource_data/
About the Data:The data was collected from https://www.dukascopy.com/ via a public API that allows for the download of tick data on the hour level. These files come in the form of a .bi5 file. The data starts as early as 2004 all the way to 2019.
These files were decompressed, then merged into yearly CSV’s named in the following convention. “AUDCHF_tick_UTC+0_00_2011.csv” or ‘Pair_Resolution_Timezone_Year.csv’
These CSV’s are split into 3 categories “Majors”, “Crosses”, “Commodities”.
Majors, Crosses, and Commodities have had their timestamps modified so that they are in the official UTC ISO standard. This was originally done for a Postgresql database that quickly became obsolesced. Any files that have been modified are appended with a “-Parse”. These timestamps have been modified in the following format.
Millisecond timestamps to UTC +00:00 time [2017.01.01 22:37:08.014] -- [2017-01-01T22:37:08.014+00:00]
User Resources:For those looking to use this data in a live context or update it frequently, I have included a number of tools for both Windows and Linux that will be useful.
WindowsThe ~/dukascopy/resources/windows folder contains a third party tool written in java that can download and convert Dukascopy’s .bi5 files. I have also included the latest zstd binaries from Zstandard Github page.
LinuxLinux is my daily driver in 99% of cases, so I have developed all my scraping tools using Linux only tools. In the ~/dukascopy/resources/linux folder you will find a number of shell script and pyhton3 files that I used to collect this data. There are quite a few files in this directory but I will cover the core ones below.
download-day.py:This file is used to download a single symbol for a single day and then convert and merge all 24 .bi5 files into a single CSV.
download-year.pyThis file is used to download a single symbol for a full year and then convert and merge all .bi5 files into a single CSV.
dukascopy.pyThis file contains all the core logic for downloading and converting data from dukascopy.
utc-timestamp-convert.pyThis tad slow but works well enough. It requires the pandas project and parses timestamps into the UTC ISO standard. This is useful for those looking to maintain the format of new files with the those in this repo, or those looking to use this in a SQL database.
submitted by jtimperio to datasets [link] [comments]
|submitted by TweetArchiveBot to LibertyRSA [link] [comments]|
submitted by Cold_Ice7 to Forex [link] [comments]
|submitted by remittances09 to BankingIndustry [link] [comments]|
|submitted by FX_Winner to Forex [link] [comments]|
|submitted by Tonniatang to Forex [link] [comments]|
|submitted by HowForexTradingWorks to Forex [link] [comments]|
Are you also wondering what is the AED to INR exchange rate today? Or, how to do Emirati Dirham to Indian Rupee conversion? AED to INR exchange rate Nov, 2020 and Emirati Dirham to Indian Rupee conversion data by Conversion Ai provides historical chart price for Emirati Dirham to Indian Rupee with easy to use tools like AED to INR converter to help you get the best AED to INR quote today. When you convert AED to INR online in India with BookMyForex.com which is the best AED converter, ... AED TC Buy Rate: N/A: AED Forex Card Sell Rate: 19.7342: AED Currency Sell Rate: 20.1168: AED TC Sell Rate: N/A: AED DD Remit Rate: 20.5298: AED TT Remit Rate: 20.5298: SEE FULL RATE CARD . Freeze the Rates to Convert AED to INR Online . UAE Dirham comes in coins and notes. Coins are of the ... Rating of United Arab Emirates dirham (AED) Exchange Rates & Converter 4.07 / 5 based on 14 ratings Saturday, 05 September 2020, 12:00 Dubai time (Saturday, 05 September 2020, 08:00 GMT ) AED to USD currency converter. Get live exchange rates for United Arab Emirates Dirham to United States Dollar. Use XE's free calculator to convert foreign currencies and precious metals. Instant free online tool for AED to USD conversion or vice versa. The AED [United Arab Emirates Dirham] to USD [United States Dollar] conversion table and conversion steps are also listed. Also, explore tools to convert AED or USD to other currency units or learn more about currency conversions. XE Currency Converter: 1 USD to AED = 3.67250 Emirati Dirhams. Amount. From. USD US Dollar. To. AED Emirati Dirham. 1 USD = 3.67250 AED. 1 AED = 0.272294 USD. 1 USD = 3.67250 AED. US Dollar to Emirati Dirham Conversion. Last updated: 2020-11-01 04:11 UTC. All figures are live mid-market rates, which are not available to consumers and are for informational purposes only. Want to send money from ... 1 DEM to AED Online Currency Converter (Calculator). Convert Deutsche Marks to UAE Dirhams with real time forex rates based on up-to-the-second interbank exchange rates. Forex / EUR / AED. EUR to AED exchange rate Nov, 2020 The euro (sign: €; code: EUR) is the official currency of the eurozone, which consists of 19 of the 28 member states of the European Union: Austria, Belgium, Cyprus, Estonia, Finland, France, Germany, Greece, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, the Netherlands, Portugal, Slovakia, Slovenia, and Spain. The currency is ... United Arab Emirates Dirham exchange rates and currency conversion. United Arab Emirates currency (AED). Track Dirham forex rate changes, track Dirham historical changes. Directory of best currency transfer providers, compare to exchange rates when sending money from United Arab Emirates Free currency converter or travel reference card using daily OANDA Rate® data. Convert currencies using interbank, ATM, credit card, and kiosk cash rates.
[index]          
uae currency I have created this interesting video named uae currency. Learn how to convert INR to AED. The Emirati Dirham is the currency of United Arab Emirates. Our currency rankings show that ... EUR / AED exchange rate, USD / AED, GBP / AED, CNY / AED, JPY / AED, CAD / AED, PKR / AED, PHP / AED, INR / AED exchange rates... 1 USD USA dollar to AED UAE dirham exchange rate … 1 EUR euro to ... 19-04-2020 l dollar rate today l usd to aud l 1 usd to inr l aed to usd l php l euro l gbp l yen l pkr Daily report of currency rates/1 dollar in rupees toda... Add and Calculate All Currencies in Real time in Excel Sheet also update currency.. Click here for more detail... http://www.bsocialshine.com/2016/04/how-to-... Official Exchange Rates Of The United Arab Emirates Dirham (AED)... (Information Source: Central Bank Of United Arab Emirates) 1 USD United States Dollar to ... Dubai Currency Exchange guide for visitors in this DIY Dubai travel guide by Hipfig. 1). Dubai Currency information (Dirham or AED) 2). Dubai Money change co...