Posted by BlairMABEL25 March - 17 - 2015 14 COMMENTS

Sentdex.com Facebook.com/sentdex Twitter.com/sentdex A video covering the manipulation and reformatting of large data files. The code and the stock price fil…

Tags : , , , , , , , , Big Data Challenges

14 Responses to “Python Big Data Analytics & Stock Algorithmic Trading Part 1: Big Data Files”

  1. Najeeb Choudhary Says:

    amat tick data download link 

  2. olayinka adeniji Says:

    Thanks. Please how can I compile a report of analyses of two bigdata sets
    in python

  3. Mark Bobl Says:

    Sentdex,
    Really cool and awesome,but I can’t find source code and price file in
    your tutorials from the site:
    http://sentdex.com/sentiment-analysisbig-data-and-python-tutorials-algorithmic-trading/;could
    you please share it to me for sentiment analysis and python learning. my
    mail:boblmark@hotmail.com
    

  4. Victor F Says:

    – stockName never changes here so you don’t need to parse it at every
    iteration. Could be moved before the for loop, and changed to stockName =
    “AMAT” (edit: unless you need to parse other similar files, but still, it
    would be best to do it only once)

    – You need to know the timezone of your data : mktime uses local time but
    if the timezone of your machine is different from the timezone of the data,
    you will get wrong timestamps. Regardless unix timestamps are UTC, and
    time.localtime() gives you the time in your machine’s timezone. This means
    you can’t use the dateStamp field of your reformatted file in another
    timezone… This can happen on a remote server, or when sharing files, so
    you should add timezone info in dateStamp. You could also drop the field,
    it seems redundant and useless anyway. This file is meant to be read by a
    program, not a human.

    – The output file should be opened once before the loop, and closed once
    after the loop.

    – You don’t need to read the whole thing all at once beforehand, but i
    believe this issue has already been addressed… (edit: you can use
    readline() as somebody suggested)

  5. John Slater Says:

    Your videos are the bomb! Ignore the ignorant naysayers and keep on
    changing the world.

  6. 김준원 Says:

    Thank you for your kind explanation.

  7. human417 Says:

    Sounds like Topre switch you are typing into. Beautiful~ Very helpful
    tutorial!

  8. Lasha Gogua Says:
  9. Pedro Pezzarini Says:

    #programming #codable #python #bigdata #analytics

    *Python Big Data Analytics & Stock Algorithmic Trading Part 1: Big Data
    Files*

    Python Big Data Analytics & Stock Algorithmic Trading Part 1: Big Data Files
    

  10. Joshua Downer Says:
  11. Fernando Enzo Guarini Says:

    #programming #codable #python #bigdata #analytics

    *Python Big Data Analytics & Stock Algorithmic Trading Part 1: Big Data
    Files*

    Python Big Data Analytics & Stock Algorithmic Trading Part 1: Big Data Files
    

  12. Tom Ablewhite Says:

    #Python #BigData Analytics & Stock Algorithmic Trading Part 1: Big Data
    Files http://bit.ly/1dFPOBS 

  13. regikeyz Says:

    would be great if you add in the settings ability to set at 1.5 and 2x
    speed.. can hear information quicker 

  14. wellcentive Says:

    It’s interesting how versatile Python is in crunching data from many
    different industries.

Leave a Reply

You must be logged in to post a comment.