Skip to content

DOC: Add doc pages for specific connectors #464

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 21, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ Contents:
remote_data.rst
cache.rst
see-also.rst
readers/index


Indices and tables
Expand Down
8 changes: 8 additions & 0 deletions docs/source/readers/bank-of-canada.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Bank of Canada
--------------

.. py:module:: pandas_datareader.bankofcanada

.. autoclass:: BankOfCanadaReader
:members:
:inherited-members:
8 changes: 8 additions & 0 deletions docs/source/readers/enigma.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Engima
------

.. py:module:: pandas_datareader.enigma

.. autoclass:: EnigmaReader
:members:
:inherited-members:
8 changes: 8 additions & 0 deletions docs/source/readers/eurostat.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Eurostat
--------

.. py:module:: pandas_datareader.eurostat

.. autoclass:: EurostatReader
:members:
:inherited-members:
10 changes: 10 additions & 0 deletions docs/source/readers/famafrench.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
Fama-French Data (Ken French's Data Library)
--------------------------------------------

.. py:module:: pandas_datareader.famafrench

.. autoclass:: FamaFrenchReader
:members:
:inherited-members:

.. autofunction:: get_available_datasets
10 changes: 10 additions & 0 deletions docs/source/readers/fred.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
Federal Reserve Economic Data (FRED)
------------------------------------

.. py:module:: pandas_datareader.fred

.. autoclass:: FredReader
:members:
:inherited-members: read


48 changes: 48 additions & 0 deletions docs/source/readers/iex.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
The Investors Exchange (IEX)
----------------------------

.. py:module:: pandas_datareader.iex.market

.. autoclass:: MarketReader
:members:
:inherited-members:

.. py:module:: pandas_datareader.iex.ref

.. autoclass:: SymbolsReader
:members:
:inherited-members:

.. py:module:: pandas_datareader.iex.stats

.. autoclass:: DailySummaryReader
:members:
:inherited-members:

.. autoclass:: MonthlySummaryReader
:members:
:inherited-members:

.. autoclass:: RecordsReader
:members:
:inherited-members:

.. autoclass:: RecentReader
:members:
:inherited-members:

.. py:module:: pandas_datareader.iex.deep

.. autoclass:: Deep
:members:
:inherited-members:

.. py:module:: pandas_datareader.iex.tops

.. autoclass:: TopsReader
:members:
:inherited-members:

.. autoclass:: LastReader
:members:
:inherited-members:
19 changes: 19 additions & 0 deletions docs/source/readers/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
Data Readers
------------

.. toctree::
:maxdepth: 2

fred
famafrench
bank-of-canada
enigma
eurostat
iex
moex
nasdaq-trader
oecd
quandl
stooq
tsp
world-bank
8 changes: 8 additions & 0 deletions docs/source/readers/moex.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Moscow Exchange (MOEX)
----------------------

.. py:module:: pandas_datareader.moex

.. autoclass:: MoexReader
:members:
:inherited-members:
6 changes: 6 additions & 0 deletions docs/source/readers/nasdaq-trader.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
NASDAQ
------

.. py:module:: pandas_datareader.nasdaq_trader

.. autofunction:: get_nasdaq_symbols
8 changes: 8 additions & 0 deletions docs/source/readers/oecd.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Organisation for Economic Co-operation and Development (OECD)
-------------------------------------------------------------

.. py:module:: pandas_datareader.oecd

.. autoclass:: OECDReader
:members:
:inherited-members:
8 changes: 8 additions & 0 deletions docs/source/readers/quandl.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Quandl
------

.. py:module:: pandas_datareader.quandl

.. autoclass:: QuandlReader
:members:
:inherited-members:
8 changes: 8 additions & 0 deletions docs/source/readers/stooq.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Stooq.com
---------

.. py:module:: pandas_datareader.stooq

.. autoclass:: StooqDailyReader
:members:
:inherited-members:
8 changes: 8 additions & 0 deletions docs/source/readers/tsp.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
Thrift Savings Plan (TSP)
-------------------------

.. py:module:: pandas_datareader.tsp

.. autoclass:: TSPReader
:members:
:inherited-members:
16 changes: 16 additions & 0 deletions docs/source/readers/world-bank.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
World Bank
----------

.. py:module:: pandas_datareader.wb

.. autoclass:: WorldBankReader
:members:
:inherited-members:

.. autofunction:: download

.. autofunction:: get_countries

.. autofunction:: get_indicators

.. autofunction:: search
37 changes: 18 additions & 19 deletions pandas_datareader/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -15,25 +15,24 @@


class _BaseReader(object):

"""
Parameters
----------
symbols : {str, List[str]}
String symbol of like of symbols
start : string, (defaults to '1/1/2010')
Starting date, timestamp. Parses many different kind of date
representations (e.g., 'JAN-01-2010', '1/1/10', 'Jan, 1, 1980')
end : string, (defaults to today)
Ending date, timestamp. Same format as starting date.
retry_count : int, default 3
Number of times to retry query request.
pause : float, default 0.1
Time, in seconds, of the pause between retries.
session : Session, default None
requests.sessions.Session instance to be used
freq : {str, None}
Frequency to use in select readers
symbols : {str, List[str]}
String symbol of like of symbols
start : string, (defaults to '1/1/2010')
Starting date, timestamp. Parses many different kind of date
representations (e.g., 'JAN-01-2010', '1/1/10', 'Jan, 1, 1980')
end : string, (defaults to today)
Ending date, timestamp. Same format as starting date.
retry_count : int, default 3
Number of times to retry query request.
pause : float, default 0.1
Time, in seconds, of the pause between retries.
session : Session, default None
requests.sessions.Session instance to be used
freq : {str, None}
Frequency to use in select readers
"""

_chunk_size = 1024 * 1024
Expand All @@ -58,7 +57,7 @@ def __init__(self, symbols, start=None, end=None, retry_count=3,
self.freq = freq

def close(self):
""" close my session """
"""Close network session"""
self.session.close()

@property
Expand All @@ -71,7 +70,7 @@ def params(self):
return None

def read(self):
""" read data """
"""Read data from connector"""
try:
return self._read_one_data(self.url, self.params)
finally:
Expand Down Expand Up @@ -193,7 +192,7 @@ def _get_params(self, *args, **kwargs):
raise NotImplementedError

def read(self):
""" read data """
"""Read data"""
# If a single symbol, (e.g., 'GOOG')
if isinstance(self.symbols, (compat.string_types, int)):
df = self._read_one_data(self.url,
Expand Down
31 changes: 12 additions & 19 deletions pandas_datareader/enigma.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,28 +11,21 @@
class EnigmaReader(_BaseReader):
"""
Collects current snapshot of Enigma data located at the specified
dataset ID and returns a pandas DataFrame.
data set ID and returns a pandas DataFrame.

# Example
Download current snapshot for the following Florida Inspections Dataset
Examples
--------
Download current snapshot for the following Florida Inspections Dataset:
https://public.enigma.com/datasets/bedaf052-5fcd-4758-8d27-048ce8746c6a

Usage (high-level):
```
import pandas_datareader as pdr
df = pdr.get_data_enigma('bedaf052-5fcd-4758-8d27-048ce8746c6a')

# in the event that ENIGMA_API_KEY does not exist in your env,
# it can be supplied as the second arg:
df = prd.get_data_enigma('bedaf052-5fcd-4758-8d27-048ce8746c6a',
... 'INSERT_API_KEY')
```

Usage:
```
df = EnigmaReader(dataset_id='bedaf052-5fcd-4758-8d27-048ce8746c6a',
... api_key='INSERT_API_KEY').read()
```
>>> import pandas_datareader as pdr
>>> df = pdr.get_data_enigma('bedaf052-5fcd-4758-8d27-048ce8746c6a')

In the event that ENIGMA_API_KEY does not exist in your env, the key can
be supplied as the second argument or as the keyword argument `api_key`

>>> df = EnigmaReader(dataset_id='bedaf052-5fcd-4758-8d27-048ce8746c6a',
... api_key='INSERT_API_KEY').read()
"""
def __init__(self,
dataset_id=None,
Expand Down
1 change: 0 additions & 1 deletion pandas_datareader/eurostat.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@


class EurostatReader(_BaseReader):

"""Get data for the given name from Eurostat."""

_URL = 'http://www.ec.europa.eu/eurostat/SDMX/diss-web/rest'
Expand Down
21 changes: 15 additions & 6 deletions pandas_datareader/famafrench.py
Original file line number Diff line number Diff line change
Expand Up @@ -44,11 +44,6 @@ class FamaFrenchReader(_BaseReader):

For annual and monthly data, index is a pandas.PeriodIndex, otherwise
it's a pandas.DatetimeIndex.

Returns
-------
df : a dictionary of pandas.DataFrame. Tables are accessed by integer keys.
See df['DESCR'] for a description of the dataset
"""

@property
Expand All @@ -66,6 +61,18 @@ def _read_zipfile(self, url):

return data

def read(self):
"""
Read data

Returns
-------
df : dict
A dictionary of DataFrames. Tables are accessed by integer keys.
See df['DESCR'] for a description of the data set.
"""
return super(FamaFrenchReader, self).read()

def _read_one_data(self, url, params):

params = {'index_col': 0,
Expand Down Expand Up @@ -128,9 +135,11 @@ def _read_one_data(self, url, params):
def get_available_datasets(self):
"""
Get the list of datasets available from the Fama/French data library.

Returns
-------
A list of valid inputs for get_data_famafrench.
datasets: list
A list of valid inputs for get_data_famafrench
"""
try:
from lxml.html import document_fromstring
Expand Down
1 change: 1 addition & 0 deletions pandas_datareader/fred.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ def url(self):
return "https://fred.stlouisfed.org/graph/fredgraph.csv"

def read(self):
"""Read data"""
try:
return self._read()
finally:
Expand Down
Loading