Difference between revisions of "International Energy Agency (IEA)"

From Wiki
Jump to: navigation, search
Line 21: Line 21:
 
== Batch Pull ==
 
== Batch Pull ==
  
The IEA update is performed as a Batch Pull using the Batch Data Update feature in IFs. In the display, "IEA" is the Source, "IEA Countries" are used for country concordance. For the Code Location in Source Data portion of the update form, the source Excel must be formatted so that each Code in Source term is in a different column. For example, SeriesEnImportsOilProductsIEA's Code in Sourse is "Imports.Oil products," so there should be two columns with "Imports" in one and "Oil products" in the next.
+
The IEA update is performed as a Batch Pull that includes '''138 series''' using the Batch Data Update feature in IFs. In the display, "IEA" is the Source, "IEA Countries" are used for country concordance. For the Code Location in Source Data portion of the update form, the source Excel must be formatted so that each Code in Source term is in a different column. For example, SeriesEnImportsOilProductsIEA's Code in Sourse is "Imports.Oil products," so there should be two columns with "Imports" in one and "Oil products" in the next.
  
 
== Series Codes ==
 
== Series Codes ==
Line 29: Line 29:
 
'''Example'''
 
'''Example'''
  
Variable: SeriesEnImportsOilProductsIEA
+
Variable: EnImportsOilProductsIEA
  
 
Code: Imports.Oil products
 
Code: Imports.Oil products
  
[INSERT SCREEN SHOT OF IEA DATABASE HERE]
+
https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642
 +
 
 +
 
  
 
== Pulling the Data ==
 
== Pulling the Data ==
Line 74: Line 76:
  
 
'''Formula: '''These were not changed from previous years this data was pulled, and are either blank or convert data from ktoe to BBOE or GwH
 
'''Formula: '''These were not changed from previous years this data was pulled, and are either blank or convert data from ktoe to BBOE or GwH
 +
 +
== Preprocessor Series ==
 +
 +
Of the 138 IEA Batch Pull series, 24 are preprocessor. These series should be updated first in any IEA batch update. They include:
 +
 +
{| border="0" cellpadding="0" cellspacing="0" width="175"
 +
|- height="20"
 +
| height="20" width="175" | EnExportsCoalIEA
 +
|- height="20"
 +
| height="20" | EnExportsNatGasIEA
 +
|- height="20"
 +
| height="20" | EnExportsOilIEA
 +
|- height="20"
 +
| height="20" | EnExportsOilProductsIEA
 +
|- height="20"
 +
| height="20" | EnExportsPeatIEA
 +
|- height="20"
 +
| height="20" | EnExportsTotalIEA
 +
|- height="20"
 +
| height="20" | EnImportsCoalIEA
 +
|- height="20"
 +
| height="20" | EnImportsNatGasIEA
 +
|- height="20"
 +
| height="20" | EnImportsOilIEA
 +
|- height="20"
 +
| height="20" | EnImportsOilProductsIEA
 +
|- height="20"
 +
| height="20" | EnImportsPeatIEA
 +
|- height="20"
 +
| height="20" | EnImportsTotalIEA
 +
|- height="20"
 +
| height="20" | EnProdBiodieselIEA
 +
|- height="20"
 +
| height="20" | EnProdBiogasIEA
 +
|- height="20"
 +
| height="20" | EnProdCoalIEA
 +
|- height="20"
 +
| height="20" | EnProdGeothermIEA
 +
|- height="20"
 +
| height="20" | EnProdHydroIEA
 +
|- height="20"
 +
| height="20" | EnProdNatGasIEA
 +
|- height="20"
 +
| height="20" | EnProdNuclearIEA
 +
|- height="20"
 +
| height="20" | EnProdOilIEA
 +
|- height="20"
 +
| height="20" | EnProdSolarPhotoIEA
 +
|- height="20"
 +
| height="20" | EnProdSolarThermIEA
 +
|- height="20"
 +
| height="20" | EnProdTideWaveOceanIEA
 +
|- height="20"
 +
| height="20" | EnProdWindIEA
 +
|}
 +
 +
== Country Concordance ==

Revision as of 17:34, 25 May 2017

About

The International Energy Agency commenced its operation in 1974 under the auspices of the Organization for Economic Co-operation and Development (OECD). The IEA is the energy forum for 26 Member countries, all from the OECD, to improve the world’s energy supply and to promote reliable databases for energy-related information. IEA member governments are committed to sharing energy information, to co-ordinating their energy policies and to co-operating in the development of rational energy programs. IEA publishes monthly reports on electricity, natural gas, prices, and the oil market. The World Energy Outlook is the IEA's most comprehensive publication, and is considerd " the world’s most authoritative source of energy market analysis and projections."

The main IEA sources used by IFs are the World Energy Balances (WEB) and World Energy Statistics (WES), databases assocated with the World Energy Outlook. They contain variables such as the production, trade, and consumption of coal, oil, gas, electricity, heat, renewables, and waste for OECD countries and over 100 non-OECD countries.

Metadata

Data Acquisition

Unlike most data used in IFs, IEA data from the WEB and WES are not open source. The data must be purchased from the IEA and is delivered on two CD-ROMs.[1] Each disc runs on a database management software program called Beyond 20/20 that comes loaded on the discs, along with the data. Financial support for the purchase of the IEA data is available from a University Library Association grant. Pardee successfully applied for grant funding through this program for the 2017 update with the help of staff at the Anderson Academic Commons at the University of Denver.

Documentation

Full documentation is available for each dataset detailing its contents, structure, definitions, geographical coverage, etc. 

World Energy Balances 2016 Database Documentation

World Energy Statistics 2016 Database Documentation

Batch Pull

The IEA update is performed as a Batch Pull that includes 138 series using the Batch Data Update feature in IFs. In the display, "IEA" is the Source, "IEA Countries" are used for country concordance. For the Code Location in Source Data portion of the update form, the source Excel must be formatted so that each Code in Source term is in a different column. For example, SeriesEnImportsOilProductsIEA's Code in Sourse is "Imports.Oil products," so there should be two columns with "Imports" in one and "Oil products" in the next.

Series Codes

Because this is a batch pull, each series needs a Code in addition to a variable name to be imported. The codes are listed in the DataDict, and should match (or be extremely close to) the series name in the IEA source database. For the 2017 update, series on the WEB and WES discs were organized by two parameters, FLOW and PRODUCT, where FLOW is the first term of the Code and PRODUCT is the second term of the Code.

Example

Variable: EnImportsOilProductsIEA

Code: Imports.Oil products

https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642https://mail.google.com/mail/u/0/?ui=2&ik=f9951a9c73&view=fimg&th=15c40aa76094e2f8&attid=0.1&disp=inline&realattid=ii_15c40aa6f8730247&safe=1&attbid=ANGjdJ-guNot5n88S-ZiRvWJ6S395lb3KaBrMbO_69sUt_EPMmkDdXyd6HLz-tDaTDQ2N_TAfyuokBL1vqdGjfub5OVCUCzNYr8fVMxl7TptSATUiEUhZIp0FATmC4Q&ats=1495733538007&rm=15c40aa76094e2f8&zw&sz=w829-h642


Pulling the Data

Ideally, the IEA series can be pulled from the discs in bulk. 

DataDict

Variable: Variable names were not changed from previous years this data was pulled, and no additional variables were added for the 2017 pull.

Table: These were not changed from previous years this data was pulled. 

Code in Source: Identifies the series for batch import; were not changed from previous years this data was pulled.

Groups: These were not changed from previous years this data was pulled. 

Subgroups: These were not changed form previoys years this data was pulled.

Definitions and Units: These were not changed from previous years this data was pulled.

Extended Source Defn: All were marked as "No Extended Source" for 2017 pull. Units used in this dataset include BBOE and GwHr.

Years: Years for every series were changed to available data provided through the database. Most series begin in 1960 with the exception of EnExportsOilIEA, EnImportsOiliIEA, and EnProdOilIEA, which begin in 1971. All extend through either 2014 or 2015 as of the 2017 update.

Source: The source used in the 2017 update for all batch pull IEA series is "IEA (International Energy Agency) Batch Pull."

Original Source: The original source used in the 2017 update for all series is the "World Energy Outlook."

Notes: Notes were updated to reflect the source disc for the series (WEB or WES), any conversion factors used, and the appropriate initials.

Aggregation: Aggregations were not changed from pervious updates.

Disaggregation: Disaggregations were not changed from previous updates.

Name in source: Was updated based on the name of each variable as it is displayed in the Beyond 20/20 database format; generally matches the Code in Source.

Decimal places: These were not changed from previous years this data was pulled.

Country Concordance: FAO Countries were used.

Formula: These were not changed from previous years this data was pulled, and are either blank or convert data from ktoe to BBOE or GwH

Preprocessor Series

Of the 138 IEA Batch Pull series, 24 are preprocessor. These series should be updated first in any IEA batch update. They include:

EnExportsCoalIEA
EnExportsNatGasIEA
EnExportsOilIEA
EnExportsOilProductsIEA
EnExportsPeatIEA
EnExportsTotalIEA
EnImportsCoalIEA
EnImportsNatGasIEA
EnImportsOilIEA
EnImportsOilProductsIEA
EnImportsPeatIEA
EnImportsTotalIEA
EnProdBiodieselIEA
EnProdBiogasIEA
EnProdCoalIEA
EnProdGeothermIEA
EnProdHydroIEA
EnProdNatGasIEA
EnProdNuclearIEA
EnProdOilIEA
EnProdSolarPhotoIEA
EnProdSolarThermIEA
EnProdTideWaveOceanIEA
EnProdWindIEA

Country Concordance