Preprocessing script (fixing inconsistent DEA entries)

[euronion]

I'm becoming a bit frustrated by the inconsistent data format of the DEA input data.

E.g.: Column orders and names being inconsistent, most unchanging values are filled across all years while sometimes they are not. The inconsistencies for "Hydrogen to Jet Fuel" are e.g. at an extend were I simply started extracting the numbers by hand rather than automatically =/

The inconsistencies also make the compile_cost_assumption.py script more and more bloated and unreadable.

Suggestion:
Have a pre-processing script which is responsible for creating a consistent input data format and move all "if this tech than special treatment" cases there.

[euronion]

I'll just bump this issue again as I've run into another perculiarity (the first time for this one) with the new data on RE fuels by DEA.

On pg. 297 / in the excel file they include cost development for green ammonia plants.
The values are as usually given for 2020-2050.

The cost reduction from 2020-2050 in this case however is not driven by technology improvements, but only economies of scale ("The cost development exclusively reflects economy of scale and no further technological development is expected.").
They also suggest that "one should use the expected cost values" for 2050 "in case a gigiaplant of e.g. 2290 TPD [tonnes per day] is expected" earlier.

I am not sure whether it is the first time they use this approach (implicitly assuming EoS) in the cost data? @lisazeyen

[lisazeyen]

In the technology data cataloque for electricity and district heating on p.378 there is a chapter for the estimation of "future costs". They are assuming installed capacities projected by the IEA scenarios and calculated from the learning curve the respective costs per unit (learning rate 10% for most technologies, there are more detailed chapters for e.g. PV and offshore wind). They write on p.14

"The learning rates also take into account benefits from economy of scale and benefits
related to using automated production processes at high production volumes."

They assume for (at least some) technologies cost and efficiency improvements, so technology development is included.

[euronion]

So they presumably have been applying EoS before but haven't made it as apparent as in the new ammonia chapter? ;-)