Harvest EIA 861 Utilities?

[katie-lamb]

Overview

The EIA-SEC record linkage would benefit from harvesting EIA 861 utilities. It's been a long standing PUDL issue to harvest 861. I think we could investigate whether there's a way to harvest 861 utilities into the EIA utilities table without this opening a larger can of worms or spiraling out of budget. Here's some preliminary investigation into 861 utilities:

Temporary solution using core_eia861__assn_utility

• contains 4831 unique utility_id_eia as well as state
• there are 520 utility_id_eia that are in 861 but not 860 (out_eia__yearly_utilities)
• we can merge on utility_name_eia from core_eia861__yearly_utility_data_misc, core_eia861__yearly_operational_data_misc, core_eia861__yearly_operational_data_misc, and core_eia861__yearly_demand_side_management_misc (as well as other tables but this roughly covers the missing utilities)
• after that merge there are 4 utilities missing utility_name_eia

Success Criteria

Either punt the 861 harvesting or make a plan for a contained harvesting of 861 utilities in PUDL