Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Epic][E2e Streamlit] Create Feed Overview streamlit page (expand lake/ + analytics/) #478

Closed
7 tasks
idiom-bytes opened this issue Jan 3, 2024 · 1 comment
Labels

Comments

@idiom-bytes
Copy link
Member

idiom-bytes commented Jan 3, 2024

Motivation

As @KatunaNorbert recommended, we should have a clear E2E of what #447 is working towards.

get_endpoint_statistics() has many feed_statistics that should be reported somewhere. To avoid adding this as a cli_module to then change it again, let's remove it for now.

This ticket is for revisiting this when creating the "Feed Overview" and "Feed Detail" pages found here: https://docs.google.com/presentation/d/18y_nfpc3e-dop5NtfIisgUkc-oPt8dft9WyAnqhSqZg/edit#slide=id.g28d2e627aad_0_0

This ticket should explain how to create the "Feed" tables inside the Lake, load them from parquet in Analytics, and render them into Streamlit.

At the end, we should have lake/ creating this data as it updates, and new "streamlit-single-page-app" should simply consume this data to provide insights on Feeds.

DoD - Medallion Workflow + Streamlit requirements

  • Design tables, charts, and requirements for the Feed Overview + Feed Details pages
  • Define table requirements to service Feed Overview Page- gold_pdr_feeds_summary <feed, timeframe, source> final aggregated metrics to provide an overall summary: total_stake, total_payout, rolling_accuracy.
  • Define table requirements to service Feed Details Page - silver_pdr_feeds <feed, timeframe, source> per event aggregation to report time-series insights: {sum_staked, n_staked, sum_stake_revenue, sum_stake_slash, sum_df_rewards, sum_rose_rewards, rolling_accuracy, rolling_stake}
  • Build data-workflows for silver_pdr_feeds and gold_pdr_feeds_summary into ETL.
  • Create Feed Overview streamlit page
  • Add gold_summary as a table
  • Add silver time-series data as charts
@idiom-bytes idiom-bytes added the Type: Enhancement New feature or request label Jan 3, 2024
@idiom-bytes idiom-bytes changed the title [Epic] E2E Data Lake + Streamlit Page [Epic] E2E Data Worfklow + Streamlit Page - Feed Overview Jan 3, 2024
@idiom-bytes idiom-bytes added Epic and removed Type: Enhancement New feature or request labels Jan 3, 2024
@idiom-bytes idiom-bytes changed the title [Epic] E2E Data Worfklow + Streamlit Page - Feed Overview [Epic] Expand lake/ + analytics/ to report Feed Overview Jan 3, 2024
@idiom-bytes idiom-bytes changed the title [Epic] Expand lake/ + analytics/ to report Feed Overview [Epic] Create Feed Overview streamlit page (expand lake/ + analytics/) Jan 3, 2024
@idiom-bytes idiom-bytes changed the title [Epic] Create Feed Overview streamlit page (expand lake/ + analytics/) [Epic][E2e Streamlit] Create Feed Overview streamlit page (expand lake/ + analytics/) Jan 3, 2024
@idiom-bytes
Copy link
Member Author

Closing this ticket for now. Re-open when we're closer to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant