OpenTSDB DB Schema Clarification

[Sync1011]

I am trying to learn more about OpenTSDB.

I came across the database schema documentation documentation. It mentions that, "Rows are broken up into hour increments, reflected by the timestamp in each row. Thus each timestamp will be normalized to an hour value, e.g. 2013-01-01 08:00:00."

If I understand this correctly, OpenTSDB will store all the metrics emitted for that one hour in a single row with the timestamp normalized to the beginning of that hour.

---

My question now is, if I want to see the metrics emitted for a given label/metric between the 20th minute and the 40th minute for a given hour, how will OpenTSDB accommodate this query? Since the row key is normalized to the beginning of the hour and it does not keep track of any other timestamp (AFAIK), how will it know which metrics came between the 20th minute and the 40th minute?

[johann8384]

It will retrieve the entire hour from HBase.

…

On Wed, Apr 28, 2021 at 1:21 PM Sync1011 ***@***.***> wrote: I am trying to learn more about OpenTSDB. I came across the database schema documentation <http://opentsdb.net/docs/build/html/user_guide/backends/hbase.html> documentation. It mentions that, *"Rows are broken up into hour increments, reflected by the timestamp in each row. Thus each timestamp will be normalized to an hour value, e.g. 2013-01-01 08:00:00."* If I understand this correctly, OpenTSDB will store all the metrics emitted for that one hour in a single row with the timestamp normalized to the beginning of that hour. ------------------------------ My question now is, if I want to see the metrics emitted for a given label/metric between the 20th minute and the 40th minute for a given hour, how will OpenTSDB accommodate this query? Since the row key is normalized to the beginning of the hour and it does not keep track of any other timestamp (AFAIK), how will it know which metrics came between the 20th minute and the 40th minute? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#2115>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABFYMLRUB3HE5OZBTZJODDTLA7YHANCNFSM43XQBWEA> .

[Sync1011]

Thanks @johann8384!

If I were plotting he 1hr period on a graph, how does it maintain the order? For example if I wanted to see how many 500s an API emitted in the past 1hour, how will it graph the number of 500s at the 10min mark and 20min mark and so on.

[johann8384]

The data is still timestamped with the original timestamp, it's just not "indexed" that way in HBase, so it gets the data in 1 hour chunks then processes it and returns to you the time period you asked for.

…

On Wed, Apr 28, 2021 at 3:34 PM Sync1011 ***@***.***> wrote: Thanks @johann8384 <https://github.com/johann8384>! If I were plotting he 1hr period on a graph, how does it maintain the order? For example if I wanted to see how many 500s an API emitted in the past 1hour, how will it graph the number of 500s at the 10min mark and 20min mark and so on. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2115 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABFYMMVTQ37VM4YPCEPRCLTLBPN5ANCNFSM43XQBWEA> .