Ibis - Querying every file in every release on the Python Package Index (redux)

[giscus[bot]]

Ibis - Querying every file in every release on the Python Package Index (redux)

https://ibis-project.org/posts/querying-pypi-metadata-compiled-languages/

[hengaini2055]

I copy the final code to Jupyter lab, and get the following error:

......
ExpressionError                           Traceback (most recent call last)
File D:\Program Files\condamini\envs\panel110\lib\site-packages\altair\vegalite\v5\api.py:2520, in Chart.to_dict(self, *args, **kwargs)
   2518     copy.data = core.InlineData(values=[{}])
   2519     return super(Chart, copy).to_dict(*args, **kwargs)
-> 2520 return super().to_dict(*args, **kwargs)

File D:\Program Files\condamini\envs\panel110\lib\site-packages\altair\vegalite\v5\api.py:838, in TopLevelMixin.to_dict(self, *args, **kwargs)
    836 copy = self.copy(deep=False)  # type: ignore[attr-defined]
    837 original_data = getattr(copy, "data", Undefined)
--> 838 copy.data = _prepare_data(original_data, context)
    840 if original_data is not Undefined:
    841     context["data"] = original_data

File D:\Program Files\condamini\envs\panel110\lib\site-packages\altair\vegalite\v5\api.py:107, in _prepare_data(data, context)
    104     data = core.UrlData(data)
    106 elif hasattr(data, "__dataframe__"):
--> 107     data = _pipe(data, data_transformers.get())
    109 # consolidate inline data to top-level datasets
    110 if context is not None and data_transformers.consolidate_datasets:

File D:\Program Files\condamini\envs\panel110\lib\site-packages\toolz\functoolz.py:628, in pipe(data, *funcs)
    608 """ Pipe a value through a sequence of functions
    609 
    610 I.e. ``pipe(data, f, g, h)`` is equivalent to ``h(g(f(data)))``
   (...)
    625     thread_last
    626 """
    627 for func in funcs:
--> 628     data = func(data)
    629 return data

File D:\Program Files\condamini\envs\panel110\lib\site-packages\toolz\functoolz.py:304, in curry.__call__(self, *args, **kwargs)
    302 def __call__(self, *args, **kwargs):
    303     try:
--> 304         return self._partial(*args, **kwargs)
    305     except TypeError as exc:
    306         if self._should_curry(args, kwargs, exc):

File D:\Program Files\condamini\envs\panel110\lib\site-packages\altair\vegalite\data.py:19, in default_data_transformer(data, max_rows)
     17 @curried.curry
     18 def default_data_transformer(data, max_rows=5000):
---> 19     return curried.pipe(data, limit_rows(max_rows=max_rows), to_values)

File D:\Program Files\condamini\envs\panel110\lib\site-packages\toolz\functoolz.py:628, in pipe(data, *funcs)
    608 """ Pipe a value through a sequence of functions
    609 
    610 I.e. ``pipe(data, f, g, h)`` is equivalent to ``h(g(f(data)))``
   (...)
    625     thread_last
    626 """
    627 for func in funcs:
--> 628     data = func(data)
    629 return data

File D:\Program Files\condamini\envs\panel110\lib\site-packages\toolz\functoolz.py:304, in curry.__call__(self, *args, **kwargs)
    302 def __call__(self, *args, **kwargs):
    303     try:
--> 304         return self._partial(*args, **kwargs)
    305     except TypeError as exc:
    306         if self._should_curry(args, kwargs, exc):

File D:\Program Files\condamini\envs\panel110\lib\site-packages\altair\utils\data.py:81, in limit_rows(data, max_rows)
     79 elif hasattr(data, "__dataframe__"):
     80     values = data
---> 81 if max_rows is not None and len(values) > max_rows:
     82     raise MaxRowsError(
     83         "The number of rows in your dataset is greater "
     84         f"than the maximum allowed ({max_rows}).\n\n"
   (...)
     88         "in the right circumstance, disable the restriction"
     89     )
     90 return data

File D:\Program Files\condamini\envs\panel110\lib\site-packages\ibis\expr\types\relations.py:640, in Table.__len__(self)
    639 def __len__(self):
--> 640     raise com.ExpressionError("Use .count() instead")

ExpressionError: Use .count() instead

ibis version is 7.1.0
Jupyter lab
Python 3.11.5
OS windows 11

[hengaini2055]

This is the last step wrong, all above steps are ok.

[cpcloud]

Can you try upgrading your version of altair to the latest version?

[NickCrews]

Or, if you can't upgrade altair (which contains a feature that makes altair work with any __dataframe__()-compatible library, such as ibis or vaex), then the other option is to execute the ibis expression to a pandas DF before passing to altair: change alt.Chart(full_query) to alt.Chart(full_query.to_pandas())