Supported APIs#

The following table lists all the pandas APIs currently supported in Ponder. If you have need of an operation that is listed as not implemented, feel free to email us at support@ponder.io.

The following table is structured as follows: The first column contains the method name. The second column contains link to a description of corresponding pandas method. The third column is a flag for whether or not there is an implementation in Modin for the method in the left column. Y stands for yes, N stands for no, P stands for partial (meaning some parameters may not be supported yet). Empty cells means that the method is untested.

Last updated: May 25, 2023

Pandas Doc Link

Snowflake

BigQuery

DuckDB

Notes

T

Y

Y

Y

abs

Y

Y

Y

add

Y

Y

Y

add_prefix

Y

Y

Y

add_suffix

Y

Y

Y

agg / aggregate

align

all

Y

P

Y

  • No support for axis=None, columns . e.g., df.all(axis=None) df.all(axis='columns') (BigQuery)

  • No support for bool_only=None, False. e.g., df.all(bool_only=None) df.all(bool_only=False) (BigQuery)

any

Y

P

Y

  • No support for axis=None, columns . e.g., df.all(axis=None) df.all(axis='columns') (BigQuery)

  • No support for bool_only=None, False. e.g., df.all(bool_only=None) df.all(bool_only=False) (BigQuery)

append

No support on any database

apply

P

P

applymap

P

P

  • No support for na_action

asfreq

P

P

P

asof

assign

P

P

  • Supports lambda but not new column creation e.g., df.assign(new_array_col = np.arange(1, 101, 1))

astype

P

P

at

Y

Y

Y

at_time

Y

Y

axes

Y

Y

between_time

Y

Y

bfill

P

P

P

  • No support for axis=1

bool

boxplot

clip

P

P

P

  • No support for axis=0

columns

Y

Y

Y

combine

combine_first

compare

Y

N

copy

Y

Y

Y

corr

P

P

corrwith

N

N

N

count

Y

Y

cov

P

P

  • Only supports ddof=1 or ddf=None

cummax

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1 (BigQuery)

cummin

P

P

P

  • No support for skipna=False with datasets that have nulls - No support for axis=1 (BigQuery)

cumprod

N

N

N

cumprod copied as snowflake results

cumsum

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1 (BigQuery)

P

P

P

describe

Y

Y

Y

diff

P

P

  • No support for axis=1 and columns

div

Y

Y

Y

divide

Y

Y

Y

dot

Y

N

drop

P

P

P

  • Currently don’t support the axis parameter

droplevel

P

P

drop_duplicates

dropna

P

Y

P

  • No support for certain list types for subset such as pandas.Series

dtypes

Y

Y

Y

duplicated

N

N

N

empty

Y

Y

Y

eq

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

equals

P

P

eval

N

N

N

ewm

expanding

Y

Y

Y

explode

ffill

P

P

P

  • No support for axis=1

fillna

P

P

P

  • Inconsistent value and column types are not yet supported

  • No support for inplace

filter

P

P

P

  • Cannot select rows with bool indexer. Requires using index.

first

Y

Y

first_valid_index

N

N

N

floordiv

Y

Y

Y

from_dict

from_records

ge

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

get

Y

Y

Y

groupby

P

P

  • No support for ascending

  • No support for inplace=True

  • No support for non-default index for head/tail operations

  • No support for groupby().nth(dropna=any, all)

gt

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

head

Y

Y

Y

hist

iat

Y

Y

Y

idxmax

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1

idxmin

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1

iloc

P

P

P

  • Currently don’t support setitem

index

Y

Y

Y

infer_objects

info

Y

N

insert

P

P

P

  • Currently don’t support list or Series as inputs

interpolate

isin

P

N

  • Indexes must be equal positional indexes

isna

Y

Y

Y

isnull

Y

Y

Y

items

Y

P

Y

iteritems

Y

Y

iterrows

Y

Y

itertuples

Y

Y

join

P

P

  • No support for axis=1 with different indexes

keys

Y

Y

kurt

P

N

kurtosis

P

N

last

Y

Y

last_valid_index

N

N

N

le

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

loc

P

P

P

  • masked array inputs not supported,

lookup

  • Deprecated API since pandas 1.2.0

lt

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

mad

  • Deprecated API since pandas 1.5.0

mask

max

Y

Y

mean

Y

Y

median

Y

Y

  • Some median ops supported in groupby and resample

melt

Y

Y

memory_usage

Y

Y

merge

Y

Y

Y

merge_asof

Y

Y

min

Y

Y

mod

Y

Y

Y

mode

N

N

N

mul

Y

Y

Y

multiply

Y

Y

Y

ndim

Y

Y

Y

ne

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

nlargest

P

P

P

  • No support for keep=last and keep=all (Snowflake)

notna

Y

Y

Y

notnull

Y

Y

Y

nsmallest

P

P

P

  • No support for keep=last and keep=all (Snowflake)

nunique

P

P

P

Incorrect values for axis=1 and null values

pct_change

Y

N

Y

pipe

pivot

P

P

P

  • No support for aggfunc parameter

pivot_table

P

P

  • No support for aggfunc parameter

plot

Y

Y

pop

Y

Y

Y

pow

Y

Y

Y

prod

Y

Y

  • Some support in DuckDB, unclear if there is more work

product

Y

Y

quantile

P

P

  • No support for axis=1

  • No support for transposed frame

query

P

P

  • Columns with spaces not yet supported

radd

Y

Y

Y

rank

rdiv

N

N

N

  • explicitly not implement

reindex

Y

Y

reindex_like

Y

Y

rename

Y

Y

rename_axis

P

P

reorder_levels

replace

P

N

  • Type mismatches between to_replace values and replacement values are not yet supported

resample

P

P

  • No support for Multi-column indexing

  • No support for bfill, backfill, ffill, pad for upsampling

reset_index

P

P

P

  • No support for parameters level, col_level and col_fill for dataframes (related to multi-index)

rfloordiv

Y

Y

Y

rmod

Y

Y

Y

rmul

Y

Y

Y

rolling

Y

Y

Y

May

round

Y

N

Y

rpow

N

N

N

rsub

Y

Y

Y

rtruediv

N

N

N

sample

Y

Y

select_dtypes

Y

Y

Y

sem

P

P

  • Incorrect values for ddof > 1

set_axis

Y

Y

Y

set_index

Y

Y

Y

shape

Y

Y

Y

shift

P

N

  • Cannot concat dfs with non-range indexes

size

Y

Y

Y

skew

P

N

  • Null values and axis=1 not yet handled

slice_shift

sort_index

Y

Y

sort_values

P

P

  • No support for ignore_index=True

  • No support for axis=1, axis= columns

sparse

N

N

N

squeeze

Y

Y

Y

No tests, but appears to work

stack

P

N

std

P

P

  • Non-default ddof not yet supported

style

sub

Y

Y

Y

subtract

Y

Y

sum

Y

Y

swapaxes

Y

Y

Y

swaplevel

tail

Y

Y

Y

take

Y

Y

Y

to_clipboard

to_csv

N

N

N

to_dict

N

N

N

to_excel

N

N

N

to_feather

N

N

N

to_gbq

N

N

N

to_hdf

N

N

N

to_html

N

N

N

to_json

N

N

N

to_latex

N

N

N

to_parquet

N

N

N

to_period

N

N

N

to_pickle

N

N

N

to_records

N

N

N

to_sql

Y

Y

Y

to_stata

N

N

N

to_string

N

N

N

to_timestamp

N

N

N

to_xarray

N

N

N

transform

N

N

N

transpose

Y

Y

Y

truediv

Y

Y

Y

truncate

Y

Y

tshift

P

P

  • freq of days, months, or years not yet supported

tz_convert

Y

N

Cannot support tz convert

tz_localize

Y

P

unstack

P

N

  • Multiindex pivot not yet supported

update

Y

Y

values

N

N

N

value_counts

Y

Y

Y

var

P

P

  • Non-default ddof not yet supported

where

N

N

N