DataFrame#

The following table lists all the pandas APIs currently supported in Ponder. If you have need of an operation that is listed as not implemented, feel free to email us at support@ponder.io.

The following table is structured as follows: The first column contains the method name. The second column contains link to a description of corresponding pandas method. The third column is a flag for whether or not there is an implementation in Modin for the method in the left column. Y stands for yes, N stands for no, P stands for partial (meaning some parameters may not be supported yet). Empty cells means that the method is untested.

Last updated: July 18, 2023

Pandas Doc Link

Snowflake

BigQuery

DuckDB

Notes

T

Y

Y

Y

abs

Y

Y

Y

add

Y

Y

Y

add_prefix

Y

Y

Y

add_suffix

Y

Y

Y

agg / aggregate

align

all

Y

P

Y

  • No support for axis=None, columns . e.g., df.all(axis=None) df.all(axis='columns') (BigQuery)

  • No support for bool_only=None, False. e.g., df.all(bool_only=None) df.all(bool_only=False) (BigQuery)

any

Y

P

Y

  • No support for axis=None, columns . e.g., df.all(axis=None) df.all(axis='columns') (BigQuery)

  • No support for bool_only=None, False. e.g., df.all(bool_only=None) df.all(bool_only=False) (BigQuery)

append

Y

Y

Y

apply

P

P

applymap

P

P

  • No support for na_action

asfreq

P

P

P

asof

N

N

N

assign

P

P

P

  • Does not support assignment to numpy objects e.g., df.assign(new_array_col = np.arange(1, 101, 1))

astype

P

P

P

at

Y

Y

Y

at_time

Y

Y

Y

axes

Y

Y

Y

between_time

Y

Y

Y

bfill

P

P

P

  • No support for axis=1

bool

Y

Y

Y

boxplot

clip

P

P

P

  • No support for axis=0

columns

Y

Y

Y

combine

combine_first

compare

Y

N

copy

Y

Y

Y

corr

P

P

P

corrwith

N

N

N

count

Y

Y

Y

cov

P

P

P

  • Only supports ddof=1 or ddf=None

cummax

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1 (BigQuery)

cummin

P

P

P

  • No support for skipna=False with datasets that have nulls - No support for axis=1 (BigQuery)

cumprod

N

N

N

cumsum

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1 (BigQuery)

P

P

P

describe

Y

Y

Y

diff

P

P

P

  • No support for axis=1 and columns

div

Y

Y

Y

divide

Y

Y

Y

dot

Y

N

drop

P

P

P

  • Currently don’t support the level parameter

droplevel

P

P

P

drop_duplicates

dropna

P

Y

P

  • No support for certain list types for subset such as pandas.Series

dtypes

Y

Y

Y

duplicated

N

N

N

empty

Y

Y

Y

eq

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

equals

P

P

P

eval

N

N

N

ewm

expanding

Y

Y

Y

explode

ffill

P

P

P

  • No support for axis=1

fillna

P

P

P

  • Inconsistent value and column types are not yet supported

  • No support for inplace

filter

P

P

P

  • Cannot select rows with bool indexer. Requires using index.

first

Y

Y

first_valid_index

N

N

N

floordiv

Y

Y

Y

from_dict

from_records

ge

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

get

Y

Y

Y

groupby

P

P

P

  • No support for ascending

  • No support for inplace=True

  • No support for non-default index for head/tail operations

  • No support for groupby().nth(dropna=any, all)

gt

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

head

Y

Y

Y

hist

iat

Y

Y

Y

idxmax

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1

idxmin

P

P

P

  • No support for skipna=False with datasets that have nulls

  • No support for axis=1

iloc

P

P

P

  • Currently don’t support setitem

index

Y

Y

Y

infer_objects

info

Y

Y

Y

insert

P

P

P

  • Currently don’t support list or Series as inputs

interpolate

isin

P

N

  • Indexes must be equal positional indexes

isna

Y

Y

Y

isnull

Y

Y

Y

items

Y

P

Y

iteritems

Y

Y

Y

iterrows

Y

Y

Y

itertuples

Y

Y

Y

join

P

P

  • No support for axis=1 with different indexes

keys

Y

Y

Y

kurt

P

P

N

kurtosis

P

P

N

last

Y

Y

last_valid_index

N

N

N

le

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

loc

P

P

P

  • masked array inputs not supported,

lookup

  • Deprecated API since pandas 1.2.0

lt

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

mad

  • Deprecated API since pandas 1.5.0

mask

max

Y

Y

Y

mean

Y

Y

Y

median

Y

Y

Y

  • Some median ops supported in groupby and resample

melt

Y

Y

memory_usage

Y

Y

Y

merge

Y

Y

Y

merge_asof

Y

Y

min

Y

Y

Y

mod

Y

Y

Y

mode

N

N

N

mul

Y

Y

Y

multiply

Y

Y

Y

ndim

Y

Y

Y

ne

P

P

P

  • No support for level

  • No support for comparison with other DataFrame

nlargest

P

P

P

  • No support for keep=last and keep=all (Snowflake)

notna

Y

Y

Y

notnull

Y

Y

Y

nsmallest

P

P

P

  • No support for keep=last and keep=all (Snowflake)

nunique

P

P

P

Incorrect values for axis=1 and null values

pct_change

Y

N

Y

pipe

Y

Y

Y

pivot

P

P

P

  • No support for aggfunc parameter

pivot_table

P

P

P

  • No support for aggfunc parameter

plot

Y

Y

Y

pop

Y

Y

Y

pow

Y

Y

Y

prod

Y

Y

Y

  • Some support in DuckDB, unclear if there is more work

product

Y

Y

Y

quantile

P

P

P

  • No support for axis=1

  • No support for transposed frame

query

P

P

P

  • Columns with spaces not yet supported

radd

Y

Y

Y

rank

rdiv

Y

Y

Y

reindex

Y

Y

Y

reindex_like

Y

Y

Y

rename

Y

Y

Y

rename_axis

P

P

P

reorder_levels

replace

P

N

  • Type mismatches between to_replace values and replacement values are not yet supported

resample

P

P

P

  • No support for Multi-column indexing

  • No support for bfill, backfill, ffill, pad for upsampling

reset_index

P

P

P

  • No support for parameters level, col_level and col_fill for dataframes (related to multi-index)

rfloordiv

Y

Y

Y

rmod

Y

Y

Y

rmul

Y

Y

Y

rolling

Y

Y

Y

round

Y

N

Y

rpow

Y

Y

Y

rsub

Y

Y

Y

rtruediv

Y

Y

Y

sample

P

P

P

select_dtypes

Y

Y

Y

sem

P

P

P

  • Incorrect values for ddof > 1

set_axis

Y

Y

Y

set_index

Y

Y

Y

shape

Y

Y

Y

shift

P

N

  • Cannot concat dfs with non-range indexes

size

Y

Y

Y

skew

P

N

  • Null values and axis=1 not yet handled

slice_shift

sort_index

Y

Y

Y

sort_values

P

P

P

  • No support for ignore_index=True

  • No support for axis=1, axis= columns

sparse

N

N

N

squeeze

Y

Y

Y

stack

P

N

std

P

P

P

  • Non-default ddof not yet supported

style

sub

Y

Y

Y

subtract

Y

Y

Y

sum

Y

Y

Y

swapaxes

Y

Y

Y

swaplevel

tail

Y

Y

Y

take

Y

Y

Y

to_clipboard

N

N

N

to_csv

N

N

N

to_dict

N

N

N

to_excel

N

N

N

to_feather

N

N

N

to_gbq

N

N

N

to_hdf

N

N

N

to_html

N

N

N

to_json

N

N

N

to_latex

N

N

N

to_parquet

N

N

N

to_period

N

N

N

to_pickle

N

N

N

to_records

N

N

N

to_sql

Y

Y

Y

to_stata

N

N

N

to_string

N

N

N

to_timestamp

N

N

N

to_xarray

N

N

N

transform

N

N

N

transpose

Y

Y

Y

truediv

Y

Y

Y

truncate

Y

Y

Y

tshift

P

P

  • freq of days, months, or years not yet supported

tz_convert

Y

Y

N

tz_localize

Y

Y

P

unstack

P

N

  • Multiindex pivot not yet supported

update

Y

Y

Y

values

Y

Y

Y

value_counts

Y

Y

Y

var

P

P

P

  • Non-default ddof not yet supported

where

N

N

N