我正在尝试使用列多索引数据格式,但我不太明白如何处理缺少级别的列。作为MWE,我创建了一个像这样的虚拟数据文件
In [4]: df = pd.DataFrame(
...: np.random.rand(2, 4),
...: columns=pd.MultiIndex.from_product([['A', 'B'], [1, 2]])
...: )
...: df[('C', np.nan)] = 3
...: df
Out[4]:
A B C
1.0 2.0 1.0 2.0 NaN
0 0.484498 0.218928 0.480720 0.530619 3
1 0.789152 0.687612 0.953487 0.926798 3注意代码的最后一行,它创建一个具有单一级别和填充nan的新列(我这样做是因为当传递不同长度的元组时,pd.MultiIndex.from_tuples就是这样做的)。
我可以毫无问题地进入第一列,
In [5]: df[('A', 1)]
Out[5]:
0 0.484498
1 0.789152
Name: (A, 1.0), dtype: float64但是当我试图以完全相同的方式访问最后一列时
df[('C', np.nan)]我得到了一个KeyError
In [6]: df[('C', np.nan)]
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
Input In [6], in <cell line: 1>()
----> 1 df[('C', np.nan)]
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/core/frame.py:3504, in DataFrame.__getitem__(self, key)
3502 if is_single_key:
3503 if self.columns.nlevels > 1:
-> 3504 return self._getitem_multilevel(key)
3505 indexer = self.columns.get_loc(key)
3506 if is_integer(indexer):
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/core/frame.py:3555, in DataFrame._getitem_multilevel(self, key)
3553 def _getitem_multilevel(self, key):
3554 # self.columns is a MultiIndex
-> 3555 loc = self.columns.get_loc(key)
3556 if isinstance(loc, (slice, np.ndarray)):
3557 new_columns = self.columns[loc]
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/core/indexes/multi.py:2882, in MultiIndex.get_loc(self, key, method)
2880 if keylen == self.nlevels and self.is_unique:
2881 try:
-> 2882 return self._engine.get_loc(key)
2883 except TypeError:
2884 # e.g. test_partial_slicing_with_multiindex partial string slicing
2885 loc, _ = self.get_loc_level(key, list(range(self.nlevels)))
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/_libs/index.pyx:779, in pandas._libs.index.BaseMultiIndexCodesEngine.get_loc()
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/_libs/index.pyx:136, in pandas._libs.index.IndexEngine.get_loc()
File ~/anaconda3/envs/dlsproc/lib/python3.10/site-packages/pandas/_libs/index.pyx:163, in pandas._libs.index.IndexEngine.get_loc()
File pandas/_libs/hashtable_class_helper.pxi:1832, in pandas._libs.hashtable.UInt64HashTable.get_item()
File pandas/_libs/hashtable_class_helper.pxi:1841, in pandas._libs.hashtable.UInt64HashTable.get_item()
KeyError: 12有线索吗?
干杯。
发布于 2022-04-21 08:22:06
用空字符串替换列中缺少的值:
print (df.rename(columns= lambda x: '' if pd.isna(x) else x)[('C','')])
0 3
1 3
Name: (C, ), dtype: int64发布于 2022-04-21 08:15:00
您可以只使用df['C'],这将选择该系列:
NaN
0 3
1 3或者df['C'][np.nan]来获取以下值:
0 4
1 4
Name: nan, dtype: int64(注意:只有在多个索引中C下只有一个NaN列,否则就可以得到ValueError: cannot handle a non-unique multi-index!)
发布于 2022-04-21 11:54:42
不完全是我想要的,但我终于采用了发布在here上的解决方案。本质上,用空字符串替换np.nan更容易处理。在dataframe的创作中,
df[('C', '')] = 3然后
In [7]: df[('C', '')]
Out[7]:
0 3
1 3
Name: (C, ), dtype: int64https://stackoverflow.com/questions/71951008
复制相似问题