Manipulating multi-indices for a pandas dataframeHow to binary encode multi-valued categorical variable from Pandas dataframe?How to implement accurate counts or sums when you have different numbers of days of the week?Pandas Dataframe to DMatrixImprove Pandas dataframe filtering speedSegmenting pandas dataframe with lists as elementsResampling pandas Dataframe keeping other columnsPandas DataFrame: Aggregating multi-level groups by matching keysNumpy array from pandas dataframePandas DataFrame Rollup ErrorIndexError: too many indices for array
Is it possible to stack the damage done by the Absorb Elements spell?
Is it true that good novels will automatically sell themselves on Amazon (and so on) and there is no need for one to waste time promoting?
Print a physical multiplication table
How to generate binary array whose elements with values 1 are randomly drawn
My friend is being a hypocrite
How to define limit operations in general topological spaces? Are nets able to do this?
Recruiter wants very extensive technical details about all of my previous work
Does the attack bonus from a Masterwork weapon stack with the attack bonus from Masterwork ammunition?
Calculate the frequency of characters in a string
What favor did Moody owe Dumbledore?
Why didn't Héctor fade away after this character died in the movie Coco?
What does "Four-F." mean?
Wrapping homogeneous Python objects
Is honey really a supersaturated solution? Does heating to un-crystalize redissolve it or melt it?
In Aliens, how many people were on LV-426 before the Marines arrived?
Is there a term for accumulated dirt on the outside of your hands and feet?
Existence of a celestial body big enough for early civilization to be thought of as a second moon
Asserting that Atheism and Theism are both faith based positions
Violin - Can double stops be played when the strings are not next to each other?
How does one measure the Fourier components of a signal?
Relation between independence and correlation of uniform random variables
Light propagating through a sound wave
Do US professors/group leaders only get a salary, but no group budget?
What does Deadpool mean by "left the house in that shirt"?
Manipulating multi-indices for a pandas dataframe
How to binary encode multi-valued categorical variable from Pandas dataframe?How to implement accurate counts or sums when you have different numbers of days of the week?Pandas Dataframe to DMatrixImprove Pandas dataframe filtering speedSegmenting pandas dataframe with lists as elementsResampling pandas Dataframe keeping other columnsPandas DataFrame: Aggregating multi-level groups by matching keysNumpy array from pandas dataframePandas DataFrame Rollup ErrorIndexError: too many indices for array
$begingroup$
I have a pandas dataframe with multi-index. I have couple of questions on this.
The indices are week numbers (38 to 42) and for each week, day of the week (DOW). So it looks like
The problem is the 2nd level index, that is, DofWeek, is automatically sorted in lexicographic ordering. But I want to have the usual weekdays ordering, i,e for week 39, I want it to appear as Monday, Tuesday, Wednesday, Thoursday, Friday, Saturday and Sunday and NOT in the order they appear. So when I graph it, it appears this way:
I want it to appear in the usual Monday, Tuesday, Wednesday etc. I have tried reindexing, but it didn't work. This is my first question.
My second question is regarding querying such dataframes. For example when I do dataframe.query('DofWeek == 'Saturday'), it is throwing an error saying Saturday is not defined. However, if I swap levels and then query, it works. For example dataframe.swaplevel().query('weekNum == 39'), it works perfectly. As far as I know, the multi-indices should be sorted in order for certain methods to work. But in my case, they are. Then why isn't it working.
Any help would be hugely appreciated.
Thanks.
python pandas
asked 2 days ago
user62198user62198
4732617
$endgroup$
add a comment |
$begingroup$
I have a pandas dataframe with multi-index. I have couple of questions on this.
The indices are week numbers (38 to 42) and for each week, day of the week (DOW). So it looks like
The problem is the 2nd level index, that is, DofWeek, is automatically sorted in lexicographic ordering. But I want to have the usual weekdays ordering, i,e for week 39, I want it to appear as Monday, Tuesday, Wednesday, Thoursday, Friday, Saturday and Sunday and NOT in the order they appear. So when I graph it, it appears this way:
I want it to appear in the usual Monday, Tuesday, Wednesday etc. I have tried reindexing, but it didn't work. This is my first question.
My second question is regarding querying such dataframes. For example when I do dataframe.query('DofWeek == 'Saturday'), it is throwing an error saying Saturday is not defined. However, if I swap levels and then query, it works. For example dataframe.swaplevel().query('weekNum == 39'), it works perfectly. As far as I know, the multi-indices should be sorted in order for certain methods to work. But in my case, they are. Then why isn't it working.
Any help would be hugely appreciated.
Thanks.
python pandas
asked 2 days ago
user62198user62198
4732617
$endgroup$
1
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago
add a comment |
$begingroup$
I have a pandas dataframe with multi-index. I have couple of questions on this.
The indices are week numbers (38 to 42) and for each week, day of the week (DOW). So it looks like
The problem is the 2nd level index, that is, DofWeek, is automatically sorted in lexicographic ordering. But I want to have the usual weekdays ordering, i,e for week 39, I want it to appear as Monday, Tuesday, Wednesday, Thoursday, Friday, Saturday and Sunday and NOT in the order they appear. So when I graph it, it appears this way:
I want it to appear in the usual Monday, Tuesday, Wednesday etc. I have tried reindexing, but it didn't work. This is my first question.
My second question is regarding querying such dataframes. For example when I do dataframe.query('DofWeek == 'Saturday'), it is throwing an error saying Saturday is not defined. However, if I swap levels and then query, it works. For example dataframe.swaplevel().query('weekNum == 39'), it works perfectly. As far as I know, the multi-indices should be sorted in order for certain methods to work. But in my case, they are. Then why isn't it working.
Any help would be hugely appreciated.
Thanks.
python pandas
asked 2 days ago
user62198user62198
4732617
$endgroup$
I have a pandas dataframe with multi-index. I have couple of questions on this.
The indices are week numbers (38 to 42) and for each week, day of the week (DOW). So it looks like
The problem is the 2nd level index, that is, DofWeek, is automatically sorted in lexicographic ordering. But I want to have the usual weekdays ordering, i,e for week 39, I want it to appear as Monday, Tuesday, Wednesday, Thoursday, Friday, Saturday and Sunday and NOT in the order they appear. So when I graph it, it appears this way:
I want it to appear in the usual Monday, Tuesday, Wednesday etc. I have tried reindexing, but it didn't work. This is my first question.
My second question is regarding querying such dataframes. For example when I do dataframe.query('DofWeek == 'Saturday'), it is throwing an error saying Saturday is not defined. However, if I swap levels and then query, it works. For example dataframe.swaplevel().query('weekNum == 39'), it works perfectly. As far as I know, the multi-indices should be sorted in order for certain methods to work. But in my case, they are. Then why isn't it working.
Any help would be hugely appreciated.
Thanks.
python pandas
python pandas
asked 2 days ago
user62198user62198
4732617
asked 2 days ago
user62198user62198
4732617
edited 2 days ago
user62198
asked 2 days ago
user62198user62198
4732617
asked 2 days ago
user62198user62198
4732617
asked 2 days ago
user62198user62198
4732617
4732617
1
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago
add a comment |
1
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago
1
1
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Ordering
You can achieve this by changing the datatype to ordered categorical:
df['DofWeek'] = pd.Categorical(
df['DofWeek'],
categories=['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'],
ordered=True)
And then sorting the index:
df = df.sort_index()
Error
The issue with dataframe.query('DofWeek == 'Saturday') is bad quote encapsulation. You could solve it with e.g. 'DofWeek == "Saturday"'
answered 2 days ago
ukemiukemi
1488
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
return StackExchange.using("mathjaxEditing", function ()
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
);
);
, "mathjax-editing");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "557"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47363%2fmanipulating-multi-indices-for-a-pandas-dataframe%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Ordering
You can achieve this by changing the datatype to ordered categorical:
df['DofWeek'] = pd.Categorical(
df['DofWeek'],
categories=['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'],
ordered=True)
And then sorting the index:
df = df.sort_index()
Error
The issue with dataframe.query('DofWeek == 'Saturday') is bad quote encapsulation. You could solve it with e.g. 'DofWeek == "Saturday"'
answered 2 days ago
ukemiukemi
1488
$endgroup$
add a comment |
$begingroup$
Ordering
You can achieve this by changing the datatype to ordered categorical:
df['DofWeek'] = pd.Categorical(
df['DofWeek'],
categories=['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'],
ordered=True)
And then sorting the index:
df = df.sort_index()
Error
The issue with dataframe.query('DofWeek == 'Saturday') is bad quote encapsulation. You could solve it with e.g. 'DofWeek == "Saturday"'
answered 2 days ago
ukemiukemi
1488
$endgroup$
add a comment |
$begingroup$
Ordering
You can achieve this by changing the datatype to ordered categorical:
df['DofWeek'] = pd.Categorical(
df['DofWeek'],
categories=['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'],
ordered=True)
And then sorting the index:
df = df.sort_index()
Error
The issue with dataframe.query('DofWeek == 'Saturday') is bad quote encapsulation. You could solve it with e.g. 'DofWeek == "Saturday"'
answered 2 days ago
ukemiukemi
1488
$endgroup$
Ordering
You can achieve this by changing the datatype to ordered categorical:
df['DofWeek'] = pd.Categorical(
df['DofWeek'],
categories=['Monday','Tuesday','Wednesday','Thursday','Friday','Saturday','Sunday'],
ordered=True)
And then sorting the index:
df = df.sort_index()
Error
The issue with dataframe.query('DofWeek == 'Saturday') is bad quote encapsulation. You could solve it with e.g. 'DofWeek == "Saturday"'
answered 2 days ago
ukemiukemi
1488
edited 2 days ago
answered 2 days ago
ukemiukemi
1488
answered 2 days ago
ukemiukemi
1488
answered 2 days ago
ukemiukemi
1488
1488
add a comment |
add a comment |
Thanks for contributing an answer to Data Science Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdatascience.stackexchange.com%2fquestions%2f47363%2fmanipulating-multi-indices-for-a-pandas-dataframe%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
$begingroup$
Just a heads up: you should only ask one question per question.
$endgroup$
– ukemi
2 days ago