Skip to content

Commit

Permalink
memcg: fix race at move_parent around compound_order()
Browse files Browse the repository at this point in the history
A fix up mem_cgroup_move_parent() which use compound_order() in
asynchronous manner.  This compound_order() may return unknown value
because we don't take lock.  Use PageTransHuge() and HPAGE_SIZE instead
of it.

Also clean up for mem_cgroup_move_parent().
 - remove unnecessary initialization of local variable.
 - rename charge_size -> page_size
 - remove unnecessary (wrong) comment.
 - added a comment about THP.

Note:
 Current design take compound_page_lock() in caller of move_account().
 This should be revisited when we implement direct move_task of hugepage
 without splitting.

[[email protected]: coding-style fixes]
Signed-off-by: KAMEZAWA Hiroyuki <[email protected]>
Reviewed-by: Johannes Weiner <[email protected]>
Acked-by: Daisuke Nishimura <[email protected]>
Cc: Balbir Singh <[email protected]>
Signed-off-by: Andrew Morton <[email protected]>
Signed-off-by: Linus Torvalds <[email protected]>
  • Loading branch information
hkamezawa authored and torvalds committed Jan 26, 2011
1 parent 3d37c4a commit 52dbb90
Showing 1 changed file with 16 additions and 9 deletions.
25 changes: 16 additions & 9 deletions mm/memcontrol.c
Original file line number Diff line number Diff line change
Expand Up @@ -2236,7 +2236,12 @@ static int mem_cgroup_move_account(struct page_cgroup *pc,
{
int ret = -EINVAL;
unsigned long flags;

/*
* The page is isolated from LRU. So, collapse function
* will not handle this page. But page splitting can happen.
* Do this check under compound_page_lock(). The caller should
* hold it.
*/
if ((charge_size > PAGE_SIZE) && !PageTransHuge(pc->page))
return -EBUSY;

Expand Down Expand Up @@ -2268,7 +2273,7 @@ static int mem_cgroup_move_parent(struct page_cgroup *pc,
struct cgroup *cg = child->css.cgroup;
struct cgroup *pcg = cg->parent;
struct mem_cgroup *parent;
int charge = PAGE_SIZE;
int page_size = PAGE_SIZE;
unsigned long flags;
int ret;

Expand All @@ -2281,22 +2286,24 @@ static int mem_cgroup_move_parent(struct page_cgroup *pc,
goto out;
if (isolate_lru_page(page))
goto put;
/* The page is isolated from LRU and we have no race with splitting */
charge = PAGE_SIZE << compound_order(page);

if (PageTransHuge(page))
page_size = HPAGE_SIZE;

parent = mem_cgroup_from_cont(pcg);
ret = __mem_cgroup_try_charge(NULL, gfp_mask, &parent, false, charge);
ret = __mem_cgroup_try_charge(NULL, gfp_mask,
&parent, false, page_size);
if (ret || !parent)
goto put_back;

if (charge > PAGE_SIZE)
if (page_size > PAGE_SIZE)
flags = compound_lock_irqsave(page);

ret = mem_cgroup_move_account(pc, child, parent, true, charge);
ret = mem_cgroup_move_account(pc, child, parent, true, page_size);
if (ret)
mem_cgroup_cancel_charge(parent, charge);
mem_cgroup_cancel_charge(parent, page_size);

if (charge > PAGE_SIZE)
if (page_size > PAGE_SIZE)
compound_unlock_irqrestore(page, flags);
put_back:
putback_lru_page(page);
Expand Down

0 comments on commit 52dbb90

Please sign in to comment.