Skip to content

Commit

Permalink
mm: fix false-positive WARN_ON() in truncate/invalidate for hugetlb
Browse files Browse the repository at this point in the history
Hugetlb pages have ->index in size of the huge pages (PMD_SIZE or
PUD_SIZE), not in PAGE_SIZE as other types of pages.  This means we
cannot user page_to_pgoff() to check whether we've got the right page
for the radix-tree index.

Let's introduce page_to_index() which would return radix-tree index for
given page.

We will be able to get rid of this once hugetlb will be switched to
multi-order entries.

Fixes: fc127da ("truncate: handle file thp")
Link: http://lkml.kernel.org/r/20161123093053.mjbnvn5zwxw5e6lk@black.fi.intel.com
Signed-off-by: Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Reported-by: Doug Nelson <doug.nelson@intel.com>
Tested-by: Doug Nelson <doug.nelson@intel.com>
Reviewed-by: Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>
Cc: <stable@vger.kernel.org>	[4.8+]
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
  • Loading branch information
kiryl authored and torvalds committed Dec 1, 2016
1 parent 828347f commit 5cbc198
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 10 deletions.
21 changes: 15 additions & 6 deletions include/linux/pagemap.h
Original file line number Diff line number Diff line change
Expand Up @@ -374,16 +374,13 @@ static inline struct page *read_mapping_page(struct address_space *mapping,
}

/*
* Get the offset in PAGE_SIZE.
* (TODO: hugepage should have ->index in PAGE_SIZE)
* Get index of the page with in radix-tree
* (TODO: remove once hugetlb pages will have ->index in PAGE_SIZE)
*/
static inline pgoff_t page_to_pgoff(struct page *page)
static inline pgoff_t page_to_index(struct page *page)
{
pgoff_t pgoff;

if (unlikely(PageHeadHuge(page)))
return page->index << compound_order(page);

if (likely(!PageTransTail(page)))
return page->index;

Expand All @@ -396,6 +393,18 @@ static inline pgoff_t page_to_pgoff(struct page *page)
return pgoff;
}

/*
* Get the offset in PAGE_SIZE.
* (TODO: hugepage should have ->index in PAGE_SIZE)
*/
static inline pgoff_t page_to_pgoff(struct page *page)
{
if (unlikely(PageHeadHuge(page)))
return page->index << compound_order(page);

return page_to_index(page);
}

/*
* Return byte-offset into filesystem object for page.
*/
Expand Down
8 changes: 4 additions & 4 deletions mm/truncate.c
Original file line number Diff line number Diff line change
Expand Up @@ -283,7 +283,7 @@ void truncate_inode_pages_range(struct address_space *mapping,

if (!trylock_page(page))
continue;
WARN_ON(page_to_pgoff(page) != index);
WARN_ON(page_to_index(page) != index);
if (PageWriteback(page)) {
unlock_page(page);
continue;
Expand Down Expand Up @@ -371,7 +371,7 @@ void truncate_inode_pages_range(struct address_space *mapping,
}

lock_page(page);
WARN_ON(page_to_pgoff(page) != index);
WARN_ON(page_to_index(page) != index);
wait_on_page_writeback(page);
truncate_inode_page(mapping, page);
unlock_page(page);
Expand Down Expand Up @@ -492,7 +492,7 @@ unsigned long invalidate_mapping_pages(struct address_space *mapping,
if (!trylock_page(page))
continue;

WARN_ON(page_to_pgoff(page) != index);
WARN_ON(page_to_index(page) != index);

/* Middle of THP: skip */
if (PageTransTail(page)) {
Expand Down Expand Up @@ -612,7 +612,7 @@ int invalidate_inode_pages2_range(struct address_space *mapping,
}

lock_page(page);
WARN_ON(page_to_pgoff(page) != index);
WARN_ON(page_to_index(page) != index);
if (page->mapping != mapping) {
unlock_page(page);
continue;
Expand Down

0 comments on commit 5cbc198

Please sign in to comment.