Ivan T. Ivanov 4d8706
From: Christoph Hellwig <hch@lst.de>
Ivan T. Ivanov 4d8706
Date: Tue, 30 Apr 2019 06:51:50 -0400
Ivan T. Ivanov 4d8706
Subject: arm64/iommu: handle non-remapped addresses in ->mmap and
Ivan T. Ivanov 4d8706
 ->get_sgtable
Ivan T. Ivanov 4d8706
Git-commit: a98d9ae937d256ed679a935fc82d9deaa710d98e
Ivan T. Ivanov 4d8706
Patch-mainline: v5.2-rc2
Ivan T. Ivanov 4d8706
References: git-fixes
Ivan T. Ivanov 4d8706
Ivan T. Ivanov 4d8706
DMA allocations that can't sleep may return non-remapped addresses, but
Ivan T. Ivanov 4d8706
we do not properly handle them in the mmap and get_sgtable methods.
Ivan T. Ivanov 4d8706
Resolve non-vmalloc addresses using virt_to_page to handle this corner
Ivan T. Ivanov 4d8706
case.
Ivan T. Ivanov 4d8706
Ivan T. Ivanov 4d8706
Cc: <stable@vger.kernel.org>
Ivan T. Ivanov 4d8706
Acked-by: Catalin Marinas <catalin.marinas@arm.com>
Ivan T. Ivanov 4d8706
Reviewed-by: Robin Murphy <robin.murphy@arm.com>
Ivan T. Ivanov 4d8706
Signed-off-by: Christoph Hellwig <hch@lst.de>
Ivan T. Ivanov 4d8706
Signed-off-by: Will Deacon <will.deacon@arm.com>
Ivan T. Ivanov 4d8706
Acked-by: Ivan T. Ivanov <iivanov@suse.de>
Ivan T. Ivanov 4d8706
---
Ivan T. Ivanov 4d8706
 arch/arm64/mm/dma-mapping.c |   10 ++++++++++
Ivan T. Ivanov 4d8706
 1 file changed, 10 insertions(+)
Ivan T. Ivanov 4d8706
Ivan T. Ivanov 4d8706
--- a/arch/arm64/mm/dma-mapping.c
Ivan T. Ivanov 4d8706
+++ b/arch/arm64/mm/dma-mapping.c
Ivan T. Ivanov 4d8706
@@ -720,6 +720,11 @@ static int __iommu_mmap_attrs(struct dev
Ivan T. Ivanov 4d8706
 	if (dma_mmap_from_coherent(dev, vma, cpu_addr, size, &ret))
Ivan T. Ivanov 4d8706
 		return ret;
Ivan T. Ivanov 4d8706
 
Ivan T. Ivanov 4d8706
+	if (!is_vmalloc_addr(cpu_addr)) {
Ivan T. Ivanov 4d8706
+		unsigned long pfn = page_to_pfn(virt_to_page(cpu_addr));
Ivan T. Ivanov 4d8706
+		return __swiotlb_mmap_pfn(vma, pfn, size);
Ivan T. Ivanov 4d8706
+	}
Ivan T. Ivanov 4d8706
+
Ivan T. Ivanov 4d8706
 	if (attrs & DMA_ATTR_FORCE_CONTIGUOUS) {
Ivan T. Ivanov 4d8706
 		/*
Ivan T. Ivanov 4d8706
 		 * DMA_ATTR_FORCE_CONTIGUOUS allocations are always remapped,
Ivan T. Ivanov 4d8706
@@ -743,6 +748,11 @@ static int __iommu_get_sgtable(struct de
Ivan T. Ivanov 4d8706
 	unsigned int count = PAGE_ALIGN(size) >> PAGE_SHIFT;
Ivan T. Ivanov 4d8706
 	struct vm_struct *area = find_vm_area(cpu_addr);
Ivan T. Ivanov 4d8706
 
Ivan T. Ivanov 4d8706
+	if (!is_vmalloc_addr(cpu_addr)) {
Ivan T. Ivanov 4d8706
+		struct page *page = virt_to_page(cpu_addr);
Ivan T. Ivanov 4d8706
+		return __swiotlb_get_sgtable_page(sgt, page, size);
Ivan T. Ivanov 4d8706
+	}
Ivan T. Ivanov 4d8706
+
Ivan T. Ivanov 4d8706
 	if (attrs & DMA_ATTR_FORCE_CONTIGUOUS) {
Ivan T. Ivanov 4d8706
 		/*
Ivan T. Ivanov 4d8706
 		 * DMA_ATTR_FORCE_CONTIGUOUS allocations are always remapped,