colin
/
onnx-mlir
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
onnx-mlir/test/mlir/onnx/onnx_bundle_memory_pool.mlir

29 lines
1.9 KiB
MLIR
Raw Normal View History

[NFC] Rename passes for stylistic consistency. (#232) * lower-frontend -> convert-onnx-to-krnl * lower-all-llvm -> convert-krnl-to-llvm * lower-krnl -> convert-krnl-to-affine * Name fix.
2020-07-31 21:37:35 +08:00
// RUN: onnx-mlir-opt --shape-inference --convert-onnx-to-krnl --enable-memory-pool --bundle-memory-pools --canonicalize %s -split-input-file | FileCheck %s
Bundle individual memory pools into a single memory pool (#183) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Add memory pooling for constant sized arrays. * Clean code. * Clean code. * Clean code. * Add simple bundling test. Co-authored-by: Tian Jin <tjingrant@gmail.com>
2020-07-09 00:35:31 +08:00
func @test_bundle_memory_pool(%arg0: tensor<10x10xf32>, %arg1: tensor<10x20xf32>) -> tensor<10x20xf32> {
%0 = "onnx.Add"(%arg0, %arg0) : (tensor<10x10xf32>, tensor<10x10xf32>) -> tensor<10x10xf32>
%1 = "onnx.MatMul"(%0, %arg1) : (tensor<10x10xf32>, tensor<10x20xf32>) -> tensor<10x20xf32>
%2 = "onnx.Add"(%1, %arg1) : (tensor<10x20xf32>, tensor<10x20xf32>) -> tensor<10x20xf32>
%3 = "onnx.Add"(%0, %arg0) : (tensor<10x10xf32>, tensor<10x10xf32>) -> tensor<10x10xf32>
%4 = "onnx.MatMul"(%3, %arg1) : (tensor<10x10xf32>, tensor<10x20xf32>) -> tensor<10x20xf32>
%5 = "onnx.Add"(%4, %arg1) : (tensor<10x20xf32>, tensor<10x20xf32>) -> tensor<10x20xf32>
return %5 : tensor<10x20xf32>
// CHECK-LABEL: test_bundle_memory_pool
Emit allocs at the top of functions (#222) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Add support for moving dynamic alloca instructions to top of functions. * Fix memory pooling tests. * Various fixes. * Fix lit tests. * More test fixes. * Reformat. * Reformat some more. * Fix issue with TestConv and split-input-file. * Use smart pointers. * Remove redundant pointer. * Reformat. * Add initMap description. * Clean up tests.
2020-07-21 07:24:17 +08:00
// CHECK: [[CONST0:%.+]] = constant 0 : i64
Revert "Emit allocs at the top of functions (#222)" (#226) This reverts commit b27e57cc4f4fdc3ba955639a44026265592e5e09.
2020-07-22 06:30:39 +08:00
// CHECK: [[CONST00:%.+]] = constant 0.000000e+00 : f32
Bundle individual memory pools into a single memory pool (#183) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Add memory pooling for constant sized arrays. * Clean code. * Clean code. * Clean code. * Add simple bundling test. Co-authored-by: Tian Jin <tjingrant@gmail.com>
2020-07-09 00:35:31 +08:00
// CHECK: [[CONST2400:%.+]] = constant 2400 : i64
Support per-block bundling for static memory pools. (#325) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Support the bundling on a per-block basis. * Format. * Fix test. * Fix indent. * Improve data structure. * Format. * Simplify maps for static pools. * Format. * Clean-up.
2020-10-02 02:15:03 +08:00
// CHECK: [[CONST2000:%.+]] = constant 2000 : i64
// CHECK: [[CONST1200:%.+]] = constant 1200 : i64
// CHECK: [[CONST400:%.+]] = constant 400 : i64
Bundle individual memory pools into a single memory pool (#183) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Add memory pooling for constant sized arrays. * Clean code. * Clean code. * Clean code. * Add simple bundling test. Co-authored-by: Tian Jin <tjingrant@gmail.com>
2020-07-09 00:35:31 +08:00
// CHECK: [[RES:%.+]] = alloc() : memref<10x20xf32>
// CHECK: [[MEMPOOL:%.+]] = alloc() : memref<3200xi8>
// CHECK: "krnl.getref"([[MEMPOOL]], [[CONST2400]]) : (memref<3200xi8>, i64) -> memref<10x20xf32>
// CHECK: "krnl.getref"([[MEMPOOL]], [[CONST2000]]) : (memref<3200xi8>, i64) -> memref<10x10xf32>
// CHECK: "krnl.getref"([[MEMPOOL]], [[CONST1200]]) : (memref<3200xi8>, i64) -> memref<10x20xf32>
// CHECK: "krnl.getref"([[MEMPOOL]], [[CONST400]]) : (memref<3200xi8>, i64) -> memref<10x20xf32>
// CHECK: "krnl.getref"([[MEMPOOL]], [[CONST0]]) : (memref<3200xi8>, i64) -> memref<10x10xf32>
// CHECK: dealloc [[MEMPOOL]] : memref<3200xi8>
// CHECK: return [[RES]] : memref<10x20xf32>
Assorted fixes for memory pool related passes (#244) * Reorganize main function. * Follow review comments. * Emit constants are globals in Krnl and LLVM dialects. * Make mempooling more robust. * Fix. * Update MainUtils.cpp Additional canonicalization not required anymore.
2020-08-12 05:34:59 +08:00
}