2020-07-11 13:23:13 +08:00
|
|
|
add_subdirectory(jni)
|
|
|
|
|
2020-07-01 15:06:55 +08:00
|
|
|
# Create static libcruntime.a to be embedded in model.so to make model.so self contained.
|
|
|
|
# However, by default object code for static library is not compiled with -fPIC. Embedding
|
|
|
|
# such static library in a shared library can cause runtime failure on some architectures,
|
|
|
|
# such as z. So we override the default and explicitly compile with -fPIC.
|
Compiling Models with Large Constant Arrays (#146)
* PoC works.
* MNist works.
* Clean up.
* Fix test.
* Make Linux work.
* Use consistent symbol name.
* Fix variable name.
* Fix array addr access.
* Bug fix.
* Bug fix.
* install before running e2e tests.
* Fix build config.
* Use sudo when installing.
* Make embeddedDataLoader position independent.
* Enable ResNet50.
* Format code.
* Format MainUtil.
* Try not using sudo to install.
* Supply runtime dir via environment variable.
* Dump problematic operation.
* Dump entire function.
* Debug.
* Dump input.
* Dump constant op.
* Debug.
* Debug.
* Debug.
* Print to stderr.
* take care of endianness.
* Use endianness-aware execution session.
* Fix ZLinux error.
* Include warning when desired output endianness can't be deduced.
* Remove debug code.
* Remove debug code in shape inference.
* Support binary-decoder for testing constants packing.
* Support filename, move-to-file, elision-threshold configurations in constant packing pass for easy testing.
* Add lit test, fix lit test type mismatch.
* Add more consts packing tests.
* Ensure intermediate files are properly cleaned up.
* No need for constant elimination.
* Link with threading libraries.
* Remove debug code.
* Format code.
* More tests.
* test nit.
* Remove debug code.
* Reduce hard-coded constants.
* Use temporary and unique working directory for hosting model parameters.
* Test if it works.
* Try to find objcopy.
* Rename symbols using objcopy.
* Move sanitized name to linux section.
* Use verbose mode for debugging.
* Disambiguate pass constructor.
* Fix symbol name.
* Use Command API to build and execute commands.
* Move linux to use Command API.
* Fix reset args.
* Execute redefine sym.
* Format code.
* Do not use verbose mode for CircleCI.
* Remove debug code.
* Prettify code, add comments.
* getSegmentData -> getEmbeddedConstPool
* vector -> std::vector.
* Make sure we properly clean up intermediate files.
* Fix test cases.
* Add runtime directory.
* Trigger rebuild.
* [Merge with master] fix debug script.
* Diable affine fusion pass for now.
* Support generic fallback const packing mechanism.
* Remove debug code.
* Handle the case where objcopy is not available.
* Fix Windows missing types.
* Support int64.
* Copy packed constant to a local directory for non-Linux/Mac platforms.
* Nit: remove debug code, refactor const pack preprocessing out as a separate function.
* Cannot make preprocessConstPack a standalone function because file removers are stack-allocated, and they are deallocated prematurely when function stack gets popped, deleteing intermediate files too early.
* Don't require executable filename.
* Import ONNX data types directly.
* Fix LIT test.
* Bug fix, use moved string value.
* Remove redundant filenames.
* Fix CMake script.
* Embed endianness information as a symbol, and check during runtime.
* More comments, update lit tests.
* Fix lit test on BE machine.
* Copyright notices.
2020-06-12 10:27:05 +08:00
|
|
|
add_library(cruntime STATIC
|
2020-06-30 10:58:21 +08:00
|
|
|
RtMemRef.cpp
|
|
|
|
RtMemRef.h
|
2020-03-19 16:48:09 +08:00
|
|
|
DataType.h)
|
2020-07-01 15:06:55 +08:00
|
|
|
set_target_properties(cruntime PROPERTIES
|
|
|
|
POSITION_INDEPENDENT_CODE TRUE)
|
2019-12-22 13:25:02 +08:00
|
|
|
|
2020-06-30 10:58:21 +08:00
|
|
|
add_library(RtMemRefUtils
|
|
|
|
RtMemRef.h
|
|
|
|
RtMemRef.cpp
|
2020-06-08 10:18:55 +08:00
|
|
|
DataType.h)
|
|
|
|
|
|
|
|
add_library(ExecutionSession
|
|
|
|
ExecusionSession.hpp
|
|
|
|
ExecusionSession.cpp)
|
|
|
|
target_link_libraries(ExecutionSession
|
|
|
|
${CMAKE_DL_LIBS})
|
|
|
|
target_include_directories(ExecutionSession PRIVATE
|
|
|
|
${ONNX_MLIR_SRC_ROOT}
|
|
|
|
${ONNX_MLIR_BIN_ROOT}
|
|
|
|
${ONNX_MLIR_SRC_ROOT})
|
|
|
|
set_target_properties(ExecutionSession PROPERTIES
|
|
|
|
POSITION_INDEPENDENT_CODE TRUE)
|
|
|
|
|
|
|
|
pybind11_add_module(PyRuntime
|
|
|
|
PyExecutionSession.cpp
|
|
|
|
PyExecutionSession.hpp)
|
|
|
|
target_link_libraries(PyRuntime PRIVATE
|
|
|
|
${CMAKE_DL_LIBS}
|
|
|
|
ExecutionSession
|
2020-06-30 10:58:21 +08:00
|
|
|
RtMemRefUtils
|
|
|
|
onnx)
|
2020-06-08 10:18:55 +08:00
|
|
|
target_include_directories(PyRuntime PRIVATE
|
|
|
|
${ONNX_MLIR_SRC_ROOT}
|
|
|
|
${ONNX_MLIR_BIN_ROOT}
|
2020-03-17 21:16:33 +08:00
|
|
|
${ONNX_MLIR_SRC_ROOT})
|
2020-06-08 10:18:55 +08:00
|
|
|
|
2020-07-01 15:06:55 +08:00
|
|
|
# See comments above about libcruntime.a
|
Compiling Models with Large Constant Arrays (#146)
* PoC works.
* MNist works.
* Clean up.
* Fix test.
* Make Linux work.
* Use consistent symbol name.
* Fix variable name.
* Fix array addr access.
* Bug fix.
* Bug fix.
* install before running e2e tests.
* Fix build config.
* Use sudo when installing.
* Make embeddedDataLoader position independent.
* Enable ResNet50.
* Format code.
* Format MainUtil.
* Try not using sudo to install.
* Supply runtime dir via environment variable.
* Dump problematic operation.
* Dump entire function.
* Debug.
* Dump input.
* Dump constant op.
* Debug.
* Debug.
* Debug.
* Print to stderr.
* take care of endianness.
* Use endianness-aware execution session.
* Fix ZLinux error.
* Include warning when desired output endianness can't be deduced.
* Remove debug code.
* Remove debug code in shape inference.
* Support binary-decoder for testing constants packing.
* Support filename, move-to-file, elision-threshold configurations in constant packing pass for easy testing.
* Add lit test, fix lit test type mismatch.
* Add more consts packing tests.
* Ensure intermediate files are properly cleaned up.
* No need for constant elimination.
* Link with threading libraries.
* Remove debug code.
* Format code.
* More tests.
* test nit.
* Remove debug code.
* Reduce hard-coded constants.
* Use temporary and unique working directory for hosting model parameters.
* Test if it works.
* Try to find objcopy.
* Rename symbols using objcopy.
* Move sanitized name to linux section.
* Use verbose mode for debugging.
* Disambiguate pass constructor.
* Fix symbol name.
* Use Command API to build and execute commands.
* Move linux to use Command API.
* Fix reset args.
* Execute redefine sym.
* Format code.
* Do not use verbose mode for CircleCI.
* Remove debug code.
* Prettify code, add comments.
* getSegmentData -> getEmbeddedConstPool
* vector -> std::vector.
* Make sure we properly clean up intermediate files.
* Fix test cases.
* Add runtime directory.
* Trigger rebuild.
* [Merge with master] fix debug script.
* Diable affine fusion pass for now.
* Support generic fallback const packing mechanism.
* Remove debug code.
* Handle the case where objcopy is not available.
* Fix Windows missing types.
* Support int64.
* Copy packed constant to a local directory for non-Linux/Mac platforms.
* Nit: remove debug code, refactor const pack preprocessing out as a separate function.
* Cannot make preprocessConstPack a standalone function because file removers are stack-allocated, and they are deallocated prematurely when function stack gets popped, deleteing intermediate files too early.
* Don't require executable filename.
* Import ONNX data types directly.
* Fix LIT test.
* Bug fix, use moved string value.
* Remove redundant filenames.
* Fix CMake script.
* Embed endianness information as a symbol, and check during runtime.
* More comments, update lit tests.
* Fix lit test on BE machine.
* Copyright notices.
2020-06-12 10:27:05 +08:00
|
|
|
add_library(EmbeddedDataLoader STATIC
|
|
|
|
GetEmbeddedConstPool.h
|
|
|
|
GetEmbeddedConstPool.cpp)
|
|
|
|
set_target_properties(EmbeddedDataLoader PROPERTIES
|
|
|
|
POSITION_INDEPENDENT_CODE TRUE)
|
|
|
|
|
2020-06-08 10:18:55 +08:00
|
|
|
add_dependencies(PyRuntime cruntime)
|
2020-06-30 10:58:21 +08:00
|
|
|
install(FILES RtMemRef.h DESTINATION include)
|
2020-05-26 16:05:00 +08:00
|
|
|
install(TARGETS cruntime DESTINATION lib)
|
Compiling Models with Large Constant Arrays (#146)
* PoC works.
* MNist works.
* Clean up.
* Fix test.
* Make Linux work.
* Use consistent symbol name.
* Fix variable name.
* Fix array addr access.
* Bug fix.
* Bug fix.
* install before running e2e tests.
* Fix build config.
* Use sudo when installing.
* Make embeddedDataLoader position independent.
* Enable ResNet50.
* Format code.
* Format MainUtil.
* Try not using sudo to install.
* Supply runtime dir via environment variable.
* Dump problematic operation.
* Dump entire function.
* Debug.
* Dump input.
* Dump constant op.
* Debug.
* Debug.
* Debug.
* Print to stderr.
* take care of endianness.
* Use endianness-aware execution session.
* Fix ZLinux error.
* Include warning when desired output endianness can't be deduced.
* Remove debug code.
* Remove debug code in shape inference.
* Support binary-decoder for testing constants packing.
* Support filename, move-to-file, elision-threshold configurations in constant packing pass for easy testing.
* Add lit test, fix lit test type mismatch.
* Add more consts packing tests.
* Ensure intermediate files are properly cleaned up.
* No need for constant elimination.
* Link with threading libraries.
* Remove debug code.
* Format code.
* More tests.
* test nit.
* Remove debug code.
* Reduce hard-coded constants.
* Use temporary and unique working directory for hosting model parameters.
* Test if it works.
* Try to find objcopy.
* Rename symbols using objcopy.
* Move sanitized name to linux section.
* Use verbose mode for debugging.
* Disambiguate pass constructor.
* Fix symbol name.
* Use Command API to build and execute commands.
* Move linux to use Command API.
* Fix reset args.
* Execute redefine sym.
* Format code.
* Do not use verbose mode for CircleCI.
* Remove debug code.
* Prettify code, add comments.
* getSegmentData -> getEmbeddedConstPool
* vector -> std::vector.
* Make sure we properly clean up intermediate files.
* Fix test cases.
* Add runtime directory.
* Trigger rebuild.
* [Merge with master] fix debug script.
* Diable affine fusion pass for now.
* Support generic fallback const packing mechanism.
* Remove debug code.
* Handle the case where objcopy is not available.
* Fix Windows missing types.
* Support int64.
* Copy packed constant to a local directory for non-Linux/Mac platforms.
* Nit: remove debug code, refactor const pack preprocessing out as a separate function.
* Cannot make preprocessConstPack a standalone function because file removers are stack-allocated, and they are deallocated prematurely when function stack gets popped, deleteing intermediate files too early.
* Don't require executable filename.
* Import ONNX data types directly.
* Fix LIT test.
* Bug fix, use moved string value.
* Remove redundant filenames.
* Fix CMake script.
* Embed endianness information as a symbol, and check during runtime.
* More comments, update lit tests.
* Fix lit test on BE machine.
* Copyright notices.
2020-06-12 10:27:05 +08:00
|
|
|
install(TARGETS EmbeddedDataLoader DESTINATION lib)
|