ae00ae487c
[mlir] Simplify DDR matching patterns with equal operands for operators.
...
This https://reviews.llvm.org/D89254 diff introduced implicit matching between same name arguments. Modify usages accordingly.
PiperOrigin-RevId: 338090110
2020-10-20 10:47:09 -07:00
7a983ea389
Add folder for mhlo::pad
...
PiperOrigin-RevId: 337827560
2020-10-19 04:21:44 -07:00
4a18aa41ee
Add folder to mhlo::round_nearest_afz
...
PiperOrigin-RevId: 337823786
2020-10-19 03:45:15 -07:00
27968619b7
Verify non-scalar inputs for HLO concat
...
XLA HLO concat does not accept scalars, so fail verification if this occurs. Avoids segfault when accessing an empty output shape.
PiperOrigin-RevId: 337618167
2020-10-16 19:39:31 -07:00
2e30b59ddc
Extend hlo-fuse-linalg slightly to support aliased returns.
...
The fusion heuristic identifies the root of a fusion by checking whether an
output of a linalg operation is a function result. It did not consider outputs
flowing through aliasing operations (like casts).
PiperOrigin-RevId: 337479910
2020-10-16 04:04:23 -07:00
51cd4200b6
Make LMHLO's Dot have the same power as MHLO's DotGeneral.
...
PiperOrigin-RevId: 337391565
2020-10-15 15:09:06 -07:00
05ee41baf8
Add folder for mhlo::scatter
...
PiperOrigin-RevId: 337274351
2020-10-15 03:26:05 -07:00
0f36979e2c
Integrate LLVM at llvm/llvm-project@220de1f32a
...
Updates LLVM usage to match
[220de1f32add](https://github.com/llvm/llvm-project/commit/220de1f32add )
PiperOrigin-RevId: 337270545
2020-10-15 02:54:24 -07:00
f6b4e6758a
Add GPU specific LMHLO level ops
...
- Introduce operations in a new lmhlo_gpu dialect that map to GPU library function calls
in the XLA:GPU backend.
- Add basic unit tests as well.
PiperOrigin-RevId: 337132166
2020-10-14 11:23:55 -07:00
15fe5ca737
Integrate LLVM at llvm/llvm-project@6713332fdd
...
Updates LLVM usage to match
[6713332fddb7](https://github.com/llvm/llvm-project/commit/6713332fddb7 )
PiperOrigin-RevId: 336988895
2020-10-13 17:21:14 -07:00
53d16d9f8e
Integrate LLVM at llvm/llvm-project@93377888ae
...
Updates LLVM usage to match
[93377888ae89](https://github.com/llvm/llvm-project/commit/93377888ae89 )
PiperOrigin-RevId: 336669842
2020-10-12 08:42:31 -07:00
f6af1fc134
Support hlo to lhlo buffer placement through shape.assuming ops.
...
PiperOrigin-RevId: 336287728
2020-10-09 07:14:12 -07:00
d986bd7ad7
Use tensor_cast instead of mhlo::reshape in the lowering of unranked binary operations.
...
We know that the value already is a scalar and we just want to update the type, so no need to reshape anything.
PiperOrigin-RevId: 336252315
2020-10-09 01:46:48 -07:00
3736c5542f
[MLIR][KernelGen] Fix unranked codegeneration in kernel generator
...
PiperOrigin-RevId: 335847086
2020-10-07 05:39:55 -07:00
84277ed784
Remove unused `using` statements.
...
PiperOrigin-RevId: 335517711
2020-10-05 15:53:59 -07:00
a33441907c
[MLIR][KernelGen] Add E2E test for `tf.Acos`
...
PiperOrigin-RevId: 335419310
2020-10-05 08:14:36 -07:00
bae0815ef0
[MLIR][KernelGen] Legalize `atan` to approximation
...
PiperOrigin-RevId: 335417836
2020-10-05 08:05:52 -07:00
7f84a86cf5
[MLIR][KerneGen] Lower `tf.Atan` all the way to LLVM
...
PiperOrigin-RevId: 335394668
2020-10-05 05:07:13 -07:00
d927e32451
[HLO] Clean-up dynamic allocation in hlo-legalize-to-lhlo pass.
...
PiperOrigin-RevId: 335385243
2020-10-05 03:55:24 -07:00
7367eac074
Add folder for mhlo::remainder
...
PiperOrigin-RevId: 335372628
2020-10-05 02:20:01 -07:00
3eb767b43d
Add missing lowering step for IsFiniteOp.
...
Also add a BUILD target for generating the GPU kernel.
PiperOrigin-RevId: 334993362
2020-10-02 03:09:00 -07:00
5f303440da
[MLIR][KerneGen] Lower `tf.Atan` all the way to LLVM
...
PiperOrigin-RevId: 334843070
2020-10-01 10:25:51 -07:00
458e861254
[MLIR][KerneGen] Lower `tf.Atan` all the way to LLVM
...
PiperOrigin-RevId: 334810730
2020-10-01 07:38:40 -07:00
049ca060a1
[MLIR][KernelGen] Legalize `atan2` to approximation
...
Legalize `atan2` analogously to XLA. `atan2` is first reduced to `atan` on the
interval [-1, 1] and subsequently approximated. This CL also adds e2e tests for
trigonometric approximations.
PiperOrigin-RevId: 334794336
2020-10-01 05:34:48 -07:00
4b1809784a
Support collapse_slice_dims in the mhlo.gather->mhlo.slice canonicalizer
...
PiperOrigin-RevId: 334774763
2020-10-01 02:46:49 -07:00
bce128b070
Introduce CustomCall operation in LHLO Dialect
...
- And add conversion from MHLO CustomCall to LHLO CustomCall
- According to XLA documentation, the called function should not be side effecting,
so marking the argument MemRefs as MemRead.
PiperOrigin-RevId: 334737196
2020-09-30 20:56:18 -07:00
dfe64d3958
Implement InferShapedTypeOpInterface for mhlo.complex
...
Binary companion for 8bcd33e4b7
2020-09-30 12:14:15 -07:00
c8919f8419
Implement InferShapedTypeOpInterface and use inferReturnTypes for mhlo.imag and mhlo.real
...
This makes the lhlo lowering work with dynamic shapes.
PiperOrigin-RevId: 334553472
2020-09-30 02:02:26 -07:00
39389587d2
{mhlo.is_finite, lmhlo.is_finite} -> linalg.generic conversion
...
PiperOrigin-RevId: 334414295
2020-09-29 10:50:42 -07:00
6459f12235
Lower mhlo.not to a xor with all ones
...
PiperOrigin-RevId: 334361499
2020-09-29 05:59:40 -07:00
26ac5baae4
Make mhlo.sort return variadic results instead of a tuple
...
Tuple is only used on XLA's sort to return multiple inputs. MLIR supports
multiple inputs, switch to a tuple return.
PiperOrigin-RevId: 334226937
2020-09-28 13:32:23 -07:00
9c6640cbb6
Only apply GeneralDotOpLoweringPatterns for static shaped inputs
...
PiperOrigin-RevId: 333439680
2020-09-23 21:42:01 -07:00
233f1a8a1a
Folders for mhlo.compare
...
Constant evaluation of compare for the case where inputs are either the same
variable or the values are constant.
PiperOrigin-RevId: 333342328
2020-09-23 12:03:48 -07:00
08e0d09463
[MLIR][KernelGen] Rename `legalize-tanh-to-approximation` to `legalize-trigonometric-to-approximation`
...
To add more approximation lowerings in the future, generalize the pass name.
PiperOrigin-RevId: 333340075
2020-09-23 11:53:45 -07:00
dd92c8ef61
Integrate LLVM at llvm/llvm-project@7e78d89052
...
Updates LLVM usage to match
[7e78d89052b1](https://github.com/llvm/llvm-project/commit/7e78d89052b1 )
PiperOrigin-RevId: 333090785
2020-09-22 09:08:23 -07:00
7abd557a61
Add a header for table-gen generated pass for MHLO and use it in SinkConstantsToControlFlowPass
...
A non globally registered pass should define `getName()` in order to generate correct crash reproducers.
This is something we get "for free" when using the TableGen generated base class.
We should also migrate the other passes to the same mechanism and remove the static
global registration.
PiperOrigin-RevId: 332976907
2020-09-21 18:01:57 -07:00
4002077261
[MLIR][KernelGen] Lower `tf.Sinh` to MLHLO
...
PiperOrigin-RevId: 332425724
2020-09-18 04:27:07 -07:00
2fbbbe9cf1
[MLIR][KernelGen] Lower `tf.Acos` to LMHLO.
...
- Add ranked code generation for `mhlo.compare/select`
- Add bufferization for `tensor_cast`
- Add lowerings for `Atan2Op`
PiperOrigin-RevId: 332407734
2020-09-18 01:40:18 -07:00
b1fd4d27cf
[MLIR][KernelGen] Implement InferShapedTypeOpInterface for `mhlo.compare/select`
...
PiperOrigin-RevId: 332227340
2020-09-17 07:10:10 -07:00
b29dd5ef8f
Fix a bug in the case check of reshape op lowering.
...
PiperOrigin-RevId: 332044191
2020-09-16 11:06:16 -07:00
69b80d8deb
[MLIR] Extend unranked transformation to CHLO dialect
...
PiperOrigin-RevId: 332026604
2020-09-16 09:49:18 -07:00
2aa07b0091
Insert explicit casts to model extra shape knowledge for unranked chlo transform
...
When transforming unranked binary operations from CHLO to HLO, we insert `shape.broadcast` operations. Due to context, we know that the result of the `shape.broadcast` operation has a static shape. Instead of modelling this in the type of the broadcast operation itself, which is illegal, we now use an explicit cast.
PiperOrigin-RevId: 331989879
2020-09-16 06:14:49 -07:00
1880f87737
Integrate LLVM at llvm/llvm-project@e1669843f2
...
Updates LLVM usage to match
[e1669843f2aa](https://github.com/llvm/llvm-project/commit/e1669843f2aa )
PiperOrigin-RevId: 331987679
2020-09-16 05:58:08 -07:00
1800f44a29
Add sqrt folder.
...
PiperOrigin-RevId: 331974344
2020-09-16 04:04:09 -07:00
a6fdebdc6c
[MLIR] Lower `chlo.constant_like` to MHLO
...
Lower `chlo.constant_like` to a constant and, if needed, a broadcast.
PiperOrigin-RevId: 331964137
2020-09-16 02:41:44 -07:00
da43c8596b
[MLIR] Simplify and generalize `transform-unranked-hlo`
...
This refactoring allows to support a wider range of n-ary operations in future
changes.
PiperOrigin-RevId: 331953362
2020-09-16 01:13:23 -07:00
dff98f8cd5
Folder for mhlo.negate
...
PiperOrigin-RevId: 331592342
2020-09-14 11:38:44 -07:00
48022987ce
[XLA][MLIR] Lower `tf.Tan` and `tf.Sin` to MLHLO
...
Add `tan` op and lowering to CHLO dialect, move CHLO lowerings to
`chlo_legalize_to_hlo_patterns` and extend missing patterns.
PiperOrigin-RevId: 331506094
2020-09-14 02:34:52 -07:00
ce1c8a1ebc
[MLIR][LHLO] Replace lhlo-copy-removal pass with mlir-copy-removal pass
...
Imported from GitHub PR https://github.com/tensorflow/tensorflow/pull/43137
This PR removes lhlo-copy-removal pass entirely and replace its usages with ```mlir::createCopyRemovalPass()```.
--
7ce1a06f507c8db46c6d7b43c7870cf56002e18e by Ehsan Toosi <ehsan.nadjaran_toosi@dfki.de>:
[mlir][lhlo] Replace lhlo-copy-removal pass with mlir-copy-removal pass
COPYBARA_INTEGRATE_REVIEW=https://github.com/tensorflow/tensorflow/pull/43137 from dfki-ehna:using_mlir_copy_removal 7ce1a06f507c8db46c6d7b43c7870cf56002e18e
PiperOrigin-RevId: 331498501
2020-09-14 01:22:19 -07:00
a7a7184eb6
[XLA][MLIR] Lower `tf.Tan` and `tf.Sin` to MLHLO
...
Add `tan` op and lowering to CHLO dialect, move CHLO lowerings to
`chlo_legalize_to_hlo_patterns` and extend missing patterns.
PiperOrigin-RevId: 331128170
2020-09-11 05:05:58 -07:00
Roman Dzhabarov
A. Unique TensorFlower
Jacques Pienaar
Stephan Herhut
Adrian Kuegel
Rahul Joshi
Tres Popp
Lucy Fox
Alexander Belyaev
Chao Xie
Benjamin Kramer
Ahmed S. Taei
Robert Suderman
Mehdi Amini
Hanhan Wang
Ehsan Toosi