Commit Graph

980 Commits

Author SHA1 Message Date
A. Unique TensorFlower 89d81adf6d [mhlo] Lower float->bool to a comparison with zero
This matches what TF (and C++) do in this case.

PiperOrigin-RevId: 357541594
2021-02-15 03:11:56 -08:00
Benjamin Kramer 3e80d91e73 [mhlo] Lower float->bool to a comparison with zero
This matches what TF (and C++) do in this case.

PiperOrigin-RevId: 357534118
2021-02-15 02:17:19 -08:00
Adrian Kuegel 824bc9c425 Improve broadcast transformation to treat dynamic shapes with 1 element as scalar.
A shape that contains exactly one element is effectively a scalar. This leads
to a speedup in cases where we have a binary op with one operand that is
effectively a scalar, because we can use the fast path.

PiperOrigin-RevId: 357515552
2021-02-14 23:25:41 -08:00
A. Unique TensorFlower 4060a86fe2 Integrate LLVM at llvm/llvm-project@2bfe27da17
Updates LLVM usage to match
[2bfe27da171e](https://github.com/llvm/llvm-project/commit/2bfe27da171e)

PiperOrigin-RevId: 357196336
2021-02-12 08:32:03 -08:00
A. Unique TensorFlower e993082b97 Integrate LLVM at llvm/llvm-project@6f04addc8b
Updates LLVM usage to match
[6f04addc8b2e](https://github.com/llvm/llvm-project/commit/6f04addc8b2e)

PiperOrigin-RevId: 357170209
2021-02-12 05:21:12 -08:00
A. Unique TensorFlower f7ac575dd9 Integrate LLVM at llvm/llvm-project@0c118831a3
Updates LLVM usage to match
[0c118831a37a](https://github.com/llvm/llvm-project/commit/0c118831a37a)

PiperOrigin-RevId: 357158589
2021-02-12 03:32:55 -08:00
A. Unique TensorFlower a7365aadbe Integrate LLVM at llvm/llvm-project@8151c1b442
Updates LLVM usage to match
[8151c1b44211](https://github.com/llvm/llvm-project/commit/8151c1b44211)

PiperOrigin-RevId: 357080940
2021-02-11 16:17:46 -08:00
A. Unique TensorFlower 077df4f8cc Integrate LLVM at llvm/llvm-project@418c218efa
Updates LLVM usage to match
[418c218efa95](https://github.com/llvm/llvm-project/commit/418c218efa95)

PiperOrigin-RevId: 357010454
2021-02-11 10:49:27 -08:00
Tim Shen 6fa6974e8d [XLA/GPU] Plumb through Bitcast op for LMHLO.
Also remove BitcastOp. XLA bitcast requires the input buffer to alias the output buffer, which makes bitcast always a no-op.

PiperOrigin-RevId: 356884383
2021-02-10 19:45:40 -08:00
A. Unique TensorFlower 4e202135d1 Integrate LLVM at llvm/llvm-project@9db6e97a86
Updates LLVM usage to match
[9db6e97a8605](https://github.com/llvm/llvm-project/commit/9db6e97a8605)

PiperOrigin-RevId: 356753027
2021-02-10 09:32:14 -08:00
Alexander Belyaev 36e04d92c0 [KERNEL_GEN] Add a pattern to bufferize `mhlo.reshape(<unranked_tensor>)`.
PiperOrigin-RevId: 356720899
2021-02-10 06:32:21 -08:00
A. Unique TensorFlower 54c2a49866 Integrate LLVM at llvm/llvm-project@a5222aa085
Updates LLVM usage to match
[a5222aa0858a](https://github.com/llvm/llvm-project/commit/a5222aa0858a)

PiperOrigin-RevId: 356515740
2021-02-09 09:13:45 -08:00
A. Unique TensorFlower 7446b6022d Integrate LLVM at llvm/llvm-project@2fa4186d4e
Updates LLVM usage to match
[2fa4186d4e1c](https://github.com/llvm/llvm-project/commit/2fa4186d4e1c)

PiperOrigin-RevId: 356383544
2021-02-08 16:53:07 -08:00
A. Unique TensorFlower 4a29ca3b1d Add layout to mhlo::InfeedOp td.
PiperOrigin-RevId: 356286875
2021-02-08 09:48:14 -08:00
A. Unique TensorFlower 80d753c1fe Integrate LLVM at llvm/llvm-project@f89f6d1e5d
Updates LLVM usage to match
[f89f6d1e5d7d](https://github.com/llvm/llvm-project/commit/f89f6d1e5d7d)

PiperOrigin-RevId: 356265374
2021-02-08 09:47:00 -08:00
Tres Popp d086b8a0ec Correct HLO atan2 lowering in cases of -inf and -0 inputs.
This is being done by just removing the approximation and lowering to atan2 lib calls later to make the implementation the same as XLA. Note that if the approximation is brought back later, it can be fixed by changing the IR checking `less-than(X, 0)` to `less-than(copysign(X, 1), 0)`

PiperOrigin-RevId: 356253941
2021-02-08 06:58:04 -08:00
A. Unique TensorFlower bd0856578f Integrate LLVM at llvm/llvm-project@a4fa667dee
Updates LLVM usage to match
[a4fa667dee60](https://github.com/llvm/llvm-project/commit/a4fa667dee60)

PiperOrigin-RevId: 355945749
2021-02-05 15:53:55 -08:00
A. Unique TensorFlower 2aa8a90c69 Integrate LLVM at llvm/llvm-project@a1a1d338e9
Updates LLVM usage to match
[a1a1d338e99d](https://github.com/llvm/llvm-project/commit/a1a1d338e99d)

PiperOrigin-RevId: 355927079
2021-02-05 14:20:29 -08:00
Rahul Joshi b251712b1d [XLA:GPU] Add conversion from HLO -> MLIR LMHLO for TriangularSolve
- Also add layout attributes for inputs and output for error checking.

PiperOrigin-RevId: 355863625
2021-02-05 09:18:02 -08:00
Adrian Kuegel 1c4521cc42 Integrate LLVM at llvm/llvm-project@d1978fa4bf
Updates LLVM usage to match
[d1978fa4bf0d](https://github.com/llvm/llvm-project/commit/d1978fa4bf0d)

PiperOrigin-RevId: 355848094
2021-02-05 07:42:06 -08:00
A. Unique TensorFlower 99bc05f2e4 Integrate LLVM at llvm/llvm-project@91e7a17133
Updates LLVM usage to match
[91e7a1713332](https://github.com/llvm/llvm-project/commit/91e7a1713332)

PiperOrigin-RevId: 355702100
2021-02-04 13:42:31 -08:00
Stephan Herhut 60e1b6882c Add kernel definition for zeta operation.
PiperOrigin-RevId: 355575619
2021-02-04 01:27:43 -08:00
A. Unique TensorFlower 945bf8768d Integrate LLVM at llvm/llvm-project@56fcd4ea8d
Updates LLVM usage to match
[56fcd4ea8daf](https://github.com/llvm/llvm-project/commit/56fcd4ea8daf)

PiperOrigin-RevId: 355529409
2021-02-03 18:48:22 -08:00
A. Unique TensorFlower 3380d0a761 Integrate LLVM at llvm/llvm-project@ea5b75de49
Updates LLVM usage to match
[ea5b75de4999](https://github.com/llvm/llvm-project/commit/ea5b75de4999)

PiperOrigin-RevId: 355493884
2021-02-03 15:20:56 -08:00
Mahesh Ravishankar 44d0464d16 Use linalg.fill on tensors instead of tensor.generate in MHLO -> Linalg conversion.
linalg.fill on tensors is a structured op that allows use tile + fuse
to reduce the fill overhead.

PiperOrigin-RevId: 355490400
2021-02-03 15:03:49 -08:00
A. Unique TensorFlower 10cd797d6d Integrate LLVM at llvm/llvm-project@bbb7555403
Updates LLVM usage to match
[bbb755540385](https://github.com/llvm/llvm-project/commit/bbb755540385)

PiperOrigin-RevId: 355462338
2021-02-03 12:58:16 -08:00
Stephan Herhut 6cd1875ee4 Implement lowering of chlo::zeta to mhlo dialect.
PiperOrigin-RevId: 355395581
2021-02-03 07:50:05 -08:00
Adrian Kuegel 9d8a53c452 Integrate LLVM at llvm/llvm-project@e635feb15a
Updates LLVM usage to match
[e635feb15a91](https://github.com/llvm/llvm-project/commit/e635feb15a91)

PiperOrigin-RevId: 355392465
2021-02-03 07:32:31 -08:00
Adrian Kuegel 0472837e50 Integrate LLVM at llvm/llvm-project@54afcade3b
Updates LLVM usage to match
[54afcade3bbc](https://github.com/llvm/llvm-project/commit/54afcade3bbc)

PiperOrigin-RevId: 355378020
2021-02-03 05:50:41 -08:00
Adrian Kuegel 1b63101a38 Integrate LLVM at llvm/llvm-project@fae6d129da
Updates LLVM usage to match
[fae6d129dac2](https://github.com/llvm/llvm-project/commit/fae6d129dac2)

PiperOrigin-RevId: 355360042
2021-02-03 03:21:07 -08:00
A. Unique TensorFlower 39aa1235d1 Integrate LLVM at llvm/llvm-project@2668714747
Updates LLVM usage to match
[2668714747c5](https://github.com/llvm/llvm-project/commit/2668714747c5)

PiperOrigin-RevId: 355292910
2021-02-02 17:58:41 -08:00
A. Unique TensorFlower 7cbf8d8878 Integrate LLVM at llvm/llvm-project@83d705adb2
Updates LLVM usage to match
[83d705adb2e0](https://github.com/llvm/llvm-project/commit/83d705adb2e0)

PiperOrigin-RevId: 355258427
2021-02-02 14:53:50 -08:00
A. Unique TensorFlower 04110a4b1c Integrate LLVM at llvm/llvm-project@67dfe9c8d7
Updates LLVM usage to match
[67dfe9c8d70c](https://github.com/llvm/llvm-project/commit/67dfe9c8d70c)

PiperOrigin-RevId: 355235205
2021-02-02 13:09:20 -08:00
A. Unique TensorFlower 3b67b207c4 [MLIR][CHLO] Use CHLO lowering for `is_inf` op
PiperOrigin-RevId: 355189054
2021-02-02 09:53:13 -08:00
Adrian Kuegel 0726ab20fa Integrate LLVM at llvm/llvm-project@4d904776a7
Updates LLVM usage to match
[4d904776a77a](https://github.com/llvm/llvm-project/commit/4d904776a77a)

PiperOrigin-RevId: 355142758
2021-02-02 05:11:40 -08:00
Tres Popp ae722a883f Improve performance of lowered chlo.pow with integers
The new lowering takes 6 iterations of a loop always rather than iterating the exponent's number of times.

PiperOrigin-RevId: 355131133
2021-02-02 03:28:38 -08:00
A. Unique TensorFlower 0458ae9a22 [MLIR][KernelGen] Add `tf.Digamma` kernels
PiperOrigin-RevId: 355129028
2021-02-02 03:07:39 -08:00
A. Unique TensorFlower f40ccc5b4b [MLIR][CHLO] Add `chlo.digamma` and lowering to MHLO
PiperOrigin-RevId: 355122765
2021-02-02 02:10:17 -08:00
Adrian Kuegel c2115f56c7 Integrate LLVM at llvm/llvm-project@8f7f2c4211
Updates LLVM usage to match
[8f7f2c4211ca](https://github.com/llvm/llvm-project/commit/8f7f2c4211ca)

PiperOrigin-RevId: 355120697
2021-02-02 01:54:32 -08:00
Adrian Kuegel 96f8771ed7 Add MLIR generated kernel for Angle kernel.
This also requires a canonicalization pattern to remove a redundant dynamic
reshape from rank 1 to rank 1.

PiperOrigin-RevId: 355113135
2021-02-02 00:47:20 -08:00
A. Unique TensorFlower 9d682343a9 Integrate LLVM at llvm/llvm-project@68f66f37d7
Updates LLVM usage to match
[68f66f37d7d7](https://github.com/llvm/llvm-project/commit/68f66f37d7d7)

PiperOrigin-RevId: 355069626
2021-02-01 18:17:47 -08:00
A. Unique TensorFlower 6c8ad0895b Integrate LLVM at llvm/llvm-project@75347ba1fa
Updates LLVM usage to match
[75347ba1fae2](https://github.com/llvm/llvm-project/commit/75347ba1fae2)

PiperOrigin-RevId: 355031910
2021-02-01 14:51:46 -08:00
A. Unique TensorFlower 16bb35009b Integrate LLVM at llvm/llvm-project@78c22fbce9
Updates LLVM usage to match
[78c22fbce991](https://github.com/llvm/llvm-project/commit/78c22fbce991)

PiperOrigin-RevId: 354999980
2021-02-01 12:28:24 -08:00
A. Unique TensorFlower 816d279be3 [MLIR][CHLO] Simplify conversions with upcast
PiperOrigin-RevId: 354975366
2021-02-01 10:48:10 -08:00
Rahul Joshi 8e3890e8e8 [MLIR:HLO] Add AllGather and AllToAll operations to LMHLO dialect.
- Use a common base class to for AllReduce, AllGather, and AllToAll in the ODS spec.
- Add basic verification for replica groups attribute.

PiperOrigin-RevId: 354969654
2021-02-01 10:23:46 -08:00
Adrian Kuegel 7a251aaed4 Integrate LLVM at llvm/llvm-project@49a6502cd5
Updates LLVM usage to match
[49a6502cd5c2](https://github.com/llvm/llvm-project/commit/49a6502cd5c2)

PiperOrigin-RevId: 354936788
2021-02-01 07:43:37 -08:00
Adrian Kuegel 2da9d6947d Integrate LLVM at llvm/llvm-project@e90e455d2a
Updates LLVM usage to match
[e90e455d2a0c](https://github.com/llvm/llvm-project/commit/e90e455d2a0c)

PiperOrigin-RevId: 354922438
2021-02-01 05:57:58 -08:00
Rahul Joshi 1be1123c70 [XLA:GPU] Add support for PartitionId
PiperOrigin-RevId: 354599221
2021-01-29 13:31:54 -08:00
A. Unique TensorFlower b1ce05cfc9 Integrate LLVM at llvm/llvm-project@1c762a81d2
Updates LLVM usage to match
[1c762a81d20f](https://github.com/llvm/llvm-project/commit/1c762a81d20f)

PiperOrigin-RevId: 354567452
2021-01-29 11:04:26 -08:00
A. Unique TensorFlower 2b72ddc6b2 [MLIR][KernelGen] Add `lgamma` kernels
PiperOrigin-RevId: 354519407
2021-01-29 06:14:17 -08:00