Error in _prob2cornerflow() function

[JasonGUTU]

hd3/models/hd3_ops.py

Line 207 in 84792e2

out, indice = max_pool(avg_pool(pr))

In this line, the indice is of type long int, and the d is also an int. however, the results of / maybe a float type number, resulting in an error in the following calculation.

Can you help me with this line? What is it about?

[dbm9741]

I have the same issue.... If you try to run it using Pytorch 1.0 the problem goes away.

I was able to fix the problem by replacing

hd3/models/hd3_ops.py

Line 208 in 84792e2

indice += indice / (d - 1) # in original coordinate

with indice += torch.div(indice, d-1, rounding_mode='trunc')

[josephinemonica]

@dbm9741 Is the rounding_mode supposed to be 'trunc' or something else e.g., 'floor'?

[dbm9741]

@josephinemonica I don't think it matters as the indices can only be positive number and floor and trunc will give you the same result for positive number.