Spark Couldn't Find Window Function

Using the solution provided in https://stackoverflow.com/a/32407543/5379015 I tried to recreate the same query but using the programmatic syntax in stead of the Dataframe API as fo

Solution 1:

SQL equivalent of rowNumber is row_number:

SELECT k, v, row_number() OVER (PARTITION BY k ORDER BY v) AS rn FROM df