Lab Sql

I am computing mean of a column in data-frame but it resulted in all the values zeros. Can someone … Read more Pyspark: Add The Average As A New Column To Dataframe

Here is the question in the image attached: Table: Row Col1 Col2 Col3 Result 1 10 … Read more Doing Some Of Columns Based On Some Complex Logic In Pyspark

I am using pyspark so I have tried both pyspark code and SQL. I am trying to get the time that the … Read more Sql Or Pyspark - Get The Last Time A Column Had A Different Value For Each Id

I got stuck into an issue which already has wasted 3 days of mine. I have a dataproc cluster 1.5 an… Read more Google Dataproc To Sql Server(based On Centos 7) Connection Error?

I need to transform this given date format: 2019-10-22 00:00:00 to this one: 2019-10-22T00:00:00.00… Read more How To Format Date In Spark Sql?

I need to find groups in time series data. Data sample I need to output column group based on val… Read more How To Split Data Into Groups In Pyspark

I am stuckup with getting weeknumber from month in pyspark from a datafrme column , For Examples co… Read more Pyspark Getting Weeknumber Of Month

I'm working in an environment pyspark with python3.6 in AWS Glue. I have this table : +----+---… Read more Break Down A Table To Pivot In Columns (sql,pyspark)