'DataFrame' object has no attribute 'sql' [on hold]2019 Community Moderator ElectionHow do I set/get heap size for Spark (via Python notebook)Spark DataFrame coursesRDD of gziped files to “uncompressed” DataframeDataframe request with groupBySpark SQL Pivot CrossTab functionalityPlot RDD data using a pyspark dataframe from csv filePySpark dataframe repartitionAdding multiple columns to spark dataframeSpark DataFrame Limit Function Takes Too Much Time to ShowHow to store dataframe result into text file?

Everything Bob says is false. How does he get people to trust him?

How to be diplomatic in refusing to write code that breaches the privacy of our users

Applicability of Single Responsibility Principle

Do I need a multiple entry visa for a trip UK -> Sweden -> UK?

Increase performance creating Mandelbrot set in python

Is there a problem with hiding "forgot password" until it's needed?

How to verify if g is a generator for p?

Opposite of a diet

Cynical novel that describes an America ruled by the media, arms manufacturers, and ethnic figureheads

There is only s̶i̶x̶t̶y one place he can be

How does it work when somebody invests in my business?

Bash method for viewing beginning and end of file

I'm in charge of equipment buying but no one's ever happy with what I choose. How to fix this?

Are there any comparative studies done between Ashtavakra Gita and Buddhim?

Best way to store options for panels

when is out of tune ok?

What defines a dissertation?

Why "be dealt cards" rather than "be dealing cards"?

Is there a good way to store credentials outside of a password manager?

How was Earth single-handedly capable of creating 3 of the 4 gods of chaos?

Finding all intervals that match predicate in vector

Implement the Thanos sorting algorithm

Star/Wye electrical connection math symbol

Was the picture area of a CRT a parallelogram (instead of a true rectangle)?



'DataFrame' object has no attribute 'sql' [on hold]



2019 Community Moderator ElectionHow do I set/get heap size for Spark (via Python notebook)Spark DataFrame coursesRDD of gziped files to “uncompressed” DataframeDataframe request with groupBySpark SQL Pivot CrossTab functionalityPlot RDD data using a pyspark dataframe from csv filePySpark dataframe repartitionAdding multiple columns to spark dataframeSpark DataFrame Limit Function Takes Too Much Time to ShowHow to store dataframe result into text file?










0












$begingroup$


I have compiled the following code in Databricks written in spark.sql. I'm getting an AttributeError: 'DataFrame' object has no attribute 'sql'



The code is as follows:



purchaseByCustomerPerHour = streamingDataFrame.sql("""SELECT
 retail_data.CustomerID
 ,retail_data.InvoiceDate AS window
 ,SUM(retail_data.UnitPrice * retail_data.Quantity) AS total_cost
FROM retail_data
GROUP BY retail_data.CustomerID
 ,retail_data.InvoiceDate
 ,retail_data.UnitPrice""")


Normally, I would write the first line of code as follows:



purchaseByCustomerPerHour = spark.sql


However, I'm trying out StructuredStreaming with Spark.



Can someone interpret the error message?



Thanks






apache-spark pyspark







share|improve this question







New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$



put on hold as off-topic by Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F Mar 22 at 7:09


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "This question does not appear to be about data science, within the scope defined in the help center." – Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F
If this question can be reworded to fit the rules in the help center, please edit the question.















  • $begingroup$
    I am running spark 2.4
    $endgroup$
    – Carltonp
    Mar 21 at 17:21










  • $begingroup$
    Your question is out of scope of this site. It's better to ask it in stackoverflow.com
    $endgroup$
    – Alireza Zolanvari
    Mar 21 at 17:40















0












$begingroup$


I have compiled the following code in Databricks written in spark.sql. I'm getting an AttributeError: 'DataFrame' object has no attribute 'sql'



The code is as follows:



purchaseByCustomerPerHour = streamingDataFrame.sql("""SELECT
 retail_data.CustomerID
 ,retail_data.InvoiceDate AS window
 ,SUM(retail_data.UnitPrice * retail_data.Quantity) AS total_cost
FROM retail_data
GROUP BY retail_data.CustomerID
 ,retail_data.InvoiceDate
 ,retail_data.UnitPrice""")


Normally, I would write the first line of code as follows:



purchaseByCustomerPerHour = spark.sql


However, I'm trying out StructuredStreaming with Spark.



Can someone interpret the error message?



Thanks






apache-spark pyspark







share|improve this question







New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$



put on hold as off-topic by Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F Mar 22 at 7:09


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "This question does not appear to be about data science, within the scope defined in the help center." – Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F
If this question can be reworded to fit the rules in the help center, please edit the question.















  • $begingroup$
    I am running spark 2.4
    $endgroup$
    – Carltonp
    Mar 21 at 17:21










  • $begingroup$
    Your question is out of scope of this site. It's better to ask it in stackoverflow.com
    $endgroup$
    – Alireza Zolanvari
    Mar 21 at 17:40













0












0








0





$begingroup$


I have compiled the following code in Databricks written in spark.sql. I'm getting an AttributeError: 'DataFrame' object has no attribute 'sql'



The code is as follows:



purchaseByCustomerPerHour = streamingDataFrame.sql("""SELECT
 retail_data.CustomerID
 ,retail_data.InvoiceDate AS window
 ,SUM(retail_data.UnitPrice * retail_data.Quantity) AS total_cost
FROM retail_data
GROUP BY retail_data.CustomerID
 ,retail_data.InvoiceDate
 ,retail_data.UnitPrice""")


Normally, I would write the first line of code as follows:



purchaseByCustomerPerHour = spark.sql


However, I'm trying out StructuredStreaming with Spark.



Can someone interpret the error message?



Thanks






apache-spark pyspark







share|improve this question







New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$




I have compiled the following code in Databricks written in spark.sql. I'm getting an AttributeError: 'DataFrame' object has no attribute 'sql'



The code is as follows:



purchaseByCustomerPerHour = streamingDataFrame.sql("""SELECT
 retail_data.CustomerID
 ,retail_data.InvoiceDate AS window
 ,SUM(retail_data.UnitPrice * retail_data.Quantity) AS total_cost
FROM retail_data
GROUP BY retail_data.CustomerID
 ,retail_data.InvoiceDate
 ,retail_data.UnitPrice""")


Normally, I would write the first line of code as follows:



purchaseByCustomerPerHour = spark.sql


However, I'm trying out StructuredStreaming with Spark.



Can someone interpret the error message?



Thanks






apache-spark pyspark




apache-spark pyspark






share|improve this question







New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question







New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question






New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked Mar 21 at 17:19









CarltonpCarltonp

1




1




New contributor




Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






Carltonp is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




put on hold as off-topic by Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F Mar 22 at 7:09


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "This question does not appear to be about data science, within the scope defined in the help center." – Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F
If this question can be reworded to fit the rules in the help center, please edit the question.







put on hold as off-topic by Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F Mar 22 at 7:09


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "This question does not appear to be about data science, within the scope defined in the help center." – Kiritee Gak, Toros91, Siong Thye Goh, tuomastik, Mark.F
If this question can be reworded to fit the rules in the help center, please edit the question.











  • $begingroup$
    I am running spark 2.4
    $endgroup$
    – Carltonp
    Mar 21 at 17:21










  • $begingroup$
    Your question is out of scope of this site. It's better to ask it in stackoverflow.com
    $endgroup$
    – Alireza Zolanvari
    Mar 21 at 17:40
















  • $begingroup$
    I am running spark 2.4
    $endgroup$
    – Carltonp
    Mar 21 at 17:21










  • $begingroup$
    Your question is out of scope of this site. It's better to ask it in stackoverflow.com
    $endgroup$
    – Alireza Zolanvari
    Mar 21 at 17:40















$begingroup$
I am running spark 2.4
$endgroup$
– Carltonp
Mar 21 at 17:21




$begingroup$
I am running spark 2.4
$endgroup$
– Carltonp
Mar 21 at 17:21












$begingroup$
Your question is out of scope of this site. It's better to ask it in stackoverflow.com
$endgroup$
– Alireza Zolanvari
Mar 21 at 17:40




$begingroup$
Your question is out of scope of this site. It's better to ask it in stackoverflow.com
$endgroup$
– Alireza Zolanvari
Mar 21 at 17:40










0






active

oldest

votes

















0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes

-

Popular posts from this blog

Marja Vauras Lähteet | Aiheesta muualla | NavigointivalikkoMarja Vauras Turun yliopiston tutkimusportaalissaInfobox OKSuomalaisen Tiedeakatemian varsinaiset jäsenetKasvatustieteiden tiedekunnan dekaanit ja muu johtoMarja VaurasKoulutusvienti on kestävyys- ja ketteryyslaji (2.5.2017)laajentamallaWorldCat Identities0000 0001 0855 9405n86069603utb201588738523620927

Image
Vuonna 1953 syntyneetSuomalaiset kasvatustieteilijätSuomalaiset professoritTurun yliopiston professorit 9. maaliskuuta1953TurkuTurun yliopistonSuomalaisen tiedeakatemian Marja Vauras Henkilötiedot Syntynyt 9. maaliskuuta 1953 (ikä 66) Turku Kansallisuus Suomi Ammatti kasvatustieteen professori Koulutus ja ura Instituutti Turun yliopisto Aiheesta muualla Marja Vauras Turun yliopiston tutkimusportaalissa Infobox OK Marja Merja Sinikka Vauras (s. 9. maaliskuuta 1953 Turku) on suomalainen filosofian tohtori, ja Turun yliopiston kasvatustieteen professori. [1] [2] Hän on toiminut myös Turun yliopiston Kasvatustieteellisen tiedekunnan dekaanina. [3] Suomalaisen tiedeakatemian jäsen Vauras on ollut vuodesta 2013. [2] Lähteet | ↑ Suomen professorit 1640–2007 , Professoriliitto, 2008 (ISBN  978-952-99281-1-8 ja 978-952-99281-2-5 , viitattu 7 huhtikuuta 2019 ) ↑ a b Suomalaisen Tiedeakatemian varsinaiset jäsenet pä...
Read more

Which is better: GPT or RelGAN for text generation?2019 Community Moderator ElectionWhat is the difference between TextGAN and LM for text generation?GANs (generative adversarial networks) possible for text as well?Generator loss not decreasing- text to image synthesisChoosing a right algorithm for template-based text generationHow should I format input and output for text generation with LSTMsGumbel Softmax vs Vanilla Softmax for GAN trainingWhich neural network to choose for classification from text/speech?NLP text autoencoder that generates text in poetic meterWhat is the interpretation of the expectation notation in the GAN formulation?What is the difference between TextGAN and LM for text generation?How to prepare the data for text generation task

Image
Neighboring nodes in the network Is it canonical bit space? Why do I get two different answers for this counting problem? Python: return float 1.0 as int 1 but float 1.5 as float 1.5 Drawing a Grid/Tikz image Why is it a bad idea to hire a hitman to eliminate most corrupt politicians? Why is this clock signal connected to a capacitor to gnd? Blender 2.8 I can't see vertices, edges or faces in edit mode How to say in German "enjoying home comforts" Is there an expression that means doing something right before you will need it rather than doing it in case you might need it? Can a virus destroy the BIOS of a modern computer? Saudi Arabia Transit Visa Why "Having chlorophyll without photosynthesis is actually very dangerous" and "like living with a bomb"? What is the word for reserving something for yourself before others do? Why do bosons tend to occupy the same state? Is the Joker left-handed? What method can I use to des...
Read more

Is this part of the description of the Archfey warlock's Misty Escape feature redundant?When is entropic ward considered “used”?How does the reaction timing work for Wrath of the Storm? Can it potentially prevent the damage from the triggering attack?Does the Dark Arts Archlich warlock patrons's Arcane Invisibility activate every time you cast a level 1+ spell?When attacking while invisible, when exactly does invisibility break?Can I cast Hellish Rebuke on my turn?Do I have to “pre-cast” a reaction spell in order for it to be triggered?What happens if a Player Misty Escapes into an Invisible CreatureCan a reaction interrupt multiattack?Does the Fiend-patron warlock's Hurl Through Hell feature dispel effects that require the target to be on the same plane as the caster?What are you allowed to do while using the Warlock's Eldritch Master feature?

Image
How to Reset Passwords on Multiple Websites Easily? How can a function with a hole (removable discontinuity) equal a function with no hole? What is the opposite of 'gravitas'? Return the Closest Prime Number Term for the "extreme-extension" version of a straw man fallacy? How to check is there any negative term in a large list? How does it work when somebody invests in my business? How do I rename a Linux host without needing to reboot for the rename to take effect? Avoiding estate tax by giving multiple gifts Purchasing a ticket for someone else in another country? Energy of the particles in the particle accelerator How can I get through very long and very dry, but also very useful technical documents when learning a new tool? How did Doctor Strange see the winning outcome in Avengers: Infinity War? How to create a 32-bit integer from eight (8) 4-bit integers? What can we do to stop prior company from asking us questions? How to be diplo...
Read more