Reply
Member
Posts: 52
Registered: ‎07-05-2018
Accepted Solution

streaming data postgresql-python-API

Hi all, 

 

I am a naive user trying to play around streaming dataset and would really like your help. 

 

I am trying to get the query from PostgreSQL and use python to push into API. The doubt I have is when I use the sql code as, 

 

 

sql = "select * from table where date >= now() and city='chennai';"

 

 

doesn't work as it gets data from that time only and repeats. 

 

When I use the following code, It runs for a long time but doesn't work

 

 

sql = "select * from table where city='chennai';"

 

Am I using it correctly? Can we use where clause? 

 

Thanks,

Indhu


Accepted Solutions
Highlighted
Community Support Team
Posts: 7,310
Registered: ‎05-02-2017

Re: streaming data postgresql-python-API

Hi Indhu,

 

Both of the SQL statements look great. The problem is if there isn't any new data in the PostgreSQL, the results of these SQLs are always the same. There could be two solutions. 

1. Add new data to the source. 

2. Change the SQL statements to make them retrieve dynamic data. For instances, 

 

# usually, this block is in a loop.

date = datetime.date.today()
sql = "select * from table where city='chennai' and date = '" + str(date) + "'"
date += datetime.timedelta(days = 1)

 

Best Regards,
Dale

Community Support Team _ Dale
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post


All Replies
Highlighted
Community Support Team
Posts: 7,310
Registered: ‎05-02-2017

Re: streaming data postgresql-python-API

Hi Indhu,

 

Both of the SQL statements look great. The problem is if there isn't any new data in the PostgreSQL, the results of these SQLs are always the same. There could be two solutions. 

1. Add new data to the source. 

2. Change the SQL statements to make them retrieve dynamic data. For instances, 

 

# usually, this block is in a loop.

date = datetime.date.today()
sql = "select * from table where city='chennai' and date = '" + str(date) + "'"
date += datetime.timedelta(days = 1)

 

Best Regards,
Dale

Community Support Team _ Dale
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.