Getting execution time from QueryDatabaseTable in NiFi

Question

I am using the process QueryDatabaseTable in NiFi for incrementally getting data from a DB2. QueryDatabaseTable is scheduled to run every 5 minutes. Maximum-value Columns is set to "rep" (which corresponds to a date, in the DB2 db).

I have a seperate MySQL database I want to update with the value "rep", that QueryDatabaseTable uses to query the DB2 database with. How can i get this value?

In the logfiles I've found that the attributes of the FlowFiles does not contain this value.

mattyb · Accepted Answer · 2016-07-21 16:35:01Z

1

QueryDatabaseTable doesn't currently accept incoming flow files or allow the use of Expression Language to define the table name, I've written up an improvement Jira to handle this:

https://issues.apache.org/jira/browse/NIFI-2340

answered Jul 21, 2016 at 16:35

mattyb

12.2k20 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

John Deer Over a year ago

What i want is the value of "rep", that QueryDatabaseTable saves as a state (ie. the LAST value it has queried for). I've thought about making a custom process for this task, and add the State of QueryDatabaseTable (the max value) to an attribute according to github.com/apache/nifi/blob/master/nifi-nar-bundles/… line 250 - I just don't like that solution. Are the "State" of a process avaliable to me to reference somehow?

mattyb Over a year ago

The state itself isn't available. I've added another improvement Jira to add the observed max values as attributes: issues.apache.org/jira/browse/NIFI-2641

Collectives™ on Stack Overflow

Getting execution time from QueryDatabaseTable in NiFi

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related