We are pulling some data from HDFS. we are using listHDFS and fetchHDFS processor for this.
We are pulling some data from HDFS. we are using listHDFS and fetchHDFS processor for this.
When we stopped the fetchHDFS processor, We can see there a number of active threads even after stopping the processor. So I used "terminate" option To kill those threads.
how terminate option works?
Does it gracefully Close all the connections with FS?
Since all the threads are killed, do I lose out on the data that was consumed by these threads?
Is it advised the terminate option only when the threads are stuck or the flow enters a frozen state?
Tagged: