Talend query data in mysql based on inputs from hive -


I need to query a column in the hive and depending on the output I want to query it in MySQL DB.

The flow is something similar to:

  1. Get the list of questions hive tables, IDs
  2. Use the list of IDs to query the MySQL table >

    How do I do this?

    You just need to use a tHiveInput component to retrieve the ID to create your query And then you get two options, the easiest way or the hard (and better) way:

    For easy way you can then run from a tHiveInput component on a tFlowToIterate and then a tmySqlInput component Can iterate Your query in the TMySqlInput component will look something similar: 

      "SELECT a, b, c fROM x WHERE id = '" + ((integer) globalMap.get ("row1.id") ) + "'"

    Line 1 here represents the row running in your TflotOitrate. You can also get this variable by kissing the ctrl + space and selecting the tFlowToIterate_x.id option.

    You can add a tBufferOutput component to your tMySqlInput component to collect all iterations again and then read it with a TuberFinder input component for further processing.

    This is clearly a simple combination that is not the best method for efficiency and is definitely open for SQL injection. But this is a difficult and ready way.

    Your other (hard but potentially better) option is to use a parameterized query using a tMySqlRow component (currently not supported in tmySqlInput component as Tamnand 5.4).

    In Talend, some details about parameterized queries go into the form of a solution of another problem (increasing efficiency) as mentioned in the answer, there is more details on parameterized queries.


-

Comments

Post a Comment

Popular posts from this blog

Python Equivalent for matlab cart2pol and pol2cart -

I would like to use pol2cart and cart2pol for two functions in MATLAB. Is there an equivalent Python Function? Or if we can define work? For example, I tried to use the CeMatePactor function, but it only accepts one argument, I have 2 arguments to cross the polar and REC function. P> I have tried to use this function for cart2pol: def cart2pol (x, y): theta = atan2 (y, x) rho = Sqrt (x ** 2 + y ** 2) returns (theta, ro) thanks
Read more

javascript - Render HTML after each iteration in loop -

I'm trying to gradually increase the font size of text on a web page. The code works in my place, although the new HTML / CSS does not render after every iteration of the loop and when all this is done, then display only the text of 100 px size. To see the text as if it is slowly zooming, I need to do this JavaScript is down because it is being used from a different file here is what I have ... & lt; P class = "game-title" style = "font-size: 50px" & gt; Test & lt; / P & gt; Function sleep (milliseconds) {var start = new date (). GetTime (); For (var i = 0; i & lt; 1e7; i ++) {if ((new date). GetTime () - start) & gt; Milliseconds {break; CSS ('font-size', 'parseInt ($ (' game-title '). CSS (' font-size ')) + 1 + "pixels"); } While (parasont ($ ('# text'). Css ('font-size')) & lt; = 100) {sleep (1000); IncreaseSize (); Using CSS: Use of jQuery (sample): $ ('...
Read more

sip - Call SipJs to Asterisk 12 -

I am trying to call Asterisk 12 from SIPJ. My partner is here [6002]] type = friend secret = 6002 host = dynamic reference = public transport = ws avpf = yes icesupport = no encryption = no And my JSP code is here var configuration = {'ws_servers':' ws: //192.168.0.102: 8088 / ws', 'Yuri': 'SIP: 6002 @ 192.168.0.102 ',' Password ':' 6002 '}; Var option = {'EventHolders': EventHandler, 'Media Consultants': {'Audio': True, 'Video': Incorrect}}; Function call () {quietphonecall ('sip: 6003@192.168.0.102', option); } It is properly registered, but when I call "call" function asterisk logs this error secure without encryption details Rejecting Audio Stream: Audio 46421 RTP / SAVPF 111 103 104 0 8 106 105 13 126 JSSIp error is here Call failed with reason: Incompatible SDP Can someone help me? First of all, you will have to create a certificate for DTLS. Then enabl...
Read more