Menu
▾
▴
postgres-xc-developers
|
From: Amit L. <ami...@gm...> - 2014-11-04 01:49:17
|
Hi Demai, On Tue, Nov 4, 2014 at 10:40 AM, Demai Ni <ni...@gm...> wrote: > hi, hackers, > > I am looking for a simple way to pass a value(ideally a hashtable, and use a > string for easy implementation for now), that is generated by coordinator > node, and pass it to all data nodes. Plans may be one approach, I am just > wondering whether there is a simpler hook? > Correct list for this question would be (added to 'cc'): pos...@li... Thanks, Amit |
|
From: Demai Ni <ni...@gm...> - 2014-11-04 18:47:30
|
hi, Koichi, thanks for your response. I am trying to connect to a hdfs system, and reading hdfs files through FDW. Assuming I have 10 files mapping to one foreign table, and have 3 datanode on PG-XC, I'd like coordinator node to do some simple scheduling so that each dataNode of PG-XC will read roughtly same amount of data. That is why I'd like to hook a value(a String will be fine) that generated by coordinator node, and visible to every data node. Demai > > Demai; > > Anyway, could you describe your point more specifically? What would > you do this in vanilla postgresql? This will help to find how to do > it in XC. > > Regards; > --- > Koichi Suzuki >> hi, hackers, >> >> I am looking for a simple way to pass a value(ideally a hashtable, and use a >> string for easy implementation for now), that is generated by coordinator >> node, and pass it to all data nodes. Plans may be one approach, I am just >> wondering whether there is a simpler hook? >> |
|
From: 鈴木 幸市 <ko...@in...> - 2014-11-05 00:59:18
|
Thank you Demai; Unfortunately, XC does not support FDW at present. All the FDW statements are blocked. It is not an architecture issue but an issue of development and testing. Now that XC support materialized view stored in datanodes, I hope planner can handle FDW correctly. Anyway, please understand we need somebody to write a code to enable FDW at coordinator level and test it. Do you have any other idea to do the same thing without FDW? Regards; --- Koichi Suzuki 2014/11/05 3:47、Demai Ni <ni...@gm...<mailto:ni...@gm...>> のメール： hi, Koichi, thanks for your response. I am trying to connect to a hdfs system, and reading hdfs files through FDW. Assuming I have 10 files mapping to one foreign table, and have 3 datanode on PG-XC, I'd like coordinator node to do some simple scheduling so that each dataNode of PG-XC will read roughtly same amount of data. That is why I'd like to hook a value(a String will be fine) that generated by coordinator node, and visible to every data node. Demai Demai; Anyway, could you describe your point more specifically? What would you do this in vanilla postgresql? This will help to find how to do it in XC. Regards; --- Koichi Suzuki >> hi, hackers, >> >> I am looking for a simple way to pass a value(ideally a hashtable, and use a >> string for easy implementation for now), that is generated by coordinator >> node, and pass it to all data nodes. Plans may be one approach, I am just >> wondering whether there is a simpler hook? >> ------------------------------------------------------------------------------ _______________________________________________ Postgres-xc-developers mailing list Pos...@li...<mailto:Pos...@li...> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers |
|
From: Aris S. <ari...@gm...> - 2014-12-21 13:47:06
|
> All the FDW statements are blocked > Anyway, please understand we need somebody to write a code to enable FDW at coordinator level and test it. > Do you have any other idea to do the same thing without FDW? FDW statements only blocked in coordinator. So we can create fwd table manually in every data nodes (before join them in XC cluster), and then join them in XC cluster. Please correct me if I'm wrong. On 11/5/14, 鈴木 幸市 <ko...@in...> wrote: > Thank you Demai; > > Unfortunately, XC does not support FDW at present. All the FDW statements > are blocked. It is not an architecture issue but an issue of development > and testing. Now that XC support materialized view stored in datanodes, I > hope planner can handle FDW correctly. Anyway, please understand we need > somebody to write a code to enable FDW at coordinator level and test it. > > Do you have any other idea to do the same thing without FDW? > > Regards; > --- > Koichi Suzuki > > 2014/11/05 3:47、Demai Ni <ni...@gm...<mailto:ni...@gm...>> のメール： > > hi, Koichi, > > thanks for your response. I am trying to connect to a hdfs system, and > reading hdfs files through FDW. Assuming I have 10 files mapping to one > foreign table, and have 3 datanode on PG-XC, I'd like coordinator node to do > some simple scheduling so that each dataNode of PG-XC will read roughtly > same amount of data. That is why I'd like to hook a value(a String will be > fine) that generated by coordinator node, and visible to every data node. > > Demai > > Demai; > > Anyway, could you describe your point more specifically? What would > you do this in vanilla postgresql? This will help to find how to do > it in XC. > > Regards; > --- > Koichi Suzuki > >>> hi, hackers, >>> >>> I am looking for a simple way to pass a value(ideally a hashtable, and >>> use a >>> string for easy implementation for now), that is generated by >>> coordinator >>> node, and pass it to all data nodes. Plans may be one approach, I am >>> just >>> wondering whether there is a simpler hook? >>> > > ------------------------------------------------------------------------------ > _______________________________________________ > Postgres-xc-developers mailing list > Pos...@li...<mailto:Pos...@li...> > https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers > > |
|
From: 鈴木幸市 <koi...@gm...> - 2014-12-21 23:12:00
|
Yes, this may work because detained is almost postgres. I’m afraid how you can make it useful, I mean, if you can create distributed/replicated tables via FDW in datanodes created manually. Please let me know your idea. Regards; — Koichi Suzuki > 2014/12/21 22:46、Aris Setyawan <ari...@gm...> のメール： > >> All the FDW statements are blocked >> Anyway, please understand we need somebody to write a code to enable FDW at coordinator level and test it. >> Do you have any other idea to do the same thing without FDW? > > FDW statements only blocked in coordinator. > So we can create fwd table manually in every data nodes (before join > them in XC cluster), and then join them in XC cluster. > > Please correct me if I'm wrong. > > On 11/5/14, 鈴木 幸市 <ko...@in...> wrote: >> Thank you Demai; >> >> Unfortunately, XC does not support FDW at present. All the FDW statements >> are blocked. It is not an architecture issue but an issue of development >> and testing. Now that XC support materialized view stored in datanodes, I >> hope planner can handle FDW correctly. Anyway, please understand we need >> somebody to write a code to enable FDW at coordinator level and test it. >> >> Do you have any other idea to do the same thing without FDW? >> >> Regards; >> --- >> Koichi Suzuki >> >> 2014/11/05 3:47、Demai Ni <ni...@gm...<mailto:ni...@gm...>> のメール： >> >> hi, Koichi, >> >> thanks for your response. I am trying to connect to a hdfs system, and >> reading hdfs files through FDW. Assuming I have 10 files mapping to one >> foreign table, and have 3 datanode on PG-XC, I'd like coordinator node to do >> some simple scheduling so that each dataNode of PG-XC will read roughtly >> same amount of data. That is why I'd like to hook a value(a String will be >> fine) that generated by coordinator node, and visible to every data node. >> >> Demai >> >> Demai; >> >> Anyway, could you describe your point more specifically? What would >> you do this in vanilla postgresql? This will help to find how to do >> it in XC. >> >> Regards; >> --- >> Koichi Suzuki >> >>>> hi, hackers, >>>> >>>> I am looking for a simple way to pass a value(ideally a hashtable, and >>>> use a >>>> string for easy implementation for now), that is generated by >>>> coordinator >>>> node, and pass it to all data nodes. Plans may be one approach, I am >>>> just >>>> wondering whether there is a simpler hook? >>>> >> >> ------------------------------------------------------------------------------ >> _______________________________________________ >> Postgres-xc-developers mailing list >> Pos...@li...<mailto:Pos...@li...> >> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers >> >> > > ------------------------------------------------------------------------------ > Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server > from Actuate! Instantly Supercharge Your Business Reports and Dashboards > with Interactivity, Sharing, Native Excel Exports, App Integration & more > Get technology previously reserved for billion-dollar corporations, FREE > http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk > _______________________________________________ > Postgres-xc-developers mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers |
|
From: Koichi S. <koi...@gm...> - 2014-11-04 09:34:33
|
Demai; Anyway, could you describe your point more specifically? What would you do this in vanilla postgresql? This will help to find how to do it in XC. Regards; --- Koichi Suzuki 2014-11-04 10:48 GMT+09:00 Amit Langote <ami...@gm...>: > Hi Demai, > > On Tue, Nov 4, 2014 at 10:40 AM, Demai Ni <ni...@gm...> wrote: >> hi, hackers, >> >> I am looking for a simple way to pass a value(ideally a hashtable, and use a >> string for easy implementation for now), that is generated by coordinator >> node, and pass it to all data nodes. Plans may be one approach, I am just >> wondering whether there is a simpler hook? >> > > Correct list for this question would be (added to 'cc'): > > pos...@li... > > Thanks, > Amit > > ------------------------------------------------------------------------------ > _______________________________________________ > Postgres-xc-developers mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers |
|
From: Demai Ni <ni...@gm...> - 2014-11-04 18:58:37
|
sorry if this message is a dup, previous one sent to postgres-xc-developers was bounded back. hi, Koichi, thanks for your response. I am trying to connect to a hdfs system, and reading hdfs files through FDW. Assuming I have 10 files mapping to one foreign table, and have 3 datanode on PG-XC, I'd like coordinator node to do some simple scheduling so that each dataNode of PG-XC will read roughtly same amount of data. That is why I'd like to hook a value(a String will be fine) that generated by coordinator node, and visible to every data node. The string will be the same value for all datanodes. Demai On Tue, Nov 4, 2014 at 1:34 AM, Koichi Suzuki <koi...@gm...> wrote: > Demai; > > Anyway, could you describe your point more specifically? What would > you do this in vanilla postgresql? This will help to find how to do > it in XC. > > Regards; > --- > Koichi Suzuki > > > 2014-11-04 10:48 GMT+09:00 Amit Langote <ami...@gm...>: > > Hi Demai, > > > > On Tue, Nov 4, 2014 at 10:40 AM, Demai Ni <ni...@gm...> wrote: > >> hi, hackers, > >> > >> I am looking for a simple way to pass a value(ideally a hashtable, and > use a > >> string for easy implementation for now), that is generated by > coordinator > >> node, and pass it to all data nodes. Plans may be one approach, I am > just > >> wondering whether there is a simpler hook? > >> > > > > Correct list for this question would be (added to 'cc'): > > > > pos...@li... > > > > Thanks, > > Amit > > > > > ------------------------------------------------------------------------------ > > _______________________________________________ > > Postgres-xc-developers mailing list > > Pos...@li... > > https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers > |
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X