etch-users Mailing List for Etch System Configuration Management (Page 2)

Brought to you by: darrendao, foechterle, gnolan, jheiss, and 3 others

etch-users — General discussion and questions about using etch

You can subscribe to this list here.

2008	Jan	Feb	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct	Nov (3)	Dec (1)
2009	Jan (1)	Feb	Mar	Apr (1)	May	Jun	Jul	Aug	Sep (1)	Oct (9)	Nov (10)	Dec (5)
2010	Jan (10)	Feb	Mar	Apr	May (4)	Jun (2)	Jul	Aug (5)	Sep (2)	Oct (2)	Nov	Dec (1)
2011	Jan (1)	Feb	Mar	Apr (1)	May (29)	Jun (9)	Jul (4)	Aug (8)	Sep	Oct	Nov	Dec
2012	Jan	Feb (1)	Mar (13)	Apr (1)	May	Jun	Jul	Aug	Sep	Oct	Nov (1)	Dec
2014	Jan	Feb (1)	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct (1)	Nov	Dec
2021	Jan	Feb	Mar	Apr	May	Jun	Jul	Aug	Sep	Oct	Nov	Dec (1)

Flat | Threaded

<< < 1 2 3 4 .. 6 > >> (Page 2 of 6)

Re: [etch-users] Request: etchdebug.log to configurable destination

From: Pat O'B. <obr...@gm...> - 2011-08-08 05:20:00

I've never bothered to try this so I don't know if it's configurable or not.
If it's not open a bug ticket and I'll take a look at it when I get some
spare time this week.

Just as a side note: my personal preference is to not have system logs end
up in /var/log, but to each their own :)

-pat


On Wed, Aug 3, 2011 at 3:27 PM, Johnston, Nathaniel <
Nat...@ca...> wrote:

> Etch Mensches,
>
> I am not sure how best to do this, but I am trying to move my Etch logs
> over to /var along with the other logfiles I have.  I noticed that on line
> 205 of lib/etchserver.rb the etchdebug.log file is specified as:
>
> @dlogger = Logger.new(File.join(Rails.configuration.root_path, 'log',
> 'etchdebug.log'))
>
> Is there a way that this could leverage the value of
> config.log_path/paths.log or another configurable parameter so that we could
> override the location of this file?
>
> --N.
>
>
>
>
> ------------------------------------------------------------------------------
> BlackBerry&reg; DevCon Americas, Oct. 18-20, San Francisco, CA
> The must-attend event for mobile developers. Connect with experts.
> Get tools for creating Super Apps. See the latest technologies.
> Sessions, hands-on labs, demos & much more. Register early & save!
> http://p.sf.net/sfu/rim-blackberry-1
> _______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users
>

[etch-users] Request: etchdebug.log to configurable destination

From: Johnston, N. <Nat...@ca...> - 2011-08-03 22:27:56

Etch Mensches,

I am not sure how best to do this, but I am trying to move my Etch logs over to /var along with the other logfiles I have.  I noticed that on line 205 of lib/etchserver.rb the etchdebug.log file is specified as:

@dlogger = Logger.new(File.join(Rails.configuration.root_path, 'log', 'etchdebug.log'))

Is there a way that this could leverage the value of config.log_path/paths.log or another configurable parameter so that we could override the location of this file?  

--N.

Re: [etch-users] etch local_requests + quasi-xml = fail

From: Pat O'B. <obr...@gm...> - 2011-07-30 03:55:01

Well, I got something working, but it's fairly ugly (don't you hate it when
you find a solution a few minutes AFTER you send an email to a mailing
list?).

First, I finally found the tag in XML to have it ignore XML "like" markup:

<![CDATA[ <who wants icecream?> ]]>

This solved the problem of etch bailing when loading up the XML file into
the @local_requests variable, but wouldn't solve REXML bailing. What I did
to fix that is somewhat jankey:

if @local_requests && !@local_requests.empty?
  require 'rexml/document'
  this_is_pretty_ugly = REXML::Document.new()
  requests_xml = REXML::Document.new(@local_requests)
  requests_xml.elements.each('/requests/request') do |request_xml|
    request_xml.to_s.split("\n").each do |line|
      next if line =~ /^\]\]\>|^\!\[CDATA\[|^\<request\>|^\<\/request\>/
      @contents << line + "\n"
    end
  end
end

Normally I would have offended myself with this sort of solution, but since
we're writing a chef resource to add the contents to the local request file
we should be able to control it well enough without having to worry about
someone placing in bad XML or XML like languages into the file for etch to
pick up.

It would be nice if there didn't need to be a work around, although I
completely understand why the behavior is the way it is.

Anyway, hope this helps anyone who tries and gets caught with this.

-pat

On Fri, Jul 29, 2011 at 8:33 PM, Pat O'Brien <obr...@gm...>wrote:

> collectd appears to have it's config file set up to read "quasi-xml", which
> is causing etch to fail when parsing it for a local request:
>
> Local request file
> /var/etch/requests/data/svc/collectd/etc/collectd.conf/from_etch is not
> valid XML and will be ignored:
> #<REXML::ParseException: malformed XML: missing tag start
> Line:
> Position:
> Last 80 unconsumed characters:
> <Plugin "tail">   <File "/data/svc/mule/instance01/logs/log4j.log">
> Instance >
> ...
>
> here is what the config bit looks like:
>
> <Plugin "tail">
>   <File "/data/svc/app/logs/log4j.log">
>     Instance "westcoast"
>     <Match>
>       Regex "ERROR"
>       DSType "CounterInc"
>       Type "derive"
>       Instance "instance_errors"
>     </Match>
>   </File>
> </Plugin>
>
> Running this through other XML verifiers also verifies that this is not
> valid XML. One problem I noticed is that any invalid XML (or XML like file,
> including HTML and ERB included) in the local requests directory will cause
> etch to bail when slurping in to add the contents to @local_requests.
>
> Initially I thought it was just REXML bailing on loading the local request
> and rejecting it, but it looks like it is etch itself which is bailing
> (although it's completely possible that REXML would bail in the script
> itself as well since REXML validates XML when it loads it).
>
> Any thoughts on where to go from here? Is there an XML tag that allows free
> form text and ignores all formatting of data within the tag end and the tag
> begin? I'll also dig through collectd and see if I can make the config
> proper XML as well.
>
> -pat
>

[etch-users] etch local_requests + quasi-xml = fail

From: Pat O'B. <obr...@gm...> - 2011-07-30 03:33:48

collectd appears to have it's config file set up to read "quasi-xml", which
is causing etch to fail when parsing it for a local request:

Local request file
/var/etch/requests/data/svc/collectd/etc/collectd.conf/from_etch is not
valid XML and will be ignored:
#<REXML::ParseException: malformed XML: missing tag start
Line:
Position:
Last 80 unconsumed characters:
<Plugin "tail">   <File "/data/svc/mule/instance01/logs/log4j.log">
Instance >
...

here is what the config bit looks like:

<Plugin "tail">
  <File "/data/svc/app/logs/log4j.log">
    Instance "westcoast"
    <Match>
      Regex "ERROR"
      DSType "CounterInc"
      Type "derive"
      Instance "instance_errors"
    </Match>
  </File>
</Plugin>

Running this through other XML verifiers also verifies that this is not
valid XML. One problem I noticed is that any invalid XML (or XML like file,
including HTML and ERB included) in the local requests directory will cause
etch to bail when slurping in to add the contents to @local_requests.

Initially I thought it was just REXML bailing on loading the local request
and rejecting it, but it looks like it is etch itself which is bailing
(although it's completely possible that REXML would bail in the script
itself as well since REXML validates XML when it loads it).

Any thoughts on where to go from here? Is there an XML tag that allows free
form text and ignores all formatting of data within the tag end and the tag
begin? I'll also dig through collectd and see if I can make the config
proper XML as well.

-pat

Re: [etch-users] When running a script, how to properly indicate an error

From: Jason H. <jh...@ap...> - 2011-07-12 20:48:22

On Jul 12, 2011, at 10:38 AM, Johnston, Nathaniel wrote:

> I have a configuration I am working on that will set up /etc/snmpd.conf on some of my hosts.  In order for me to properly set the SNMP trap destinations using the "trapsink" directive, I need to call out to an external resource.  In the event that the external resource call fails for whatever reason, I do not want Etch to take action for that run.  What is the proper way in my script to indicate "An error occurred, do not etch this particular /etc/snmpd.conf" in a graceful manner?

Add nothing to @contents.  If nothing is added to @contents then etch will skip the file.

So for example, instead of this:

@contents << "First line"
@contents << `something that might break`

Do something like this:

externalbits = `something that might break`
if externalbits
  @contents << "First line"
  @contents << externalbits
end

That way if your external resource fails nothing gets added to @contents.

Jason

[etch-users] When running a script, how to properly indicate an error

From: Johnston, N. <Nat...@ca...> - 2011-07-12 17:38:35

The Powers That Etch,

I have a configuration I am working on that will set up /etc/snmpd.conf on some of my hosts.  In order for me to properly set the SNMP trap destinations using the "trapsink" directive, I need to call out to an external resource.  In the event that the external resource call fails for whatever reason, I do not want Etch to take action for that run.  What is the proper way in my script to indicate "An error occurred, do not etch this particular /etc/snmpd.conf" in a graceful manner?

--N.

Re: [etch-users] using etch + svn externals

From: Jason H. <jh...@ap...> - 2011-06-23 22:21:05

I'd rate it somewhere between clever and kinda bad, just because svn externals seem to end up sucking every time I use them.

The alternative would be to use a script (i.e. <script> instead of <plain>) to generate the file, and have the script read or generate the config file in such a way that you don't have to store a duplicate copy of the data.  That would be somewhat more in the "traditional" etch way of doing things.

Jason

On Jun 22, 2011, at 9:33 AM, Pat O'Brien wrote:

> Just wanted to run this by the etch-users list to see if this was either a) a bad idea or b) an exceptionally bad idea.
> 
> We have some processes (that some of you will be familiar with) which automatically updates a bind9 zone's serial and generates PTR zones after parsing through the forward zones. This is done in an svn repo outside of etch since we'd rather have the updates go out immediately rather than in 1-4 hours. It also generates two separate files - include_ptr.conf.master and include_ptr.conf.slave. The master's get this file just fine since when updates are pushed it just simply does an svn up, but most of the slaves configs are in etch so the current way of doing this was to just manually copy over the file whenever we'd need to add a new subnet to DNS. We've recently added some more subnets (we already have about 200 for a single datacenter, so why not add some more?) at which point I forgot to update the file in etch. Oops.
> 
> I gave it a few minutes thought and figured I would try out adding this file as an svn external to etch:
> 
> wordup:var pobrien$ tree
> .
> ├── named
> │   └── chroot
> │       └── etc
> │           ├── include_ptr.conf
> │           │   ├── README
> │           │   ├── config.xml
> │           │   └── svn_external
> │           │       └── include_ptr.conf
> │           │           └── include_ptr.conf
> 
> config.xml:
> <config>
>   <depend>/var/named/chroot/etc/named.conf</depend>
>   <file>
>   <comment_line>// </comment_line>
>     <source>
>       <plain operatingsystem="/RedHat|CentOS/" group="dns-resolver">svn_external/include_ptr.conf/include_ptr.conf</plain>
>     </source>
>   </file>
> </config>
> 
> wordup:var pobrien$ svn status
> X       named/chroot/etc/include_ptr.conf/svn_external/include_ptr.conf
> 
> 
> svn:props are set to pull the latest version of the file, it's fairly clearly marked that the file is being provided by an svn external, and our automation can continue on without me forgetting to update this file.
> 
> So, back to the original question - is this a bad idea or an exceptionally bad idea? I didn't see anything about this documented anywhere on the etch wiki. Is there a better way of doing this?
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with vRanger.
> Installation's a snap, and flexible recovery options mean your data is safe,
> secure and there when you need it. Data protection magic?
> Nope - It's vRanger. Get your free trial download today.
> http://p.sf.net/sfu/quest-sfdev2dev_______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users

[etch-users] using etch + svn externals

From: Pat O'B. <obr...@gm...> - 2011-06-22 16:34:23

Just wanted to run this by the etch-users list to see if this was either a)
a bad idea or b) an exceptionally bad idea.

We have some processes (that some of you will be familiar with) which
automatically updates a bind9 zone's serial and generates PTR zones after
parsing through the forward zones. This is done in an svn repo outside of
etch since we'd rather have the updates go out immediately rather than in
1-4 hours. It also generates two separate files - include_ptr.conf.master
and include_ptr.conf.slave. The master's get this file just fine since when
updates are pushed it just simply does an svn up, but most of the slaves
configs are in etch so the current way of doing this was to just manually
copy over the file whenever we'd need to add a new subnet to DNS. We've
recently added some more subnets (we already have about 200 for a single
datacenter, so why not add some more?) at which point I forgot to update the
file in etch. Oops.

I gave it a few minutes thought and figured I would try out adding this file
as an svn external to etch:

wordup:var pobrien$ tree
.
├── named
│   └── chroot
│       └── etc
│           ├── include_ptr.conf
│           │   ├── README
│           │   ├── config.xml
│           │   └── svn_external
│           │       └── include_ptr.conf
│           │           └── include_ptr.conf

config.xml:
<config>
  <depend>/var/named/chroot/etc/named.conf</depend>
  <file>
  <comment_line>// </comment_line>
    <source>
      <plain operatingsystem="/RedHat|CentOS/"
group="dns-resolver">svn_external/include_ptr.conf/include_ptr.conf</plain>
    </source>
  </file>
</config>

wordup:var pobrien$ svn status
X       named/chroot/etc/include_ptr.conf/svn_external/include_ptr.conf


svn:props are set to pull the latest version of the file, it's fairly
clearly marked that the file is being provided by an svn external, and our
automation can continue on without me forgetting to update this file.

So, back to the original question - is this a bad idea or an exceptionally
bad idea? I didn't see anything about this documented anywhere on the etch
wiki. Is there a better way of doing this?

Re: [etch-users] repeated crashes due to segmentation fault

From: Ian Y. <Ian...@me...> - 2011-06-08 18:39:40

I added 'export xmllib=nokogiri' to the etch startup script and it's been running without interruption since Monday.  So far so good... Thanks!

From: Jason Heiss [mailto:jh...@ap...]
Sent: Monday, June 06, 2011 11:43 AM
To: Ian Young
Cc: etc...@li...
Subject: Re: [etch-users] repeated crashes due to segmentation fault

Are you running with the libxml gem?  That's the default if you have the libxml or libxml-ruby gems installed.

If so try installing the nokogiri gem and set "xmllib=nokogiri" in your environment before starting up mongrel.  Those seg fault crashes are always the libxml gem in my experience.  Using nokogiri for XML parsing will be the default starting in the next etch release.  Nokogiri is newer but seems much better written and tested than the libxml gem.  I and at least one other user on the list have switched our installations to nokogiri and eliminated the seg faults.

Jason

On Jun 6, 2011, at 11:16 AM, Ian Young wrote:

Our Etch cluster has been crashing periodically.  The mongrel log indicates there is a known bug.  Is there a workaround for this?

** Daemonized, any open files are closed.  Look at /var/run/etch-server1.pid and log/mongrel.log for info.
** Starting Mongrel listening at :7070
** Starting Rails with production environment...
/usr/lib64/ruby/gems/1.8/gems/rails-2.3.4/lib/rails/gem_dependency.rb:119:Warning: Gem::Dependency#version_requirements is deprecated and will be removed on or after August 2010.  Use #requirement
** Rails loaded.
** Loading any Rails specific GemPlugins
** Signals ready.  TERM => stop.  USR2 => restart.  INT => stop (no restart).
** Rails signals registered.  HUP => reload (without restart).  It might not work well.
** Mongrel 1.1.5 available at :7070
** Writing PID file to /var/run/etch-server1.pid
/usr/bin/etch-server/lib/etch.rb:176: [BUG] Segmentation fault
ruby 1.8.6 (2008-08-11) [x86_64-linux]
------------------------------------------------------------------------------
Simplify data backup and recovery for your virtual environment with vRanger.
Installation's a snap, and flexible recovery options mean your data is safe,
secure and there when you need it. Discover what all the cheering's about.
Get your free trial download today.
http://p.sf.net/sfu/quest-dev2dev2 _______________________________________________
etch-users mailing list
etc...@li...<mailto:etc...@li...>
https://lists.sourceforge.net/lists/listinfo/etch-users

Re: [etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Jason H. <jh...@ap...> - 2011-06-06 19:21:54

On Jun 6, 2011, at 9:09 AM, Johnston, Nathaniel wrote:

> Jason,
> 
> OK, so I am correct that the functional base of the etch repository is "$etchserverbase/[output of $etchserverbase/nodetagger]/source"?

Yes

> For example, if $etchserverbase was set to /etc/etchserver13 and nodetagger returns "foo" then to configure /etc/motd on a remote node I would set up "/etc/etchserver13/foo/source/etc/motd/"?

Yes

> In the example scenario above, where would the Etch server expect to find nodes.xml?  I believe it would be in the same directory as the "source" subdirectory, i.e. /etc/etchserver13/foo/nodes.xml.

Yes

> However, when I see hosts try to check in, I see log messages like:
> 
> No entry found for node edgenode-02p.internal in nodes.xml
> 
> In nodes.xml there is an entry for this host: 
> 
>        <node name="edgenode-02p.internal">
>                <group> edge_hosts </group>
>        </node>

That's definitely odd.  Double-check the etchdebug.log file and make sure the line like "Using /etc/etchserver/trunk as tagged base for node <blah>" matches up with your expectations.

> Does the etch server drop a log message to indicate whether it got node group association from the nodes.xml or from the nodegrouper script?

Yes, in etchdebug.log (when the client is run with --debug).  You'll get a set of lines that look like the following.  In retrospect the phrase "native groups" isn't super obvious, but those are groups from nodes.xml.

Native groups for node <blah>: 
Added groups for node <blah> due to node group hierarchy: 
Added groups for node <blah> due to external node grouper: 
Total groups for node <blah>:

Re: [etch-users] repeated crashes due to segmentation fault

From: Jason H. <jh...@ap...> - 2011-06-06 18:43:01

Are you running with the libxml gem?  That's the default if you have the libxml or libxml-ruby gems installed.

If so try installing the nokogiri gem and set "xmllib=nokogiri" in your environment before starting up mongrel.  Those seg fault crashes are always the libxml gem in my experience.  Using nokogiri for XML parsing will be the default starting in the next etch release.  Nokogiri is newer but seems much better written and tested than the libxml gem.  I and at least one other user on the list have switched our installations to nokogiri and eliminated the seg faults.

Jason

On Jun 6, 2011, at 11:16 AM, Ian Young wrote:

> Our Etch cluster has been crashing periodically.  The mongrel log indicates there is a known bug.  Is there a workaround for this?
> 
> ** Daemonized, any open files are closed.  Look at /var/run/etch-server1.pid and log/mongrel.log for info.
> ** Starting Mongrel listening at :7070
> ** Starting Rails with production environment...
> /usr/lib64/ruby/gems/1.8/gems/rails-2.3.4/lib/rails/gem_dependency.rb:119:Warning: Gem::Dependency#version_requirements is deprecated and will be removed on or after August 2010.  Use #requirement
> ** Rails loaded.
> ** Loading any Rails specific GemPlugins
> ** Signals ready.  TERM => stop.  USR2 => restart.  INT => stop (no restart).
> ** Rails signals registered.  HUP => reload (without restart).  It might not work well.
> ** Mongrel 1.1.5 available at :7070
> ** Writing PID file to /var/run/etch-server1.pid
> /usr/bin/etch-server/lib/etch.rb:176: [BUG] Segmentation fault
> ruby 1.8.6 (2008-08-11) [x86_64-linux]
> ------------------------------------------------------------------------------
> Simplify data backup and recovery for your virtual environment with vRanger.
> Installation's a snap, and flexible recovery options mean your data is safe,
> secure and there when you need it. Discover what all the cheering's about.
> Get your free trial download today. 
> http://p.sf.net/sfu/quest-dev2dev2 _______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users

[etch-users] repeated crashes due to segmentation fault

From: Ian Y. <Ian...@me...> - 2011-06-06 18:16:12

Our Etch cluster has been crashing periodically.  The mongrel log indicates there is a known bug.  Is there a workaround for this?

** Daemonized, any open files are closed.  Look at /var/run/etch-server1.pid and log/mongrel.log for info.
** Starting Mongrel listening at :7070
** Starting Rails with production environment...
/usr/lib64/ruby/gems/1.8/gems/rails-2.3.4/lib/rails/gem_dependency.rb:119:Warning: Gem::Dependency#version_requirements is deprecated and will be removed on or after August 2010.  Use #requirement
** Rails loaded.
** Loading any Rails specific GemPlugins
** Signals ready.  TERM => stop.  USR2 => restart.  INT => stop (no restart).
** Rails signals registered.  HUP => reload (without restart).  It might not work well.
** Mongrel 1.1.5 available at :7070
** Writing PID file to /var/run/etch-server1.pid
/usr/bin/etch-server/lib/etch.rb:176: [BUG] Segmentation fault
ruby 1.8.6 (2008-08-11) [x86_64-linux]

Re: [etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Johnston, N. <Nat...@ca...> - 2011-06-06 16:10:26

Jason,

OK, so I am correct that the functional base of the etch repository is "$etchserverbase/[output of $etchserverbase/nodetagger]/source"?  For example, if $etchserverbase was set to /etc/etchserver13 and nodetagger returns "foo" then to configure /etc/motd on a remote node I would set up "/etc/etchserver13/foo/source/etc/motd/"?  I apologize for asking the same question again, I just want to make sure I grasp this completely.

In the example scenario above, where would the Etch server expect to find nodes.xml?  I believe it would be in the same directory as the "source" subdirectory, i.e. /etc/etchserver13/foo/nodes.xml.  However, when I see hosts try to check in, I see log messages like:

No entry found for node edgenode-02p.internal in nodes.xml

In nodes.xml there is an entry for this host: 

        <node name="edgenode-02p.internal">
                <group> edge_hosts </group>
        </node>

Does the etch server drop a log message to indicate whether it got node group association from the nodes.xml or from the nodegrouper script?

Thanks again!

--N.

On Jun 3, 2011, at 6:23 PM, Jason Heiss wrote:

> As far as debugging this you can run the client with the --debug flag.  This will show you the XML messages exchanged with the server.  It will also turn on debugging on the server just for that session, causing the server to write debug messages to <etchserver>/log/etchdebug.log
> 
> That said, it looks like your directory structure is not correct.  The etch server looks for the configuration repository in /etc/etchserver/ by default.  You can change that by setting the "etchserverbase" environment variable before starting the server.  The /etc/etchserver directory is generally separate from the directory where you install the etch server itself, although you could certainly install it into a subdirectory of /etc/etchserver if you wanted.
> 
> The directory structure within /etc/etchserver would be what you have under /etch/root in your listing below.  I.e. the nodetagger script, the trunk directory in your case, etc.  In general most or all of /etc/etchserver is expected to come out of your local revision control system.
> 
> Jason
> 
> On Jun 2, 2011, at 2:47 PM, Johnston, Nathaniel wrote:
> 
>> Thanks for your response - the nokogiri library has been rock-solid and very stable.  Now I was wondering if you could help me figure out why the nodegrouping stuff does not seem to be applying correctly to my hosts.
>> 
>> [root@edgenode-03p ~]# etch --list-files
>> Files under management:
>> [root@edgenode-03p ~]#
>> 
>> But I can use etch to fetch files freely.  For example, /etc/issue.net and /etc/motd have already been configured on the host in question.  I have this in nodes.xml:
>> 
>>       <node name="edgenode-03p.internal">
>>               <group> etch_test_hosts </group>
>>       </node>
>> 
>> I do not get an error on the etch server indicating that the host was not found in nodes.xml, so I believe that the values are correct, even if they are not having any effect.  
>> 
>> Perhaps I have my files in the incorrect location.  Given an etch installed in /etch on the etch server, I have the following directory hierarchy for the etch server application, which has evolved by running etch many times and evolving it until I could etch various files and not get big hairy errors.
>> 
>> /etch - root of application, with "app", "config", "public", etc. subdirectories
>> /etch/root 
>> /etch/root/nodegrouper - external script that returns carriage-return-delimited roles for a given FQDN
>> /etch/root/nodetagger - always returns "trunk"
>>   /etch/root/orig - Seems to have been automatically created
>>   /etch/root/trunk 
>>     /etch/root/trunk/commands.dtd
>>     /etch/root/trunk/config.dtd
>>     /etch/root/trunk/defaults.xml
>>     /etch/root/trunk/nodegrouper - symlink to ../nodegrouper
>>     /etch/root/trunk/nodegroups.dtd
>>     /etch/root/trunk/nodegroups.xml
>>     /etch/root/trunk/nodes.xml - has all the same info that nodegrouper would return
>>     /etch/root/trunk/warning.txt
>>     /etch/root/trunk/source
>>       /etch/root/trunk/source/etc
>>         /etch/root/trunk/source/etc/motd
>>           /etch/root/trunk/source/etc/motd/config.xml - see below
>>           /etch/root/trunk/source/etc/motd/motd.template
>> 
>> Here is what the config.xml has - there is nothing in it that would preclude it from getting the motd file:
>> 
>> <config>
>>       <file>
>>               <owner>root</owner>
>>               <group>sys</group>
>>               <perms>644</perms>
>>               <warning_file></warning_file>
>>               <source>
>>                       <template>motd.template</template>
>>               </source>
>>       </file>
>> </config>
>> 
>> So I would expect that I would be able to do "etch --list-files" and be able to get back some kind of output that includes /etc/motd - but it seems that I can not.  What am I doing wrong?
>> 
>> Thanks,
>> 
>> --N.
>

Re: [etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Jason H. <jh...@ap...> - 2011-06-03 22:24:04

As far as debugging this you can run the client with the --debug flag.  This will show you the XML messages exchanged with the server.  It will also turn on debugging on the server just for that session, causing the server to write debug messages to <etchserver>/log/etchdebug.log

That said, it looks like your directory structure is not correct.  The etch server looks for the configuration repository in /etc/etchserver/ by default.  You can change that by setting the "etchserverbase" environment variable before starting the server.  The /etc/etchserver directory is generally separate from the directory where you install the etch server itself, although you could certainly install it into a subdirectory of /etc/etchserver if you wanted.

The directory structure within /etc/etchserver would be what you have under /etch/root in your listing below.  I.e. the nodetagger script, the trunk directory in your case, etc.  In general most or all of /etc/etchserver is expected to come out of your local revision control system.

Jason

On Jun 2, 2011, at 2:47 PM, Johnston, Nathaniel wrote:

> Thanks for your response - the nokogiri library has been rock-solid and very stable.  Now I was wondering if you could help me figure out why the nodegrouping stuff does not seem to be applying correctly to my hosts.
> 
> [root@edgenode-03p ~]# etch --list-files
> Files under management:
> [root@edgenode-03p ~]#
> 
> But I can use etch to fetch files freely.  For example, /etc/issue.net and /etc/motd have already been configured on the host in question.  I have this in nodes.xml:
> 
>        <node name="edgenode-03p.internal">
>                <group> etch_test_hosts </group>
>        </node>
> 
> I do not get an error on the etch server indicating that the host was not found in nodes.xml, so I believe that the values are correct, even if they are not having any effect.  
> 
> Perhaps I have my files in the incorrect location.  Given an etch installed in /etch on the etch server, I have the following directory hierarchy for the etch server application, which has evolved by running etch many times and evolving it until I could etch various files and not get big hairy errors.
> 
> /etch - root of application, with "app", "config", "public", etc. subdirectories
>  /etch/root 
>  /etch/root/nodegrouper - external script that returns carriage-return-delimited roles for a given FQDN
>  /etch/root/nodetagger - always returns "trunk"
>    /etch/root/orig - Seems to have been automatically created
>    /etch/root/trunk 
>      /etch/root/trunk/commands.dtd
>      /etch/root/trunk/config.dtd
>      /etch/root/trunk/defaults.xml
>      /etch/root/trunk/nodegrouper - symlink to ../nodegrouper
>      /etch/root/trunk/nodegroups.dtd
>      /etch/root/trunk/nodegroups.xml
>      /etch/root/trunk/nodes.xml - has all the same info that nodegrouper would return
>      /etch/root/trunk/warning.txt
>      /etch/root/trunk/source
>        /etch/root/trunk/source/etc
>          /etch/root/trunk/source/etc/motd
>            /etch/root/trunk/source/etc/motd/config.xml - see below
>            /etch/root/trunk/source/etc/motd/motd.template
> 
> Here is what the config.xml has - there is nothing in it that would preclude it from getting the motd file:
> 
> <config>
>        <file>
>                <owner>root</owner>
>                <group>sys</group>
>                <perms>644</perms>
>                <warning_file></warning_file>
>                <source>
>                        <template>motd.template</template>
>                </source>
>        </file>
> </config>
> 
> So I would expect that I would be able to do "etch --list-files" and be able to get back some kind of output that includes /etc/motd - but it seems that I can not.  What am I doing wrong?
> 
> Thanks,
> 
> --N.

[etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Johnston, N. <Nat...@ca...> - 2011-06-02 21:47:37

Thanks for your response - the nokogiri library has been rock-solid and very stable.  Now I was wondering if you could help me figure out why the nodegrouping stuff does not seem to be applying correctly to my hosts.

[root@edgenode-03p ~]# etch --list-files
Files under management:
[root@edgenode-03p ~]#

But I can use etch to fetch files freely.  For example, /etc/issue.net and /etc/motd have already been configured on the host in question.  I have this in nodes.xml:

        <node name="edgenode-03p.internal">
                <group> etch_test_hosts </group>
        </node>

I do not get an error on the etch server indicating that the host was not found in nodes.xml, so I believe that the values are correct, even if they are not having any effect.  

Perhaps I have my files in the incorrect location.  Given an etch installed in /etch on the etch server, I have the following directory hierarchy for the etch server application, which has evolved by running etch many times and evolving it until I could etch various files and not get big hairy errors.

/etch - root of application, with "app", "config", "public", etc. subdirectories
  /etch/root 
  /etch/root/nodegrouper - external script that returns carriage-return-delimited roles for a given FQDN
  /etch/root/nodetagger - always returns "trunk"
    /etch/root/orig - Seems to have been automatically created
    /etch/root/trunk 
      /etch/root/trunk/commands.dtd
      /etch/root/trunk/config.dtd
      /etch/root/trunk/defaults.xml
      /etch/root/trunk/nodegrouper - symlink to ../nodegrouper
      /etch/root/trunk/nodegroups.dtd
      /etch/root/trunk/nodegroups.xml
      /etch/root/trunk/nodes.xml - has all the same info that nodegrouper would return
      /etch/root/trunk/warning.txt
      /etch/root/trunk/source
        /etch/root/trunk/source/etc
          /etch/root/trunk/source/etc/motd
            /etch/root/trunk/source/etc/motd/config.xml - see below
            /etch/root/trunk/source/etc/motd/motd.template

Here is what the config.xml has - there is nothing in it that would preclude it from getting the motd file:

<config>
        <file>
                <owner>root</owner>
                <group>sys</group>
                <perms>644</perms>
                <warning_file></warning_file>
                <source>
                        <template>motd.template</template>
                </source>
        </file>
</config>

So I would expect that I would be able to do "etch --list-files" and be able to get back some kind of output that includes /etc/motd - but it seems that I can not.  What am I doing wrong?

Thanks,

--N.

Re: [etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Jason H. <jh...@ap...> - 2011-05-26 18:38:59

We've also seen intermittent segfaults from the libxml gem.  In the 3.19.0 release I added support for the nokogiri XML library.  I'd recommend you try that. Install the nokogiri gem, then set "xmllib=nokogiri" in your shell environment before starting Unicorn.

I plan to make nokogiri the default in an upcoming release as it seems to be more stable than libxml.

Jason

On May 26, 2011, at 10:29 AM, Johnston, Nathaniel wrote:

> An update on this,
> 
> I updated to libxml-ruby-v2.0.6, and now the issue is a little different.  After I start the server, I can serve one request, and then I get a segfault.  I just started up the server, and I run the first request, which is "etch -n --debug /etc/issue.net".  The output on the server is the facter load, and this at the end:
> 
>>   Fact Load (9.6ms)   SELECT * FROM "facts" WHERE ("facts"."client_id" = 1) 
>>   Original Load (0.3ms)   SELECT * FROM "originals" WHERE ("originals"."client_id" = 1 AND "originals"."file" = '/etc/issue.net') LIMIT 1
>>   EtchConfig Load (0.3ms)   SELECT * FROM "etch_configs" WHERE ("etch_configs"."client_id" = 1 AND "etch_configs"."file" = '/etc/issue.net') LIMIT 1
>> Completed in 873ms (View: 1, DB: 40) | 200 OK [http://etch.sys.comcast.net/files]
> 
> 
> Here is what the client sees, after the big hash of facts:
> 
>> Response from server:
>> '<?xml version="1.0" encoding="UTF-8"?>
>> <files>
>>   <configs>
>>     <config filename="/etc/issue.net">
>>         <file>
>>                 <!--
>>                         By default files will be owned by root,
>>                         but you can change that.  If this user or
>>                         group doesn't exist UID 0 and GID 0 will
>>                         be used as a faillback.
>>                   -->
>>                 <owner>root</owner>
>>                 <group>sys</group>
>>                 <perms>644</perms>
>> 
>>                 
>>         <contents>KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq
>> KioqKioqKioqKioKV0FSTklORzoKICAgIAogIFRoaXMgc3lzdGVtICBpcyBz
>> b2xlbHkgZm9yICB0aGUgdXNlIG9mIGF1dGhvcml6ZWQgIENvbWNhc3QgZW1w
>> bG95ZWVzCiAgYW5kIGNvbnRyYWN0b3JzLgogICAgCiAgQ29tY2FzdCAgcmVz
>> ZXJ2ZXMgdGhlIHJpZ2h0ICBhdCBhbnkgIHRpbWUgdG8gIG1vbml0b3IgdXNh
>> Z2UgIG9mIHRoaXMKICBzeXN0ZW0gdG8gZW5zdXJlIGNvbXBsaWFuY2Ugd2l0
>> aCB0aGlzIHBvbGljeSwgYWxsIGFwcGxpY2FibGUgQ29tY2FzdAogIHBvbGlj
>> aWVzIHRoYXQgYXBwbHkgdG8gZWxlY3Ryb25pYyBjb21tdW5pY2F0aW9ucywg
>> YW5kIGFsbCBhcHBsaWNhYmxlCiAgbGF3cy4KICAgIAogIFlvdXIgdXNlIG9m
>> IHRoaXMgc3lzdGVtIGNvbnN0aXR1dGVzIHlvdXIgYWNjZXB0YW5jZSBvZiBh
>> bmQgYWdyZWVtZW50CiAgdG8gYWxsICBhcHBsaWNhYmxlIENvbWNhc3QgZWxl
>> Y3Ryb25pYyAgY29tbXVuaWNhdGlvbnMgcG9saWNpZXMsIHlvdXIKICBjb25z
>> ZW50IHRvIG1vbml0b3JpbmcgYnkgQ29tY2FzdCwgIGFuZCB5b3VyIGV4cHJl
>> c3MgYWdyZWVtZW50IHRvIHVzZQogIHRoaXMgc3lzdGVtIGluIGNvbXBsaWFu
>> Y2Ugd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLgogICAgCiAgQW55IHVuYXV0
>> aG9yaXplZCAgdXNlIG9mIG9yICBhY2Nlc3MgdG8gdGhpcyAgc3lzdGVtIG1h
>> eSByZXN1bHQgIGluIGEKICByZXZvY2F0aW9uIG9mIHlvdXIgdXNlciAgcHJp
>> dmlsZWdlcywgb3RoZXIgZGlzY2lwbGluYXJ5IGFjdGlvbiB1cCB0bwogIGFu
>> ZCBpbmNsdWRpbmcgdGVybWluYXRpb24gb2YgZW1wbG95bWVudCBvciBjb250
>> cmFjdCwgb3IgcmVmZXJyYWxzIHRvCiAgbGF3IGVuZm9yY2VtZW50ICBvZmZp
>> Y2lhbHMgaW5jbHVkaW5nICB0aGUgcHJvdmlzaW9uIGV2aWRlbmNlICBvZiBh
>> bnkKICB1bmF1dGhvcml6ZWQgdXNlIG9yIGFjY2VzcyB0byBsYXcgZW5mb3Jj
>> ZW1lbnQuCioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq
>> KioqKioqKioqKioqKioqKioqKioqKioqIAoK
>> </contents></file>
>> </config>
>>   </configs>
>>   <allcommands/>
>>   <retrycommands/>
>> </files>
>> '
>> Processing config for /etc/issue.net
>> Processing /etc/issue.net
>> No change to /etc/issue.net necessary
> 
> 
> Then I run the same command again exactly as before.  Here is what the server logs see:
> 
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/libxml-ruby-2.0.6/lib/libxml/node.rb:61: [BUG] Segmentation fault
>> ruby 1.8.7 (2011-02-18 patchlevel 334) [x86_64-linux], MBARI 0x6770, Ruby Enterprise Edition 2011.03
>> 
>> E, [2011-05-26T17:26:34.509706 #2212] ERROR -- : reaped #<Process::Status: pid=2213,signaled(SIGIOT=6)> worker=0
>> Exception `Errno::ECHILD' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:401 - No child processes
>> I, [2011-05-26T17:26:34.509984 #2212]  INFO -- : worker=0 spawning...
> 
> 
> Here is what the client sees, after the hash of facts:
> 
>> end of file reached
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:135:in `sysread'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:135:in `rbuf_fill'
>> /opt/comcast/platform/etch/lib/ruby/1.8/timeout.rb:67:in `timeout'
>> /opt/comcast/platform/etch/lib/ruby/1.8/timeout.rb:101:in `timeout'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:134:in `rbuf_fill'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:116:in `readuntil'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:126:in `readline'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:2028:in `read_status_line'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:2017:in `read_new'
>> /opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:1051:in `request'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:339:in `process_until_done'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:312:in `times'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:312:in `process_until_done'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:240:in `catch'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:240:in `process_until_done'
>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/bin/etch:109
>> /opt/comcast/etch/bin/etch:19:in `load'
>> /opt/comcast/etch/bin/etch:19
> 
> 
> So, what can I do from here?
> 
> Thanks,
> 
> --N.
> 
> 
> 
> On May 25, 2011, at 3:16 PM, Johnston, Nathaniel wrote:
> 
>> EtchMen,
>> 
>> I am having an issue where I see the Etch server segfaulting each time I try and run Etch, even if I use the --list-files or the --dry-run methods.  Here's how it happens.  First, I start up the Etch server.  Here is what it outputs on startup:
>> 
>>> # unicorn_rails -d -p 38240 
>>> {:daemonize=>false,
>>>  :app=>
>>>   #<Proc:0x000000000eaf56c8@/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/bin/unicorn_rails:135>,
>>>  :unicorn_options=>{:listeners=>[]}}
>>> Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/cache
>>> Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/pids
>>> Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sessions
>>> Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sockets
>>> I, [2011-05-25T19:11:33.677699 #19746]  INFO -- : listening on addr=0.0.0.0:38240 fd=3
>>> I, [2011-05-25T19:11:33.677935 #19746]  INFO -- : worker=0 spawning...
>>> I, [2011-05-25T19:11:33.678549 #19746]  INFO -- : master process ready
>>> Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
>>> I, [2011-05-25T19:11:33.679040 #19747]  INFO -- : worker=0 spawned pid=19747
>>> I, [2011-05-25T19:11:33.679169 #19747]  INFO -- : Refreshing Gem list
>>> Exception `NoMethodError' at /opt/comcast/platform/etch/lib/ruby/1.8/rational.rb:82 - undefined method `gcd' for Rational(1, 2):Rational
>>> Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:274 - can't activate activerecord (~> 2.3.11, runtime) for ["searchlogic-2.5.6"], already activated activerecord-2.3.8 for ["rails-2.3.8"]
>>> Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - RubyGem version error: builder(3.0.0 not ~> 2.1.2)
>>> 
>>> Exception `TypeError' at (eval):4 - can't modify frozen object
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- fast_xs
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- json
>>> Using Ext extension for JSON.
>>> Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - Could not find RubyGem activerecord-sqlite3-adapter (>= 0)
>>> 
>>> Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:443 - uninitialized constant ActionDispatch
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- ruby-debug
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- classtree
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- classtree
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- classtree
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- methodsig
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- methodsig
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- methodsig
>>> => Debugger enabled
>>> worker=0 ready
>> 
>> 
>> I run a simple command on the etch client, which seems to bomb, although the error messaging is enigmatic:
>> 
>>> [root@jumphst-ch-2p tmp]# etch /etc/yum.conf
>>> Saving temporary copy of original file:  /etc/yum.conf -> /var/etch/orig/etc/yum.conf.TMP
>>> 1 block
>>> end of file reached
>> 
>> 
>> Etch server segfaults.  Here is what it says, although I cut the output off for brevity when it was restating messages from the startup block of logs, above.
>> 
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- sqlite3
>>> Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- libxml
>>> /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/libxml-ruby-1.1.2/lib/libxml/node.rb:57: [BUG] Segmentation fault
>>> ruby 1.8.7 (2011-02-18 patchlevel 334) [x86_64-linux], MBARI 0x6770, Ruby Enterprise Edition 2011.03
>>> 
>>> E, [2011-05-25T19:12:23.940838 #19746] ERROR -- : reaped #<Process::Status: pid=19756,signaled(SIGIOT=6)> worker=0
>>> Exception `Errno::ECHILD' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:401 - No child processes
>>> I, [2011-05-25T19:12:23.941145 #19746]  INFO -- : worker=0 spawning...
>>> Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
>>> I, [2011-05-25T19:12:23.942207 #19758]  INFO -- : worker=0 spawned pid=19758
>>> I, [2011-05-25T19:12:23.942324 #19758]  INFO -- : Refreshing Gem list
>> 
>> 
>> Here is the output of `gem list --local`:
>> 
>>> *** LOCAL GEMS ***
>>> 
>>> actionmailer (2.3.8)
>>> actionpack (2.3.8)
>>> activerecord (2.3.11, 2.3.8)
>>> activeresource (2.3.8)
>>> activesupport (2.3.11, 2.3.8)
>>> builder (3.0.0)
>>> bundler (1.0.13)
>>> columnize (0.3.2)
>>> etch (3.19.0)
>>> facter (1.5.8)
>>> fast_xs (0.8.0)
>>> gem2rpm (0.6.0)
>>> i18n (0.6.0)
>>> json (1.5.1)
>>> kgio (2.4.0)
>>> libxml-ruby (1.1.2)
>>> linecache (0.43)
>>> memcache-client (1.8.5)
>>> nokogiri (1.4.4)
>>> rack (1.1.2)
>>> rails (2.3.8)
>>> rake (0.8.7)
>>> ruby-debug (0.10.4)
>>> ruby-debug-base (0.10.4)
>>> searchlogic (2.5.6)
>>> sqlite3-ruby (1.2.5)
>>> tmail (1.2.7.1)
>>> tzinfo (0.3.27)
>>> unicorn (3.6.2)
>>> will_paginate (2.3.15)
>> 
>> 
>> --N.
>> ------------------------------------------------------------------------------
>> vRanger cuts backup time in half-while increasing security.
>> With the market-leading solution for virtual backup and recovery, 
>> you get blazing-fast, flexible, and affordable data protection.
>> Download your free trial now. 
>> http://p.sf.net/sfu/quest-d2dcopy1_______________________________________________
>> etch-users mailing list
>> etc...@li...
>> https://lists.sourceforge.net/lists/listinfo/etch-users
> 
> 
> ------------------------------------------------------------------------------
> vRanger cuts backup time in half-while increasing security.
> With the market-leading solution for virtual backup and recovery, 
> you get blazing-fast, flexible, and affordable data protection.
> Download your free trial now. 
> http://p.sf.net/sfu/quest-d2dcopy1_______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users

Re: [etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Johnston, N. <Nat...@ca...> - 2011-05-26 17:29:55

An update on this,

I updated to libxml-ruby-v2.0.6, and now the issue is a little different.  After I start the server, I can serve one request, and then I get a segfault.  I just started up the server, and I run the first request, which is "etch -n --debug /etc/issue.net".  The output on the server is the facter load, and this at the end:

  Fact Load (9.6ms)   SELECT * FROM "facts" WHERE ("facts"."client_id" = 1)
  Original Load (0.3ms)   SELECT * FROM "originals" WHERE ("originals"."client_id" = 1 AND "originals"."file" = '/etc/issue.net') LIMIT 1
  EtchConfig Load (0.3ms)   SELECT * FROM "etch_configs" WHERE ("etch_configs"."client_id" = 1 AND "etch_configs"."file" = '/etc/issue.net') LIMIT 1
Completed in 873ms (View: 1, DB: 40) | 200 OK [http://etch.sys.comcast.net/files]

Here is what the client sees, after the big hash of facts:

Response from server:
'<?xml version="1.0" encoding="UTF-8"?>
<files>
  <configs>
    <config filename="/etc/issue.net">
        <file>
                <!--
                        By default files will be owned by root,
                        but you can change that.  If this user or
                        group doesn't exist UID 0 and GID 0 will
                        be used as a faillback.
                  -->
                <owner>root</owner>
                <group>sys</group>
                <perms>644</perms>


        <contents>KioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq
KioqKioqKioqKioKV0FSTklORzoKICAgIAogIFRoaXMgc3lzdGVtICBpcyBz
b2xlbHkgZm9yICB0aGUgdXNlIG9mIGF1dGhvcml6ZWQgIENvbWNhc3QgZW1w
bG95ZWVzCiAgYW5kIGNvbnRyYWN0b3JzLgogICAgCiAgQ29tY2FzdCAgcmVz
ZXJ2ZXMgdGhlIHJpZ2h0ICBhdCBhbnkgIHRpbWUgdG8gIG1vbml0b3IgdXNh
Z2UgIG9mIHRoaXMKICBzeXN0ZW0gdG8gZW5zdXJlIGNvbXBsaWFuY2Ugd2l0
aCB0aGlzIHBvbGljeSwgYWxsIGFwcGxpY2FibGUgQ29tY2FzdAogIHBvbGlj
aWVzIHRoYXQgYXBwbHkgdG8gZWxlY3Ryb25pYyBjb21tdW5pY2F0aW9ucywg
YW5kIGFsbCBhcHBsaWNhYmxlCiAgbGF3cy4KICAgIAogIFlvdXIgdXNlIG9m
IHRoaXMgc3lzdGVtIGNvbnN0aXR1dGVzIHlvdXIgYWNjZXB0YW5jZSBvZiBh
bmQgYWdyZWVtZW50CiAgdG8gYWxsICBhcHBsaWNhYmxlIENvbWNhc3QgZWxl
Y3Ryb25pYyAgY29tbXVuaWNhdGlvbnMgcG9saWNpZXMsIHlvdXIKICBjb25z
ZW50IHRvIG1vbml0b3JpbmcgYnkgQ29tY2FzdCwgIGFuZCB5b3VyIGV4cHJl
c3MgYWdyZWVtZW50IHRvIHVzZQogIHRoaXMgc3lzdGVtIGluIGNvbXBsaWFu
Y2Ugd2l0aCBhbGwgYXBwbGljYWJsZSBsYXdzLgogICAgCiAgQW55IHVuYXV0
aG9yaXplZCAgdXNlIG9mIG9yICBhY2Nlc3MgdG8gdGhpcyAgc3lzdGVtIG1h
eSByZXN1bHQgIGluIGEKICByZXZvY2F0aW9uIG9mIHlvdXIgdXNlciAgcHJp
dmlsZWdlcywgb3RoZXIgZGlzY2lwbGluYXJ5IGFjdGlvbiB1cCB0bwogIGFu
ZCBpbmNsdWRpbmcgdGVybWluYXRpb24gb2YgZW1wbG95bWVudCBvciBjb250
cmFjdCwgb3IgcmVmZXJyYWxzIHRvCiAgbGF3IGVuZm9yY2VtZW50ICBvZmZp
Y2lhbHMgaW5jbHVkaW5nICB0aGUgcHJvdmlzaW9uIGV2aWRlbmNlICBvZiBh
bnkKICB1bmF1dGhvcml6ZWQgdXNlIG9yIGFjY2VzcyB0byBsYXcgZW5mb3Jj
ZW1lbnQuCioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioqKioq
KioqKioqKioqKioqKioqKioqKioqKioqIAoK
</contents></file>
</config>
  </configs>
  <allcommands/>
  <retrycommands/>
</files>
'
Processing config for /etc/issue.net
Processing /etc/issue.net
No change to /etc/issue.net necessary

Then I run the same command again exactly as before.  Here is what the server logs see:

/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/libxml-ruby-2.0.6/lib/libxml/node.rb:61: [BUG] Segmentation fault
ruby 1.8.7 (2011-02-18 patchlevel 334) [x86_64-linux], MBARI 0x6770, Ruby Enterprise Edition 2011.03

E, [2011-05-26T17:26:34.509706 #2212] ERROR -- : reaped #<Process::Status: pid=2213,signaled(SIGIOT=6)> worker=0
Exception `Errno::ECHILD' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:401 - No child processes
I, [2011-05-26T17:26:34.509984 #2212]  INFO -- : worker=0 spawning...

Here is what the client sees, after the hash of facts:

end of file reached
/opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:135:in `sysread'
/opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:135:in `rbuf_fill'
/opt/comcast/platform/etch/lib/ruby/1.8/timeout.rb:67:in `timeout'
/opt/comcast/platform/etch/lib/ruby/1.8/timeout.rb:101:in `timeout'
/opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:134:in `rbuf_fill'
/opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:116:in `readuntil'
/opt/comcast/platform/etch/lib/ruby/1.8/net/protocol.rb:126:in `readline'
/opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:2028:in `read_status_line'
/opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:2017:in `read_new'
/opt/comcast/platform/etch/lib/ruby/1.8/net/http.rb:1051:in `request'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:339:in `process_until_done'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:312:in `times'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:312:in `process_until_done'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:240:in `catch'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/lib/etchclient.rb:240:in `process_until_done'
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/etch-3.19.0/bin/etch:109
/opt/comcast/etch/bin/etch:19:in `load'
/opt/comcast/etch/bin/etch:19

So, what can I do from here?

Thanks,

--N.



On May 25, 2011, at 3:16 PM, Johnston, Nathaniel wrote:

EtchMen,

I am having an issue where I see the Etch server segfaulting each time I try and run Etch, even if I use the --list-files or the --dry-run methods.  Here's how it happens.  First, I start up the Etch server.  Here is what it outputs on startup:

# unicorn_rails -d -p 38240
{:daemonize=>false,
 :app=>
  #<Proc:0x000000000eaf56c8@/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/bin/unicorn_rails:135>,
 :unicorn_options=>{:listeners=>[]}}
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/cache
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/pids
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sessions
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sockets
I, [2011-05-25T19:11:33.677699 #19746]  INFO -- : listening on addr=0.0.0.0:38240 fd=3
I, [2011-05-25T19:11:33.677935 #19746]  INFO -- : worker=0 spawning...
I, [2011-05-25T19:11:33.678549 #19746]  INFO -- : master process ready
Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
I, [2011-05-25T19:11:33.679040 #19747]  INFO -- : worker=0 spawned pid=19747
I, [2011-05-25T19:11:33.679169 #19747]  INFO -- : Refreshing Gem list
Exception `NoMethodError' at /opt/comcast/platform/etch/lib/ruby/1.8/rational.rb:82 - undefined method `gcd' for Rational(1, 2):Rational
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:274 - can't activate activerecord (~> 2.3.11, runtime) for ["searchlogic-2.5.6"], already activated activerecord-2.3.8 for ["rails-2.3.8"]
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - RubyGem version error: builder(3.0.0 not ~> 2.1.2)

Exception `TypeError' at (eval):4 - can't modify frozen object
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- fast_xs
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- json
Using Ext extension for JSON.
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - Could not find RubyGem activerecord-sqlite3-adapter (>= 0)

Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:443 - uninitialized constant ActionDispatch
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- ruby-debug
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- methodsig
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- methodsig
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- methodsig
=> Debugger enabled
worker=0 ready

I run a simple command on the etch client, which seems to bomb, although the error messaging is enigmatic:

[root@jumphst-ch-2p tmp]# etch /etc/yum.conf
Saving temporary copy of original file:  /etc/yum.conf -> /var/etch/orig/etc/yum.conf.TMP
1 block
end of file reached

Etch server segfaults.  Here is what it says, although I cut the output off for brevity when it was restating messages from the startup block of logs, above.

Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- sqlite3
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- libxml
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/libxml-ruby-1.1.2/lib/libxml/node.rb:57: [BUG] Segmentation fault
ruby 1.8.7 (2011-02-18 patchlevel 334) [x86_64-linux], MBARI 0x6770, Ruby Enterprise Edition 2011.03

E, [2011-05-25T19:12:23.940838 #19746] ERROR -- : reaped #<Process::Status: pid=19756,signaled(SIGIOT=6)> worker=0
Exception `Errno::ECHILD' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:401 - No child processes
I, [2011-05-25T19:12:23.941145 #19746]  INFO -- : worker=0 spawning...
Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
I, [2011-05-25T19:12:23.942207 #19758]  INFO -- : worker=0 spawned pid=19758
I, [2011-05-25T19:12:23.942324 #19758]  INFO -- : Refreshing Gem list

Here is the output of `gem list --local`:

*** LOCAL GEMS ***

actionmailer (2.3.8)
actionpack (2.3.8)
activerecord (2.3.11, 2.3.8)
activeresource (2.3.8)
activesupport (2.3.11, 2.3.8)
builder (3.0.0)
bundler (1.0.13)
columnize (0.3.2)
etch (3.19.0)
facter (1.5.8)
fast_xs (0.8.0)
gem2rpm (0.6.0)
i18n (0.6.0)
json (1.5.1)
kgio (2.4.0)
libxml-ruby (1.1.2)
linecache (0.43)
memcache-client (1.8.5)
nokogiri (1.4.4)
rack (1.1.2)
rails (2.3.8)
rake (0.8.7)
ruby-debug (0.10.4)
ruby-debug-base (0.10.4)
searchlogic (2.5.6)
sqlite3-ruby (1.2.5)
tmail (1.2.7.1)
tzinfo (0.3.27)
unicorn (3.6.2)
will_paginate (2.3.15)

--N.
------------------------------------------------------------------------------
vRanger cuts backup time in half-while increasing security.
With the market-leading solution for virtual backup and recovery,
you get blazing-fast, flexible, and affordable data protection.
Download your free trial now.
http://p.sf.net/sfu/quest-d2dcopy1_______________________________________________
etch-users mailing list
etc...@li...
https://lists.sourceforge.net/lists/listinfo/etch-users

[etch-users] How can I debug what happens on Etch server when a client does --list-files

From: Johnston, N. <Nat...@ca...> - 2011-05-25 19:16:17

EtchMen,

I am having an issue where I see the Etch server segfaulting each time I try and run Etch, even if I use the --list-files or the --dry-run methods.  Here's how it happens.  First, I start up the Etch server.  Here is what it outputs on startup:

# unicorn_rails -d -p 38240
{:daemonize=>false,
 :app=>
  #<Proc:0x000000000eaf56c8@/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/bin/unicorn_rails:135>,
 :unicorn_options=>{:listeners=>[]}}
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/cache
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/pids
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sessions
Exception `Errno::EEXIST' at /opt/comcast/platform/etch/lib/ruby/1.8/fileutils.rb:243 - File exists - tmp/sockets
I, [2011-05-25T19:11:33.677699 #19746]  INFO -- : listening on addr=0.0.0.0:38240 fd=3
I, [2011-05-25T19:11:33.677935 #19746]  INFO -- : worker=0 spawning...
I, [2011-05-25T19:11:33.678549 #19746]  INFO -- : master process ready
Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
I, [2011-05-25T19:11:33.679040 #19747]  INFO -- : worker=0 spawned pid=19747
I, [2011-05-25T19:11:33.679169 #19747]  INFO -- : Refreshing Gem list
Exception `NoMethodError' at /opt/comcast/platform/etch/lib/ruby/1.8/rational.rb:82 - undefined method `gcd' for Rational(1, 2):Rational
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:274 - can't activate activerecord (~> 2.3.11, runtime) for ["searchlogic-2.5.6"], already activated activerecord-2.3.8 for ["rails-2.3.8"]
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - RubyGem version error: builder(3.0.0 not ~> 2.1.2)

Exception `TypeError' at (eval):4 - can't modify frozen object
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- fast_xs
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- json
Using Ext extension for JSON.
Exception `Gem::LoadError' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems.rb:861 - Could not find RubyGem activerecord-sqlite3-adapter (>= 0)

Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:443 - uninitialized constant ActionDispatch
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- ruby-debug
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- classtree
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- methodsig
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:35 - no such file to load -- methodsig
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/activesupport-2.3.8/lib/active_support/dependencies.rb:162 - no such file to load -- methodsig
=> Debugger enabled
worker=0 ready

I run a simple command on the etch client, which seems to bomb, although the error messaging is enigmatic:

[root@jumphst-ch-2p tmp]# etch /etc/yum.conf
Saving temporary copy of original file:  /etc/yum.conf -> /var/etch/orig/etc/yum.conf.TMP
1 block
end of file reached

Etch server segfaults.  Here is what it says, although I cut the output off for brevity when it was restating messages from the startup block of logs, above.

Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- sqlite3
Exception `MissingSourceFile' at /opt/comcast/platform/etch/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:29 - no such file to load -- libxml
/opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/libxml-ruby-1.1.2/lib/libxml/node.rb:57: [BUG] Segmentation fault
ruby 1.8.7 (2011-02-18 patchlevel 334) [x86_64-linux], MBARI 0x6770, Ruby Enterprise Edition 2011.03

E, [2011-05-25T19:12:23.940838 #19746] ERROR -- : reaped #<Process::Status: pid=19756,signaled(SIGIOT=6)> worker=0
Exception `Errno::ECHILD' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:401 - No child processes
I, [2011-05-25T19:12:23.941145 #19746]  INFO -- : worker=0 spawning...
Exception `NameError' at /opt/comcast/platform/etch/lib/ruby/gems/1.8/gems/unicorn-3.6.2/lib/unicorn/http_server.rb:499 - uninitialized constant Unicorn::HttpServer::OpenSSL
I, [2011-05-25T19:12:23.942207 #19758]  INFO -- : worker=0 spawned pid=19758
I, [2011-05-25T19:12:23.942324 #19758]  INFO -- : Refreshing Gem list

Here is the output of `gem list --local`:

*** LOCAL GEMS ***

actionmailer (2.3.8)
actionpack (2.3.8)
activerecord (2.3.11, 2.3.8)
activeresource (2.3.8)
activesupport (2.3.11, 2.3.8)
builder (3.0.0)
bundler (1.0.13)
columnize (0.3.2)
etch (3.19.0)
facter (1.5.8)
fast_xs (0.8.0)
gem2rpm (0.6.0)
i18n (0.6.0)
json (1.5.1)
kgio (2.4.0)
libxml-ruby (1.1.2)
linecache (0.43)
memcache-client (1.8.5)
nokogiri (1.4.4)
rack (1.1.2)
rails (2.3.8)
rake (0.8.7)
ruby-debug (0.10.4)
ruby-debug-base (0.10.4)
searchlogic (2.5.6)
sqlite3-ruby (1.2.5)
tmail (1.2.7.1)
tzinfo (0.3.27)
unicorn (3.6.2)
will_paginate (2.3.15)

--N.

Re: [etch-users] <dependcommand></dependcommand>

From: Gareth G. <gar...@gm...> - 2011-05-19 19:00:26

Thanks very much Pat, yea that does work.
Glad to be of help Jason, I am really liking etch a lot ;)

Gareth

On Thu, May 19, 2011 at 6:54 PM, Jason Heiss <jh...@ap...> wrote:

> Whoops, good catch on the etchserver-{demo,samples} DTD files being out of
> date.  The copies within test/testrepo/ in the distribution tarball are
> correct and I've updated the others in subversion for future releases.
>
> Etch uses cpio extensively to move files around while preserving
> permissions, ownership, etc.  In order to use etch you'll need cpio
> installed on your clients before etch can do much of anything.
>
> Typically this would be done by having it as a dependency of the etch
> package (rpm, deb, etc.)  However your question led me to notice that it
> wasn't listed as a dependency in the packaging files included in the
> distribution.  On all of our Red Hat and Debian boxes cpio was installed as
> part of the base installation and I hadn't thought about cases where folks
> excluded it.  I've added cpio as an explicit dependency for the RPM spec and
> Debian control files.
>
> Jason
>
> On May 19, 2011, at 4:48 AM, Gareth Greener wrote:
>
> Hi there,
>
> I am in the process of moving from cfengine to etch but hitting a little
> snag.
> I noticed that the dependcommand is not allowed by default, so I edited the
> config.dtd to allow it, following the same syntax as depend.
>
> I have also created the relevant files and folders under commands for cpio
> to be installed.
>
> The problem I am having is that there are files that exist on my clients,
> however the cpio command is not installed so I am calling it with the
> <dependcommand> tags, but etch seems to ignore that if the file already
> exists on the client.
>
>
> Config.xml
> ----------------
> <config>
> <dependcommand>cpio</dependcommand>
>         <file>
>  <perms>644</perms>
>                 <source>
>                         <script>scriptfile.script</script>
>                 </source>
>         </file>
>         <post>
>                 <exec>/etc/init.d/ssh restart</exec>
>         </post>
> </config>
>
>
> Commands.xml
> -----------------------
> <commands>
>   <step>
>     <guard>
>       <exec>test -f /bin/cpio</exec>
>     </guard>
>     <command>
>       <exec>apt-get update &amp;&amp; apt-get -qq install cpio</exec>
>     </command>
>   </step>
> </commands>
>
>
> And I get the following error:
>
> Saving temporary copy of original file:  /etc/ssh/sshd_config ->
> /var/etch/orig/etc/ssh/sshd_config.TMP
> sh: cpio: not found
> Recursive copy /etc/ssh/sshd_config to
> /var/etch/orig/etc/ssh/sshd_config.TMP20110519-7810-ckicl4-0 failed
>
> -------------------------------
> Thanks for your time.
>
> Gareth
>
>
>

Re: [etch-users] <dependcommand></dependcommand>

From: Jason H. <jh...@ap...> - 2011-05-19 17:55:10

Whoops, good catch on the etchserver-{demo,samples} DTD files being out of date.  The copies within test/testrepo/ in the distribution tarball are correct and I've updated the others in subversion for future releases.

Etch uses cpio extensively to move files around while preserving permissions, ownership, etc.  In order to use etch you'll need cpio installed on your clients before etch can do much of anything.

Typically this would be done by having it as a dependency of the etch package (rpm, deb, etc.)  However your question led me to notice that it wasn't listed as a dependency in the packaging files included in the distribution.  On all of our Red Hat and Debian boxes cpio was installed as part of the base installation and I hadn't thought about cases where folks excluded it.  I've added cpio as an explicit dependency for the RPM spec and Debian control files.

Jason

On May 19, 2011, at 4:48 AM, Gareth Greener wrote:

> Hi there,
> 
> I am in the process of moving from cfengine to etch but hitting a little snag.
> I noticed that the dependcommand is not allowed by default, so I edited the config.dtd to allow it, following the same syntax as depend.
> 
> I have also created the relevant files and folders under commands for cpio to be installed.
> 
> The problem I am having is that there are files that exist on my clients, however the cpio command is not installed so I am calling it with the <dependcommand> tags, but etch seems to ignore that if the file already exists on the client.
> 
> 
> Config.xml
> ----------------
> <config>
> 	<dependcommand>cpio</dependcommand>
>         <file>
> 		<perms>644</perms>
>                 <source>
>                         <script>scriptfile.script</script>
>                 </source>
>         </file>
>         <post>
>                 <exec>/etc/init.d/ssh restart</exec>
>         </post>
> </config>
> 
> 
> Commands.xml
> -----------------------
> <commands>
>   <step>
>     <guard>
>       <exec>test -f /bin/cpio</exec>
>     </guard>
>     <command>
>       <exec>apt-get update &amp;&amp; apt-get -qq install cpio</exec>
>     </command>
>   </step>
> </commands>
> 
> 
> And I get the following error:
> 
> Saving temporary copy of original file:  /etc/ssh/sshd_config -> /var/etch/orig/etc/ssh/sshd_config.TMP
> sh: cpio: not found
> Recursive copy /etc/ssh/sshd_config to /var/etch/orig/etc/ssh/sshd_config.TMP20110519-7810-ckicl4-0 failed
> 
> -------------------------------
> Thanks for your time.
> 
> Gareth
>

Re: [etch-users] <dependcommand></dependcommand>

From: Pat O'B. <obr...@gm...> - 2011-05-19 17:44:05

I would do this:

<config>
  <pre>
    <exec>your command here</exec>
  </pre>
...
</config>

Does that work?

-pat

On Thu, May 19, 2011 at 4:48 AM, Gareth Greener <gar...@gm...>wrote:

> Hi there,
>
> I am in the process of moving from cfengine to etch but hitting a little
> snag.
> I noticed that the dependcommand is not allowed by default, so I edited the
> config.dtd to allow it, following the same syntax as depend.
>
> I have also created the relevant files and folders under commands for cpio
> to be installed.
>
> The problem I am having is that there are files that exist on my clients,
> however the cpio command is not installed so I am calling it with the
> <dependcommand> tags, but etch seems to ignore that if the file already
> exists on the client.
>
>
> Config.xml
> ----------------
> <config>
> <dependcommand>cpio</dependcommand>
>         <file>
>  <perms>644</perms>
>                 <source>
>                         <script>scriptfile.script</script>
>                 </source>
>         </file>
>         <post>
>                 <exec>/etc/init.d/ssh restart</exec>
>         </post>
> </config>
>
>
> Commands.xml
> -----------------------
> <commands>
>   <step>
>     <guard>
>       <exec>test -f /bin/cpio</exec>
>     </guard>
>     <command>
>       <exec>apt-get update &amp;&amp; apt-get -qq install cpio</exec>
>     </command>
>   </step>
> </commands>
>
>
> And I get the following error:
>
> Saving temporary copy of original file:  /etc/ssh/sshd_config ->
> /var/etch/orig/etc/ssh/sshd_config.TMP
> sh: cpio: not found
> Recursive copy /etc/ssh/sshd_config to
> /var/etch/orig/etc/ssh/sshd_config.TMP20110519-7810-ckicl4-0 failed
>
> -------------------------------
> Thanks for your time.
>
> Gareth
>
>
>
> ------------------------------------------------------------------------------
> What Every C/C++ and Fortran developer Should Know!
> Read this article and learn how Intel has extended the reach of its
> next-generation tools to help Windows* and Linux* C/C++ and Fortran
> developers boost performance applications - including clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users
>
>

[etch-users] <dependcommand></dependcommand>

From: Gareth G. <gar...@gm...> - 2011-05-19 11:48:05

Hi there,

I am in the process of moving from cfengine to etch but hitting a little
snag.
I noticed that the dependcommand is not allowed by default, so I edited the
config.dtd to allow it, following the same syntax as depend.

I have also created the relevant files and folders under commands for cpio
to be installed.

The problem I am having is that there are files that exist on my clients,
however the cpio command is not installed so I am calling it with the
<dependcommand> tags, but etch seems to ignore that if the file already
exists on the client.


Config.xml
----------------
<config>
<dependcommand>cpio</dependcommand>
        <file>
<perms>644</perms>
                <source>
                        <script>scriptfile.script</script>
                </source>
        </file>
        <post>
                <exec>/etc/init.d/ssh restart</exec>
        </post>
</config>


Commands.xml
-----------------------
<commands>
  <step>
    <guard>
      <exec>test -f /bin/cpio</exec>
    </guard>
    <command>
      <exec>apt-get update &amp;&amp; apt-get -qq install cpio</exec>
    </command>
  </step>
</commands>


And I get the following error:

Saving temporary copy of original file:  /etc/ssh/sshd_config ->
/var/etch/orig/etc/ssh/sshd_config.TMP
sh: cpio: not found
Recursive copy /etc/ssh/sshd_config to
/var/etch/orig/etc/ssh/sshd_config.TMP20110519-7810-ckicl4-0 failed

-------------------------------
Thanks for your time.

Gareth

Re: [etch-users] undefined method `name' for "actionmailer":String

From: Spyda <web...@gm...> - 2011-05-17 08:53:00

Thanks a mill Pat,

I installed rubygems-1.7.2 and only got the depreciation warning, but it
seemed to install my gems fine ;)

All seems to be working perfectly , thanks !!

------------------------------
Thanks for your time.

Gareth



On 16 May 2011 18:21, Pat O'Brien <obr...@gm...> wrote:

> I get this same error with the following setups:
>
> rubygems 1.8.2
> ruby 1.8.7-p174
> OS X 10.6.6
>
> rubygems 1.8.2
> ruby 1.8.7-p299
> CentOS 5.5 x86_64
>
> but it works fine with rubygems 1.3.7 and the following setup:
> rubygems 1.3.7
> ruby 1.8.7-p299
> CentOS 5.5 x86_64
>
> Looks like it's a rubygems 1.8.2 issue.
>
> -pat
>
>
>
> On Mon, May 16, 2011 at 9:36 AM, Spyda <web...@gm...> wrote:
>
>> Thanks a mill for your response,
>> I cant even get to the unicorn start because I get stuck just installing
>> the gems :(
>> I have reinstalled all the deb packages, even installed the rubygems from
>> the tgz package and managed to upgrade gem from 1.8.1 to 1.8.2
>>
>>
>> I am running Debian Squeeze (just upgraded from lenny)
>>
>> Here is the info you were looking for:
>>
>> server# dpkg --list |grep ruby
>> ii  libruby1.8                          1.8.7.302-2
>>  Libraries necessary to run Ruby 1.8
>> ii  ruby                                4.5                          An
>> interpreter of object-oriented scripting language Ruby
>> ii  ruby-dev                            4.5
>>  Header files for compiling extension modules for Ruby
>> ii  ruby1.8                             1.8.7.302-2
>>  Interpreter of object-oriented scripting language Ruby 1.8
>> ii  ruby1.8-dev                         1.8.7.302-2
>>  Header files for compiling extension modules for the Ruby 1.8
>> ii  rubygems                            1.3.7-3
>>  package management framework for Ruby libraries/applications
>> ii  rubygems1.8                         1.3.7-3
>>  package management framework for Ruby libraries/applications
>>
>>
>> server# gem -v
>> 1.8.2
>>
>> server# rake gems:install --trace
>> (in /opt/etch-3.19.0/server)
>> DEPRECATION WARNING: Rake tasks in vendor/plugins/open_flash_chart/tasks
>> are deprecated. Use lib/tasks instead. (called from
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/rails.rb:10)
>> ** Invoke gems:install (first_time)
>> ** Invoke gems:base (first_time)
>> ** Execute gems:base
>> ** Invoke environment (first_time)
>> ** Execute environment
>> rake aborted!
>> undefined method `name' for "actionmailer":String
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/rails/gem_dependency.rb:277:in
>> `=='
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:217:in `==='
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:217:in
>> `matching_specs'
>> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in `find_all'
>> /usr/local/lib/site_ruby/1.8/rubygems/specification.rb:403:in `each'
>> /usr/local/lib/site_ruby/1.8/rubygems/specification.rb:402:in `each'
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:216:in `find_all'
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:216:in
>> `matching_specs'
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:238:in `to_specs'
>> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:256:in `to_spec'
>> /usr/local/lib/site_ruby/1.8/rubygems.rb:1182:in `gem'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/rails/gem_dependency.rb:75:in
>> `add_load_paths'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in
>> `add_gem_load_paths'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in `each'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in
>> `add_gem_load_paths'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:132:in
>> `process'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:113:in `send'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:113:in `run'
>> /opt/etch-3.19.0/server/config/environment.rb:13
>> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in
>> `gem_original_require'
>> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in `require'
>> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:182:in
>> `require'
>> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:547:in
>> `new_constants_in'
>> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:182:in
>> `require'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/misc.rake:4
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `call'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `execute'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `each'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `execute'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:597:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:583:in `invoke'
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/gems.rake:17
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `call'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `execute'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `each'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `execute'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:597:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:607:in
>> `invoke_prerequisites'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:604:in `each'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:604:in
>> `invoke_prerequisites'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:596:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
>> `invoke_with_call_chain'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:583:in `invoke'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2051:in `invoke_task'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `top_level'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `each'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `top_level'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2068:in
>> `standard_exception_handling'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2023:in `top_level'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2001:in `run'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2068:in
>> `standard_exception_handling'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:1998:in `run'
>> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/bin/rake:31
>> /usr/bin/rake:19:in `load'
>> /usr/bin/rake:19
>>
>>
>> ----------------------------------
>> Thank you for your time.
>>
>> Gareth
>>
>>
>> On 16 May 2011 17:21, Jason Heiss <jh...@ap...> wrote:
>>
>>> Rails is somehow failing to assemble itself, but that particular error is
>>> a new one on me.  Google turned up a few other folks with the same error
>>> message, but no obvious solution.
>>>
>>> A couple of thoughts though.  I don't know if any of these will help
>>> narrow down the problem.
>>>
>>> If you're trying to set up a production install you'll want to set your
>>> RAILS_ENV environment variable to "production" before running any commands.
>>>  Otherwise rails will default to the "development" database configuration in
>>> config/database.yml.  Eventually you'll want an init script or similar that
>>> sets RAILS_ENV before firing up unicorn, but for the rake commands to
>>> install gems and setup the database it's easiest to just set it manually.
>>>
>>> What version of rubygems do you have?  (gem -v)  It's possible you have
>>> an old version that isn't compatible with newer versions of rails.  You can
>>> update with "sudo gem update --system" and see if that changes anything.
>>>
>>> Jason
>>>
>>> On May 16, 2011, at 2:25 AM, Gareth Greener wrote:
>>>
>>> > Hi,
>>> >
>>> > I am quite new to Ruby and I have etch working on a test machine, but
>>> really struggling to install it in my production environment.
>>> > I have followed all the steps to install but I get an error on the
>>> below:
>>> >
>>> > server# rake gems:install
>>> > (in /opt/etch-3.19.0/server)
>>> > DEPRECATION WARNING: Rake tasks in
>>> vendor/plugins/open_flash_chart/tasks are deprecated. Use lib/tasks instead.
>>> (called from /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/rails.rb:10)
>>> > rake aborted!
>>> > undefined method `name' for "actionmailer":String
>>> >
>>> > (See full trace by running task with --trace)
>>> >
>>> > *** LOCAL GEMS ***
>>> >
>>> > actionmailer (2.3.11, 2.3.8)
>>> > actionpack (2.3.11, 2.3.8)
>>> > activerecord (2.3.11, 2.3.8)
>>> > activeresource (2.3.11, 2.3.8)
>>> > activesupport (2.3.11, 2.3.8)
>>> > etch (3.19.0)
>>> > facter (1.5.8)
>>> > kgio (2.4.0)
>>> > libxml-ruby (1.1.2)
>>> > rack (1.1.2)
>>> > rails (2.3.11, 2.3.8)
>>> > rake (0.8.7)
>>> > sqlite3 (1.3.3)
>>> > sqlite3-ruby (1.3.3)
>>> > unicorn (3.6.2)
>>> >
>>> >
>>> > ------------------------------
>>> > Thanks for your time.
>>> >
>>> > Gareth
>>> >
>>> >
>>> ------------------------------------------------------------------------------
>>> > Achieve unprecedented app performance and reliability
>>> > What every C/C++ and Fortran developer should know.
>>> > Learn how Intel has extended the reach of its next-generation tools
>>> > to help boost performance applications - inlcuding clusters.
>>> >
>>> http://p.sf.net/sfu/intel-dev2devmay_______________________________________________
>>> > etch-users mailing list
>>> > etc...@li...
>>> > https://lists.sourceforge.net/lists/listinfo/etch-users
>>>
>>>
>>
>>
>> ------------------------------------------------------------------------------
>> Achieve unprecedented app performance and reliability
>> What every C/C++ and Fortran developer should know.
>> Learn how Intel has extended the reach of its next-generation tools
>> to help boost performance applications - inlcuding clusters.
>> http://p.sf.net/sfu/intel-dev2devmay
>> _______________________________________________
>> etch-users mailing list
>> etc...@li...
>> https://lists.sourceforge.net/lists/listinfo/etch-users
>>
>>
>

Re: [etch-users] Format for output of 'nodegrouper' script

From: Kenneth W. <hap...@gm...> - 2011-05-16 17:36:48

I'm pregenerating nodegroups.xml from nVentory through a bash script via
crontab... mainly to offload from nVentory... The basic format is:

<!DOCTYPE nodegroups SYSTEM "nodegroups.dtd">
<nodegroups>
   <nodegroup name="parent_group_1">
      <child>child_a</child>
      <child>child_b</child>
   </nodegroup>
   <nodegroup name="parent_group_2">
      <child>child_c</child>
      <child>child_d</child>
   </nodegroup>
<nodegroups>

Etch seems to be happy with this setup. Only caveat I've seen from this: do
your file creation in /tmp or something and then move the final file on top
of /etc/etchserver/nodegroups.xml or else your clients may get some
malformed xml messages during the file generation, and also load the xml in
some parser first using the dtd to sanity check the syntax just in case of a
hiccup in your scripts... you really don't want bad xml running around in
your nodes.xml or nodegroups.xml... it tends to screw things up a bit ;)



On Mon, May 16, 2011 at 10:02 AM, Johnston, Nathaniel <
Nat...@ca...> wrote:

>  Is there any support for an external script to output the equivalent to
> the nodegroups.xml file?
>
>  --N.
>
>  On May 16, 2011, at 12:59 PM, Jason Heiss wrote:
>
>  The output from nodegrouper is plain text, one group name per line.
>  I.e.:
>
> % nodegrouper host1.example.com
> group1
> group2
> othergroup
>
>
> On May 16, 2011, at 9:49 AM, Johnston, Nathaniel wrote:
>
> I am not using nVentory, so I am unable to grok the provided example script
> for externally based "nodegrouper".  If I am fashioning my own "nodegrouper"
> script, will the output be XML?  Can you give me an example of what the
> output would look like?
>
>
>  Thanks much!
>
>
>  --N.
>
>
>
>  --N.
>
>  ----
> Nate Johnston                      "You are what you automate."
> Nat...@ca...            ph:703-939-8521
>
>
>
>
>
> ------------------------------------------------------------------------------
> Achieve unprecedented app performance and reliability
> What every C/C++ and Fortran developer should know.
> Learn how Intel has extended the reach of its next-generation tools
> to help boost performance applications - inlcuding clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users
>
>


-- 
Kenneth Williams

Re: [etch-users] undefined method `name' for "actionmailer":String

From: Pat O'B. <obr...@gm...> - 2011-05-16 17:21:44

I get this same error with the following setups:

rubygems 1.8.2
ruby 1.8.7-p174
OS X 10.6.6

rubygems 1.8.2
ruby 1.8.7-p299
CentOS 5.5 x86_64

but it works fine with rubygems 1.3.7 and the following setup:
rubygems 1.3.7
ruby 1.8.7-p299
CentOS 5.5 x86_64

Looks like it's a rubygems 1.8.2 issue.

-pat


On Mon, May 16, 2011 at 9:36 AM, Spyda <web...@gm...> wrote:

> Thanks a mill for your response,
> I cant even get to the unicorn start because I get stuck just installing
> the gems :(
> I have reinstalled all the deb packages, even installed the rubygems from
> the tgz package and managed to upgrade gem from 1.8.1 to 1.8.2
>
>
> I am running Debian Squeeze (just upgraded from lenny)
>
> Here is the info you were looking for:
>
> server# dpkg --list |grep ruby
> ii  libruby1.8                          1.8.7.302-2
>  Libraries necessary to run Ruby 1.8
> ii  ruby                                4.5                          An
> interpreter of object-oriented scripting language Ruby
> ii  ruby-dev                            4.5                          Header
> files for compiling extension modules for Ruby
> ii  ruby1.8                             1.8.7.302-2
>  Interpreter of object-oriented scripting language Ruby 1.8
> ii  ruby1.8-dev                         1.8.7.302-2                  Header
> files for compiling extension modules for the Ruby 1.8
> ii  rubygems                            1.3.7-3
>  package management framework for Ruby libraries/applications
> ii  rubygems1.8                         1.3.7-3
>  package management framework for Ruby libraries/applications
>
>
> server# gem -v
> 1.8.2
>
> server# rake gems:install --trace
> (in /opt/etch-3.19.0/server)
> DEPRECATION WARNING: Rake tasks in vendor/plugins/open_flash_chart/tasks
> are deprecated. Use lib/tasks instead. (called from
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/rails.rb:10)
> ** Invoke gems:install (first_time)
> ** Invoke gems:base (first_time)
> ** Execute gems:base
> ** Invoke environment (first_time)
> ** Execute environment
> rake aborted!
> undefined method `name' for "actionmailer":String
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/rails/gem_dependency.rb:277:in
> `=='
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:217:in `==='
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:217:in `matching_specs'
> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in `find_all'
> /usr/local/lib/site_ruby/1.8/rubygems/specification.rb:403:in `each'
> /usr/local/lib/site_ruby/1.8/rubygems/specification.rb:402:in `each'
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:216:in `find_all'
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:216:in `matching_specs'
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:238:in `to_specs'
> /usr/local/lib/site_ruby/1.8/rubygems/dependency.rb:256:in `to_spec'
> /usr/local/lib/site_ruby/1.8/rubygems.rb:1182:in `gem'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/rails/gem_dependency.rb:75:in
> `add_load_paths'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in
> `add_gem_load_paths'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in `each'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:301:in
> `add_gem_load_paths'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:132:in
> `process'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:113:in `send'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/initializer.rb:113:in `run'
> /opt/etch-3.19.0/server/config/environment.rb:13
> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in
> `gem_original_require'
> /usr/local/lib/site_ruby/1.8/rubygems/custom_require.rb:36:in `require'
> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:182:in
> `require'
> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:547:in
> `new_constants_in'
> /usr/lib/ruby/gems/1.8/gems/activesupport-2.3.11/lib/active_support/dependencies.rb:182:in
> `require'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/misc.rake:4
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `call'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `execute'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `each'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `execute'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:597:in
> `invoke_with_call_chain'
> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
> `invoke_with_call_chain'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:583:in `invoke'
> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/gems.rake:17
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `call'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:636:in `execute'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `each'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:631:in `execute'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:597:in
> `invoke_with_call_chain'
> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
> `invoke_with_call_chain'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:607:in
> `invoke_prerequisites'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:604:in `each'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:604:in
> `invoke_prerequisites'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:596:in
> `invoke_with_call_chain'
> /usr/lib/ruby/1.8/monitor.rb:242:in `synchronize'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:590:in
> `invoke_with_call_chain'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:583:in `invoke'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2051:in `invoke_task'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `top_level'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `each'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2029:in `top_level'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2068:in
> `standard_exception_handling'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2023:in `top_level'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2001:in `run'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:2068:in
> `standard_exception_handling'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/lib/rake.rb:1998:in `run'
> /usr/lib/ruby/gems/1.8/gems/rake-0.8.7/bin/rake:31
> /usr/bin/rake:19:in `load'
> /usr/bin/rake:19
>
>
> ----------------------------------
> Thank you for your time.
>
> Gareth
>
>
> On 16 May 2011 17:21, Jason Heiss <jh...@ap...> wrote:
>
>> Rails is somehow failing to assemble itself, but that particular error is
>> a new one on me.  Google turned up a few other folks with the same error
>> message, but no obvious solution.
>>
>> A couple of thoughts though.  I don't know if any of these will help
>> narrow down the problem.
>>
>> If you're trying to set up a production install you'll want to set your
>> RAILS_ENV environment variable to "production" before running any commands.
>>  Otherwise rails will default to the "development" database configuration in
>> config/database.yml.  Eventually you'll want an init script or similar that
>> sets RAILS_ENV before firing up unicorn, but for the rake commands to
>> install gems and setup the database it's easiest to just set it manually.
>>
>> What version of rubygems do you have?  (gem -v)  It's possible you have an
>> old version that isn't compatible with newer versions of rails.  You can
>> update with "sudo gem update --system" and see if that changes anything.
>>
>> Jason
>>
>> On May 16, 2011, at 2:25 AM, Gareth Greener wrote:
>>
>> > Hi,
>> >
>> > I am quite new to Ruby and I have etch working on a test machine, but
>> really struggling to install it in my production environment.
>> > I have followed all the steps to install but I get an error on the
>> below:
>> >
>> > server# rake gems:install
>> > (in /opt/etch-3.19.0/server)
>> > DEPRECATION WARNING: Rake tasks in vendor/plugins/open_flash_chart/tasks
>> are deprecated. Use lib/tasks instead. (called from
>> /usr/lib/ruby/gems/1.8/gems/rails-2.3.11/lib/tasks/rails.rb:10)
>> > rake aborted!
>> > undefined method `name' for "actionmailer":String
>> >
>> > (See full trace by running task with --trace)
>> >
>> > *** LOCAL GEMS ***
>> >
>> > actionmailer (2.3.11, 2.3.8)
>> > actionpack (2.3.11, 2.3.8)
>> > activerecord (2.3.11, 2.3.8)
>> > activeresource (2.3.11, 2.3.8)
>> > activesupport (2.3.11, 2.3.8)
>> > etch (3.19.0)
>> > facter (1.5.8)
>> > kgio (2.4.0)
>> > libxml-ruby (1.1.2)
>> > rack (1.1.2)
>> > rails (2.3.11, 2.3.8)
>> > rake (0.8.7)
>> > sqlite3 (1.3.3)
>> > sqlite3-ruby (1.3.3)
>> > unicorn (3.6.2)
>> >
>> >
>> > ------------------------------
>> > Thanks for your time.
>> >
>> > Gareth
>> >
>> >
>> ------------------------------------------------------------------------------
>> > Achieve unprecedented app performance and reliability
>> > What every C/C++ and Fortran developer should know.
>> > Learn how Intel has extended the reach of its next-generation tools
>> > to help boost performance applications - inlcuding clusters.
>> >
>> http://p.sf.net/sfu/intel-dev2devmay_______________________________________________
>> > etch-users mailing list
>> > etc...@li...
>> > https://lists.sourceforge.net/lists/listinfo/etch-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Achieve unprecedented app performance and reliability
> What every C/C++ and Fortran developer should know.
> Learn how Intel has extended the reach of its next-generation tools
> to help boost performance applications - inlcuding clusters.
> http://p.sf.net/sfu/intel-dev2devmay
> _______________________________________________
> etch-users mailing list
> etc...@li...
> https://lists.sourceforge.net/lists/listinfo/etch-users
>
>

Flat | Threaded

<< < 1 2 3 4 .. 6 > >> (Page 2 of 6)