¿Donde estás Perl, que no te vemos? Mientras tanto, Java Servlets 3.0 promete cosas interesantes.

Buscar en otros sitios:

Blogalaxia:perl, cgi, obsolete, parrot
Technorati:perl, cgi, obsolete, parrot
To2blogs:perl, cgi, obsolete, parrot
Del.icio.us:perl, cgi, obsolete, parrot

NEW! Sentilla Work (Beta) for Mac and Linux

Downloads of the Beta release of Sentilla Work for both Mac OS X and Ubuntu Linux are now available for current Perk customers at the following URLs:

• Sentilla Work (Beta) for Linux
• Sentilla Work (Beta) for Mac OS X

Go to the URL for your OS of choice and login as

XXXXXX

and use the password

ZZZZZZZZ

After you download the release to your computer and expand the files, refer to the Release Notes included with the builds for installation instructions (page 10) and important notices. You do not need to reinstall mote firmware for this release; your current Perk firmware will work on both the Mac OS X and Linux platforms.

Note that you cannot install firmware with the Mac OS X release.

Christine at Sentilla

Los instalaré en algún momento el fin de semana, vamos a ver que tal se porta.

Buscar en otros sitios:

Blogalaxia:sentilla, perl, kodegeek, mac osx, ubuntu
Technorati:sentilla, perl, kodegeek, mac osx, ubuntu
To2blogs:sentilla, perl, kodegeek, mac osx, ubuntu
Del.icio.us:sentilla, perl, kodegeek, mac osx, ubuntu

line 15 column 1 - Warning: unexpected </head> in <link>line 20 column 165 - Warning: unexpected </a> in <img>line 20 column 169 - Warning: unexpected </td> in <img>line 23 column 97 - Warning: unexpected </td> in <img>line 24 column 5 - Warning: unexpected </tr> in <img>line 26 column 93 - Warning: unexpected </a> in <img>line 26 column 97 - Warning: unexpected </td> in <img>This document has errors that must be fixed beforeusing HTML Tidy to generate a tidied up version.

Asi que, ¿como procesar un documento que está así de roto en Java?

Bueno, el sitio de Java tiene mucha documentación y una de las cosas interesantes que muestran es como usar el parser que tiene Swing pero afuera de sus componentes gráficos. Esto resolvió perfectamente como obtener e iterar un documento roto, ahora sólo quedaba resolver el problema de escribir el RSS lo más fácil posible.

Después de buscar un poco me decidí a usar la librería Rome. No es pesada, lo único fastidioso es que requiere JDOM. Bueno, antes tuve que pedir que instalarn Expat para Perl, asi que mejor no me quejo

El código como siempre está en Source Forge, en el sitio de KodeGeek. Se los pongo aquí por comodidad:

 package com.kodegeek.blog.rss; import java.io.BufferedReader; import java.io.FileWriter; import java.io.InputStreamReader; import java.io.Reader; import java.io.Writer; import java.net.URL; import java.util.ArrayList; import java.util.Date; import java.util.List; import java.util.logging.Level; import java.util.logging.Logger; import javax.swing.text.AttributeSet; import javax.swing.text.MutableAttributeSet; import javax.swing.text.html.HTML; import javax.swing.text.html.HTML.Tag; import javax.swing.text.html.HTMLEditorKit.ParserCallback; import javax.swing.text.html.parser.ParserDelegator; import com.sun.syndication.feed.synd.SyndEntry; import com.sun.syndication.feed.synd.SyndEntryImpl; import com.sun.syndication.feed.synd.SyndFeed; import com.sun.syndication.feed.synd.SyndFeedImpl; import com.sun.syndication.io.SyndFeedOutput; /**  * Program that converts the main summary news from Globovision.comto RSS format.  * @author josevnz at kodeeek.com  *

License: GPL

  * I use a combination of Yahoo Pipes and Google Reader to keep meupdated about news of any kind. However, some websites like  * Globovision.com still don't have a proper RSS feed,so one day Idecided to create my own mashup  .  * It worked for a while until my Blog hosting providerdecided toremove the XML::RSS Perl module I asked to install for me.Because of that,  * this Java version was born.  */ public final class GlobovisionHtml2Rss {  public static final StringGLOBOVISION_URL = "http://globovision.com";  public static final String NEWS_URL =GLOBOVISION_URL + "/history.php?cha=1&pag=1";  private static Logger log;  private static final long DEFAULT_WAIT = 1000L*60L*5L;  // Do not alow instances of this class to be created  private GlobovisionHtml2Rss() {   // Empty  }  static {   log = Logger.getLogger(GlobovisionHtml2Rss.class.getName());  }  /**   * @param args   */  public static void main(String[] args) throws Exception {   try {    fetch(NEWS_URL, args[0]);   } catch (Exception exp) {    log.log(Level.SEVERE, "Cannot recover from thisexception", exp);   }  }  /**   * Try to fetch the URL and convert it to a Document   * @param url   * @param outfile   * @return   * @throws Exception   */  private static void fetch(String url, String outfile) throws Exception {   Reader reader = null;   Writer writer = null;   SyndFeed feed;   List <SyndEntry>news = new ArrayList<SyndEntry>();   try {    feed = new SyndFeedImpl();    feed.setAuthor("Jose Nunez, josevnz at kodegeek.com");    feed.setDescription("Globovision.com news - Brough toyou by http://KodeGeek.com");    feed.setFeedType("rss_1.0");    feed.setLink("http://www.kodegeek.com/rss/globovision.rss");    feed.setTitle("Globovision.com Venezuelan News");    URL globovisionURL = new URL(url);    reader = new BufferedReader(new InputStreamReader(globovisionURL.openStream()));    ParserDelegator parser = new ParserDelegator();    parser.parse(reader, new GlobovisionHtml2Rss().new GlobovisionParser(news), false);    if (news.size() > 0) {     feed.setEntries(news);     writer = new FileWriter(outfile);     SyndFeedOutput feedOut = new SyndFeedOutput();     feedOut.output(feed, writer);    }   } catch (Exception exp) {    throw new Exception("Unexpected problem", exp);   } finally {    if (reader != null) {     reader.close();    }    if (writer != null) {     writer.close();    }    news.clear();   }  }  /**   * Helper class used to parse Globovision news website   * @author josevnz   */  class GlobovisionParser extends ParserCallback {   private boolean getHeadline = false;   private AttributeSet attribute;   private List <SyndEntry>entries;   public GlobovisionParser(List <SyndEntry>entries) {    this.entries = entries;   }   /**    * Globovision HTML is so broken than we will ignore the errorssilently.    * Increase the logger verbosity to see the errors    */   public void handleError(String errorMsg, int pos) {    log.log(Level.FINE, String.format("%s, %d", errorMsg, pos));   }   /**    * Looking for:  tag = "a" and  attr{href} =~ /news.php?nid=\d+/    * @param t Tag    * @param a Attribute set    * @param pos position    */   public void handleStartTag(Tag t, MutableAttributeSet a, int pos) {    if (      (t == Tag.A) &&      (a.getAttribute(HTML.Attribute.HREF) != null)&&      (a.getAttribute(HTML.Attribute.HREF).toString().matches("news\\.php\\?nid=\\d+"))    ) {      attribute = a.copyAttributes();      log.log(Level.FINE,String.format("Tag: %s, attributes: %s", t, a));      getHeadline = true;    }   }   /**    * Get the headline and also write the RSS entry    * @param data Text next to the headline    * @param pos position    */   public void handleText(char[] data, int pos) {    if (getHeadline) {     SyndEntry entry = new SyndEntryImpl();     entry.setLink(String.format("%s/%s",GLOBOVISION_URL, attribute.getAttribute(HTML.Attribute.HREF).toString()));     entry.setPublishedDate(new Date());     entry.setTitle(new String(data));     entries.add(entry);     getHeadline = false;     attribute = null;    }   }  } }

Debo admitir que el proceso para volver a crear el RSS de Globovision desde Java fué más complejo y requirió más código que el de Perl (aunque terminé mi nueva versión antes que Lunar Pages reemplazara el modulo perdido, unas cuantas horas después) . Pero por otro lado, aprendí más trucos con este y al menos ya no tengo que preocuparme por pedirles que instalen módulos no estandares.

Nota a los subscriptores del la fuente de Globovision en RSS: La versión vieja ya funciona de nuevo. Pienso montar la nueva dentro de poco con nuevas mejoras. Una de ellas es que este tipo de error no afectará el programa (aunque no doy ningún tipo de garantias por soporte gratis ).

To Lunar Pages: Response to this issue was kind of slow, thanks for fixing the issue on my account anyways.

Buscar en otros sitios:

Blogalaxia:java, perl, XML::RSS, HTMLEditorKit, Lunar Pages
Technorati:java, perl, XML::RSS, HTMLEditorKit, Lunar Pages
To2blogs:java, perl, XML::RSS, HTMLEditorKit, Lunar Pages
Del.icio.us:java, perl, XML::RSS, HTMLEditorKit, Lunar Pages

Can't locate XML/RSS.pm in @INC (@INC contains:/usr/lib/perl5/5.8.5/i386-linux-thread-multi/usr/lib/perl5/5.8.5 /usr/lib/perl5/site_perl/5.8.5/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.4/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.3/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.2/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.1/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.0/i386-linux-thread-multi/usr/lib/perl5/site_perl/5.8.5 /usr/lib/perl5/site_perl/5.8.4/usr/lib/perl5/site_perl/5.8.3 /usr/lib/perl5/site_perl/5.8.2/usr/lib/perl5/site_perl/5.8.1 /usr/lib/perl5/site_perl/5.8.0/usr/lib/perl5/site_perl /usr/lib/perl5/vendor_perl/5.8.5/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.4/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.3/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.2/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.1/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.0/i386-linux-thread-multi/usr/lib/perl5/vendor_perl/5.8.5 /usr/lib/perl5/vendor_perl/5.8.4/usr/lib/perl5/vendor_perl/5.8.3 /usr/lib/perl5/vendor_perl/5.8.2/usr/lib/perl5/vendor_perl/5.8.1 /usr/lib/perl5/vendor_perl/5.8.0/usr/lib/perl5/vendor_perl .) at/home/kodeg2/scripts/GlobovisionHtml2Rss.pl line 6.BEGIN failed--compilation aborted at/home/XXXX/scripts/GlobovisionHtml2Rss.pl line 6.

Esta es una de las pocas cosas que odio de Perl; Montar módulos en ubicaciones alternativas ES UN FASTIDIO (si no tienes ROOT). En mi caso no tengo accesso a shell para hacerlo yo, así que dependo de la bondad de los administradores de Lunar Pages para que ellos lo hagan.

¿Que hacer? Bueno, o pedirles que lo monten en mi directorio (y yo agrego la ruta de busqueda usando “use lib”) o lo hago en otro lenguaje como Java (en cuyo caso copio mis Jar en donde me de la gana).

Voy a pensarlo un poco, vamos a ver que tanto tiempo toma escribir el mismo código en otro lenguaje.

Blogalaxia:XML::RSS, perl, Java
Technorati:XML::RSS, perl, Java
To2blogs:XML::RSS, perl, Java
Del.icio.us:XML::RSS, perl, Java

Buscar en otros sitios:

So I was somehow happy with Appleworks until I decided to do something simple as to import a CSV file created with Google Finance portfolio application.

It didn’t work. Fustrated I asked for help on the Apple support forum (the Appleworks FAQ is just useless at least with this particular issue) and luckly for me I got my answer in a couple of hours.

At the end I rolled out a savy one Perl liner that solved my problem:

auyan:~/Desktop josevnz$ perl -p -i -e ‘s#,#\t#g; s#\n#\rn#;’ 401k-funds-appleworks.csv

I guess I will try OpenOffice again or will buy Office for OSX and byte the bullet. But my advice is to stay away from a product that cannot deal with a simple conversions like this

Correction: Is CSV file not CVS. Too lazy to republish the whole thing again

Blogalaxia:appleworks, sucks, import csv, open office, microsoft office, perl
Technorati:appleworks, sucks, import csv, open office, microsoft office, perl
To2blogs:appleworks, sucks, import csv, open office, microsoft office, perl
Del.icio.us:appleworks, sucks, import csv, open office, microsoft office, perl

Asi que con un poco de imaginación decidí escribir este programa en Perl:

 #!/usr/bin/perl use strict; use LWP::UserAgent; use HTML::Parser; use XML::RSS; my $rss = XML::RSS->new( version => '0.9' ); my $rssFile = "$ENV{HOME}/globovision.rss"; $rss->channel(  title        => "Globovision.com Venezuelan News",  link         => "http://globovision.com/",  description  => "Globovision.com news -Brough to you by http://KodeGeek.com"); # Be carefull with this one as nested elements can be ignored and # HTML normally is not well formed! my @ignore_tags = (  "head",  "h1",  "strong",  "form"    ); my $baseUrl = "http://globovision.com/"; # We are only interested on the news from the first page,as more news come up it will push older news my $newsUrl = "$baseUrl" . "history.php?cha=1&pag=1"; use constant DEFAULT_TIMEOUT  => 180; my $agent = LWP::UserAgent->new({   agent => 'GlobovisionHtml2Rss.pl/kodegeek 0.1',   timeout => DEFAULT_TIMEOUT      }); my $response = $agent->get($newsUrl); if (! $response->is_success) {  die  sprintf "[ERROR]: Unable to retrieve the HTMLfrom '%s', Status: '%s'", $newsUrl, $response->status_line; } my $parser = HTML::Parser->new(                         api_version => 3,    start_h => [ \&start_a, "tagname, attr" ],    text_h => [ \&get_headline, "dtext" ]    ); $parser->ignore_tags(@ignore_tags); my $headlineFlag=0; my $currUrl=undef; $parser->parse($response->decoded_content()); $rss->save($rssFile); # ****** Functions used on the script ******* # Get the headline sub get_headline {  my $headline = $_[0];  if ($headlineFlag) {   $rss->add_item( title => $headline, link => $currUrl);   $headlineFlag = 0;   $currUrl=undef;  } } # Identify news items sub start_a {  my $tagname = $_[0];  my %attr = %{$_[1]};  if ( ($tagname eq "a") && ($attr{href} =~ /^news.php?.nid=\d+/) ) {   my $url = $baseUrl . "/" . $attr{href};   $url =~ s/&/&/g;   $currUrl = $url;   $headlineFlag=1;  } } __END__ =head1 NAME GlobovisionHtml2Rss.pl - Script to convert Globovision.com Venezuelalocal news from HTML to RSS. =head1 DESCRIPTION I use a combination of Yahoo Pipes and Google Reader to keep meupdated about news of any kind. However, some websites like Globovision.com still don't have a proper RSS feed, so one dayI decided to create my own mashup :). =head1 AUTHOR Jose Vicente Nunez Zuleta (josevnz@kodegeek.com) =head1 BLOG KodeGeek - http://kodegeek.com =head1 LICENSE GPL cut

Lo más fastidioso de este ejercicio fué instalar EXPAT (para el procesamiento del XML del feed RSS) y el módulo parta crear el archivo RSS (me da un fastidio enorme aprender como es el formato resultante).

Mi proveedor de hosting gustosamente instaló el módulo XML::RSS. Después de probarlo un poco aquí les dejo las noticias de Globovisión para que la disfruten (planeo actualizar el lector de noticias cada 10 minutos para no matar a mi servidor).

Blogalaxia.com:globovision, rss, html to rss, perl, open source
Technorati.com:globovision, rss, html to rss, perl, open source

Richard Stallman en Walc 2005, cortesía de Jorge Camargo.

Me parece curioso que habiendo tanta actividad del movimiento Open Source en Venezuela, no haya un grupo en Flickr en el cual se puedan compartir esos momentos capturados en una fotografía.

Por eso me decidí a crear un grupo, llamado Venezuela Open Source. El grupo está abierto a la discusión del acontecer Open Source en el país y no está limitado a fotos, sino tambien a captura de programas que ustedes conozcan.

Asi que les pido el favor y que rieguen la voz para que todos los interesados nos beneficiemos.

Blogalaxia.com:venezuela, open source, linux, java, gnu, perl, discusion
Technorati.com:venezuela, open source, linux, java, gnu, perl, discusion

#!/usr/bin/perluse File::Find;use Getopt::Long;use strict;

my $func;my $unit;my @dirs;my %units = (      kb => [ 1024.0,  "KB"],      mb => [ 1024.0* 1024.0, "MB"],      gb => [ 1024.0 * 1024.0 * 1024.0, "GB" ]);

GetOptions("dirs=s" => \@dirs, "unit=s" => \$unit);die "Define the directories to measure" if (scalar(@dirs) == 0);$unit = "gb" if not defined $unit;$unit = "gb" if not defined $units{$unit};

{      my $tsize = 0;      $func = sub {              my (                      $dev,                      $ino,                      $mode,                      $nlink,                      $uid,                      $gid,                      $rdev,                      $size,                      $atime,                      $mtime,                      $ctime,                      $blksize,                      $blocks) = stat($File::Find::name);              if ( -f ($File::Find::name)) {                      $tsize += $size;              }              return $tsize;      }}

printf "Scanning directories: %s\n", join(',', @dirs);foreach my $dir (@dirs) {      find({ wanted => $func, follow => 0 }, $dir);}

printf "Total size of all combined directories: %.2f %s\n",      (&$func) / $units{$unit}[0], $units{$unit}[1];

La salida de ejemplo seria la siguiente:

auyan:~/src/perl/blog josevnz$ ./du.pl -dir /Users/josevnz -dir /tmp -unit ppScanning directories: /Users/josevnz,/tmpTotal size of all combined directories: 31.05 GB

Una belleza por lo simple

Blogalaxia.com:du, perl
Technorati.com:du, perl