Last week I explored using the Inline::Perl5 module to port a short Perl script to Raku while still keeping its Perl dependencies. Over at the Dev.to community, Dave Cross pointed out that I could get a bit more bang for my buck by letting his Feed::Find do the heavy lifting instead of WWW::Mechanize’s more general-purpose parsing.
A little more MetaCPAN investigation yielded XML::Feed, also maintained by Dave, and it had the added benefit of obviating my need for XML::RSS by not only discovering feeds but also retrieving and parsing them. It also handles the Atom syndication format as well as RSS(hi daxim!). Putting it all together produces the following much shorter and clearer Perl:
#!/usr/bin/env perl
use v5.12; # for strict and say
use warnings;
use XML::Feed;
use URI;
my $url = shift @ARGV || 'https://phoenixtrap-com.us.stackstaging.com';
my @feeds = XML::Feed->find_feeds($url);
my $feed = XML::Feed->parse( URI->new( $feeds[0] ) )
or die "Couldn't find a feed at $url\n";
binmode STDOUT, ':encoding(UTF-8)';
say $_->title, "\t", $_->link for $feed->entries;
And here’s the Raku version:
#!/usr/bin/env raku
use XML::Feed:from<Perl5>;
use URI:from<Perl5>;
sub MAIN($url = 'https://phoenixtrap-com.us.stackstaging.com') {
my @feeds = XML::Feed.find_feeds($url);
my $feed = XML::Feed.parse( URI.new( @feeds.first ) )
or exit note "Couldn't find a feed at $url";
put .title, "\t", .link for $feed.entries;
}
It’s even closer to Perl now, though it’s using the first routine rather than subscripting the @feeds array and leaving off the the $_ variable name when calling methods on it—less punctuation noise often aids readability. I also took a suggested exit idiom from Raku developer Elizabeth Mattijsen on Reddit to simplify the contortions I was going through to exit with a simple message and error code.
There are a couple of lessons here:
A little more effort in module shopping pays dividends in simpler code.
Get feedback from far and wide to help improve your code. If it’s for work and you can’t release as open-source, make sure your code review process covers readability and maintainability.
The Perl and Raku programming languages have a complicated history together. The latter was envisioned in the year 2000 as Perl 6, a complete redesign and rewrite of Perl to solve its problems of difficult maintenance and the burden of then-13 years of backward compatibility. Unfortunately, the development effort towards a first major release dragged on for ten years, and some developers began to believe the delay contributed to the decline of Perl’s market- and mindshare among programming languages.
In the intervening years work continued on Perl 5, and eventually, Perl 6 was positioned as “a sister language, part of the Perl family, not intended as a replacement for Perl.” Two years ago it was renamed Raku to better indicate it as a different project.
Although the two languages aren’t source-compatible, the Inline::Perl5 module does enable Raku developers to run Perl code and use Perl modules within Raku, You can even subclass Perl classes in Raku and call Raku methods from Perl code. I hadn’t realized until recently that the Perl support was so strong in Raku despite them being so different, and so I thought I’d take the opportunity to write some sample code in both languages to better understand the Raku way of doing things.
Rather than a simple “Hello World” program, I decided to write a simple syndicated news reader. The Raku modules directory didn’t appear to have anything comparable to Perl’s WWW::Mechanize and XML::RSS modules, so this seemed like a great way to test Perl-Raku interoperability.
Perl Feed Finder
First, the Perl script. I wanted it smart enough to either directly fetch a news feed or find it on a site’s HTML page.
#!/usr/bin/env perl
use v5.24; # for strict, say, and postfix dereferencing
use warnings;
use WWW::Mechanize;
use XML::RSS;
use List::Util 1.33 qw(first none);
my @rss_types = qw<
application/rss+xml
application/rdf+xml
application/xml
text/xml
>;
my $mech = WWW::Mechanize->new;
my $rss = XML::RSS->new;
my $url = shift @ARGV || 'https://phoenixtrap-com.us.stackstaging.com';
my $response = $mech->get($url);
# If we got an HTML page, find the linked RSS feed
if ( $mech->is_html
and my @alt_links = $mech->find_all_links( rel => 'alternate' ) )
{
for my $rss_type (@rss_types) {
$url = ( first { $_->attrs->{type} eq $rss_type } @alt_links )->url
and last;
}
$response = $mech->get($url);
}
die "$url does not have an RSS feed\n"
if none { $_ eq $response->content_type } @rss_types;
binmode STDOUT, ':encoding(UTF-8)'; # avoid wide character warnings
my @items = $rss->parse( $mech->content )->{items}->@*;
say join "\t", $_->@{qw<title link>} for @items;
The program then creates new WWW::Mechanize (called a mech for short) and XML::RSS objects for use later and gets a URL to browse from its command-line argument, defaulting to my blog if it has none. (My site, my rules, right?) It then retrieves that URL from the web. If mech believes that the URLcontains an HTML page and can find link tags with rel="alternate" attributes possibly identifying any news feeds, it then goes on to check the media types of those links against the earlier list of RSS types and retrieves the first one it finds.
Next comes the only error checking done by this script: checking if the retrieved feed’s media type actually matches the list defined earlier. This prevents the RSS parser from attempting to process plain web pages. This isn’t a large and complicated program, so the die function is called with a trailing newline character (\n) to suppress reporting the line on which the error occurred.
Finally, it’s time to output the headlines and links, but before that happens Perl has to be told that they may contain so-called “wide characters” found in the Unicode standard but not in the plain ASCII that it normally uses. This includes things like the typographical ‘curly quotes’ that I sometimes use in my titles. The last two lines of the script loop through the parsed items in the feed, extracting their titles and links and printing them out with a tab (\t) separator between them:
Output from feed_finder.pl
Raku Feed Finder
Programming is often just stitching libraries and APIs together, so it shouldn’t have been surprising that the Raku version of the above would be so similar. There are some significant (and sometimes welcome) differences, though, which I’ll go over now:
#!/usr/bin/env raku
use WWW::Mechanize:from<Perl5>;
use XML::RSS:from<Perl5>;
my @rss_types = qw<
application/rss+xml
application/rdf+xml
application/xml
text/xml
>;
my $mech = WWW::Mechanize.new;
my $rss = XML::RSS.new;
sub MAIN($url = 'https://phoenixtrap-com.us.stackstaging.com') {
my $response = $mech.get($url);
# If we got an HTML page, find the linked RSS feed
if $mech.is_html {
my @alt_links = $mech.find_all_links( Scalar, rel => 'alternate' );
$response = $mech.get(
@alt_links.first( *.attrs<type> (elem) @rss_types ).url
);
}
if $response.content_type(Scalar) !(elem) @rss_types {
# Overriding Raku's `die` stack trace is more verbose than we need
note $mech.uri ~ ' does not have an RSS feed';
exit 1;
}
my @items = $rss.parse( $mech.content ).<items>;
put join "\t", $_<title link> for @items;
}
The first thing to notice is there’s a bit less boilerplate code at the beginning. Raku is a younger language and doesn’t have to add instructions to enable less backward-compatible features. It’s also a larger language with functions and methods built-in that Perl needs to load from modules, though this feed finder program still needs to bring in WWW::Mechanize and XML::RSS with annotations to indicate they’re coming from the Perl5 side of the fence.
I decided to wrap the majority of the program in a MAIN function, which handily gives me command-line arguments as variables as well as a usage message if someone calls it with a --help option. This is a neat quality-of-life feature for script authors that cleverly reuses function signatures, and I’d love to see this available in Perl as an extension to its signatures feature.
Raku and Perl also differ in that the former has a different concept of context, where an expression may be evaluated differently depending upon whether its result is expected to be a single value (scalar) or a list of values. Inline::Perl5 calls Perl functions in list context by default, but you can add the Scalar type object as a first argument to force scalar context as I’ve done with calls to find_all_links (to return an array reference) and content_type (to return the first parameter of the HTTP Content-Type header).
Another interesting difference is the use of the (elem) operator to determine membership in a set. This is Raku’s ASCII way of spelling the ∈ symbol, which it can also use; !(elem) can also be spelled ∉. Both are hard to type on my keyboard so I chose the more verbose alternative, but if you want your code to more closely resemble mathematical notation it’s nice to know the option is there.
I also didn’t use Raku’s die routine to exit the program with an error, mainly because of its method of suppressing the line on which the error occurred. It requires using a CATCH block and then keying off of the type of exception thrown in order to customize its behavior, which seemed like overkill for such a small script. It would have looked something like this:
{
die $mech.uri ~ ' does not have an RSS feed'
if $response.content_type(Scalar) !(elem) @rss_types;
CATCH {
default {
note .message;
exit 1;
}
}
}
Doubtless, this could be golfed down to reduce its verbosity at the expense of readability, but I didn’t want to resort to clever tricks when trying to do a one-to-one comparison with Perl. More experienced Raku developers are welcome to set me straight in the comments below.
The last difference I’ll point out is Raku’s welcome lack of dereferencing operators compared to Perl. This is due to the former’s concept of containers, which I’m still learning about. It seems to be fairly DWIMmy so I’m not that worried, but it’s nice to know there’s an understandable mechanism behind it.
Overall I’m pleased with this first venture into Raku and I enjoyed what I’ve learned of the language so far. It’s not as different with Perl as I anticipated, and I can foresee coding more projects as I learn more. The community on the #rakuIRC channel was also very friendly and helpful, so I’ll be hanging out there as time permits.
What do you think? Can Perl and Raku better learn to coexist, or are they destined to be rivals? Leave a comment below.
If you can see this, then the site’s upgrade from HostGator shared hosting to VPS and the subsequent CloudflareDNS change is complete. Thank you for flying with us.
The DZone tech publishing site selected me as their Editors’ Pick Contributor of the Month for June 2021! Here’s my (blessedly brief) acceptance speech during their monthly awards ceremony.
Unfortunately, they’ve just started to de-prioritize content syndicated from elsewhere due to Google not indexing it. Since every article has to go through a moderation and editing process, this means that I may not be able to fulfill my promise to post new Perl content there every week. You can still find it here on phoenixtrap.com, of course. ☺️
Let’s say you’re a Perl developer distraught at the continued decline in usage and mindshare of your favorite language.
You know that you do good work and that your tools and techniques are sound, but the world outside of Perl-specific forums, software archives, social media groups, and IRC channels regards it as antiquated, out-of-date, or worse, that IT epithet legacy. (And the newer developers haven’t even heard of IRC!)
Let’s say you’re worried about your professional prospects both at your current employer and with possible future employers. Even though you know or can easily be trained in other languages, Perl is still your favorite.
Let’s say you’re me.
What do you do?
Step 1: Get a blog
There are two basic types of blogs: standardized format and customizable. If you’re just starting and you want to spend more time writing and less time fiddling with templates and software, choose standardized. Here are some sites that enable you to publish your work while getting out of your way and that have developer-centric communities. Pick one and set up an account:
If you want more customization options, you could try:
WordPress.com (hosted, but lets you change some things around)
GitHub Pages (good if you’re already used to collaborative software development there, but requires more setup including blog generation software)
Or your preferred hosting provider—look for ready-to-go blogging apps like WordPress
And yes, the WordPress software is based on PHP. Don’t sweat that it’s not Perl.PHP doesn’t have to “lose” for Perl to “win.”
Step 2: Write
Finding a topic to write about can seem hard, but it doesn’t have to be. The Perl (and Raku) Weekly Challenge publishes two new programming challenges every week. Work on those and publish your solution along with commentary.
Or write about whatever you’re working on or would like to work on. Write about your favorite Perl module or feature. It doesn’t matter if someone else wrote about it; you have a unique perspective.
Coming up with a pithy title for your posts may be harder—you want to be clickbait-y but honest, and you want to mention Perl so that search engines associate your posts with the topic.
The important thing to do is write something. And length doesn’t matter; one or two paragraphs is fine.
Step 3: Promote
Here’s the bad news: no one is going to find your blog posts on their own. You need to put them in front of readers where they already are.
This means posting links on social networks like Twitter, Facebook, and LinkedIn. It means discussiongroups and #hashtags (like #perl, #programming, #webdev, etc.) on those social networks. It means news forums like Reddit and Hacker News. And it means posting inside and outside of Perl-specific groups. Here are a couple of examples of the latter:
This social promotion might get tedious after a while, so look into plugins for your blogging platform and services like IFTTT and Zapier that will monitor your blog’s news feed and automatically post on your behalf.
Also, remember when I said above that there were blogging sites with developer-centric communities? Even if your main blog isn’t on one of them, set up accounts and cross-post. I repost my articles on Dev.to, DZone, and Medium; all of these offer ways to import posts from your main site. One caveat: their importers don’t seem to be very smart when it comes to source code, so you may need to do a bit of editing and reformatting after import.
Lastly, I would be remiss if I didn’t mention the Perl Weekly newsletter. Every Monday a fresh batch of Perl content is sent to people’s inboxes and you could be part of it. Contact editor Gábor Szabó about publishing links to your new blog.
Step 4: Repeat
Remember that consistency builds trust from your audience. Make time to write regularly and publish posts as often as you can manage. I set a goal to publish at least once a week and have kept up this pace since January of this year. You can often find new topics as you monitor and participate in the social forums in which you’re promoting your blog, especially in the comments. Even negative comments can drive new topics.
Did this article inspire you to start a blog? Do you have more questions? Let me know in the comments below!