More Record Oriented Reading

May 16, 2001, 11:00 PM —  ITworld — 

Last week, we looked at three common cases for defining the 'record'
that Perl's input operator reads: line oriented records, paragraph
oriented records, and file oriented records. Now we'll look at grabbing
and parsing records in a more custom format.

One common type of multi-line record is the name/value pair format:

name = andrew
age = 37
beer = dark ale
*****
name = john
beer = pale ale
age = 35
*****

In this case, we have records consisting of three named fields
separated by "*****\n". We can simply read this data in and output it
with a different record separator:

$/ = "*****\n";
while(<>){
chomp;
print "$_#####\n";
}

Not very exciting, but it illustrates the concept of the input record
separator. By setting the input record separator to the
string "*****\n", when we read from the file the input operator reads
one multi-line record at a time: everything up to and including the
next record separator string is returned. This also illustrates that
chomp() removes any trailing record separator, not just any trailing
newline character (and not just the last character of the string as
does the chop() function). In the above, we are merely removing the
record separator and producing output with a new separator string.

A slightly less trivial task might be to convert such a file into a csv
style data file. Let's assume we've been asked to read a file such as
the above and produce a csv file with a ':' as the field separator and
ordered fields: name, age, beer.

$/ = "*****\n";
my @fields = qw/name age beer/;
while(){
chomp;
my %hash = split /\s*[\n=]\s*/;
print join(':',@hash{@fields}),"\n";
}

__DATA__
name = andrew
age = 37
beer = dark ale
*****
name = john
beer = pale ale
age = 35
*****

Here we've chomp()'d off the record separator and created a hash by
splitting the record at every '=' and "\n" character. We were careful
to account for possible whitespace around the '=' character in our split
(), but we may need to be a little more careful: What if one of the
field lines is indented? In that case we would have a hash key like "
name" instead of just "name", and our hash slice to produce the output
wouldn't work as we wished.

Sign up for ITworld's Daily newsletter
Follow ITworld on Twitter @IT_world

I like it!
Post a comment
The content of this field is kept private and will not be shown publicly.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.
peer-to-peer

jfruh
Apple syncing patent can't come soon enough

pasmith
New Twitter features borrow from 3rd party clients

Esther Schindler
Open Source Changes the Software Acquisition Process

mikelgan
How to set up continuous podcast play on the new iTunes

David Strom
Five important Windows 7 mobility features

sjvn
Guard your Wi-Fi for your own sake                        

Sandra Henry-Stocker
Grepping on Whole Words

 

Sidekick: The Good News & the Bad News
Either way you look at it Microsoft Data Center management did not follow standards or best practices in this failure. In which case it makes me wonder more about the outsourcing of corporate data much less personal data.
- mburton325

Join the conversation here

The Daily Tip

The Daily TipQuick, practical advice for IT pros. Made fresh daily.

Hot tips:

Want to cash in on your IT savvy? Send your tip to tips@itworld.com. If we post it, we'll send you a $25 Amazon e-gift card.

Newsletters

Subscribe to ITWORLD TODAY and receive the latest IT news and analysis.

I would like to receive offers via email from ITworld partners.
By clicking submit you agree to the terms and conditions outlined in ITworld's privacy policy.
Featured Sponsor

AISO founders envisioned a Web hosting company that was environmentally friendly. While the company employed energy-efficient innovations like solar panels, its infrastructure produced unacceptable power and cooling requirements. Find out how AISO leveraged AMD technology to overcome their challenge in this case study white paper.

In this whitepaper, Scalar explores the opportunity to change the landscape with respect to mission critical databases built around Oracle. Leveraging technologies such as Linux, high-end commodity processing power and Oracle RAC technology to architect, design, build and maintain database infrastructure that delivers maximum availability, reliability and performance at a fraction of traditional cost.

On a typical day, weather.com, the Web site for The Weather Channel in Atlanta, serves up between 15 million and 20 million page views. But in September 2004, when back-to-back hurricanes ransacked Florida, the peak traffic on one day more than tripled: over 70 million page views by more than 7 million unique visitors. Read the full success story now.

Marketplace