pugs: a perl 6 implementation

PugsAn implementation of

Perl 6Audrey Tang

Pugs...

Pugs...

≝ Perl 6 Compiler

Pugs...

≝ Perl 6 Compiler

≝ Perl 6 Runtime

Pugs...

≝ Perl 6 Compiler

≝ Perl 6 Runtime

≝ Perl 6 Test Suite

Perl 6 Code

Perl 6 Code

✓ 130+ Modules

Perl 6 Code

✓ 130+ Modules

✓ 160+ Examples

Perl 6 Code

✓ 130+ Modules

✓ 160+ Examples

✓ 18,000+ Unit Tests

“Official Perl 6”


✓ Defined by semantics,not by accidents of history


✓ Defined by semantics,not by accidents of history

✓ Compatibility test suite(cf. JavaTest/TCK)

Spec ⇔ Test

✓

Test ⇔ Spec

✓

Perl, circa 1995

• use 5.000;

Perl, circa 1995

• use 5.000;• require 'fastcwd.pl';

Perl, circa 1995

• use 5.000;• require 'fastcwd.pl';• require 'newgetopt.pl';

Perl, circa 1995

• use 5.000;• require 'fastcwd.pl';• require 'newgetopt.pl';• require 'exceptions.pl';

Perl, circa 1995

Perl, circa 2005

• use v6-alpha;

Perl, circa 2005

• use v6-alpha;• use perl5:DBI;

Perl, circa 2005

• use v6-alpha;• use perl5:DBI;• use perl5:Encode <encode decode>;

Perl, circa 2005

• use v6-alpha;• use perl5:DBI;• use perl5:Encode <encode decode>;• use perl5:Template;

Perl, circa 2005

• use v6-alpha;• use perl5:DBI;• use perl5:Encode <encode decode>;• use perl5:Template;

• # Implementation of "crypt"eval "crypt()" :lang<perl5>;

Perl, circa 2005

Hybrid RuncorePugs

Pugs::RuntimePugs::CompilerPugs::Grammar

Pugs.EvalPugs.Prim

Pugs.Types

Perl 5

Runtime

GHC

Runtime

Hybrid Runcore

⇚ Perl 5Pugs


Pugs.EvalPugs.Prim

Pugs.Types

Perl 5

Runtime

GHC

Runtime

Hybrid Runcore

⇚ Perl 5

⇚ Haskell

Pugs


Pugs.EvalPugs.Prim

Pugs.Types

Perl 5

Runtime

GHC

Runtime

Hybrid Runcore

⇚ Perl 5

⇚ Haskell

⇚ C (.so/.dll)

Pugs


Pugs.EvalPugs.Prim

Pugs.Types

Perl 5

Runtime

GHC

Runtime

PugsIntermediateLanguage

Compilation Flow

Pugs

JavaScript

Haskell Perl 5

Backends

Pugs

JavaScript

Haskell Perl 5

YARV?JVM?

CLR? PyPy?

Backends

Perl 5 Backend

Augmentation (XS)PadWalker, Devel::Caller

autobox, re::override ...

SemanticsData::Bind, Class::MOP

Pugs::Runtime, Pugs::Compiler::Rule ...

Perl 5 SugarMoose, Moose::Autobox ...

Syntaxv6.pm

Pugs::Compiler::Perl6 ...

Core

perl

Tool SupportCPAN, PAUSE

Perldoc, Perl::Tidy ...

Stable

Experimental

Perl 6's CPAN stack

InfrastructureParse::Yapp

Module::Compile ...

Perl 5 Backend

⇛ Augment P5VM

Augmentation (XS)PadWalker, Devel::Caller





Syntaxv6.pm


Core

perl



Stable

Experimental

Perl 6's CPAN stack


Module::Compile ...

Perl 5 Backend

⇛ Augment P5VM

⇛ Deploy P6 as P5Augmentation (XS)PadWalker, Devel::Caller





Syntaxv6.pm


Core

perl



Stable

Experimental

Perl 6's CPAN stack


Module::Compile ...

Perl 5 Backend

⇛ Augment P5VM

⇛ Deploy P6 as P5

⇛ v6.pm on CPANAugmentation (XS)PadWalker, Devel::Caller





Syntaxv6.pm


Core

perl



Stable

Experimental

Perl 6's CPAN stack


Module::Compile ...

JavaScript Backend

JavaScript Backend

⇛ Like GWT, Hop, Links...

JavaScript Backend


⇛ Passes 90% of tests

JavaScript Backend


⇛ Passes 90% of tests

⇛ Slow - Aim for JS2/Tamarin

6.0Primitives䷁

6.2Functions䷗

6.28Objects䷒

6.283Grammars䷊

6.2831Types䷡

6.28318Macros䷪

6.283185Self Hosting

䷀

2πPerl 6!☯

“Frivolous Toy interpreter”(as seen on Slashdot)

“FrivolousToy interpreter”

“Toy interpreter”

“Toy”

Arrow length

Time

15500+ commits

290+ committers

Test Driven

Test Driven

☺Bug report ➟ Test

Test Driven


☺Smoke Server

Test Driven


☺Smoke Server

☺:todo<unspecced>

Anarchistic

Anarchistic

☺10+ languages

Anarchistic

☺10+ languages

☺30+ sub-projects

Anarchistic

☺10+ languages

☺30+ sub-projects

☺Aggressive recruiting

Patches Welcome !

Commits Welcome!

irc.freenode.net#perl6

λ Camels

λ Camels

✆ 200+ People

λ Camels

✆ 200+ People✆ 20+ Regulars

λ Camels

✆ 200+ People✆ 20+ Regulars✆ TimToady++

svnbot6

evalbot6

devbot6

lambdabot

IRC.pugscode.org

Run.pugscode.org

Dev.pugscode.org

Invite.pugscode.org

Smoke.pugscode.org

Spec.pugscode.org

Blog.pugscode.org

Mailing Lists

Mailing Lists

✆ perl6-users

Mailing Lists

✆ perl6-users

✆ perl6-language

Mailing Lists

✆ perl6-users

✆ perl6-language

✆ perl6-compiler

Repositories

http://svn.pugscode.org/pugs/

Repositories

http://svn.openfoundry.org/pugs/



http://darcs.pugscode.org/pugs/

Repositories






http://darcs.pugscode.org/pugs/

SVK

Repositories





Erdösing

Erdösing

♨ 2006..*

Hackathons

Hackathons♨ Taipei


♨ Vienna


♨ Vienna

♨ Toronto


♨ Vienna

♨ Toronto

♨ Amsterdam


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond

♨ Chicago


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond

♨ Chicago

♨ Boston


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond

♨ Chicago

♨ Boston

♨ Portland


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond

♨ Chicago

♨ Boston

♨ Portland

♨ Sao Paulo


♨ Vienna

♨ Toronto

♨ Amsterdam

♨ Echt

♨ Lismore

♨ Mt. Arbel

♨ Vienna2

♨ Tokyo

♨ Redmond

♨ Chicago

♨ Boston

♨ Portland

♨ Sao Paulo

♨ Mountain View?

Perl 6 Reconciling the

IrreconcilableAudrey Tang

Practical

Abstractions➥ Sexy

Closuressub make_counter { my $start = shift; return sub { ++$start };} my $from_ten = make_counter(10);my $from_three = make_counter(3); print $from_three->(); # 4print $from_three->(); # 5print $from_ten->(); # 11

Staged EvaluationBEGIN { print "Compile-time"; eval $generated_code; print "Still in compiler";}print "Normal runtime";eval $more_generated_code;

Runtime Typecasting

my $piece = Pawn->new;bless $piece, Queen;

Shorthands➥ Natural

Contexts

# Scalar vs. List context

my $one = <STDIN>; # Read one linemy @all = <STDIN>; # Read all lines

# String vs. Numeric context

print "Lines: @all" if @all < 10;

Tied Variables

tie my %search => 'Tie::Google';print $search{'Perl Pugs'}[0]{URL};# http://www.pugscode.org/

Regular Expresisons

# DeCSSs''$/=\2048;while(<>){G=29;R=142;if((@a=unqT="C*",_)[20]&48){D=89;_=unqb24,qT,@b=map{ord qB8,unqb8,qT,_^$a[--D]}@INC;s/...$/1$&/;Q=unqV,qb25,_;H=73;O=$b[4]<<9|256|$b[3];Q=Q>>8^(P=(E=255)&(Q>>12^Q>>4^Q/8^Q))<<17,O=O>>8^(E&(F=(S=O>>14&7^O)^S*8^S<<6))<<9,_=(map{U=_%16orE^=R^=110&(S=(unqT,"\xb\ntd\xbz\x14d")[_/16%8]);E^=(72,@z=(64,72,G^=12*(U-2?0:S&17)),H^=_%64?12:0,@z)[_%8]}(16..271))[_]^((D>>=8)+=P+(~F&E))for@a[128..$#a]}print+qT,@a}';s/[D-HO-U_]/\$$&/g;s/q/pack+/g;eval

Best coding➥ No coding

♡ 11 years

CPAN

♡ 11 years

♡ 5500+ authors

CPAN

♡ 11 years

♡ 5500+ authors

♡ 11000+ modules

CPAN

Services

♡ Package Management

Services


♡ Rating & Discussion

Services



♡ Smoke Testing

Services



♡ Smoke Testing

♡ Issue Tracking

Services

Vocabulary≩ Syntax

“The Best thing happened to Perl”

But...

Perl 5is not the best thing

for CPAN

SyntaxRedundancy

☣

• use v5;

• use v5;• sub render {

• use v5;• sub render {• my $self = shift;

• use v5;• sub render {• my $self = shift;• my %opts = (x => 1, y => 1, z => 0, %{$_[0]});

• use v5;• sub render {• my $self = shift;• my %opts = (x => 1, y => 1, z => 0, %{$_[0]});• for my $item ( $self->filter(@{ $self->{items} }) ) {

• use v5;• sub render {• my $self = shift;• my %opts = (x => 1, y => 1, z => 0, %{$_[0]});• for my $item ( $self->filter(@{ $self->{items} }) ) {• print $item->draw({

x => $opts{x}, y => $opts{y}, z => $opts{z}, }), "\n";

• use v5;• sub render {• my $self = shift;• my %opts = (x => 1, y => 1, z => 0, %{$_[0]});• for my $item ( $self->filter(@{ $self->{items} }) ) {• print $item->draw({

x => $opts{x}, y => $opts{y}, z => $opts{z}, }), "\n";

• }}

• use v6-alpha;

• use v6-alpha;• method render ($x = 1, $y = 1, $z = 0) {

• use v6-alpha;• method render ($x = 1, $y = 1, $z = 0) {• for @.filter(@.items) {

• use v6-alpha;• method render ($x = 1, $y = 1, $z = 0) {• for @.filter(@.items) {• say .draw(:$x, :$y, :$z);

}}

JengaInternals☣

Bug-for-bug compatibility

☣

Best Practicetakes discipline

Best Practiceshould be Natural!

2000RFCs

2001Parrot

2002Apocalypses

2003Ponie

(late, as in the late Arthur Dent)

2004Synopses

2005Pugs

2006v6-alpha

Reconcile the Irreconcilable

Static Typingvs

Dynamic Typing

Types☺

Typing☹

Static(C++, OCaml...)

☯ Efficient


☯ Efficient

☯ Robust


☯ Efficient

☯ Robust


Dynamic

(Python, Ruby, ...)

☯ Efficient

☯ Robust

☯ Productive


Dynamic

(Python, Ruby, ...)

☯ Efficient

☯ Robust

☯ Productive

☯ Flexible


Dynamic

(Python, Ruby, ...)

Gradual Typingwith Annotationsand Type Inference

•use v5;•sub f {• sqrt($_[0]**2 + $_[1]**2);•}•my $five = f( 3, 4 );

•use v6-alpha;•sub f {• sqrt(@_[0]**2 + @_[1]**2);•}•my $five = f( 3, 4 );

•sub f (Num $x, Num $y) {• sqrt($x**2 + $y**2);•}•my Num $five = f( 3, 4 );

• subset Positive of Num where { $_ > 0 }


• sub f ( Positive $x, Positive $y --> Positive where { $_ > ($x & $y) }) {



• sqrt($x ** 2 + $y ** 2);}



• sqrt($x ** 2 + $y ** 2);}

•my $five := f(3, 4); # inferred as Positive

Domain Specific vs

General Purpose

DSL(SQL, Regex, ...)

☯ Concise


☯ Concise

☯ Expressive


☯ Concise

☯ Expressive


GPL

(Lisp, C, ...)

☯ Concise

☯ Expressive

☯ Versatile


GPL

(Lisp, C, ...)

☯ Concise

☯ Expressive

☯ Versatile

☯ Reusable


GPL

(Lisp, C, ...)

Extensible Compilation

Macros

Macros

☯ Compile-time evaluation

Macros


☯ All parts are swappable

Macros


☯ All parts are swappable

☯ Even the lexer!

• macro circumfix:</* */> ($x)• is parsed /.*?/• { '' }• • /* This is a C-style comment */

•

• sub postfix:<!> ($x) {• [*] 1..$x• }• • say 10!; # 3628800

• macro GREETING () {• # A late-bound macro• q:code(:COMPILING){ "Hello, $s" };• }

• my $s = "world";• say GREETING; # Hello, world

Lazy Evaluationvs

Eager Evaluation

Lazy(Haskell, Unix pipes)

☯Modular


☯Modular

☯ Reasonable


☯Modular

☯ Reasonable


Eager

(everybody else)

☯Modular

☯ Reasonable

☯ Direct


Eager

(everybody else)

☯Modular

☯ Reasonable

☯ Direct

☯ Predictable


Eager

(everybody else)

Return-type Polymorphism with Laziness Annotations

• # "cat"for =<> { .say }

• # "cat"for =<> { .say }

• # "cat", together with line numbersfor each(1..*; =<>) { say "Line $^num: $^text";}

• # Lists are lazy by default

• # Lists are lazy by default• my @fib := (

• # Lists are lazy by default• my @fib := (• 0, 1,

• # Lists are lazy by default• my @fib := (• 0, 1,• each(@fib; @fib[1..*]).map(&infix:<+>)

);

• # Lists are lazy by default• my @fib := (• 0, 1,• each(@fib; @fib[1..*]).map(&infix:<+>)

);•

say "The first ten numbers are: @fib[^10]";

• # Items are eager values. However...

• # Items are eager values. However...• my $ignored = lazy { 10 ** (10 * 10) };

• # Items are eager values. However...• my $ignored = lazy { 10 ** (10 * 10) };• my $unused = lazy { say 1..$ignored };

• # Items are eager values. However...• my $ignored = lazy { 10 ** (10 * 10) };• my $unused = lazy { say 1..$ignored };

• say "Hello, world!";

Classesvs

Prototypes

Classes(Java, Smalltalk, ...)

☯ Typeful


☯ Typeful

☯ Disciplined


☯ Typeful

☯ Disciplined


Prototypes

(JavaScript, Lua, ...)

☯ Typeful

☯ Disciplined

☯ Adaptive


Prototypes


☯ Typeful

☯ Disciplined

☯ Adaptive

☯ Convenient


Prototypes


Meta-ObjectProtocol

• class Dog is Mammal does Companion {

• class Dog is Mammal does Companion {•

my $.count where 0..100;


my $.count where 0..100;•

has $!brain;



has $!brain;

• has &.vocalize = &say; has $.name is rw = "Fido";



has $!brain;


• has $.fur handles Groomable; has $.tail handles <wag hang>;



has $!brain;


• has $.fur handles Groomable; has $.tail handles <wag hang>;

• method companion handles s/^owner_// { ... }}

• my Dog $fido .= new;

• my Dog $fido .= new;•

$fido.HOW; # the meta object for Dog


$fido.HOW; # the meta object for Dog• $fido.WHAT; # the Dog prototype object


$fido.HOW; # the meta object for Dog• $fido.WHAT; # the Dog prototype object• $fido.WHICH; # $fido’s Object ID


$fido.HOW; # the meta object for Dog• $fido.WHAT; # the Dog prototype object• $fido.WHICH; # $fido’s Object ID

• Dog.isa(Dog); $fido.isa(Dog);

• $fido.HOW.add_method( 'bark', method () { $.vocalize('Woof!') });

• $fido.HOW.add_method( 'bark', method () { $.vocalize('Woof!') });

• Dog.can('bark'); $fido.can('bark');

Threadsvs

Processes

Threads(Implicit sharing)

☯ Intuitive


☯ Intuitive

☯ Parallelizable


☯ Intuitive

☯ Parallelizable


Processes

(Explicit sharing)

☯ Intuitive

☯ Parallelizable

☯ Deterministic


Processes

(Explicit sharing)

☯ Intuitive

☯ Parallelizable

☯ Deterministic

☯Manageable


Processes

(Explicit sharing)

Concurrency☺ ☺ ☺

Locking☹ ☹ ☹

•async { $x.withdraw(3);

$y.deposit(3);}

•async { $x.withdraw(3);

$y.deposit(3);}

☣ Race Condition ☣

• async { $x.lock; $y.lock;


• $x.withdraw(3); $y.deposit(3);}



• async { $y.lock; $x.lock;}



• async { $y.lock; $x.lock;}

☣ Deadlock ☣

SoftwareTransactional

Memory

•async {• contend { # begin transaction• $x.withdraw(3); $y.deposit(3);

• } # commit or rollback•}

• # Retry with "defer"method withdraw ($n) { defer if $.balance < $n; $.balance -= $n;}


•# Choice with "maybe"sub transfer ($x1, $x2, $y) { maybe { $x1.withdraw(3) } maybe { $x2.withdraw(3) } $y.deposit(3);}


•# Choice with "maybe"sub transfer ($x1, $x2, $y) { maybe { $x1.withdraw(3) } maybe { $x2.withdraw(3) } $y.deposit(3);}

•# Composable with nested "maybe"contend { maybe { transfer($x1, $x2, $y) } maybe { transfer($x3, $x4, $y) }}

SIMDvs

MIMD

SIMD(APL, Fortran)

☯ Simple

SIMD(APL, Fortran)

☯ Simple

☯ Scalable

SIMD(APL, Fortran)

☯ Simple

☯ Scalable

SIMD(APL, Fortran)

MIMD

(everybody else)

☯ Simple

☯ Scalable

☯ Richer types

SIMD(APL, Fortran)

MIMD

(everybody else)

☯ Simple

☯ Scalable

☯ Richer types

☯ Familiar flow

SIMD(APL, Fortran)

MIMD

(everybody else)

• # Hyper Operator (SSE/GPU friendly)[1, 1, 2, 3, 5] »+« [1, 2, 3, 5, 8];

• # Hyper Operator (SSE/GPU friendly)[1, 1, 2, 3, 5] »+« [1, 2, 3, 5, 8];

• # === [2, 3, 5, 8, 13]

•# Recursive Visits-« [[1, 2], 3];

•# Recursive Visits-« [[1, 2], 3];

•# === [[-1, -2], -3]

•# Hyper Methods[1, 4, 9, 16]».sqrt;

•# Hyper Methods[1, 4, 9, 16]».sqrt;

•# === [1, 2, 3, 4]

• % time pugs -e '(1..100000)>>.sqrt'real 9.387suser 9.219s

• % time pugs -e '(1..100000)>>.sqrt'real 9.387suser 9.219s

•% time env GHCRTS=-N2 pugs -e '(1..100000)>>.sqrt'real 5.807suser 6.959s

• # Junctionssub is_prime (Int $n --> Bool) { $n % all(2 .. $n.sqrt+1);}


•sub has_twin_prime (Int $n --> Bool) { is_prime($n & ($n ± 2));}



•sub infix:<±> ($x, $y) { ($x + $y) | ($x - $y);}



•sub infix:<±> ($x, $y) { ($x + $y) | ($x - $y);}

•

My Languagevs

Your Language

Perl 6

☯ Better

Perl 6

☯ Better

☯ Better

Perl 6

☯ Better

☯ Better

Perl 6 Others

☯ Better

☯ Better

☯ Better

Perl 6 Others

☯ Better

☯ Better

☯ Better

☯ Better

Perl 6 Others

•use jsan:DOM;•use perl5:DBI;•use haskell:Numeric;•use your_language:FavouriteModule;

Pugs

JavaScript

Haskell Perl 5

YARV?JVM?

CLR? PyPy?

When willPerl 6 be released?

By Christmas!

When Perl 6 arrives,every day will be like

Christmas!❆

Thank you!

☺

pugs: a perl 6 implementation

Technology