UNIDAD 5 ANALIZADOR LEXICO

7/17/2019 UNIDAD 5 ANALIZADOR LEXICO

http://slidepdf.com/reader/full/unidad-5-analizador-lexico 1/26

UNIDAD 5“ANALISIS LEXICO”ATERIA: LENGUAJES Y AUTOMATAS 1

TEDRATICO: *******************************ALUMNOS: *DOMINGUEZ VILLANUEVA CESAR SAUL *HERNANDEZ DE LA ROSA DANIELA E.

*RAMIREZ AVELINO DULCE ANGELICA *RODRIGUEZ ACOSTA KAREN DEL ROCIO

CD. VICTCICLO ESCOLAR: AGOSTO DICIEM!RE "#1$



5.1 %UNCIONES DE UN ANALIZADORLEXICO

U& '&'()'+- (/)0 '2(' 3( '&'()'+- 2)&404)0 +3 (' -36-323&4'0)7& +3(3/38'2 +3 (2 086&3&432 (/)02.



E( '&'()'+- (/)0 63-' 9' 634)0)7& +3( '&'()'+- 2)&404)0+3;(;)3&+ <& 086&3&43 (/)0 0&=-83 3( '&'()'+- 2)&404)0 ( ;'&3032)4'&+ 6'-' ';'&'- 3& (' >-'84)0'. L2 086&3&432 (/)02 2&(2 289(2 43-8)&'(32 +3 (' >-'84)0'.

S<3(3 )86(383&4'-23 08 <&' 2<9-<4)&' +3( '&'()'+- 2)&404)0.C<'&+ -30)93 (' -+3& 94& 3( 2)><)3&43 086&3&43 (/)0, 3('&'()'+- (/)0 (33 (2 0'-'043-32 +3 3&4-'+' ?'24' )+3&4)@0'- 3(2)><)3&43 086&3&43 (/)0.



DEFINICIONES: Tokens:

S89(2 43-8)&'(32 +3 <&' >-'84)0'

I+3&4)@0'+-32, 6'('9-'2 -323-;'+'2, 63-'+-32,...

V'-)2 2)>&2 6<3+3& =-8'& 3( 8)28 4B3&

Atributos:

I&=-8'0)7& '+)0)&'( <3 4)3&3 3( 4B3&, +3 <4)()+'+ 6'-' 3( '&()2)2 2)&404)0 238&4)0.

Componentes léxicos (tokens):

<&)+'+ 8&)8' +3 )&=-8'0)7& <3 2)>&)@0' '(> ' (' ?-' +3 086)('- 0&0364 +3 6'('9-' ('2 (3&><'3 0&24'& +3 0'+3&'2 +3 086&3&432 (/)02.

Lexem:

U&' 230<3&0)' +3 0'-'043-32 +3 3&4-'+' <3 086-3&+3& <& 2( 086&3&43 (/)0 23 (('8' (30'-'043-32 <3 3/4-'3 3( 086&3&43 '924-'04 +3( 086&3&43 (/)0.

!tr"n:

D320-)60)7& +3 (' =-8' <3 ?'& +3 48'-(2 (3/38'2 6'-' '<24'-23 ' <& 086&3&43 (/)0.



#E$!LO:



OTRAS %UNCIONES:

M'&3 +3( @0?3- +3 3&4-'+' +3( 6->-'8' =<3&43: '9-)-(, (33- 2<20'-'043-32, 03--'-( >324)&'- 62)9(32 3---32 +3 (304<-'.

E()8)&'- 083&4'-)2, 326'0)2 3& 9('&0, 4'9<('+-32 2'(42 +3 (&3'F0'-'043-32 & ;'()+2 6'-' =-8'- <& 4B3&.

I&0(<2)7& +3 @0?3-2: )&0(<+3...

L' 3/6'&2)7& +3 8'0-2 =<&0)&32 )& ()&3: +3@&3...

C&4'9)()'- 3( &83- +3 (&3'2 0(<8&'2 6'-' 38)4)- 83&2'32 +33---.

R30&0)8)3&4 330<0)7& +3 ('2 +)-304);'2 +3 086)('0)7& F6-3386(, 6'-' +36<-'- < 64)8)'- 3( 07+)> =<3&43.



ASPECTOS DEL ANALISIS LEXICO

Dise%o m&s sencillo:

L2 289(2 <3 4-'4' 3( 20'&&3- 23 +320-)93 0& <&' >-'84)0' 82 2)86(3<3 (' +3( 6'-23-, >-'84)0' -3><('-

$e'or l ecienci:

G-'& 6'-43 +3( 4)386 +3 086)('0)7& 23 0&2<83 3& (' (304<-' 3/6(-'0)7& +30'-'043-32

$e'or l portbili:

S3 6<3+3& 43&3- ;'-)'2 ;3-2)&32 +3( 20'&&3- <&' 6'-' +)24)&42 07+)>2FE!CDID, ASCII, ..., 0& 3( 8)28 6'-23-

Descr* el n&lisis sint&ctico:

E386( & 6<3+ +)24)&><)- 3& %ORTRAN ?'24' +326<2 +3( 1

DO 5 I1."5

DO 5 I1,"5



+,- CO$!ONENTES L./ICOS0 !AT1ONESLE/E$AS

CO$!ONENTE LE/ICO: S& ('2 <&)+'+32 (7>)0'2 <3 >3&3-' 3( '&'()'+- (/)00'-'043-32 3& 4B3&2 32 8< 6'-30)+ ' =-8'- 6'('9-'2 3& <& (3&><'3 &'4<-'(

E2 3( 0&<&4 +3 0'+3&'2 +3 3&4-'+' <3 6-+<03 08 2'()+' 3( 8)28 086&C'+' 4B3& 32 <&' 230<3&0)' +3 0'-'043-32 <3 -36-323&4' <&' <&)+'+ +3 )&=-86->-'8' =<3&43. L2 086&3&432 (/)02 82 08<&32 2& (2 2)><)3&432: 6'('-323-;'+'2:

63-'+-32 '-)484)02

63-'+-32

-3('0)&'(32

63-'+-32 (7>)02

63-'+- +3 '2)>&'0)7&

)+3&4)@0'+-32

0&24'&432

0'+3&'2

()43-'(32

2)>&2 +3 6<&4<'0)7& ()9-3-'2



Lexem:

R36-323&4'& 0'+3&'2 +3 0'-'043-32 3& 3( 6->-'8' =<3&43 <3 23 6<3+3& 4-'4'- <&42 08 <&(/)0'. U& (3/38' 32 <&' 230<3&0)' +3 0'-'043-32 3& 3( 6->-'8' =<3&43 0& (' <3 0&0<3-+' 3<& 086&3&43 (/)0.

!tr"n:

R3>(' <3 +320-)93 3( 0&<&4 +3 (3/38'2 <3 6<3+3& -36-323&4'- ' <& +343-8)&'+ 086&3(2 6->-'8'2 =<3&43. E& 4-'2 6'('9-'2, 32 (' +320-)60)7& +3( 086&3&43 (/)0 83+)'&43 <&'

Atributos e los componentes léxicos:

E( '&'()'+- (/)0 -30>3 )&=-8'0)7& 29-3 (2 086&3&432 (/)02 3& 2<2 '4-)9<42 '20)086&3&432 (/)02 )&<3& 3& ('2 +30)2)&32 +3( '&()2)2 2)&404)0 (2 '4-)9<42 3& (' 4-'086&3&432 (/)02:

A6<&4'+- ' (' 3&4-'+' +3 (' T'9(' +3 289(2 +&+3 23 ><'-+' (' )&=-8'0)7& 29-3 3( 086

E( (3/38' 6'-' <& )+3&4)@0'+-

E( &83- +3 (&3' 3& <3 23 3&0&4-7 6- 6-)83-' ;3.



+,3 C1EACI4N DE TA5LA DETO6ENS

Tbl: 0&<&4 +3 6'-32 0(';3;'(-, (('8'+2 3(383&42 +3 (' 4'9('. L'4'9(' +3 289(2 32 <&' 086&3&43 &3032'-)' +3 <& 086)('+-. A(+30('-'- <& )+3&4)@0'+- F&-8'(83&43 <&' 2(' ;3, 243 32 )&23-4'+ 3&(' 4'9('. C'+' ;3 <3 23 <4)()03 3( )+3&4)@0'+- 23 -3'()'- <&' 92<3+'3& (' 4'9(' 6'-' 943&3- (' )&=-8'0)7& '20)'+' F3( ;'(-.

!2<3+': +'+' (' 0(';3 +3 <& 3(383&4, 3&0&4-'- 2< ;'(-. I&23-0)7&: D'+ <& 6'- 0(';3;'(-, ''+)- <& 3(383&4 &<3; ' (' 4'9('.

C'89) +3 ;'(-: !<20'- 3( 3(383&4 0'89)'- 2< ;'(-.

!--'+: E()8)&'- <& 3(383&4 +3 (' 4'9('.

L&>)4<+ +3 92<3+' F 4)386 +3 '0032



D3 <&' 0(';3: L) &83- +3 086'-'0)&32 0& 3(383&42 +3 ('4'9(' 6'-' 3&0&4-'- 32' 0(';3. M/)8': LM &83- 8/)8 +3086'-'0)&32 6'-' 3&0&4-'- 0<'(<)3- 0(';3. M3+)' F3263-'+': L8 &83- 83+) +3 086'-'0)&32 6'-' 3&0&4-'- <& ;'(-. S) ('=-30<3&0)' +3 4+'2 ('2 0(';32 32 (' 8)28':

L8 FS L)N S) (' =-30<3&0)' +3 4+'2 ('2 0(';32 & 32 (' 8)28':

L8 S 6).L)

G-'+ +3 0<6'0)7&:

2 &N +&+3 &&83- +3 3(383&42 3& (' 4'9(' N0'6'0)+'+8/)8' +3 (' 4'9('.

%<&0)7& +3 92<3+': ! : KE '20)' ' 0'+' 0(';3 B <& 3(383&4 !FB.



Valor asociado a una clave k: v(B(k)). Puede ser múltiple, en cuyo caso normalmente se

convierte en un puntero. Si está en la tabla puede almacenarse consecutivamente o en

subtablas paralelas. Tablas de smbolos (identi!icadores) "a clave es el identi!icador. #l valoestá !ormado por:

$tributos del identi!icador. Puntero a la posici%n de memoria asi&nada. "a clave puede

sustituirse por un puntero. "os identi!icadores pueden estar empa'uetados. "a lon&itud del

identi!icador puede especi!icarse en la tabla o delante del nombre, o ser implcita.

Tablas consecutivas: Todos los elementos ocupan posiciones de memoria adyacentes. Tabl

li&adas: cada elemento apunta al si&uiente. Tablas doblemente li&adas: cada elemento apun

al si&uiente y al anterior. Tablas no ordenadas nserci%n: en el primer lu&ar vaco.



+,8 E11O1ES L./ICOS

E( '&()2)2 (/)0 0&24)4<3 (' 6-)83-' ='23, '< 23 (33 3( 6->-'8'=<3&43 +3 )<)3-+' ' +3-30?' 23 '>-<6' 3& 086&3&432 (/)02F4B3&2, <3 2& 230<3&0)'2 +3 0'-'043-32 <3 4)3&3& <& 2)>&)@0'+.A+382, 4+2 (2 326'0)2 3& 9('&0, (&3'2 3& 9('&0, 083&4'-)2 +382 )&=-8'0)7& )&&3032'-)' 23 3()8)&' +3( 6->-'8' =<3&43. T'89)&23 086-<39' <3 (2 289(2 +3( (3&><'3 F6'('9-'2 0(';3,63-'+-32,... 23 ?'& 320-)4 0--304'83&43.



C8 (' 4'-3' <3 -3'()' 3( '&'()'+- (/)0 32 <& 0'2 32630)'( +3 0)&0)+3&0)'+3 6'4-&32, 23 &3032)4'& (2 84+2 +3 32630)@0'0)7& -30&0)8)3&4 +36'4-&32, 3242 84+2 2& 6-)&0)6'(83&43 ('2 3/6-32)&32 -3><('-32 (2'<478'4'2 @&)42. S)& 389'->, <& '&'()'+- (/)0 4'89)& 32 (' 6'-43 +3(4-'+<04- <3 8'&3' (' 3&4-'+' +3( 07+)> =<3&43, 6<324 <3 324' 3&4-'+' '83&<+ )&;(<0-' <& )86-4'&43 >'24 +3 4)386, 3( '&'()'+- (/)0 +393=<&0)&'- +3 8'&3-' 4'& 3@0)3&43 08 23' 62)9(3.

S& 602 (2 3---32 2)86(383&43 3& 3( &);3( (/)0 ' <3 4)3&3 <&' ;)2)7& 8<-324-)&>)+' +3 <& 6->-'8' =<3&43. E( '&'()'+- (/)0 +393 +3;(;3- 3(086&3&43 (/)0 +3 <& )+3&4)@0'+- +3'- ' 4-' ='23 23 0<63 +3 (2 3---32.

S<6&>' <3.<&' 2)4<'0)7& 3& (' 0<'( 3( '&'()'+- (/)0 & 6<3+3 0&4)&<'- 6-<3 &)&><&+3 (2 6'4-&32 0&0<3-+' 0& <& 6-3@ +3 (' 3&4-'+'. T'( ;3 (' 324-'43>)' +3-30<63-'0)7& 82 23&0)((' 23' -30<63-'0)7& “EN MODO PANICO” F3243 84++3 -30<63-'0)7& 32 +&+3 23 9--' 0'-'043-32 2<032);2 +3 (' 3&4-'+' ?'24'<3 3( '&'()'+- (/)0 6<3+' 3&0&4-'- <& 086&3&43 (/)0 9)3& =-8'+.QQL2 6->-'8'2 & 2)386-3 2& 0--3042



EL CO$!ILADO1 TIENE 9E:

R36-4'- 0('-' 3/'04'83&43 (' 6-323&0)' +3 3---32

R30<63-'-23 +3 0'+' 3--- ( 2<@0)3&4383&43 -6)+ 6'-' 6+3- +34304'- 3---322<92)><)3&432:

T-'4'- +3 3;)4'- 83&2'32 ='(22 +3 3--- U& 3--- <3 6-+<03 <& 4B3& 3--7&3

E---32 (/)02 62)9(32

U& 4B3& 086&3&43 (/)0 32 <&' 0'+3&' +3 0'-'043-32 <3 4)3&3 <& 2)>&)@0'0?3-3&43 3& 0)3-4 (3&><'3 +3 6->-'8'0)7&. E386(2 +3 4B3&2, 6+-'& 23- 60(';3 F)=, ?)(3, )&4, )+3&4)@0'+-32, &83-2, 2)>&2, <& 63-'+- +3 ;'-)2 0'S& (2 3(383&42 82 92)02 29-3 (2 0<'(32 23 +32'--((' 4+' 4-'+<00)7& +3 6->-'8', 2<->3& 3& (' 6-)83-' ='23, (('8'+' '&()2)2 (/)0.



+,+ ;ENE1ADO1ES DE ANALI<ADOL./ICOS

E&4-3 (2 >3&3-'+-32 +3 '&'()'+-32 L/)0223 3&0<3&4-'& (2 2)><)3&432:

FLE/LE/ #TLex



FLE/

E2 <&' ?3--'8)3&4' 6'-' >3&3-'- 320&3-32. U& 320&3-, ' (('8'+ <& 4B3&)3-, 32 <& 6->-'8' <3 -30&03 6'4-&33& 3( 43/4. E( 6->-'8' 3/ (33 (2 '-0?);2 +3 3&4-'+' 326

6- 3( <2<'-), (' 3&4-'+' 324&+'- 2) & 23 +'& (2 &89-'-0?);, 6'-' <&' +320-)60)7& +3 <& 320&3- ' >3&3-'-.



L' +320-)60)7& 32 3& =-8' +3 6'-32 +3 3/6-32)&32 -3><('-32 07+)> C, +3&8)&'+'2 -3>('2.

%(3/ >3&3-' <& '-0?); =<3&43 3& C (('8'+ (3/..0, <3 +3@(' =<&0)7& (3/ F.

E( (3/..0 '-0?); 6<3+3 23- 086)('+ ;)&0<('+ ' 6-+<0<& 330<4'9(3. C<'&+ 23 330<4' 3( '-0?); 330<4'9(3, 3243'&'()' 2< 3&4-'+' 6'-' ('2 '6'-)0)&32 +3 43/4 <3 0)&0)+3&0& ('2 3/6-32)&32 -3><('-32 6'-' 0'+' -3>('. C'+' ;3 <33&0<3&4-' <&' 0)&0)+3&0)', 23 330<4' 3( 07+)> C

0--326&+)3&43.



LEX

E2 <& 6->-'8' 6'-' >3&3-'- '&'()'+-32 (/)02 F3& )&>(2scanners lexers.

L3/ 23 <4)()' 08&83&43 0& 3( 6->-'8' '00 <3 23 <4)()'6'-' >3&3-'- '&()2)2 2)&404)0. L3/, 320-)4 -)>)&'(83&43 6-E-)0 S0?8)+4 M)B3 L32B, 32 3( '&'()'+- (/)0 324&+'- 3& (22)2438'2 U&)/, 23 )&0(<3 3& 3( 324&+'- +3 POSIX. L3/ 48'

08 3&4-'+' <&' 32630)@0'0)7& +3 '&'()'+- (/)0 +3;<3(;3 08 2'()+' 3( 07+)> =<3&43 )86(383&4'&+ 3('&'()'+- (/)0 3& C.

A<&<3 4-'+)0)&'(83&43 23 4-'4' +3 2=4'-3 6-6)34'-),3/)243& ;3-2)&32 ()9-32 +3 (3/ 9'2'+'2 3& 3( 07+)> -)>)&'( +3ATT 3& 2)2438'2 08 O63&S('-)2 P('& +3 (2 ('9-'4-)2!3((. O4-' ;3-2)7& 66<('- +3 2=4'-3 ()9-3 +3 (3/ 32 %(3/.

A 4 +) ) ( 4 4 4 + =4 ) 4 ) )



A<&<3 4-'+)0)&'(83&43 23 4-'4' +3 2=4'-3 6-6)34'-), 3/)2;3-2)&32 ()9-32 +3 (3/ 9'2'+'2 3& 3( 07+)> -)>)&'( +3 ATT 32)2438'2 08 O63&S('-)2 P('& +3 (2 ('9-'4-)2 !3((. O4-' ;3-2)7& 66<('- +3 2=4'-3 ()9-3 (3/ 32 %(3/.

L' 324-<04<-' +3 <& '-0?); +3 (3/ 32 )&43&0)&'+'83&43 2)8)((' +3 <& '-0?); +3( '00 (2 '-0?);2 23 +);)+3& 3& 4-32 2300)236'-'+'2 6- (&3'2 <3 0&4)3&3& 2('83&43 +2 289(2 %08 2)><3:

S300)7& +3 +30('-'0)&32WWS300)7& +3 -3>('2WW

S300)7& +3 07+)> 3& C

L' secci"n e ec

3( (<>'- 6'-' +3@&)-)86-4'- (2 '-0?);320-)42 3& C. T'89320-)9)- 0<'(<)3- 07<3 23- 06)'+ 3&=<3&43 >3&3-'+. E2+393 )- 3&4-3 (2 28



T'89)& 23 6<3+3& )&0(<)- '4'2 6'-' +3@&)- 6'4-&32 +3 (' S300)7& +3R3>('2, 6- 3386( 3& ;3 +3( 6'4-7& #[* F03- 82 +>)42 <3-30&03-'& 0<'(<)3- &83- &'4<-'(, 23 6<3+3 +3@&)- 3& 324' 2300)7&3( '4': &83-2 #[*, '2, 3& (' 2300)7& +3 07+)> 6&+-'82 3(6'4-7& &83-2 '00)7&\3&\C. C& 324 23 0('-)@0' (' 320-)4<-' +3(07+)> 3& (3/.

L' secci"n e re*ls 32 (' 2300)7& 82 )86-4'&43 '20)' 6'4-&32 '23&43&0)'2 +3 C. L2 6'4-&32 2& 2)86(383&43 3/6-32)&32 -3><('-32.C<'&+ 3( lexer 3&0<3&4-' <& 43/4 3& (' 3&4-'+' <3 32 '20)'9(3 ' <&6'4-7& +'+, 330<4' 3( 07+)> '20)'+ +3 C. ]24' 32 (' 9'23 +3 +3(

=<&0)&'8)3&4 +3 (3/.



L' secci"n e c"i*o C 0&4)3&3 23&43&0)'2 3& C =<&0)&32 <323-& 06)'+'2 3& 3( '-0?); =<3&43 >3&3-'+. E24'2 23&43&0)'20&4)3&3& >3&3-'(83&43 3( 07+)> (('8'+ 6- ('2 -3>('2 3& (' 2300)7&+3 ('2 -3>('2. E& 6->-'8'2 >-'&+32 32 82 0&;3&)3&43 6&3- 324307+)> 3& <& '-0?); 236'-'+ 3&(''-( 3& 4)386 +3 086)('0)7&.



+,= A!LICACIONES (CASO DEESTDIO)

A+382 +3 6'-' 0&24-<)- 086)('+-32 3 )&4-6-3432, (2 '&'()'+-32(/)02 23 6<3+3& 386(3'- 6'-' 8<0?2 6->-'8'2 ^0&;3&0)&'(32. L23386(2 82 0('-2 2& '<3((2 6->-'8'2 <3 4)3&3& '(>& 4)6 +33&4-'+' +3 43/4 +&+3 ?' <& =-8'4 -'&'9(383&43 ()9-3 3& 0<'&42326'0)2 083&4'-)2. E& 3242 0'22 32 9'24'&43 3&>--2 0&4-('-+&+3 386)3' 43-8)&' 0'+' 086&3&43 32 =0)( ()'-23 0& (2

6<&43-2 ' 0?'-. U& '&'()'+- (/)0 2)86()@0' &4'9(383&43 (' )&43-=' 2) 23 +)26&3 +3 <& >3&3-'+- '<484)0, 3( 6-9(38' 23 -32<3(;3 3&60'2 (&3'2 +3 07+)>.



E#E$!LO:

U& 3386( 23&0)(( +3 <2 +3 '&'()'+-32 (/)02 23- 3( 4-'9' 0&@0?3-2 ->'&)'+2 3& =-8' +3 0(<8&'2 236'-'+'2 6- 4'9<('+-32.S<6&>'82 <3 43&382 <& @0?3- +3 43/4 3& 3( <3 '6'-303&230<3&0)'2 +3 +>)42 236'-'+'2 6- 4'9<('+-32 <3 +3@&3& 0(<8&'2._<3-382 2<8'- (' 0(<8&' & +3 (' 4'9('.



P+382 386(3'- (' 2)><)3&43 32630)@0'0)7& (/)0':

P'2'- 324 ' 3/ 32 4-);)'(: )&4 (3/F



P'2'- 324 ' 3/ 32 4-);)'(:

W

)&0(<+3 0(<8&'2.?

)&0(<+3 ̀ 24+).?a

)&0(<+3 ̀ 24-)&>.?a

)&4 &()&3'

)&4 ;'(W

WW

b * E()8)&'82 (2 326'0)2. *

#[b ;'( '4)F43/4 -34<-& NUMERO

^4 -34<-& SEPARACION

^& &()&3'bb -34<-& LINEA

. =6-)&4=F24+3--, A;)2: 0'-\'043- W0 )&3263-'+,(\\&3' W+.^&, 43/4#[, &()&3'

L'2 +3@&)0)&32 '</)()'-32 &3032'-)'2 324'-'& 3&3( @0?3- 0(<8&'2 ?:

+3@&3 NUMERO "5c

+3@&3 SEPARACION "5d

+3@&3 LINEA "5e

3/43-& )&4 ;'(

3/43-& )&4 &()&3'

)&4 (3/F)&4 2<8' F)&4 &0( * S<8' (2 +'42 +0(<8&' &0(. *)&4 4B3&, 0(, -32-32 # * -32<(4'+ *&()&3' #?)(3 F F4B3& (3/F #

0( 1 * 0(<8&' '04<'( *?)(3 F1)= F 4B3& NUMERO 3---FL' (\\&3' +393 083&'- 6- <&\<83-)= F 0( &0( -32b ;'(4B3& (3/F)= F 4B3& SEPARACION 4B3&

3--- FD34-\'2 +3 <& &\<83- +393 ?4'9<('+- <& @& +3 (\\&3'.)= F 4B3& LINEA 9-3'B4B3& (3/F0(bb)= F 0(` &0( 3--- FN ?' 2<@0)3&432 0'862 3& (\\&3'.

-34<-& -32

UNIDAD 5 ANALIZADOR LEXICO

Documents

Transcript of UNIDAD 5 ANALIZADOR LEXICO