Submitted by Automa??o e Estat?stica (sst@bczm.ufrn.br) on 2017-03-15T00:19:14Z
No. of bitstreams: 1
ThiagoDavidDosSantosMarinho_DISSERT.pdf: 1356454 bytes, checksum: 1729cdbb721d0f506e383c0cbe6eb72e (MD5) / Approved for entry into archive by Arlan Eloi Leite Silva (eloihistoriador@yahoo.com.br) on 2017-03-17T00:21:08Z (GMT) No. of bitstreams: 1
ThiagoDavidDosSantosMarinho_DISSERT.pdf: 1356454 bytes, checksum: 1729cdbb721d0f506e383c0cbe6eb72e (MD5) / Made available in DSpace on 2017-03-17T00:21:08Z (GMT). No. of bitstreams: 1
ThiagoDavidDosSantosMarinho_DISSERT.pdf: 1356454 bytes, checksum: 1729cdbb721d0f506e383c0cbe6eb72e (MD5)
Previous issue date: 2016-08-30 / Este trabalho apresenta a ferramenta GenMeter, composta por: (i) uma linguagem espec?fica
de dom?nio utilizada para descrever textualmente testes de performance; e (ii) um
componente que utiliza os testes descritos para gerar projetos em diferentes plataformas
de execu??o de testes de performance. O objetivo ? utilizar os conceitos definidos na
linguagem para abstrair os conceitos de cada plataforma, que muitas vezes s?o modelados
diferentemente, quanto ? nomenclatura e/ou estrutura, e at? dependentes da ferramenta,
ao inv?s de apenas do dom?nio. A ferramenta proposta oferece suporte para testes de
servi?os SOAP, REST e de aplica??es web para JMeter e Silk Performer. Ela tamb?m
permite a customiza??o para novos tipos de testes e plataformas alvo. Foram feitos estudos
para avaliar o uso da ferramenta: 3 testes de aplica??es Web, REST e SOAP foram reescritos
na linguagem espec?fica de dom?nio (DSL - domain specific language) e ent?o foram
gerados projetos nas plataformas de destino, para que fossem executados. A partir dos
ajustes e novas implementa??es necess?rios para a gera??o dos projetos, obteve-se feedback
referente a capacidade de customiza??o da ferramenta em rela??o aos tipos de aplica??es
e caracter?sticas de plataformas e organiza??es. Al?m disso, os scripts tamb?m foram
avaliados em rela??o ? sua concis?o: al?m dos testes implementados com a DSL e com o Silk
Performer, foram criados testes com a ferramenta Gatling.io (tamb?m baseados no teste
da empresa). Comparou-se o total de palavras necess?rias para a defini??o de cada teste,
al?m da rela??o entre o n?mero de palavras reservadas e o total de palavras, e a rela??o
entre o n?mero de palavras reservadas fora do contexto e o total de palavras reservadas.
Os testes criados com a DSL GenMeter possuem, em m?dia, 59,15% menos palavras em
rela??o aos testes de Silk Performer e 39,43% em rela??o aos testes de Gatling.io, com
exce??o de um tipo de teste, em que a especifica??o com a DSL ficou com pouco mais
que o dobro (138,35%) de palavras. Na segunda compara??o, em m?dia, os testes com
a GenMeter apresentaram um percentual de 56,33% de palavras reservadas em rela??o
ao total, contra 39,98% do Silk Performer e 67,03% do Gatling.io. Esta compara??o
pode ser interpretada como a quantidade de informa??o adicional que o usu?rio precisa
fornecer pra cada linguagem, al?m das estruturas fornecidas pela mesma. J? na terceira
compara??o, que pode ser interpretada como o quanto a sintaxe da linguagem hospedeira
pode interferir na visualiza??o das informa??es dos testes, a GenMeter teve em m?dia
23,57% de palavras reservadas fora do contexto em rela??o ao total de palavras reservadas,
contra 53,38% do Silk Performer e 54,60% do Gatling. Dessa forma, foi poss?vel observar
os benef?cios de utilizar a DSL para diferentes tipos de aplica??es, customizando-a de
acordo com determinados conceitos e caracter?sticas de plataformas e organiza??es. / This work presents GenMeter, a tool composed of: (i) a domain-specific language (DSL)
used to describe textually performance tests; and (ii) a component that uses those
described test specifications to generate projects in different performance test execution
platforms. The purpose is to use concepts defined in the language to abstract the concepts
of each platform, which are often modeled differently regarding nomenclature and/or
structure and even dependent on the tool rather than just the domain. The proposed
tool supports SOAP, REST and web applications performance tests to JMeter and Silk
Performer. It also allows customization to new test types and target platforms. Studies
were conducted to evaluate the use of the tool: 3 tests of web applications, REST and
SOAP services have been rewritten in the DSL and then were generated projects to the
target platforms, to be executed. After the adaptation and new implementations necessary
for the project generation, we obtained feedback regarding the ability to customize the
tool for the applications types and platforms and organizations features. Moreover, the
scripts were also evaluated for their conciseness: tests were created with Gatling.io tool
(also based on the company?s test) to compare with existing DSL and Silk Performer tests.
Our study also compared the total number of words needed to define each test and the
relation between the number of reserved words and the total number of words; and the
relationship between the number of reserved words out of context, and the total of reserved
words. Tests created with GenMeter have, on average, 59,15% less words in relation to
Silk Performer tests and 39,43% in relation to Gatling.io tests, except by one test type,
where GenMeter?s tests get little more than the double (138,35%) of words. In second
comparison, on average, tests with the GenMeter presented a percentage of 56.33% of
reserved words in relation to the total, against 39.98% from Silk Performer and 67.03%
from Gatling.io. This first comparison can be interpreted as the amount of additional
information that the user needs to provide for each language, in addition to the structures
provided by them. In the third comparison, which can be interpreted as how the syntax
of the host language may interfere with viewing of the test information, GenMeter had
an average of 23.57% of reserved words out of context relative to the total of reserved
words against 53.38% from Silk Performer and 54.60% from Gatling. Thus, it was possible
to observe the benefits of using DSL for different types of applications, customizing it
according to certain concepts and features platforms and organizations.
| Identifer | oai:union.ndltd.org:IBICT/oai:repositorio.ufrn.br:123456789/22312 |
| Date | 30 August 2016 |
| Creators | Marinho, Thiago David dos Santos |
| Contributors | 02219235432, http://lattes.cnpq.br/0189095897739979, Ramalho, Franklin de Souza, 00094321400, http://lattes.cnpq.br/2469816352786812, Medeiros, S?rgio Queiroz de, 00984989404, http://lattes.cnpq.br/0310395336626784, Pinto, Felipe Alves Pereira, Kulesza, Uira |
| Publisher | PROGRAMA DE P?S-GRADUA??O EM ENGENHARIA DE SOFTWARE, UFRN, Brasil |
| Source Sets | IBICT Brazilian ETDs |
| Language | Portuguese |
| Detected Language | English |
| Type | info:eu-repo/semantics/publishedVersion, info:eu-repo/semantics/masterThesis |
| Source | reponame:Repositório Institucional da UFRN, instname:Universidade Federal do Rio Grande do Norte, instacron:UFRN |
| Rights | info:eu-repo/semantics/openAccess |
Page generated in 0.0026 seconds