Tese de mestrado integrado. Engenharia Informática e Computação. Faculdade de Engenharia. Universidade do Porto. 2012

La implementación de Rhinoscript en facultades de arquitectura en Latinoamérica se realizó en Santiago de Chile (2006, 2007) y Lima (2008), estableciendo algunos criterios para explorar formas complejas usando la programación, con estudiantes de pregrado bajo estrategias de postgrado. Después de documentar los resultados de las dos primeras experiencias [1], se hallaron métodos que se usaron durante la implementación. El objetivo es evidenciar como las experiencias llevadas a cabo pueden aplicarse a otros contextos regionales, proponiendo tipologías para empezar y recursos disponibles que permitan a los estudiantes desarrollar por si mismos nuevas exploraciones.

Spreadsheets are routinely used in business and scientific contexts, and one of the most vexing challenges data analysts face is performing data cleaning prior to analysis and evaluation. The ad-hoc and arbitrary nature of data cleaning problems, such as typos, inconsistent formatting, missing values, and a lack of standardization, often creates the need for highly specialized pipelines. We ask whether an LLM can find its way around a spreadsheet and how to support end-users in taking their free-form data processing requests to fruition. Just like RAG retrieves context to answer users' queries, we demonstrate how we can retrieve elements from a code library to compose data processing pipelines. Through comprehensive experiments, we demonstrate the quality of our system and how it is able to continuously augment its vocabulary by saving new codes and pipelines back to the code library for future retrieval. / Master of Science / Spreadsheets are frequently utilized in both business and scientific settings, and one of the most challenging tasks that must be accomplished before analysis and evaluation can take place is the cleansing of the data. The ad-hoc and arbitrary nature of issues in data quality, such as typos, inconsistent formatting, missing values, and lack of standardization, often creates the need for highly specialized data cleaning pipelines. Within the scope of this thesis, we investigate whether a large language model (LLM) can navigate its way around a spreadsheet, as well as how to assist end-users in bringing their free-form data processing requests to fruition. Just like Retrieval-Augmented Generation (RAG) retrieves context to answer user queries, we demonstrate how we can retrieve elements from a Python code reference to compose data processing pipelines. Through comprehensive experiments, we showcase the quality of our system and how it is capable of continuously improving its code-writing ability by saving new codes and pipelines back to the code library for future retrieval.

As technology becomes ever more pervasive, the challenges of home automation are increasingly apparent. Seamless home control, home monitoring and home programming by the end user have yet to enter the mainstream. This could be attributed to the challenge of developing a fully autonomous and extensible home system that can support devices and technologies of differing protocols and functionalities. In order to offer programming facilities to the user, the underlying rule system must be fully independent, allowing support for current and future devices. Additional challenges arise from the need to detect and handle conflicts that may arise among user rules and yield undesirable results. Non-technical individuals typically struggle when faced with a programming task. It is therefore vital to encourage and ease the process of programming the home. This thesis presents Homer, a home system that has been developed to support three key features of a home system: control, monitoring and programming. Homer supports any third-party hardware or software service that can expose its functionality through Java and conform to the Homer interface. Stand-alone end user interfaces can be written by developers to offer any of Homer's functionality. Where policies (i.e. rules) for the home are concerned, Homer offers a fully independent policy system. The thesis presents a custom policy language, Homeric, that has been designed specifically for writing home rules. The Homer policy system detects overlaps and conflicts among rules using constraint satisfaction and the effect on environment variables. The thesis also introduces the notion of perspectives to ease user interactivity. These have been integrated into Homer to accommodate the range of ways in which a user may think about different aspects and features of their home. These perspectives include location, device type, time and people-oriented points of view. Design guidelines are also discussed to aid end user programming of the home. The work presented in this thesis demonstrates a system that supports control, monitoring and programming of the home. Developers can quickly and easily add functionality to the home through components. Conflicts can be detected amongst rules within the home. Finally, design guidelines and a prototype interface have been developed to allow both technically minded and non-technical people to program their home.

As the Internet becomes more pervasive, the content and services are increasing in quantity as well as improving in quality. This trend is fostered by the advancement of technologies, such as RESTful services, Web 2.0, and Mashups. Service composition integrates services to fulfill specific tasks using a set of tools. The existing service composition techniques and tools are mainly designed for the Service Oriented Architecture (SOA) professionals. The business processes used in the service composition systems are primarily designed by business analysts who have extensive process knowledge. Due to the lack of process knowledge, novice business analysts and end users face challenge to identify and orchestrate service into a well-defined business process. Even for the experienced users, it is challenging to select appropriate services from a set of functionally similar services as the quality information of services may not be available. In this thesis, we propose a framework that allows a non-technical user to combine web services to achieve a goal. Our approach helps users to find the process knowledge from the web. We index web services based on the semantic concepts available in the service description documents and help users to formulate a web service search query. We use online reviews to choose a web service from a set of functionally similar web services. Our approach automatically finds the data flow between web services and generates a user interface to execute a composite service. The effectiveness of our proposed approaches is demonstrated through a series of case studies. The results of our case studies show that our approaches for process knowledge extraction, service discovery, and service selection make it easier for people with less technical knowledge to compose services. / Thesis (Ph.D, Electrical & Computer Engineering) -- Queen's University, 2014-06-30 15:18:28.155

The growth of connected, or so called smart home appliances, leads to the search for interaction methods for IoT devices including various forms of smartphone app solutions. Previous research has investigated how complex systems, with multiple options and configurations, can be set up through end-user programming and how app widgets can be an interactive solution. This approach has been adopted by few providers, however, there is little feedback from users on their experiences, in particular on the ease of configuration and customization of app widgets, the ease of use and expectations. To address these questions, I developed a novel app widget as a complement to an existing IoT smartphone app, along with three evaluations: one in-volving 8 experts including designers, developers and product managers; followed by a test session with 10 end users; and finally a field trial in which 3 users lived with the ability to use the widget for two weeks. Feedback and insights about how app widgets affected the user experience were gathered during the process confirming that widgets is a promising solution for controlling smart devices and, depending on the scenario and type of users, there are considerations that could limit or enhance their functionality. / Framväxten av sammankopplade hushållsapparater, eller så kallade ”smart home appliances”,aktualiserar sökandet efter interaktionsmetoder för IoT-produkter, t.ex. smartphone-appar. Tidigare forskning har undersökt hur komplexa system, med flera alternativ och konfigurationer, kan anpassas genom ”end-user-programmering”, och hur app-widgetar kan möjliggöra interaktiva lösningar. Ett fåtal leverantörer har annamat dessa tillvägagångssätt, men det saknas fortfarandefeedback fån användare, särskilt gällande konfigurering och specialanpassning av app-widgetar, lättanvändhet, och förväntningar. För att ta itu med dessa frågor utvecklade jag en ny app-widget som komplement till en etablerad IoT-app för smartphones, samt tre utvärderingar: en med åtta experter, inklusive designers, produktutvecklare, och produktchefer; följt av ett test med tio slutanvändare; och slutligen ett fältförsök där tre anvädare kunda använda app-widgeten i hemmet under två veckor. Under processen samlades feedback och insikter om app-widgetars inverkan på användarupplevelsen, vilka bekräftade att app-widgetar är en lovande metod för att kontrollera ”smart home appliances” och att det, beroende på scenario och användartyp, finns säskilda punkter som kan begränsa eller förhöja deras användbarhet. Framväxten av samman-kopplade hushållsapparater, eller så kallade ”smart home appliances”, aktualiserar sökandet efterinteraktionsmetoder för IoT-produkter, t.ex. smartphone-appar. Tidigare forskning har undersökt hur komplexa system, med flera alternativ och konfigurationer, kan anpassas genom ”end-user-programmering”, och hur app-widgetar kan möjliggöra interaktiva lösningar. Ett fåtal leverantörer har annamat dessa tillvägagångssätt, men det saknas fortfarande feedback från användare, särskilt gällande konfigurering och specialanpassning av app-widgetar, lättanvändhet, och förväntningar. För att ta itu med dessa frågor utvecklade jag en ny app-widget som komplement till en etablerad IoT-app för smartphones, samt tre utvärderingar: en med åtta experter, inklusive designers ,produktutvecklare, och produktchefer; följt av ett test med tio slutanvändare; och slutligen ett fältförsök där tre anvädare kunde använda app-widgeten i hemmet under två veckor. Under processen samlades feedback och insikter om app-widgetars inverkan på användarupplevelsen, vilka bekräftade att app-widgetar är en lovande metod för att kontrollera ”smart home appliances” och att det, beroende på scenario och användartyp, finns säskilda punkter som kan begränsa eller förhöja deras användbarhet.

The main goal of this research is to facilitate end-user and expert developer collaboration in the creation of a web application. This research created a reverse engineering toolset and integrated it with Click (Component-based Lightweight Internet-application Construction Kit), an end-user web development tool. The toolset generates artifacts to facilitate collaboration between end-users and expert web developers when the end-users need to go beyond the limited capabilities of Click. By supporting smooth transition of workflow to expert web developers, we can help them in implementing advanced functionality in end-user developed web applications. The four artifacts generated include a sitemap, text documentation, a task model, and a canonical representation of the user interface. The sitemap is automatically generated to support the workflow of web developers. The text documentation of a web application is generated to document data representation and business logic. A task model, expressed using ConcurTaskTrees notation, covers the whole interaction specified by the end-user. A presentation and dialog model, represented in User Interface Markup Language (UIML), describe the user interface in a declarative language. The task model and UIML representation are created to support development of multi-platform user interfaces from an end-user web application. A formative evaluation of the usability of these models and representations with experienced web developers revealed that these representations were useful and easy to understand. / Master of Science

LibX is a browser extension that provides direct access to library resources. LibX enables users to add additional features to a webpage, such as placing a tutorial video on a digital library homepage. LibX achieves this ability of enhancing web pages through library applications, called LibApps. A LibApp examines a webpage, extracts and processes information of the page, and modifies the web content. It is possible to build an unlimited number of LibApps and enhance web pages in numerous ways. The developers of LibX team cannot build all possible LibApps by themselves. Hence, we decided to create an environment that allows users to create and share LibApps, thereby creating an eco-system of library applications. We developed the LibApp Builder, a cloud-based end-user programming tool that assists users in creating customized library applications with minimal effort. We designed an easy-to-understand meta-design language model with modularized, reusable components. The LibApp language model is designed to hide the complex programming details from the target audiences who are mostly non-technical users, primarily librarians. The LibApp Builder is a web-based editor that allows users to build and test LibApps in an executable environment. A built-in publishing mechanism allows users to group LibApps into packages and publish them in AtomPub format. Any user can directly reuse or adapt published components as required. Two error checking mechanisms have been built into the LibApp Builder viz., type checking and semantic checking to enhance user experience and reduce debugging effort. Additionally, the web interface displays help tooltips to guide users through the process of building a LibApp. We adhered to good software engineering practices such as the agile development model and the model-view-controller design paradigm. The LibApp Builder is built with the ZK AJAX framework and provides a rich interactive user interface. The LibApp Builder is integrated with an optimized full-text, fuzzy search engine and facilitates faceted search by exploiting the BaseX XML database system and XPath/XQuery processor. Users can locate and reuse existing language components through the search interface. To summarize, the LibApp Builder is a community platform for librarians to create, adapt and share LibApps. / Master of Science

<p>With the rise of the Web, there is more interest among end-users to create different kinds of software that use elements from the Web or allow for networked interaction between users. Currently however, many available tools for this purpose are hard to use or lack a sufficient level of expressiveness. To provide new insights on the construction of tools that allow end-users to create their own Web-enabled software, this thesis explores design issues and consequences of applying the Turtle metaphor from the Logo-programming language to an end-user programming environment for Web-enabled applications. </p><p>In order to explore this, CrawLogo was created - a programmable end-user tool that supports the creation of Web-enabled applications using a Turtle-like control metaphor and language adapted from Logo. As a proof-of-concept, several Web-enabled applications were created using this new tool, including CrawLogo Pong, a somewhat alternative version of Atari’s classic Pong game, and a collaborative browsing environment, in which users can browse the Web together. The resulting CrawLogo environment allows for creating Web-enabled applications that - using more traditional programming languages - would be quite complex and require deep technical programming skills. Further, while utilizing a Turtle-like control metaphor in CrawLogo allows for the creation of some new types of applications and some new ways of interacting with the Web, it also raises new problems such as how to successfully design within the CrawLogo metaphor and how to create a meaningful representation of Turtle- geometry-based navigation on the Web.</p>

[pt] Muitas aplicações são tornadas programáveis para usuários finais avançados adicionando recursos como scripting e macros. Outras aplicações dão a uma linguagem de programação um papel central na sua interface com o usuário. Esse é o caso, por exemplo, da linguagem de fórmulas de planilhas de cálculo. Enquanto a área de scripting se beneficiou dos avanços das pesquisas em linguagens de programação, produzindo linguagens maduras e reusáveis, o estado das linguagens em nível de interface não teve o mesmo grau de desenvolvimento. Argumentamos que um melhor entendimento desta classe de linguagens se faz necessário. Neste trabalho, modelamos semânticas de linguagens de usuário final existentes, em três diferentes domínios: multimídia, planilhas e engenharia. Nosso foco é em linguagens de dataflow, um paradigma representativo em aplicações programáveis por usuários finais. Com base nessa análise, temos como objetivo prover um melhor entendimento do design de linguagens de dataflow no contexto de programação de usuários finais e propor linhas-guia para o projeto de linguagens de nível de interface baseadas neste paradigma para aplicações programáveis. / [en] Many applications are made programmable for advanced end-users by adding facilities such as scripting and macros. Other applications take a programming language to the center stage of its UI. That is the case, for example, of the spreadsheet formula language. While scripting has benefited from the advances of programming language research, producing mature and reusable languages, the state of UI-level languages lags behind. We claim that a better understanding of such languages is necessary. In this work, we model the semantics of existing end-user programming languages in three different domains: multimedia, spreadsheets and engineering. Our focus is on dataflow languages, a representative paradigm for end-user programmable applications. Based on this analysis, we aim to provide a better understanding of dataflow semantics as used in the context of end-user programming and propose guidelines for the design of UI-level languages for end-user programmable applications.