expo:QA > conference > detailed program
Many organizations never achieve the significant benefits that are promised from automated test execution tools. What are the secrets to test automation success? There are no secrets, but the paths to success are not commonly understood. This tutorial describes the most important automation issues that you must address, both management and technical, and helps you understand and choose the best approaches for your organization-no matter which automation tools you use, or your current state of automation.
Good objectives are the foundation for successful automation, but many organizations set inappropriate and unachievable objectives for automation. Achieving good Return on Investment is a prime objective, but they must also be communicated in the right way, or your automation efforts may be doomed, no matter how good they are technically. The way an automation project is planned, estimated and managed has a large impact on later success.
A critical technical factor is to structure the automated testware with the right levels of abstraction. This is the way to achieve automation that not only gets used more and more, but also is easy to maintain. Other technical factors include pre and post processing (to achieve automated testing, not just some automated tests), test status (more than just pass or fail), scripting (including data-driven and keyword) and comparison techniques.
Advice for successful test automation includes lessons learned in experience over the past decade, based on the new book of automation case studies, co-authored by the presenter.
The tutorial consists of lecture sessions and practical exercises. Delegates will come away with a proposed set of good automation objectives, and a draft test automation strategy that they can use to plan their own automation project. They will gain a deeper understanding of the use of keywords and problems to be overcome in comparison of results, and will pick up useful technical tips.
There are six sections to the tutorial (of varying length):
Three points:
Tutorial in English
Speaker(s): Dorothy Graham
Abstract
Inspections are described as one of the most economical and necessary techniques for eliminating and preventing defects. Reviews are often done, but usually produce only a fraction of the really important defects that should be found. Formal Inspections are often abandoned because of the perceived overhead and the experience that the expected benefits fail to materialize. The reason is that without proper education people simply don't know what to look for in documents (be it requirements, design, code, test plan, contract, or otherwise), and how to look for it.
With only a few hours of proper Inspection training, people can find already many defects in a document where they first found only one or two minor issues. This should give evidence that with some more proper education Reviews and Inspections indeed can provide the benefits promised.
In this tutorial we will talk about the goal of projects, define Quality and Defects, explain the concept and the effect of Zero Defects, provide an overview of types of Inspections (Walkthroughs, Reviews, Fagan, Cleanroom, Gilb/Graham, Early Inspections, Tick-the-Code) and discuss which Inspection type to choose. If people bring three copies of one or two relevant pages of a (not too confidential) document they are using in their work right now, we will show how the result of reviews and Inspections can easily be improved.
Target audience
Anyone who is producing documents, should be producing documents or is supposed to evaluate documents, like business cases, requirements, use cases, story cards, designs, code, test plans, contracts.
Preparation
If possible, bring three copies of one or two pages of a document that is not too confidential and being used in your current project. Then you have the possibility to experience the power of real Inspection on a real document of your own environment. Warning: after the Inspection you may decide to discard the document as unacceptable!
Tutorial in English
Speaker(s): Niels Malotaux
The role of the tester in agile is to bring professional expertise in test and quality to the team. Many agile implementations however have struggled to implement effective approaches to achieving the productivity enhancements with the required level of quality. This is because of issues such as
This tutorial will, through presentation, demos, exercises and discussion:
Demos will include use of open source tools that support iteration planning, unit and acceptance test automation.
Key Points:
Table of Contents
Tutorial held in English
Speaker(s): Ken Brennock
IBM Rational® AppScan® Source Edition - Application Security Testing early in the Software Development Lifecycle
IBM Rational® AppScan® Source Edition is a static analysis security testing tool that enables you to identify vulnerabilities within your source code, review data flows and identify the threat exposure of your applications. Typically deployed during the development or build phases of the software development lifecycle (SDLC), Rational AppScan Source Edition makes it easier for you to understand your threat exposure at the executive level for audit and compliance purposes and throughout the software development lifecycle. Rational AppScan Source Edition software also helps facilitate a partnership between development and security teams by providing both groups with the information they need when they need it.
Workshop in English - Free for expo:QA'10 delegates
Speaker(s): Gareth O’Sullivan
Microsoft Test Manager 2010 - A tool that manages and run software tests in an independent manner, yet without isolating the development team.
Microsoft Test Manager 2010 is a new tool that helps testers and developers work together to produce quality products.
This application helps define, administrate, automatize and execute software tests without weakening the fundamental relationship with the developer´s code. Furthermore, Microsoft Test Manager 2010 integrates with the Team Foundation Server so that test engineers, developers, and other team members don´t lose site of their project objectives. This integration guarantees effective collaboration between testers and developers, instead of working against each other.
Microsoft´s hands-on workshop will cover the following topics:
- Managing Requirements
Microsoft Test Manager merges with Visual Studio to manage the requirements of software development and to fulfill them one by one through the testing process.
- Test Management
The test management function of Microsoft Test Manager 2010 facilitates decision making, helping clients know earlier if their software is ready for production.
- Basic Automization (Fast Forward)
Microsoft Test Manager 2010 contains a new and innovative feature that allows basic automization of manual tests, making it unnecessary to write a line of code. This type of automization accelerates manual testing (repetitive tasks) instead of replacing the process itself.
- Running Tests
This new tool allows the execution of both manual and automatic tests that can be integrated into a test plan with the Team Foundation Server. The diagnostics are saved, making results traceable.
- Managing Software Errors
Detection and follow-up are crucial to helping correct software errors and furthermore, create higher-quality programs. Microsoft Test Manager 2010 automatically applies the data it collects to fix errors found during the testing process.
- Reports
Microsoft Test Manager 2010 allows you to collect reports after running tests. These reports show how the test plan has progressed and allow users to review data relevant to the team project and related to requirements, user cases, test cases, and errors.
Language to be defined - Free for expo:QA'10 delegates
Recent research has highlighted the critical role that managers play in the success or failure of test automation.
Without adequate management support, well-intentioned initiatives are doomed to be short-lived and guaranteed to waste time and money.
But even extensive management support, without sufficient knowledge of the issues, may fail to produce results with lasting and growing benefits to the organization.
In this talk, Dorothy Graham outlines common management misconceptions about automation and how to ensure that you have realistic expectations. Understand why objectives and measurement are critical for test automation and how automation objectives area different to test objectives, how to scope, estimate and resource test automation efforts, how to measure Return on Investment, and more. Know what issues to look out for as early indications of problems, and how to get back on track to successful automation.
Speaker(s): Dorothy Graham
The purpose of testing is to be able to answer a question: "When will the system be ready to be released"?
The simple answers to the question are:
This talk goes through the means available to answer these points in a way which will convince management and is illustrated with case studies.
Speaker(s): Peter Farrell-Vinay
Even though there are countless lessons to be learned when purchasing test tools, we still continue to make the same mistakes we made over ten years ago and end up having expensive ‘shelfware' as part of our test tool kit. Many companies fail to adequately evaluate the test tools currently on the market and as a result purchase tools that only partially do the job or simply take too much time and effort to do what is expected of them. In this talk, Graham Moran explains a process specifically design for evaluating and implementing test tools and talks about some of the pitfalls that companies may find when trying to acquire these tools.
Speaker(s): Graham Moran
In the current economic situation, when there is an urgent need to cut costs, it is smart to implement measures that contribute to savings while not introducing those that paralyze activities that cannot be waived to obtain the stability and the progress that businesses need. At this juncture, the public and private managers may stop to consider steps not yet noticed, misunderstood or improperly developed within their own areas of technology, but not through clichéd and empty talk of cost optimization as is typical in the TIC sector.
During 2009, according to data from specialized consultants, only the Spanish government administrations spent around 1.100 million Euros on development and maintenance of software applications. If since then they had done software quality testing, in 2013 - the European Union committed date to return to the Stability Pact redirecting the deficit to 3%- they would have saved 750 million Euros over this period, at 125 million Euros per year. But this is just one example of what a well-established, well-managed business assurance and quality control software could contribute to improve performance of the companies.
Thus, collaboration to improve results and reduce company deficits is achievable through the introduction of assurance and software quality control, but what to do and how to get it? During this presentation, we will give you keys to achieve this goal.
Speaker(s): Francisco Sáez
Everyone is aware of the constant fight between developers and testers; the former make coding mistakes, the latter find the resulting defects. Other software vendors have traditionally approached the development and testing market by providing completely disparate tools and environments, forcing testers and developers to work in isolation and driving the two groups further apart. Developers hate leaving their coding UI to check the status of new defects; testers are constantly faced with ever changing environments and data without warning.
During the speech, Jose will demo Microsoft Test Manager and explain how it can be used. Jose Aracil will discuss his experiences working in these kind of organizations where testers and developers are in constant opposition. Jose will enlighten the audience with a different approach to this collaboration between testers and developers to increase the efficiency and quality of the software being developed.
Speaker(s): José Aracil
There are many pressures on software delivery organizations to produce more software faster in the context of extreme cost pressure and growing globalization of the software delivery organization. How can these pressures be addressed while maintaining software delivery quality?
This presentation will explore the changes in software delivery models that have taken place in recent years, and the ways in which overall software delivery quality can be managed in the current environment. In particular, we will discuss several case studies where large commercial organizaions have achieved significant improvements in software quality when adopting more agile practices. We will conclude with a set of best practices for adopting "agile at scale" that can be applied to your own organization to provide measured improvements in quality in your software delivery model.
Speaker(s): Alan Brown
It can be a challenge for QA and test engineers to be seen as making positive contributions to the success of software projects while engaged in essentially ‘negative' activities - looking for problems, predicting problems, preventing problems, and reporting problems. This ‘negative' focus is
highlighted by software testing book titles like "How to Break Software". While others working on a project focus on how to make software work, testers
focus on finding ways in which it doesn't work. These divergent perspectives have the potential to interfere with team communication, cooperation, and
effectiveness, as well as impact job satisfaction. QA and test may be seen as ‘not team players' with a ‘negative attitude'.
This problem is not unique to software projects - it is in fact a human issue so pervasive that it was given a leading role in one of the best-know literary works of all time, Homer's Illiad, the seventh-century BC collection of Greek mythology and legends. The Illiad contains the story of Cassandra and the siege of ancient Troy. Cassandra had the gift of prophecy but the curse of having no one listen to her prophecies. Many testers have at some point felt like Cassandra. Predictions of impending project problems were not heard. QA engineers may have predicted failure to meet deadlines if processes weren't followed, but no one paid attention. The presentation will discuss what we can learn from the story of Cassandra, and what can be done to counteract the ‘Cassandra Syndrome'.
Speaker(s): Rick Hower
The use of TTCN-3 outsourcing services seems to increase in direct-proportion to the downturn of the economy. Organisations are now looking to outsource part of their software testing function. TTCN-3 Testing and development can be outsourced. This brings a clear financial benefit as well a competitive advantage to organizations already using TTCN-3 and also to organizations willing to introduce TTCN-3 in their testing processes. For example, small organizations can benefit from a wealth of TTCN-3 testing expertise that otherwise will be very expensive an improbable to introduce in these type of organizations.
However, a proven methodology and approach for TTCN-3 offshore testing projects is vital for the success of these types of projects. The challenge of managing relationships will grow as the extent of the TTCN-3 outsourcing grows. This presentation will highlight the key issues to take into consideration when outsourcing TTCN-3 projects.
TTCN-3 offshore testing services have a clear financial and performance benefits which make them a serious consideration for many small, medium and large companies.
MTP has vast industry experience in offering and carrying out TTCN-3 Offshore projects. In this presentation we are going to introduce the benefits of a methodology successfully carried out for TTCN-3 Offshore projects.
The methodology includes: Continuity and control of deliverables, a flexible project to shift on-site TTCN-3 testing activities offshore, Continuous checks to early detect errors, control of the budget through an early analysis, Client relationship, Cultural proximity, Innovation and Price based on TTCN-3 scripts deliverables not on development time.
Speaker(s): Raquel Jiménez Garrido
Because testing is a mission-critical activity, we discuss a road map for building a competency center, starting small and building it out over time. The ultimate goal is establishing a Center of Excellence (CoE) with the ultimate promise of Efficiency, Consistency, Practicality but also a Career Path for your testing team, while significantly reducing your costs, accelerating the time to market and reducing the risk exposure.
Before we dig into the steps to build it, we will review the rationale behind taking that journey: Why should you consider a CoE? What should a CoE accomplish? Who is going to be involved?
Then we will go to the next level: When and where should I deploy it? How Should I do that? Deploying a CoE will involve people, process and technology and a number of decisions to trade off, like: Do we want to favor a centralized or a decentralized model? Through a series of pragmatic steps we'll review what the implications are to those three dimensions, as well as the fact that not two organizations will adopt it the same way.
We will wrap it up with a live demonstration of how an industry standard solution can help accelerate the adoption and realization of the CoE benefits.
Speaker(s): Jaume Ayerbe
Although there is much information available on test design techniques, literature says very little on how to select the ones to use. Many testers find it difficult to select the right techniques. Very often a design technique is used for the simple fact that it's possible to do so. When selecting a technique the leading argument should be "the errors that we do not want to have in your production system". Testers should gain a better understanding of the relation between types of errors and the techniques that help finding them. This understanding will lead to a better use of techniques and will lead
to asking the right questions to the stakeholders. By using the right techniques, the tester executes the right tests and is accountable for his actions and the quality of his advice. Since the techniques define the tests that are executed, they also determine the information that can be given to the
stakeholders.
Selecting the techniques you are going to use is a careful process. Selecting the wrong technique may cost you a lot of time without finding many errors or useful information. Failing to select the right technique may lead to mayor defects not being found. I'll explain the decision model from my book, and will inverse the problem. We do not use techniques because we can, but because they help us to provide the right information. Unlike many methods we start with the errors and select the techniques that help finding them.
Speaker(s): Derk-Jan de Grood
Fortunately, more and more organizations are incorporating SDLC security strategies, understanding that adopting a set of best practices will help ensure effective and efficient levels of security as new developments arise. Many frameworks can be used to guide companies in implementing these strategies such as OpenSAMM (Open Software Assurance Maturity Model), BSIMM (Building Security in Maturity Model), Security Software SDL Touchpoints and Microsoft, among others.
Each application, however, requires a certain level of security, though we must also know what evidence we need, how we find it and what goals we pursue.
In addition, it is vital to include Security Testing objectives when developing secure software for this or any other related discipline (such as for the security frameworks described above).
This presentation will focus on these questions and the techniques currently used to
carry out a comprehensive review of such applications.
Speaker(s): Vicente Aguilera Diaz
Sir Humphrey Davy said "The most important of my discoveries have been suggested by my failures."
This is as true today as it was when Sir Humphrey said it. I have been working in the test process improvement field for many years and see the same issues coming up time after time. For example, I see testers blaming everyone else for the issues they have with requirements but not doing anything to get the issues resolved. I see many test teams arriving on a project and they seem to start from a blank sheet of paper each time, repeating every error and taking all the same risks as they have always done, it's as if they never learn or want to learn.
As a profession we need to look at our common failures and understand why they happened and how we stop them happening again, and who knows maybe we will find the testing silver bullet?
This presentation will provide an overview of the common problems testers face today (problem patterns) from various perspectives:
• Outside the test project looking in
• Test Organisation
• Test Management
• Test Environment
• Test Design and execution
• Test Automation
alongside some suggestions for how to avoid them in the future.
Speaker(s): Geoff Thompson
This presentation examines service quality assessment or software quality assurance in terms of two criteria: "expectations" and "perceptions."
Currently, software quality systems are thought to be "mature" in terms of their implementation as they are supported by numerous standards and good practices. However, the majority of these systems are based on abstract methodologies and are applied directly without analyzing the specific needs and expectations of the specific management teams, organizations or clients. They thus tend to be less than satisfactory.
For this reason, we would like to reflect on this issue from two perspectives: the first refers to clients' perspectives and the second to their perceptions. The difference or discrepancy between the two serves to define the level of service quality.
The key behind offering a quality software service in IT organizations is found by balancing these expectations and perceptions and thus improving the service provided. This raises several additional questions: Do we need to talk about software quality types? Should we consider objective-based software quality? And, who benefits from our actions? In effect, on many occasions the strategies required to satisfy the different information technology clients are diametrically opposed and, as such, are ill-suited to satisfy all our clients' expectations.
Speaker(s): Salvador Folgado
We will focus on the art of load and performance testing. What can you expect for tomorrow? How you must make your load testing practices evolve to fit with the application development lifecycle?
We'll start with the basics: "Why is load testing a central part of any testing process for successful deployment". You will grasp the complexity of performance testing and know why it shall not be considered as an easy or optional task.
Then, this will give you a strong insight into the importance of using the right methodology to deal with the latest industry challenges. Sooner or later, you'll have to deal with the complexity brought by new technologies such as Rich Internet Applications or the use of the Cloud. You will understand how your recommendations can have a beneficial impact on your organization's choices.
Finally, you will be given the keys to execute Load and Performance testing to gain in productivity & flexibility. You'll deliver more value to stakeholders and gain respect in return.
After attending this presentation you will be prepared for what's coming your way. You will know the key questions to ask yourself. This way you will be able to give the right recommendations to improve the quality of the applications you have worked on and the effectiveness of your team.
Key Points:
1 Why Load and Performance testing is not just optional or to be done if you have enough time
2 Deal with complexity, the latest web applications and the Cloud.
3 Make your practices evolve and deliver more value more effectively to your stakeholders.
Speaker(s): Thomas Ripoche
Currently, the world is in the era of digital inclusion and accessibility of Web pages has become a global concern, since this environment plays a key role in the daily lives of people with special needs. This component facilitates the lives of these people, enabling them to create new forms of relationships and fulfilling activities before unviable. The Brazilian government decreed that all sites of public administration must be accessible, serving as an example for other countries. For these reasons, this work aims to develop a methodology for testing accessibility to inspect all the phases of the project, from its conception, when the test plan is done, until delivery, after examining the tests results, anticipating the errors, generating less rework, reducing project costs and causing it to be given due importance for accessibility.
Speaker(s): Virgínia Chalegre
Every day thousands of enterprises rely on software to drive critical business applications and keep vital services running. Their success depends on software performing effectively and fulfilling the tasks for which it was implemented or designed.
But unfortunately maintaining and building software can be a complicated and, therefore, senior IT decision makers face the following challenges to keep software delivery aligned with the business:
- Reduce cost
- Improve quality
- Reduce risk
- Increase agility
This presentation addresses these challenges and gives an overview how to reduce them.
Speaker(s): Belén Bernardos
As a former CIO at Allianz and Paribas, Paul Bentz has had a direct and personal experience of the challenges IT Executives face to service an increasingly demanding business community.
When it comes down to managing the complexity and performance of an Information System a lot has been achieved over time in the areas of infrastructure and project management.
Strangely enough the internal quality of business applications has been left aside for a very long time and is becoming the focus point of management with the new sourcing models and the concern for operational risks.
Mr. Bentz has always been trying to find ways to manage risk, measure outcomes, and establish the governance for application delivery that would allow benchmarking.
As an advisor to CAST Software Mr. Bentz will explain why and how CAST is providing companies around the world the ability to immediately and significantly minimize business risks, reduce hard IT costs, and gain an objective understanding of the performance of their outsourced and in-house IT teams.
Speaker(s): Paul Bentz
Panda Security, having implemented a series of improvements and practices proposed in a Product Lifecycle Management consulting project executed in 2008, has significantly boosted the level of quality of their products and the control over the development and QA processes.
By the end of 2009, the need was identified to impove the balance of the investment in quality control with the exact needs of the business. Panda
invited Sogeti Spain to study and optimize their test strategy and estimation processes. From December 2009 until february 2010, a Sogeti Consultant analyzed the maturity level of the QA divisions test management processes and stakeholder relations. Using the TPI®Next test process improvement model, Sogeti tailored and deployed a process fitting to the maturity and objectives of Panda, based on the Tmap®Next Business Driven Test Management philosophy.
To improve visibilty and enhance relations with business and technology stakeholders, the QA Divisions mission has been stated in a QA Policy and
detailed in an organisational QA strategy.
The resulting test strategy process and templates have been deployed in two projects to date, and is currently being rolled out within the remaining
certification groups, so as to be fully implemented by the end of June 2010.
Speaker(s): Miriam Serna, Ewout van Driel
In this talk we'll present an estimation method of the necessary resources in a Verification & Validation Project for a Critical & Complex software system.
In this way we'll define:
The scope of the tests in a software development project,
Through the talk we'll show both estimated values and real values, obtained from a practical case of an Air Traffic Control System.
Speaker(s): Juan Luis Valera Juanas
Pending...
Test Process Improvement (TPI®) methodology, has been instrumental in helping many organizations improve their overall test processes, an
essential initiative to ensuring the quality of information systems and critical business processes. Providing insight into the maturity of the test process, TPI has offered logical and practical steps to enhance test efficiency and effectiveness, and moreover to instil a belief in achieving a permanent improvement cycle.
Speaker(s): Augusto Sagrario
This is about a real case of too many developers feeding too few testers, causing a testing backlog of half a year, with many angry customers waiting for too long for solutions to their problems. One senior tester just had left the company. There was only one senior and one junior tester left. They were facing this huge backlog of work and didn't know where to start.
We will show how empowerment of the testers, careful planning and involvement of the developers allowed the testers to catch up in about 9 weeks, systematically making customers happy one by one along the way. The senior tester learnt how to plan the work of the testers effectively and efficiently in sync with the developers, so that there were no backlogs ever since. Trust by customers who were in the process of abandoning the supplier was restored causing turnover to grow enormously since.
We will first show how we used Evolutionary Planning techniques in this particular case. Then we will discuss in more general terms the elements of this planning technique. The answer to the question "Who is the customer of Testing?" usually causes quite a shock to most of the audience. However, this is usually a shock of recognition.
Speaker(s): Niels Malotaux
Although software testing is a relatively young discipline, immaturity is not the only reason we are still developing our methods, professional qualifications, trade associations, and position in the software industry and society. All successful professions must continuously evolve and grow. Membership of a profession provides an expectation of behaviour, qualification and experience, regulated by a professional body. We need to understand whether it is desirable or possible to be a profession, and how we should regulate ourselves for the benefit of our customers, the industry and practitioners.
Software testing is not the only trade or industry to be working through what is meant by being a profession; the horticulture industry is going through a similar discussion of whether profession status is desirable, achievable or necessary. Horticulture has been practiced for about 8,000 years longer than software testing. During those millennia, horticultural practices have continued to develop, supported by accidental discovery, increased scientific understanding, and improved technology. Just like horticulture, software testing is a multi-discipline, science- and technology-driven industry with political, sociological, and economic implications.
Both horticulturalists and software testers need to consider:
• How regulation has been used in other trades and industries as theydeveloped into professions
• The role of professional bodies in controlling and regulating professionals
• The role of standards, qualifications and bodies of knowledge in controlling and regulating entrance and practice levels for professions and trades
• The role of monitoring and regulation in maintaining standards of behaviour and practice.
Presentation track record: highly praised keynote at EuroSTAR2007, received with equal success at Eriksson Conference 2008, London SIGiST 2010.
Speaker(s): Isabel Evans
When outsourcing all or part of your testing efforts to a third-party vendor, you need a special approach to make testing effective and controlled. Martin Pol explains the roadmap to successful outsourcing. How to define the objectives and the scope, what tasks should be outsourced and what tasks should not-at least not yet. He explains how to select your supplier and how to migrate, implement, and cope with organizational issues. Martin discusses contracts, service level agreements, compensation issues, and monitoring and controlling the outsourced test work, including specific metrics. The good news for testers is that outsourcing requires more testing-not less-and that new testing jobs are coming into existence. Testing the
outsourcing is becoming a very important control mechanism for outsourcing in general.
Speaker(s): Martin Pol
Cost reductions and the quest for more efficiency are more evident in today's business world. It also follows that our testing processes will ultimately be affected. Many management theories speak about "Lean" as being one of the solutions. One of the key steps in using "Lean" is the identification of which steps add value and which do not. This presentation will explore the use of "Lean" within testing and more specifically within test management.
As a guideline, the presenter will follow the "Lean manufacturing process": the generic process management philosophy derived from the Toyota Production System. It is renowned for its focus on reduction of "seven wastes" in order to improve overall customer value. Everything not adding value to the customer is considered to be waste.
This presentation will focus on the various elements as mentioned above. Also Six Sigma as being one of the more popular theories that introduces the concept of "Lean" will be explained. Several examples of Lean Six Sigma techniques applied to testing will be given during the presentation.
As opposed to test process improvement with reference models like TMM , using lean six sigma will start improving by thoroughly investigating your own companies processes and improve from there. This will all be supported with techniques that immediately enable you to show the added value for the organization. This presentation is especially of interest to business managers, IT managers, QA managers and test managers that are involved in improving the quality of test management processes.
Speaker(s): Iris Pinkster O'Riordain
Requirements and tests are key artefacts for quality, both are needed, along with their traces, to build the system, tests the system and finally, accept the system. Tests are there not just to show us that we have build the system right, but also to let us know if we have build the right system. During this demo, it will be shown how IRQA, leader requirements engineering tool, supports the definition of requirements, tests, the creation of traces between them and how we can check the specification using IRQA. Additionally, during this demo an scenario will be set up to show how acceptance tests can be obtained automatically from use cases, how we can manage the executions of tests and how we can check tests and requirements through traces, reports and dashboards.
Speaker(s): José Manuel Muñoz
It is well-known that the cost of software application distribution and maintenance (developmental, corrective and preventative) constitutes "the lion's share" of the total cost of the applications for the organisational user.
Standards such as ISO 9126 define maintainability as a key characteristic of software quality. Unfortunately, the recommended metrics for those standards are usually obtained ‘ex post facto': they indicate the efficiency of the maintenance process, but they lack the capacity to explain what characteristics make the software difficult and as a result, they do not make it easy to take concrete technical measures that reduce this maintenance cost.
The presentation, presents different models oriented to measure directly (by means of product metrics) the maintainability of the software and its subcharacteristics: stability, ease of analysis, change and test. It analysis the properties of these models and proposes one that achieves the key objectives (technology independence, measurements that are easy to compute, explanatory ability) that permit its application to the deliverables of a software development project.
The presentation shows the application of this practical model in different scenarios of software development (internal development, external development, software houses and factories) and technology and how this allows the identification of preventative measures that improve the future maintainability of the software system, in the development phase as well as in the maintenance phase.
The presentation will finish showing how this model has been implemented in checKing QA, the dashboard of quality of Optimyth Software.
Speaker(s): Luis Rodriguez
Two awards will be given to the best speakers: the Review Comitte Award, and the Delegates Award.
an iPAD will be drawed for one of the delegate who particpated in the voting of the Best Speaker.
Software testing is generally accepted as something good for IT organizations, leading to a direct increase in their systems quality. At times, however, it is also seen as an expensive and redundant activity.
The main problem is that Testing Management activities are not often backed by clear objectives nor is there measureable data demonstrating how good these activities are for system health or how much money and time they actually save IT organizations.
Speaker(s): Ignacio López Carrillo
Pending...
Pending...
Functional test automation plays a crucial role in ensuring the quality of applications that are developed using agile processes such as SCRUM. Intermediate releases in short periods of time require the execution of regression tests more frequently, rendering manual execution unworkable. In turn, for automation testing to be successful, the selection of scenarios to automate becomes critical, as does the planning and management of the generated artifacts during the process.
This presentation will show how the activities related to the automation of functional tests were incorporated to the SCRUM team, ranging from the standardization of the automation process to the training of the testing team in the incorporated technologies. The presentation will also address how the generation of progress reports within the process was automated.
This experience demonstrates that agile processes do in fact allow for planning and the implementation of best practices, which in turn give visibility to the work done by the testing team to all players.
Speaker(s): Claudia Badell
A "House of Commons" debate on the topic 'Ethics within the testing profession'. In this sixty minute session stimulating statements are given
that will guaranteed lead to a meaty discussion and push (y)our tester's morale to its limits!
The hosted 'House of Commons' debate is derived from a Dutch television show whereby the goal is to bring current affairs to your living room in both an informative and entertaining fashion. The statements are introduced by the hosts. One host will be in favor of the statement and the other host will be against. The audience will have the opportunity to react on the pleas made. The hosts will encourage the audience to take their side and philosophize on the chosen point-of-view.
Here are a few examples of statements you that might be raised:
Do YOU dare to let go of your standards and philosophize what could be when one is not so honest? Are some statements really that black and white? And what are those nuances to be applied? Share your opinion and perhaps we will arrive at the basis of the "Testers code of conduct"!
Scored "Outstanding" at EuroSTAR 2009 (9.00 of 1-10 scale).
Speaker(s): Nathalie Rooseboom de Vries van Delft
Keep it simple. That's the philosophy of software testers who made this CMMI Level 1 to Level 5 possible and repeatable in less than 4 years.
Learn and see the templates, approaches, checklists, metrics, QA estimation model and other supporting documents that, once implemented and standardized, helped this company elevate its testing organization to CMMI Level 5 in less than four years. CMMI (Capability Maturity Model Integration) is touched upon lightly but the focus is not a process improvement specific model (CE, CMMI, IEEE, ISO, ITIL, OSA, SEI, etc.); rather, this presentation is on testing processes that satisfy the business need first and, as a added bonus, lead to robust testing process model that has been appraised to satisfy CMMI Level 5.
Many companies spend many years and many dollars to put process, control and repeatability into their organization. This presentation focuses on only one part of the organization, the test group. Additionally, it is focused and developed with what works best for this business.
Attend this session for the road map from zero process to a robust process that will work for you.
Speaker(s): Jan Fish
In a Medical Device environment, software validation is requested by regulatory bodies. Validation is expected "to provide a level of confidence that the quality of the software is appropriate to support Public Health" (FDA). To be able to certify that the software fulfils its mission for public health,
an inspector needs to know what the software does, that it works properly and that it does not imply risks for the public health. In "SW wording" it becomes: having SW functional description, test process reports and a risk management report. Validation is then a broad concept for Medical Device; it is the assurance that the process of software design, construction and verification is planned and controlled.
Is a specific SW methodology requested? There are standards that regulatory bodies suggest, but any approach is accepted, as far as it provides the
inspector with what he needs. Agile is accepted then, with those adjustments which allow manufacturer to provide the documentation requested.
There are principles in Agile approach, such as more emphasis on communication than documentation, on productivity than reliability, that may generate gaps in regulatory requirements: gaps must be overcome. Other principles, such as continuous testing, customer feedback, improvement, are in full agreement with the regulatory goal of minimizing defect insertion and maximizing defect removal from the beginning. Other Agile practices fulfil regulatory expectations, for example the Individual ownership and accountability for quality.
In conclusion, an Agile approach that considers an enhanced Life Cycle including initial overall plans and requirements, Final acceptance Test and
documentation cleaning, controlled release, appears as a good option, fulfilling both business needs of fast, easy and "low cost" adaptation to
changes and regulatory requirements (that Medical Device manufacturers are part of the business).
The presentation will focus on broad Validation concepts and Agile fulfilment or needed adjusts.
Speaker(s): Celestina Bianco
Tuesday morning, rush hour was a nightmare and you didn't have enough time to prepare the impossible, a presentation detailing how to test an application for an error free release. You know the drill, show your ID, go to the meeting
room, connect your laptop and wait for people to show up... 10 minutes later you're finally facing a new customer; he is an "old school" manager, he always thought things will work if you scare developers enough to work 14 hours day to
deliver code. If performance is not good, we'll add more hardware. If end users are not happy with the tool, we can always get another company to carry on with the development, and we might even save money...
Join Jose and Alvaro in this role playing presentation to learn how software testing meetings work in real life.
Alvaro and Jose will cover the questions and situations they have faced, on some of the most difficult meetings they have been through over the last 10 years as consultants, and how they successfully overcame them.
Situations included in the presentation:
- Jose Vs "The evil manager"
- Alvaro Vs "Mr. CMMI"
- Jose Vs "The (I want it all) manager"
- Alvaro Vs "Mr. Automation"
Speaker(s): José Aracil
Automation testing is not only functional testing automation. We will have a look over different testing processes and give some ideas how automation can help us in our testing processes. We will try to dismantle some automation myths and to present different vision of the testing automation processes.
We will talk about: TICs current frame, SQA and Testing Activities, Activities Automation, How to approach the automation, Automation Myths and Realities and Conclusions.
Speaker(s): Judith Álvarez Calvo