industry-academia collaborations in software engineering research: experience from canada and turkey

Download Industry-academia collaborations in software engineering research: Experience from Canada and Turkey

Post on 14-Apr-2017

24 views

Category:

Engineering

0 download

Embed Size (px)

TRANSCRIPT

PowerPoint Presentation

Industry-academia collaborations in software engineering research: Experience from Canada and TurkeyDr. Vahid GarousiAssociate Professor of Software Engineering

Department of Computer EngineeringHacettepe University, Ankara, Turkey

vahid.garousi@hacettepe.edu.trhttp://web.cs.hacettepe.edu.tr/~vahid

vgarousi

#Dr. Vahid GarousiOutlineBackgroundOf the Principal Investigator (PI), and his research teams in the pastSuccess stories of industry-academia collaborationsSuccess stories in CanadaSuccess stories in TurkeyChallenges, best practices, and collaboration models

#Dr. Vahid GarousiAbout the SpeakerWork experience:Hacettepe University, Turkey, Feb. 2015-University of Calgary, Canada, 2006-2014Middle East Technical University, Turkey, 2013Founder, Maral Software Consulting Corporation, 2008-Education:PhD, Carleton University, Canada, 2006 MSc, University of Waterloo, Canada, 2003 BSc, Sharif University of Technology, Iran, 2000Research expertise:Software EngineeringSoftware Testing and Quality Assurance (QA)Software MaintenanceAgile methodologiesAction research, i.e., industry-academia collaborationsCultural background and citizenship: Dual citizenship: Canadian-Iranian, now living in Turkey

#Dr. Vahid GarousiResearch in University of Calgary, Canada2006-2014Established and led the Software Quality Engineering Research Group (SoftQual)www.softqual.ucalgary.ca

Alumni 1 Post-doctoral fellow3 PhD students 9 MSc students 30+ undergraduate students

Almost all our projects were applied R&D projects in collaboration with the industry.

More than 10 industrial partners such as IBMMore than $1.3 Million CND in funding in 6 years

Output: More than 30 journal papers and 45 conference papersSeveral software toolsOne start-up firm and one commercialized software product

#Dr. Vahid Garousi

#Dr. Vahid GarousiHacettepe University Software Engineering (HUSE) 2 faculty members20+ graduate students10+ industry partners

#Dr. Vahid GarousiResearcher's profile: International collaborations

#Dr. Vahid GarousiOutlineBackgroundOf the speaker, his research team and expertiseSuccess stories of industry-academia collaborationsSuccess stories in CanadaSuccess stories in TurkeyChallenges, best practices, and collaboration models

#Dr. Vahid GarousiCollaboration modelOur research approach: Action Research

T. Gorschek, C. Wohlin, P. Carre, and S. Larsson, "A Model for Technology Transfer in Practice," IEEE Software, vol. 23, pp. 88-95, 2006

#Dr. Vahid GarousiSuccess stories in CanadaProject 1Industry partner: Pason Systems Corporation, Calgary, CanadaChallenge: The company could not systematically decide when to automate testing and what (test cases) to automate

Project 2Industry partner: NovAtel Inc., Calgary, CanadaChallenge: Huge amounts of effort had been spent for developing and maintaining software documentation

Project 3Industry partner: MR Control Systems International, Calgary, CanadaChallenge: The cost of manual testing was very high. Need for test automation

Project 4Industry partner: Alberta Energy Resources Conservation Board (ERCB), Calgary, CanadaChallenge: The cost of manual environment configuration testing was very high. Need for test automation

#Dr. Vahid GarousiSelected Project #1Industry partner: Pason Systems Corporation, Calgary, Canada. Developing software and hardware for oil rig reservoirsChallenge: The company could not decide when to automate testing and what to automateSystems under test (SUTs):

#Dr. Vahid GarousiSelected Project #1Solution: Decision support for balancing manual software testing versus test automation

#Dr. Vahid GarousiSelected Project #1Solution: Decision support for balancing manual software testing versus test automation

UC: use-case

Goal: maximize

#Dr. Vahid GarousiSelected Project #1Solution: Decision support for balancing manual software testing versus test automation

#Dr. Vahid GarousiSelected Project #1Solution: Decision support for balancing manual software testing versus test automationMore details in the following papers:

Invited paper

#Dr. Vahid GarousiOutlineBackgroundOf the speaker, his research team and expertise

Success stories of industry-academia collaborationsSuccess stories in CanadaSuccess stories in TurkeyChallenges, best practices, and collaboration models

#Dr. Vahid GarousiSuccess stories in TurkeyMultiple projects (since 2015)Industry partner: HAVELSAN (Hava Elektronik Sanayi, Aviation Electronics Industries), 2015-nowTest automation for several test groupsAssessing and improving an in-house test automation framework for test group QEstablishing a systematic, effective and efficient GQM-based measurement program for the testing directorateAssessment and improvement of test process maturity using TMMI and TPI-Next Bi-directional knowledge transfer from/to international venues and organizations in the aviation industry, e.g., NASA, DoD

2015Industry partner: Turkish Aerospace Industries, Inc. (TAI)Project topic: A tool for automated inspection of software design documents

2013Industry partner: Department for Turks Abroad and Relative Societies (Yurtd Trkler ve Akraba Topluluklar Bakanl)Challenge: The performance (response time) of the web application became poor and non-responsive when many users used the system in high user loads, response time~50 seconds!

#Dr. Vahid GarousiCompany backgroundAn example product: Helicopter simulators

#Dr. Vahid GarousiCollaborations with HAVELSANMultiple projectsIndustry partner: HAVELSAN (HAVa ELektronik SANayi, Aviation Electronics Industries), 2015-nowTest automation for test group X (an overview next)Test automation for test group YTest automation for test group ZAssessing and improving an in-house test automation framework for test group QEstablishing a systematic, effective and efficient GQM-based measurement program for the testing directorateAssessment and improvement of test process maturity using TMMI and TPI-Next Bi-directional knowledge transfer from/to international venues and organizations in the aviation industry, e.g., NASA, DoD

We even wrote a methodological paper on how we came up with the above list of projects

#Dr. Vahid GarousiCollaborations with HAVELSANContext: Visual GUI testing of tactical map systems

(not the real SUT, but a good representative taken from internet)

#Dr. Vahid GarousiCollaborations with HAVELSANContext: Visual GUI testing of tactical map systemsTwo test tools were chosen:SikulijAutomateGoal: To compare Sikuli and JAutomate in order to determine a suitable tool for GUI testing in the projectGQM was used:How do features of the two tools compare to each other (static comparison)?How do the two tools compare when they are used to develop test scripts and test SUTs (dynamic comparison)?How do the two tools compare in terms of quality of the Record and Replay features?How do the two tools compare in terms of robustness and repeatability?How do the two tools compare in terms of fault tolerance?How do the two tools compare in terms of test development effort? (some overview next)How do the two tools compare in terms of test maintenance effort?How do the two tools compare in terms of fault detection effectiveness?

#Dr. Vahid GarousiCollaborations with HAVELSANSeveral papers have been written so far

#Dr. Vahid GarousiOutlineBackgroundOf the speaker, his research team and expertise

Success stories of industry-academia collaborationsSuccess stories in CanadaSuccess stories in TurkeyChallenges, best practices, and collaboration models

#Dr. Vahid GarousiChallenges and best practicesSynthesized the findings of 33 primary studies

And 30 other studies

#Dr. Vahid GarousiChallenges and best practices

ChallengesBest practices (success patterns)Lack of research relevanceResearch method relatedLack of training, experience, and skillsLack or drop of interest / commitmentMismatch between industry and academiaCommunication-related issuesHuman and organizational factorsManagement-related issuesResource-related issuesContractual, and privacy concernsKnowledge management (communication, terminology, transfer, training and skills)Ensure engagement and manage commitmentConsider and understand industry's needs, challenges, goals and problemsEnsure giving explicit industry benefits and solve the right problemHave mutual respect, understanding and appreciationBe AgileWork in (as) a team and involving the "right" practitionersConsider and manage risks and limitationsResearcher's on-site presence and accessFollow a proper research/data collection methodManage funding/recruiting/partnerships and contracting privacyUnderstand the context, constraints and languageEfficient research project managementConduct measurement/ assessmentTest pilot solutions before using them in industryProvide tool support for solutions

#Dr. Vahid GarousiCollaboration modelsOur research approach: Action Research

T. Gorschek, C. Wohlin, P. Carre, and S. Larsson, "A Model for Technology Transfer in Practice," IEEE Software, vol. 23, pp. 88-95, 2006

#Dr. Vahid GarousiEnd of the talkBackgroundOf the speaker, his research team and expertise

Success stories of industry-academia collaborationsSuccess stories in CanadaSuccess stories in TurkeyChallenges, best practices, and collaboration models

Questions and answers

#Dr. Vahid GarousiEnd of the talk

#Dr. Vahid GarousiSuccess stories in CanadaProject 1Industry partner: Pason Systems Corporation, Calgary, CanadaChallenge: The company could not decide when to automate testing and what to automate

Project 2Industry partner: NovAtel Inc., Calgary, CanadaCh