How do I analyze the Sound Quality Testing of vacuum cleaners?

tahirawan11

Involved In Discussions
#1
Hi

I would like to perform a blind test to rank the 'sound quality' of five different vacuum cleaners. The study shall be performed by running each vacuum cleaner and then asking a voting panel to rank the perceived sound quality from 1 to 10 (1 being worst and 10 being best). Also i would like to have 3 repeats (with randomization) of the rankings so i have more confidence in the results. Can anyone tell me how should i analyse the results? Also if there are any suggestions on how to conduct this study?

Thanks
 
Elsmar Forum Sponsor

John Broomfield

Staff member
Super Moderator
#2
Last edited:

Mike S.

Happy to be Alive
Trusted Information Resource
#3
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

Sound level is relatively easy to measure quantitatively.

Sound quality is much more likely to be subjective/qualitative.

Which do you really want to know?
 
P

PaulJSmith

#4
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

Agreed. 'Sound quality' will be entirely subjective. Everyone's ears hear differently all along the audio spectrum, with some being more or less sensitive to certain frequency ranges. This individual sensitivity will color each person's opinion differently than others who are hearing the exact same thing. Distance and environmental factors (the listening room) will also affect the experience.

When you say you will "run" each vacuum, do you mean just turn it on and let it run at idle, or will it be running under various loads to represent different surfaces (carpet pile thickness/length)? Will it include debris? All of these things will change the sound of each unit.

Have you considered a simple audio spectrum analysis?
 

tahirawan11

Involved In Discussions
#5
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

yes, I agree that sound quality is very subjective and 'noise level' can be measured easily in 'db' but still the customer will prefer one 'sound' over the other; although they may have similar 'noise level'.

i plan to do a simple study where the vacuum cleaner will be run in idle for few minutes and then the 'customer panel' (who are ordinary persons and not specialist to judge sound) will rank it. The goal of the study is to learn which 'sound' sounds better to ears and then the design can be modified to achieve the most pleasant sound.

No, i have not planned to do a simple audio spectrum analysis but i have never used it but can you tell me what i can get by doing one?

I would like to know if it is fair to take the average sound rank from three runs and then rank them from good to bad. also do i need to use any statistical tool (t-test) to show the significance of results?

/tahir
 

Eredhel

Quality Manager
#6
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

One easy metric is to EQ it. You could use a graphic EQ and see how people feel about lower and higher pitch idles and use. Plus you'll have hard data with the frequency numbers. I'm sure there are some quick and easy mobile apps like garage band where you can just put an EQ on, record, and watch the spikes.
 

tahirawan11

Involved In Discussions
#7
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

I have completed the first round of sound quality testing. The sound quality has been subjectively ranked by a group of test panel on a likert scale. After which i have performed a Kruskal-Wallis test to test for significance. Based on the analysis i can conclude that there is a statistical difference between the sound quality of the different vacuum cleaners and vacuum 1 has the best quality followed by Vacuum 4. Any comments if my analysis is correct ??

I plan to do a second round of tests after making some changes in the design of vacuum cleaner and then re-run the test. The time i plan to do 2 repeatable and record the graphic EQ which will be used to detect any correlation between the results and the high/low spikes.

/Tahir
 

Attachments

Steve Prevette

Deming Disciple
Staff member
Super Moderator
#10
Steve,

I read your alternative to Likert Scales.

What does "Very Effective" mean?

Cheers,

John
Actually, that is left to the survey responder. But it is the highest positive response the person may choose.

The original paper contains all sorts of suggested categorical scales. In that case, the phrases were built around "Effective" and "Very Effective" was the highest selection. Personally, I tend to use Strongly Disagree, Disagree, Neutral, Agree, and Strongly Agree.

There is some psychology around the choice of very vs. strongly, in fact, some of the scales tend to give uniformly distributed results, and others thend to be more bell-shaped.
 
Thread starter Similar threads Forum Replies Date
Q How should I analyze measurement correlation between me and customer? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
K QMS Improvement - Analyze the systemic weaknesses of the QMS for improvement purpose Quality Tools, Improvement and Analysis 6
S Is there a difference in the process? Analyze residuals, construct interval estimate Using Minitab Software 2
K Measurement system analysis "shall be conducted to analyze the variation..." Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Q How to Analyze Risk if is out of your control ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
M Please help to analyze Response Surface Methodology by using Minitab 16 Using Minitab Software 6
D Is this an IDE or not? Helping a doctor collect and analyze data Other US Medical Device Regulations 1
D The correct way to analyze Skewed Data using Minitab Using Minitab Software 3
P How to analyze DOE: 2 Factor, 4 Level Experiment Six Sigma 7
B Analyze 'Factorial Design' or 'Variability' - Difference when used for DOE Analysis? Using Minitab Software 1
D Analyze of Fractional Factorial Design in Minitab - I didn't get F and P- values Using Minitab Software 4
B Gather and Analyze Production Scrap - MiniTab 16 vs. Excel Data Analysis Quality Assurance and Compliance Software Tools and Solutions 5
F Data Analysis Methods - No clue how to analyze this data Using Minitab Software 18
U Ideas or example on how to analyze and present results on data collected Statistical Analysis Tools, Techniques and SPC 3
P PFMEA vs. 8D report - Can we use PFMEA to analyze problems? FMEA and Control Plans 3
C Six Sigma Project - Using FMEA in the Analyze Phase Quality Manager and Management Related Issues 6
E Monitor, Measure, and Analyze Processes? ISO 9001 Clause 4.1.e and 8.2.3 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 8
D Are Process Behavior Charts the only way to Analyze Deviations from Targets? Statistical Analysis Tools, Techniques and SPC 6
N How to evaluate and analyze Customer Satisfaction Surveys Quality Tools, Improvement and Analysis 16
A PDCA (Plan Do Check Act) vs. DMAIC (Define Measure Analyze Improve Control) Quality Tools, Improvement and Analysis 24
Q Six Sigma DMAIC (Define - Measure - Analyze - Improve - Control) program Six Sigma 1
E Question on how to analyze Customer Survey Results Statistical Analysis Tools, Techniques and SPC 2
Y Sound Testing Gage R&R problem Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
M Interesting article - Analysis of Risk: Are Current Methods Theoretically Sound? ISO 14971 - Medical Device Risk Management 7
I Gages to Measure Noise (Sound) General Measurement Device and Calibration Topics 10
DanteCaspian Recommended Andons? Building 3 light-4 light andons, with or without sound Lean in Manufacturing and Service Industries 8
D Layout Inspection - Sound systems to a German car manufacturer IATF 16949 - Automotive Quality Systems Standard 2
B Statistically Sound Data Sampling Technique for Internal Audits Inspection, Prints (Drawings), Testing, Sampling and Related Topics 14
R Rms Spl And Peak Spl Spectrum - Sound Level Spectrum Reliability Analysis - Predictions, Testing and Standards 7
W Safe and Sound Software: Creating an Efficient and Effective Quality System for Softw Book, Video, Blog and Web Site Reviews and Recommendations 1
Marc Wal-Mart's Giant Sucking Sound World News 31
J Silly it may sound, but how to set smart goals? Misc. Quality Assurance and Business Systems Related Topics 8
NDesouza No Quality Professional vs Having a Quality Professional Benchmarking 24
F Does anyone have an ESD quality/cooler talk to share? Training - Internal, External, Online and Distance Learning 4
R Monitor production quality - Internal KPIs Manufacturing and Related Processes 5
U Examples of Quality Objectives for a Medtech start up ISO 13485:2016 - Medical Device Quality Management Systems 2
M SemaTech SSQA Standardized Supplier Quality Assessment - my favorite tool ever Manufacturing and Related Processes 0
D Supplier Quality level category help - high level ISO 13485:2016 - Medical Device Quality Management Systems 6
A Quality engineering positions in US - question Job Openings, Consulting and Employment Opportunities 1
R How would you work without a quality management system? IATF 16949 - Automotive Quality Systems Standard 3
P Conformity assessment based on a quality management system or production quality assurance EU Medical Device Regulations 3
H Updating Quality Manual to API Q1 Service Industry Specific Topics 4
R Electrical contractor Project Quality Management Plan Quality Manager and Management Related Issues 1
D Supplier Quality - How to classify a supplier level Medical Device and FDA Regulations and Standards News 7
R China Quality Certification Various Other Specifications, Standards, and related Requirements 1
S Quality management system (Well head installation & maintenance) Quality Management System (QMS) Manuals 5
V Quality review Meeting with Customer for complaints we received Customer Complaints 6
F Supplier Quality Assurance Job Openings - 8/2020 Job Openings, Consulting and Employment Opportunities 0
G Copy of withdrawn ISO 9001:1994 Quality Management Standard ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 2
C Quality, efficiency and effectiveness of daily work routines Misc. Quality Assurance and Business Systems Related Topics 4

Similar threads

Top Bottom