SBS - The Best Value in QMS software

How do I analyze the Sound Quality Testing of vacuum cleaners?

tahirawan11

Involved In Discussions
#1
Hi

I would like to perform a blind test to rank the 'sound quality' of five different vacuum cleaners. The study shall be performed by running each vacuum cleaner and then asking a voting panel to rank the perceived sound quality from 1 to 10 (1 being worst and 10 being best). Also i would like to have 3 repeats (with randomization) of the rankings so i have more confidence in the results. Can anyone tell me how should i analyse the results? Also if there are any suggestions on how to conduct this study?

Thanks
 
Elsmar Forum Sponsor

John Broomfield

Staff member
Super Moderator
#2
Last edited:

Mike S.

Happy to be Alive
Trusted Information Resource
#3
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

Sound level is relatively easy to measure quantitatively.

Sound quality is much more likely to be subjective/qualitative.

Which do you really want to know?
 
P

PaulJSmith

#4
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

Agreed. 'Sound quality' will be entirely subjective. Everyone's ears hear differently all along the audio spectrum, with some being more or less sensitive to certain frequency ranges. This individual sensitivity will color each person's opinion differently than others who are hearing the exact same thing. Distance and environmental factors (the listening room) will also affect the experience.

When you say you will "run" each vacuum, do you mean just turn it on and let it run at idle, or will it be running under various loads to represent different surfaces (carpet pile thickness/length)? Will it include debris? All of these things will change the sound of each unit.

Have you considered a simple audio spectrum analysis?
 

tahirawan11

Involved In Discussions
#5
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

yes, I agree that sound quality is very subjective and 'noise level' can be measured easily in 'db' but still the customer will prefer one 'sound' over the other; although they may have similar 'noise level'.

i plan to do a simple study where the vacuum cleaner will be run in idle for few minutes and then the 'customer panel' (who are ordinary persons and not specialist to judge sound) will rank it. The goal of the study is to learn which 'sound' sounds better to ears and then the design can be modified to achieve the most pleasant sound.

No, i have not planned to do a simple audio spectrum analysis but i have never used it but can you tell me what i can get by doing one?

I would like to know if it is fair to take the average sound rank from three runs and then rank them from good to bad. also do i need to use any statistical tool (t-test) to show the significance of results?

/tahir
 

Eredhel

Quality Manager
#6
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

One easy metric is to EQ it. You could use a graphic EQ and see how people feel about lower and higher pitch idles and use. Plus you'll have hard data with the frequency numbers. I'm sure there are some quick and easy mobile apps like garage band where you can just put an EQ on, record, and watch the spikes.
 

tahirawan11

Involved In Discussions
#7
Re: How do I analyze the Sound Quality Testing of vacuum cleaners ?

I have completed the first round of sound quality testing. The sound quality has been subjectively ranked by a group of test panel on a likert scale. After which i have performed a Kruskal-Wallis test to test for significance. Based on the analysis i can conclude that there is a statistical difference between the sound quality of the different vacuum cleaners and vacuum 1 has the best quality followed by Vacuum 4. Any comments if my analysis is correct ??

I plan to do a second round of tests after making some changes in the design of vacuum cleaner and then re-run the test. The time i plan to do 2 repeatable and record the graphic EQ which will be used to detect any correlation between the results and the high/low spikes.

/Tahir
 

Attachments

Steve Prevette

Deming Disciple
Staff member
Super Moderator
#10
Steve,

I read your alternative to Likert Scales.

What does "Very Effective" mean?

Cheers,

John
Actually, that is left to the survey responder. But it is the highest positive response the person may choose.

The original paper contains all sorts of suggested categorical scales. In that case, the phrases were built around "Effective" and "Very Effective" was the highest selection. Personally, I tend to use Strongly Disagree, Disagree, Neutral, Agree, and Strongly Agree.

There is some psychology around the choice of very vs. strongly, in fact, some of the scales tend to give uniformly distributed results, and others thend to be more bell-shaped.
 
Thread starter Similar threads Forum Replies Date
G Team to analyze a non conformance Customer Complaints 26
Q How should I analyze measurement correlation between me and customer? Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 12
K QMS Improvement - Analyze the systemic weaknesses of the QMS for improvement purpose Quality Tools, Improvement and Analysis 6
S Is there a difference in the process? Analyze residuals, construct interval estimate Using Minitab Software 2
K Measurement system analysis "shall be conducted to analyze the variation..." Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 3
Q How to Analyze Risk if is out of your control ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
M Please help to analyze Response Surface Methodology by using Minitab 16 Using Minitab Software 6
D Is this an IDE or not? Helping a doctor collect and analyze data Other US Medical Device Regulations 1
D The correct way to analyze Skewed Data using Minitab Using Minitab Software 3
P How to analyze DOE: 2 Factor, 4 Level Experiment Six Sigma 7
B Analyze 'Factorial Design' or 'Variability' - Difference when used for DOE Analysis? Using Minitab Software 1
D Analyze of Fractional Factorial Design in Minitab - I didn't get F and P- values Using Minitab Software 4
B Gather and Analyze Production Scrap - MiniTab 16 vs. Excel Data Analysis Quality Assurance and Compliance Software Tools and Solutions 5
F Data Analysis Methods - No clue how to analyze this data Using Minitab Software 18
U Ideas or example on how to analyze and present results on data collected Statistical Analysis Tools, Techniques and SPC 3
P PFMEA vs. 8D report - Can we use PFMEA to analyze problems? FMEA and Control Plans 3
C Six Sigma Project - Using FMEA in the Analyze Phase Quality Manager and Management Related Issues 6
E Monitor, Measure, and Analyze Processes? ISO 9001 Clause 4.1.e and 8.2.3 ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 8
D Are Process Behavior Charts the only way to Analyze Deviations from Targets? Statistical Analysis Tools, Techniques and SPC 6
N How to evaluate and analyze Customer Satisfaction Surveys Quality Tools, Improvement and Analysis 16
A PDCA (Plan Do Check Act) vs. DMAIC (Define Measure Analyze Improve Control) Quality Tools, Improvement and Analysis 24
Q Six Sigma DMAIC (Define - Measure - Analyze - Improve - Control) program Six Sigma 1
E Question on how to analyze Customer Survey Results Statistical Analysis Tools, Techniques and SPC 2
Y Sound Testing Gage R&R problem Gage R&R (GR&R) and MSA (Measurement Systems Analysis) 4
M Interesting article - Analysis of Risk: Are Current Methods Theoretically Sound? ISO 14971 - Medical Device Risk Management 7
I Gages to Measure Noise (Sound) General Measurement Device and Calibration Topics 10
DanteCaspian Recommended Andons? Building 3 light-4 light andons, with or without sound Lean in Manufacturing and Service Industries 8
D Layout Inspection - Sound systems to a German car manufacturer IATF 16949 - Automotive Quality Systems Standard 2
B Statistically Sound Data Sampling Technique for Internal Audits Inspection, Prints (Drawings), Testing, Sampling and Related Topics 14
R Rms Spl And Peak Spl Spectrum - Sound Level Spectrum Reliability Analysis - Predictions, Testing and Standards 7
W Safe and Sound Software: Creating an Efficient and Effective Quality System for Softw Book, Video, Blog and Web Site Reviews and Recommendations 1
Marc Wal-Mart's Giant Sucking Sound World News 31
J Silly it may sound, but how to set smart goals? Misc. Quality Assurance and Business Systems Related Topics 8
O What skills are most important for a new Quality Manager Career and Occupation Discussions 11
MSeibert47 Daily Quality Topics - Need Ideas Please! Food Safety - ISO 22000, HACCP (21 CFR 120) 15
P Quality and Regulatory organizational structure Consultants and Consulting 2
P Examples of quality plans in IEC 62304 US Food and Drug Administration (FDA) 2
bobdoering Most typical universal Quality System Funny Stuff - Jokes and Humour 8
F Need Quality Manager advice. Quality Manager and Management Related Issues 6
Sidney Vianna ISO 9001 News ISO 9001 Quality Check - spinning facts in LinkedIn ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 6
S Quality assurance area Manufacturing and Related Processes 11
C Quality Management System Question ISO 9000, ISO 9001, and ISO 9004 Quality Management Systems Standards 32
K Quality Control/Assurance in the Metal Industry Quality Tools, Improvement and Analysis 10
C Quality Manager as part of Management - 13485 ISO 13485:2016 - Medical Device Quality Management Systems 9
Marc Quality Assurance Specialists Job Openings, Consulting and Employment Opportunities 0
B Quality Manager Retiring IATF 16949 - Automotive Quality Systems Standard 5
S Outsourced storage Quality Agreement ISO 13485:2016 - Medical Device Quality Management Systems 7
G Does FDA allows remote approvals of quality documentation. Is there any specific guidance on signing any quality records remotely? Document Control Systems, Procedures, Forms and Templates 1
N Guidance - Cost of Good Quality Misc. Quality Assurance and Business Systems Related Topics 2
D Quality plan for moving locations ISO 13485:2016 - Medical Device Quality Management Systems 3

Similar threads

Top Bottom