Skip to main content

Blog Entry 4 - Design Of Experiment

Welcome back everyone! In this blog entry I will be solving a case study using Design Of Experiments as well as sharing my reflections for DOE and the practical I did.

What is Design Of Experiment? 

  • It is a statistics-based approach to designing experiments
  • A methodology used to obtain knowledge of a multi-variable process in fewest trials possible
  • It is the backbone of product design
Types of data analysis

  • Full factorial data analysis
    • Using data gathered from all possible runs 
    • More accurate due to larger sample size
    • Fractional factorial data analysis
      • Uses data gathered from selected possible runs
      • More efficient and resource-effective

    Case study

    In this case study, I will be investigating the cause of the loss in popcorn yield.

    Three factors have been identified as the possible cause. They are:

    1. Diameter of bowls to contain the corn
    2. Microwaving time
    3. Power setting of microwave

    In order to determine the impact of each factor, experiments will be conducted with each of the factor having a 'low' and a 'high' value. The following are the two sets of values for each factor:

     

    ‘Low’ Value ( - )

    ‘High’ value ( + )

    Factor A

    - Diameter of bowls

    10 cm

    15 cm

    Factor B

    - Microwaving time

    4 minutes

    6 minutes

    Factor C

    - Microwave power

     

    75%

    100%



    Using the above values, an experiment was conducted and here are the result:

    Run order

    Factor A

    (Bowl diameter)

    Factor B

    (Microwave time)

    Factor C

    (Microwave power)

    Un-popped kernels

    (grams)

    1

    +

    -

    -

    3.78

    2

    -

    +

    -

    2.78

    3

    -

    -

    +

    0.74

    4

    +

    +

    -

    1.78

    5

    +

    -

    +

    0.95

    6

    +

    +

    +

    0.32

    7

    -

    +

    +

    0.78

    8

    -

    -

    -

    3.12


    To begin analysis on each of the factors, I will be using both full factorial and fractional factorial methods to plot a graph to visually represent the impact of each factor.

    I will be using Microsoft Excel to assist me in plotting the graphs.

    FULL FACTORIAL ANALYSIS

    For full factorial data analysis. all the data from the 8 runs will need to be taken into account. Hence, in Microsoft excel I created a table and inputted the data for all the runs.

    I then found the average values of each factor at their 'high' and 'low' modes.






    Afterwards, I created a graph utilising the average values from the data.



    A steep gradient from the graph tells us that there is a significant change in the amount of un-popped kernel between the 'HIGH' and 'LOW' value of a factor. While a gentle gradient tells us that there is not much change in the amount of un-popped kernel between 'HIGH' and 'LOW' value of a factor.

    Therefore from the graph, it can be inferred that factor C has the greatest impact on the amount of un-popped kernel due to it having the steepest gradient. It is followed by factor B which have the second steepest gradient and impact on the amount of un-popped kernel. Finally, factor A had the least steep gradient as well as the least amount of impact on amount of un-popped kernel.

    Effects of each factor

    As factor A (bowl diameter) increases, the amount of un-popped kernel decreases.

    As factor B (microwave time) increases, the amount of un-popped kernel decreases.

    As factor C (microwave power) increases, the amount of un-popped kernel deceases.

    Interactions effects

    (A x B)

    At LOW B,

    Average of low A = (0.74 + 3.12)/2 = 1.93
    Average of high A = (3.78 + 0.95)/2 = 2.365

    Total effect of A = (2.365 - 1.93) = 0.435 (increase)

    At HIGH B,

    Average of low A = (2.78 + 0.78)/2 = 1.78
    Average of high A = (1.78 + 0.32)/2 = 1.05

    Total effect of A = (1.05 - 1.78) = -0.73 (decrease)





    The gradient of both lines are different ( LOW B is +ve and HIGH B is -ve). Therefore there is significant interaction between factor A and factor B.

    (A x C)

    At LOW C,

    Average of low A = (2.78 + 3.12)/2 = 2.95
    Average of high A = (3.78 + 1.78) = 2.78

    Total effect of A = (2.78 - 2.95) = -0.17 (decrease)

    At HIGH C,

    Average of low A = (0.74 + 0.78)/2 = 0.76
    Average of high A = (0.95 + 0.32)/2 = 0.635 

    Total effect of A = (0.635 - 0.76) = -0.125 (decrease)


    The gradient of both lines are marginally different. Therefore there is interaction between factor A and C but the interaction is small.

    (B x C)

    At LOW C,

    Average of low B = (3.78 + 3.12)/2 = 3.45
    Average of high B = (2.78 + 1.78)/2 = 2.28

    Total effect of B = (2.28 - 3.45) = -1.17 (decrease)

    At HIGH C,

    Average of low B = (0.74 + 0.95)/2 = 0.845
    Average of high B = (0.32 + 0.78)/2 = 0.55

    Total effect of B = (0.55 - 0.845) = -0.295 (decrease)


    The gradient of both lines have a noticeable difference. Therefore there is some interaction between facto B and factor C but not by much.

    Conclusion Full Factorial

    Overall, using full factorial data analysis, I was able to find out that factor C (microwave power) is the most impactful on amount of un-popped kernels. Followed by factor B (microwave time) which have a decent impact on amount of un-popped. And finally factor A (diameter of bowl) which have the least impact on amount of un-popped kernels among the three factors.

    Even though each factor have different levels of impact on the amount of un-popped kernels, all of them will reduce the amount of un-popped kernel when their values are increased.

    Hence, the values of all three factors should be set as high as possible to lower the amount of un-popped kernel and minimise loss of popcorn yield.

    Additionally, I was able to find out that all three factors have interactions with each other. With minimal interactions between factors (A x C) and (B x C) but significant interaction between factors (A x B).

    After conducting data analysis with full factorial method, I will now be using fractional factorial method to investigate the same case study.

    FRACTIONAL FACTORIAL ANALYSIS

    Since full factorial analysis does not use data from all of the runs, I will need to carefully select the runs to be used for data.

    The criteria for an effective fractional factorial design is to have a balanced design. This means all factors must occur at 'high' and 'low' levels the same amount of time.

    Hence, among the 8 runs collected I will only be selecting the following 4 runs:

    Run order

    Factor A

    (Bowl diameter)

    Factor B

    (Microwave time)

    Factor C

    (Microwave power)

    Un-popped kernels

    (grams)

    1

    +

    -

    -

    3.78

    2

    -

    +

    -

    2.78

    3

    -

    -

    +

    0.74

    6

    +

    +

    +

    0.32



    As seen from above the 4 runs chosen allows for each of the three factors to have 2 'HIGH' and 2 'LOW' value each.

    Using the data from these 4 runs, I created a graph for fractional factorial analysis.



    A steep gradient from the graph tells us that there is a significant change in the amount of un-popped kernel between the 'HIGH' and 'LOW' value of a factor. While a gentle gradient tells us that there is not much change in the amount of un-popped kernel between 'HIGH' and 'LOW' value of a factor.

    Therefore from the graph, it can be inferred that factor C has the greatest impact on the amount of un-popped kernel due to it having the steepest gradient. It is followed by factor B which have the second steepest gradient and impact on the amount of un-popped kernel. Finally, factor A had the least steep gradient as well as the least amount of impact on amount of un-popped kernel.

    Effects of each factor

    As factor A (bowl diameter) increases, the amount of un-popped kernel increases.

    As factor B (microwave time) increases, the amount of un-popped kernel decreases.

    As factor C (microwave power) increases, the amount of un-popped kernel deceases.

    Conclusion Fractional Factorial

    Similarly to full factorial method, factor C is the most impactful followed by factor B and factor A.

    Although all the values factors have different amount of impact on amount of un-popped kernels and loss in yield of popcorn. It has shown that altering the values of each factor can minimise the lost yield of popcorn. 

    However, there is a difference in effect of factor A. In full factorial the value of factor A have an inverse relationship with amount of un-popped kernels while in fractional factorial the value of factor A actually has a direct relationship. As seen from the fractional factorial graph, the increase in value of factor A actually leads to an increase in amount of un-popped kernels. 

    This discrepancy is due to fractional factorial method using only parts of all the possible data which results in it being more efficient and resource-effective but with the trade-off of missing some information.

    Hence, when conducting similar experiments in the future, I must weight the advantages and subsequent trade-off when choosing between fractional factorial and full factorial data analysis methods. 

    LINK TO EXCEL SHEET


    LEARNING REFLECTIONS

    Tutorial

    I was first introduced to Design Of Experiment in my tutorial lesson on the same topic. In the beginning of the lesson, I thought this would be a simple topic since I believed it would just be adjusting the parameters of an experiment to optimise it. However, I soon learnt that there was much more to DOE. 

    For instance, I had always thought brute forcing through all the possible situations were the only way to optimise the parameters for an experiment or process. I instantly changed my mind once I learnt about the possibility of doing fractional factorial method. Not only is it much more efficient compared to running through all possible data, it is also much less stressful and easier to use. This has opened an entire new method to optimisation for me. However, this was actually not the first time I have been introduced to fractional factorial method and DOE. 

    In a previous module CP5202, I was tasked to use DOE to identify optimal parameters to extract the maximum amount of coffee solubles from coffee beans. 



    In the practical, as a class we adjusted parameters such as temperature, stirrer speed and size of coffee beans to determine best parameters for extracting coffee solubles. We did not know it at the time but that was an example of DOE. 

    This just shows that every module I have taken is important and that they are all connected to each other. I will need to continue learning from my lecturers and fellow students as my understanding is still lacking and I have likely missed many important lessons that can not only improve my time as a student but also my daily life.

    I will also continue honing my skills in DOE as it is likely to prove useful later on especially during prototyping of my group product in this exact module.

    Practical

    After learning about DOE in the tutorial lesson , I also got the opportunity to take part in a practical utilising everything I have learnt. The practical was extremely exciting as it includes a catapult!!





    In this practical the entire class was grouped into groups of 5 to complete the experiment.
    The objective of the experiment was to use DOE to identify the effects of 3 factors at 2 levels each have on the distance travelled by a ball launched by the catapult as well as determining the most significant effect of the 3 factors.

    The factors include:
    • Arm length of catapult
    • Projectile weight
    • Stop angle of catapult 
    Additionally, within our group of 5 we split into two smaller groups. One group performed full factorial data analysis while the other performed fractional factorial data analysis.

    Although I found it quite daunting at first since there were over 90 runs in total, with the help and support from my fellow groupmates we were able to complete it quite quickly. 

    I am extremely grateful for all the assistance I received as I definitely would had trouble completing all the the full factorial runs. 

                                        (Gathering data using the catapult)

    After the entire class has finished gathering all the data. We were introduced to a surprise👻 activity that utilises all the data we had just collected.



    The objective of the activity was to knock down the above cut-outs of our lecturers using the catapult, there were 4 total cut-outs. The cut-outs were placed at various distance and angles from the catapult and so we had to adjust the catapult using the data collected in order to knock the cut-outs down. 

    To up the stakes of this activity, our grades will actually be on the line depending on how well we did relative to other groups. This actually made it much more competitive and was extremely exciting to me. My group utilise every moment and resources to maximise the chance we can knock down the cut-outs. We discussed and tested out our catapults multiple times before we began our official attempt.

                                                (Measuring distance between cut-out and catapult)

    We were actually the third team to attempt this challenge as we had taken a lot of time planning beforehand. I was actually quite nervous as the two teams before us only took down 2 of the cut-outs so the challenge seemed extremely hard for me.

    Fortunately, taking our time allowed us to perfect our plan and we were actually able to knock down all of the cut-outs!!

    I was quite proud of actually completing the challenge as a group and I can only thank my groupmates for putting in so much effort into this practical.


    My group took a picture to document our accomplishment.

    Overall, this practical has been extremely fun. Although, the collection of data was quite tedious, by being able to study the data and plan out our attempt for the challenge it ended up being extremely worth it in the end.

    Thank you for reading my blog till the end! Please stay tuned for my next blog entry, bye!!!




    Comments

    Popular posts from this blog

    Blog Entry 3 - Arduino Programming

    Welcome back everybody! Today I will be sharing my experience my journey in Arduino Programming using the maker UNO kit as well as showing some of the the tasks that I have completed. Contents 1. Input devices:     a.  Interface a potentiometer analog input to maker UNO board and measure/show its signal           in serial monitor Arduino IDE.                                                                                        b.  Interface a LDR to Maker UNO board and measure/show its signal in serial                               monitor  Arduino IDE 2. Output devices:     a.  Interface 3 LEDs (Red, Yellow, Green) to maker UNO board and program it to perform              something (fade or flash etc)     b.  Include the pushbutton on the Maker Uno board to start/stop part 2.a. above 3. For each of the tasks I will describe:     a.  The code that I have used and explanation of the code.     b.  The references that I used to write the code     c.  The problems I encountered and how I

    Blog Entry 1: Laser Cutting

         Welcome everybody to my first blog entry for CP5070. In this blog entry I will be sharing what I have learnt as well as my experience using the laser cutter during the laser cutting competency test . BACKGROUND INFORMATION Laser cutters utilises a concentrated laser beam which hits the surface of a material and heats it strongly until it melts or vaporises. Once the laser beam has penetrated the material, the cutting process can begin. The benefits of using a laser cutter include: The laser beam is able to provide high levels of precision and accuracy which allows more complex designs to be etched on smaller designs while still having a clean cut. There are less wa ste and contamination that is pro duced The laser allows for cutting of difficult to cut materials NOTABLE SAFETY HAZARDS Laser cutting comes with inherent safety risks and hazards. It is important for users to take note and understand the the hazards associated to laser cutting and the safety control measures that it h

    Blog Entry 5: Hypothesis Testing

    Welcome back everybody! In this blog I will be talking about hypothesis testing and sharing everything that I have learned.  HYPOTHESIS TESTING The first thing we should know about is what exactly is hypothesis testing. While it may seem quite obvious from the name itself, it is actually much deeper than what I thought it would be. Hypothesis testing allows for statistical hypothesis to be proven or rejected through formal procedures. Statistical hypothesis: an assumption about a population that may or may not be correct. Hypothesis testing can be used to answer questions such as: Is the new material as strong as the old one? Is the performance of our product enhanced after undergoing the revamp? Is the spare part performing as well as the original part? In my case I will be conducting an experiment to undergo hypothesis testing for the effects of various factors on a catapult. Frequent readers of my blog will recognise that this is actually the same experiment as my practical for Desi