Laser Design Inc

952-252-3479

Menu
  • Home
  • Products
      • 3D Scanners
          • Portable 3D Scanners
            • Portable 3D Scanners

              Portable Scanners are the ideal option to quickly scan complex shapes and geometric data from objects large or small when you want to go anywhere and inspect anything.

              Portable Scanners >

            • Close
          • Desktop 3D Scanner
            • Desktop Scanner

              Desktop Scanners are the ideal option to quickly scan complex shapes and geometric data from small objects.

              Desktop Scanner >

            • Close
          • Long-Range Scanner
            • Long-Range Scanner

              3D portable scanner that capture precise dimensions of large objects such as wind turbines, ship propellers, airplanes and buildings. Producing 3D scans of the highest quality.

              Long-Range Scanner >

            • Close
          • CT (X-ray) Scanners
            • CT (X-ray) Scanners

              Capture all geometry, both external and internal, of complex and free-form parts.

              CT Scanning Systems make non-destructive evaluation possible.

              CT Systems >

            • Close
          • Metrology Grade Scanners
            • Metrology Grade Scanners

              Need to capture ultra-precise surface data for reverse engineering and inspection?

              3D laser scanning with our high precision scanners are a great solution.

              Metrology Grade Scanners >

            • Close
          • Body Scanners
            • Body Scanners

              3D human body scanners obtain 3D images and models in seconds, making this an ideal solution for full body digitizing and human body modeling.

              3D Body Scanners >

            • Close
        • Close
      • Software & Accessories
          • 3D Anti-Glare Spray
            • 3D Anti-Glare Spray

              To achieve optimal accuracy and results with 3D laser scanning it is often necessary to apply an anti-reflection coating. Helling 3D Scan Spray is especially designed for this purpose.

              3D Scan Spray>

            • Close
          • Artec Studio
            • Artec Studio

              Industry acclaimed software for professional 3D scanning and data processing.

              Artec Studio>

            • Close
          • InnovMetric-Polyworks Software
            • InnovMetric-Polyworks Software

              PolyWorks is a powerful industrial 3D metrology software solution.

              Polyworks Software>

            • Close
          • Geomagic Software
            • Geomagic Software

              Geomagic software offers products for 3D digital realities.

              Geomagic Software>

            • Close
          • SpaceClaim Software
            • SpaceClaim Software

              SpaceClaim empowers engineers to be more creative and deliver products to market faster.

              SpaceClaim Software >

            • Close
          • Volume Graphics Software
            • Volume Graphics Software

              Volume Graphics offers a range of products for the visualization and analysis of CT data and has become a virtual standard for industrial voxel data analysis.

              VG Software >

            • Close
          • ExactFlat Software
            • ExactFlat Software

              ExactFlat enables manufacturers to design, flatten, conduct pattern engineering, nest, cost and create manufacturing and business documentation all on one platform.

              ExactFlat>

            • Close
        • Close
    • Close
  • Services
      • 3D Scanning
          • Parts & Objects
            • 3D Scanning - Parts & Objects

              3D scanning converts physical objects into precise digital models, enabling you to quickly and accurately capture your object’s shape and geometries.

              3D Scanning>

            • Close
          • Buildings & Structures (BIM)
            • 3D Scanning - Buildings & Structures

              Terrestrial 3D scanning is a ground-based technique for collecting high-density spatial imaging with millions of coordinates quickly and accurately.

              Buildings & Structures (BIM)>

            • Close
          • Aircraft, Vehicles & Large Objects
            • Aircraft, Vehicles & Other Large Objects

              Terrestrial & Mobile 3D scanning are techniques for collecting high-density spatial imaging with millions of coordinates quickly and accurately for your aircraft, vehicles and vessels.

              Large Object 3D Scanning>

            • Close
          • ITAR – Weapons
            • ITAR - Weapons

              Laser Design is committed to investing in secure resources that ensure that all of our ITAR data is stored in a manner that meets or exceeds the ITAR requirements. With Laser Design you know your ITAR project is not only compliant but being fulfilled by a company that is registered.

              ITAR - Weapons>

            • Close
          • Industrial CT Scanning
            • Industrial CT Scanning

              Metrology grade Computed Tomography (CT) inspection allows a complete 3D capture of complex internal geometry of parts without needing visual access – the process is nondestructive.

              CT Scanning>

            • Close
          • Reverse Engineering
            • Reverse Engineering

              Reverse engineering using 3D scan data is the most efficient way to generate a CAD model from a physical object that has any kind of complex or freeform shape.

              Reverse Engineering>

            • Close
          • Inspection & Metrology
            • Inspection & Metrology

              Helping to solve your most demanding dimensional inspection issues, digitizing, calibration, certification and all other facets of manufacturing that have to do with 3D metrology.

              Inspection & Metrology>

            • Close
        • Close
      • Point Cloud Modeling
        • Point Cloud Modeling

          If you have a scanner but would like help taking your point clouds to CAD format then let the 3D experts help! Everything from small plastic parts, blades to entire ships and buildings.

          Point Cloud Modeling>

        • Close
      • Scanner Rentals
        • Scanner Rentals

          Laser Design’s knowledgeable rental staff has actual project experience with the 3D equipment we provide.

          Scanner Rentals>

        • Close
      • 3D Photorealistic Rendering
        • 3D Photorealistic Rendering

          Moving from 2D to 3D improves how your ideas and concepts are shown and communicated. When you’re able to show your designs in 3D verses a static 2D drawing the experience is more realistic.

          3D Photorealistic Rendering>

        • Close
    • Close
  • Solutions
      • Industries
          • Aerospace
          • Anthropology
          • Architecture, Engineering, Construction
          • Automotive
          • Bridge
          • Consumer Electronics
          • Defense
          • Education
          • Entertainment
          • Forensics
          • Foundry
          • Heavy Machinery
          • Heritage
          • Hydro Power
          • Law Enforcement
          • Legal
          • Machine Shop
          • Marine
          • Medical
          • Mining
          • Oil & Gas
          • Online Retail
          • Orthotics and Prosthetics
          • Petrochemical
          • Plastics
          • Power Generation
          • Tunnels
          • Wind Power
        • Close
      • Applications
          • 2D to 3D CAD Conversion
          • Accident Reconstruction
          • Alignment
          • As-Built Documentation
          • Asset and Facility Management
          • Body Scanning Application
          • CAD-Based Inspection
          • Class A Surfacing
          • CGI and Visual Effects
          • Contract Inspection
          • Computer Aided Verification
          • Crime Scene Analysis
          • Dimensional Analysis
          • Electronic Site Survey
          • Emergency Response Scanning
          • FEA – Finite Element Analysis
          • First Article Inspection
          • Form Analysis
          • Gear Inspection
          • Incoming Inspection
          • In-Process Inspection
          • Large Part Inspection
          • Litigation Support
          • Machine Calibration
          • Non-Contact Inspection
          • Photorealistic Modeling
          • Product Design
          • Reverse Engineering
          • Robot Calibration
          • Scene Documentation
          • Tool Building and Setup
          • Virtual Simulation
        • Close
    • Close
  • About Us
    • About Laser Design
    • Why Choose Laser Design?
    • Customer Testimonials
    • 3D Technologies Used
    • Careers
    • Partner Programs
    • Terms and Conditions
    • Contact Us
    • Locations
    • Close
  • Locations
    • United States Locations
    • Close
  • Learning Portal
    • Sample Files
    • Blog
    • Case Studies
    • News
    • Videos
    • What is 3D Scanning?
    • 3D Technology Glossary
    • ROI of 3D Scanning
    • Close
  • Contact Us

Accuracy Study on WS-Series System

November 20, 2014 by Andrew Larson

Executive Summary

It is often difficult to describe the accuracy of a 3D Laser Scanning system, because, to date, there is no unified standard that governs it. The typical scanning system from Laser Design is a CMM base with a laser line sensor attached in place of a touch probe. While determining the accuracy of the CMM base is simply a matter of running an ANSI B89 Ball Bar test using a touch probe, no such standard test exists for describing accuracy when a laser probe is attached.

In addition, Laser Design includes 4th axis automation, fixturing, and specific software solutions with its systems. These components may also impact accuracy, repeatability, and reproducibility. For a user who is scanning, for example, a cell phone housing for a first article inspection process, understanding how the system functions as whole is vital. For this reason Laser Design has defined a set of tests that will once and for all determine a machine’s performance. The tests are simple and are designed to stress the entire inspection process, from fixturing to data analysis.

Briefly, the tests include an adapted B89 test, using the Laser Sensor instead of a touch probe, as well as a Gage R&R Study using a certified, modified gage block.

Results

The tests described above were completed on a WS2030 machine base with an SLP 250 laser probe attached. Running the Adapted B89 test resulted in a machine accuracy of .00898 mm. This compares to results from a standard B89 test of .005 mm. The results of the Gage R&R test yielded a 5.15 sigma result of 0.0137 mm.

Background

A CMM based Laser Scanning system represents a complicated measurement tool, whose accuracy and repeatability can be difficult to gage, especially when you add a 4th axis and ball matching to the mix. In the past, system accuracy was estimated by simply adding the CMM machine accuracy to the stated laser probe accuracy. While this may get you in the ball park, it does not address all of the factors that can impact total system accuracy. For example, on a 3 axis system, you must also consider the alignment of the laser to the CMM base as a source of error. On a 4 axis system, the part sits on a rotary stage, which also must be aligned/calibrated before use. If you wish to scan both sides of a part, you may need to rely on ball matching to bring the data from each side back together. All of these factors can combine to impact system accuracy, repeatability, and reproducibility. In addition there may be error generated by the data analysis process. For example, it can be difficult to know the accuracy and repeatability of the software for registering the point cloud to its CAD model. If that isn’t accurate, any cross sections used for dimensioning may be in the wrong place.

Test

We have taken a two prong approach to try to solve these problems. First, we use a modified B89 ball bar test using the laser probe to identify 3‐axis machine accuracy. Because this test relies only on the laser for collecting data, it is a good measure of the impact of both laser accuracy and alignment of the laser on machine accuracy. By comparing this result to results collected from a standard B89 using a touch probe, we can quickly zero in on the error component introduced by the laser probe and its alignment.

Second, we complete a Gage R&R test using a qualified modified gage block. We scan this gage block using standard practices – in this case we attach it to our Flip Fixture and scan using the rotary on both sides of the block. This provides data from use in real world conditions. We then bring the data into Raindrop Geomagic Qualify, which we recommend for inspection software. Because the gage block has been modified to include a hemisphere attached to its surface, it is now simple to accurately match the scan data to the CAD surface of the gage block created during the certification process. Without the hemisphere there was always the possibility that the scan data could match to the CAD in one of 4 ways. The hemisphere ensures that we compare the proper surfaces to one another. Finally, we take 6 measurements on the gage block and compare to the certified CAD. This test is repeated 3 times by 3 people to yield repeatability and reproducibility by the Average and Range method.

Adapted B89 Test
For our tests, we will perform a 13 position B89 test using an SLP 250 probe on a WS2030 machine base. The probe will be aligned using our standard methods (Probe Alignment Wizard) before each test. Surveyor Scan Control provides an Excel spreadsheet for calculating B89 test results. This will be used for determining the results of each test.

Materials:

  • Ball Bar Kit with bead blasted test spheres – make sure the sphere diameters are known.
  • LDI WS2030scanner – 3 axis
  • SLP 250 laser probe

Setup:

  1. The setup procedure will be completed before each test.
  2. Probe will be mounted to the CMM using the PH10.
  3. Run the Probe Alignment Wizard.
  4. Silence any rotary stages.

img67

Procedure:

  1. Open the ball bar template.ssc file from C:/LaserDesign/Surveor/Samples.
  2. Set up the ball bar in the machine work space for the position you want to scan.
  3. Select the layer that corresponds to the position of the ball bar.
  4. Open the Ball Scan Wizard (CTRL B), and move the laser over the 1st ball.
  5. Enter the proper sphere diameter into the wizard.
  6. Run the Wizard.
  7. When the system is done scanning, open the Ball Scan Wizard again. Make sure you have selected the proper layer first.
  8. Move to the second ball and finish the wizard.
  9. Repeat this process for each of the 13 ball positions required by the adapted B89 test.
  10. When complete, run Compute From Sphere Scans/Statistics on the root layer of the file.
  11. In the Goodness of Fit dialog, select Excel Export.
  12. Save the Excel file when it opens.
  13. Save the SSC file.
  14. Run this test 3 times for each probe.

img68

Analysis:

  1. For each data set, open the Excel file that contains the Goodness of Fit data.
  2. Also open the Ball Bar Template.xls file.
  3. Copy the data from the data file into the template file on worksheet 2.
  4. Worksheet 1 will now calculate the ball bar results, which is the maximum range of ball bar lengths for each test.
  5. Save the Ball Bar results for each test.
  6. Compare the tests. Calculate an average and standard deviation for each probe data set (from the 3 test samples).

Setup:

  1. Each Operator must perform the setup procedure before completing the first measurement.
  2. Setup the WS machine for typical rotary scanning, setting up the rotary stage at 30 degrees from flat with the Flip Fixture attached.
  3. Run the Probe Alignment wizard to ensure proper probe alignment.
  4. Run the Rotary calibration wizard to ensure proper rotary calibration.
  5. Using the ¼ 20 rods and nuts, mount the gage block in the fixture frame. Use super glue to fix the block to the rods. Make sure that the block is firmly fixtured and does not move.

Gage R&R Test

For these tests, we use a standard Excel template that provides d(2) values for the R&R calculations, and sets up all required formulas. The template requires the test be run with no more than 10 measurements, 5 trials, and 3 people. The test must be run with a minimum of 2 samples each. In general, a test is set up to measure a part with the laser scanner. The part – a modified and certified gage block – is mounted in the fixture frame for scanning by the first operator. This operator then completes from 2 to 5 scans of the same part. The subsequent operators repeat the same number of trials after refixturing the part. Discrete measurements are set up in Qualify, and the parts are run through the Auto Report process to ensure repeatability in the measurement locations (relative to the CAD). The discrete measurements are then entered into the spreadsheet and R&R values can be calculated.
Materials:
•3” Gage Block, bead blasted and qualified on calibrated CMM
•CAD file representing the qualified gage block (IGES or STL surface)
•LDI WS2030 scanner – 4 axis
•SLP 250 Probe
•LDI Flip Fixture for 4th axis
•¼ 20 threaded fixture rod and nuts
•Super Glue January

Setup:

  1. Each Operator must perform the setup procedure before completing the first measurement.
  2. Setup the WS machine for typical rotary scanning, setting up the rotary stage at 30 degrees from flat with the Flip Fixture attached.
  3. Run the Probe Alignment wizard to ensure proper probe alignment.
  4. Run the Rotary calibration wizard to ensure proper rotary calibration.
  5. Using the ¼ 20 rods and nuts, mount the gage block in the fixture frame. Use super glue to fix the block to the rods. Make sure that the block is firmly fixtured and does not move.

img69

 Scanning:

  1. Attach the fixture frame to the Flip Fixture.
  2. Run the Ball Matching wizard to scan the balls for side
  3. Create a path plan for scanning the first side of the gage block. Scan the block using 0.010” spacing and at every 45 degrees on the rotary. Set the optimal exposure time.
  4. Save the path plan.
  5. Scan side 1.
  6. When side 1 is complete, flip the frame over to side 2.
  7. Run the Ball Matching wizard to scan the balls for side 2.
  8. Create a path plan for scanning the second side of the gage block. Scan the block using 0.010” spacing and at every 45 degrees on the rotary. Set the optimal exposure time.
  9. Save the path plan.
  10. Scan side 2.
  11. Complete the file by running the Ball Match wizard again. This will combine the side 1 and side 2 data.
  12. Save the resulting data layer as a .scn file.
  13. Repeat the steps above for the remaining trials for each operator. Each operator may use his saved path plans to scan subsequent trials, but they must make their own path plan for the first trial.

Analysis:

  1. Import the CAD model of the gage block into Geomagic Qualify.
  2. Set up Plane Datums on 3 perpendicular faces of the gage block model.
  3. Import the .scn file from the unpainted gage block.
  4. Remove all fixture data from the file.
  5. Run Select Outliers to make sure all fixture data is removed. Delete the selected outlier data.
  6. Run Auto Create Datums and Features. Qualify will find the Datums from the CAD on the point cloud automatically.
  7. Run Datum/Feature Align. Click the Auto button to automatically align the data to the CAD using the 3 datums.
  8. Run 3D compare to create an error map. Set the color map to go from +‐.0005 to +‐ .005 (inches).
  9. Create cross sections for dimensioning. Create 3 sections using the 3 cardinal system planes in the default locations.
  10. Create 2D dimensions on the 3 cross sections. Measure 6 separate dimensions.
  11. Create a report for the data.
  12. Once the report is created, you can automatically run the same report on the other 2 data sets. Replace the point cloud data (don’t forget to delete the fixture data). Then run the auto report function.
  13. When all reports are completed, use them to fill out the Gage R&R Template.
    a) Enter the Nominal Measurement values into the Nominal Row at the top of the table.
    b) Enter the numbers of parts, trials and operators.
    c) Enter the part data into the proper columns and rows by trial product and operator.
    d) The spreadsheet will calculate the results.
Results

Adapted B89 Test

A 13 position Ball Bar test was run on the WS2030 scanner using an SLP 250 probe head. The test was repeated 3 times, after running the Probe Alignment Wizard between each test, to recalculate the Probe Alignment Matrix relative to the machine base. Table 1 below shows the test results, averaged over the 3 tests. The Total is the 3 test average of the maximum Ball Bar length range for each 13 position test. When a standard B89 test was run on this machine at installation, the results yielded an Average Test Delta of 0.005mm. The Adapted B89 test yielded an Average Test Delta of 0.00898mm.

img70

Gage R&R Test

A modified gage block was scanned 3 times by 3 separate operators, and then compared to CAD model in Geomagic Qualify. The comparison process was automated so that the same measurement cross sections were used for finding dimensions on each part. These results were then tabulated in a Gage R&R worksheet, where various Gage R&R values were calculated. The results of the test are shown in Table 2. The 5.15 sigma column represents 99% confidence, while the 1 Sigma column represents roughly 67%.

img71

Conclusions

At the start of this process, we were confronted with the problem of defining overall laser scanning system accuracy, repeatability, and reproducibility without any defined standard to lean on. We therefore developed a set of tests that would give us these results. We then applied these tests to a WS2030 laser scanner with an SLP 250 probe attached.

Running the Adapted B89 test was designed to show us the 3‐Axis machine accuracy when using the SLP 250 to collect data. Our results showed an accuracy of 0.00898mm, which compares to standard B89 results of 0.005mm for the same machine. When we take into account that the stated accuracy specification for an SLP 250 is 0.010mm, we can see that the original 3‐Axis accuracy assumption of adding the machine accuracy to the laser accuracy is a conservative assumption. This, in turn shows that using a ball bar to measure machine accuracy on a properly aligned machine will allow you to check the alignment of your machine without the need for a touch probe.

The Gage R&R test was designed to stress the typical scanning process. Therefore, the processes of fixturing, rotary scanning, ball matching, point cloud to CAD matching, and cross section measurement were tested together, while also allowing for operator variation. We found that at a 5.15 Sigma level – or 99% confidence – Repeatability was 0.0137mm, Reproducibility (operator variation) was 0.0033mm, and Part Variation was 0.0238”. The numbers, with exception of Part Variation, are all well within the assumed machine accuracy (touch probe B89 accuracy + laser accuracy, which should be about 0.015mm). The higher Part Accuracy number actually hinges on one specific measurement on all 9 tests. This indicates a variation between the CAD model and the actual gage block. This is not completely surprising, since the gage block CAD was built using 3 points on each surface to approximate the planes. Any surface variation in the part would not be included in the CAD model. This part error was also measured on a non calibrated surface of the original gage block, so it is not unreasonable to find that the surfaces are not completely flat. This also illustrates the capability of the laser scanner to identify differences between the CAD model and part repeatably.

Filed Under: Case Studies, White Papers

About Laser Design

Laser Design, a CyberOptics Corporation Brand, has been a leading supplier of 3D scanning systems and services since 1987. Laser Design helps customers successfully solve their most complex 3D inspection, analysis, and reverse engineering challenges quickly, giving them a competitive advantage.

Whether the 3D solution needed is a new 3D scanner or a service project performed in our lab or at your site – Laser Design’s expert metrologists and experienced engineers have you covered – on your schedule, within your budget and with ultra accuracy & results our customers have come to expect.

  • Learning Portal
    • Sample Files
    • Blog
    • Case Studies
    • News
    • Videos
    • What is 3D Scanning?
    • 3D Technology Glossary
    • ROI of 3D Scanning
ldi-exp_246-254

What Customers are Saying…

Soundair Aviation"The 3d scan file came out perfectly and the turn around time was super fast." -R.S. @ Soundair Aviation

Question about 3D Scanning?

Ask a 3D Expert>>

Sign-up for our eNews:

  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • Videos
  • eNews
Sign-up For Our Newsletter
PRODUCTS
  • 3D Scanners
    • Portable 3D Scanners
    • Desktop 3D Scanner
    • CT (X-ray) Scanners
    • Metrology Grade Scanners
    • Body Scanners
    • 3D Scanners for CMMs
  • Software & Accessories
    • 3D Anti-Glare Spray
    • Artec Studio
    • InnovMetric-Polyworks Software
    • Geomagic Software
    • Space Claim Software
    • Volume Graphics Software
    • ExactFlat Software
SERVICES
  • 3D Scanning
    • Parts & Objects
    • Buildings & Structures (BIM)
    • Aircraft, Vehicles & Large Objects
    • ITAR – Weapons
    • Industrial CT Scanning
    • Reverse Engineering
    • Inspection & Metrology
  • Point Cloud Modeling
  • 3D Photorealistic Rendering
  • View all services »

Solutions
Industries
Applications

About Us

Learning Portal

Contact Us
Laser Design
5900 Golden Hills Drive
Minneapolis, MN 55416

All Locations

Terms of Use | Privacy Policy | Contact Us | 952-884-9648

© 2023 CyberOptics Corporation. All Rights Reserved.

This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish. Cookie SettingsACCEPT
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
SAVE & ACCEPT