Geomagic Design X - Big .pts file (127gb) not importing
- smacl
- Global Moderator
- Posts: 1409
- Joined: Tue Jan 25, 2011 5:12 pm
- 13
- Full Name: Shane MacLaughlin
- Company Details: Atlas Computers Ltd
- Company Position Title: Managing Director
- Country: Ireland
- Linkedin Profile: Yes
- Location: Ireland
- Has thanked: 627 times
- Been thanked: 657 times
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
I can send you out a 30 day demo license to SCC which could take the in the PTS and spit it out as a E57, LAS or LAZ. We also have tools to ditch very close points on import which can dramatically reduce the size of terrestrial scans where there are a massive number of redundant points very close to the setup position. In addition we support numerous automated tiling methods that will break your point cloud into a number of smaller and more manageable files.
As per my previous post, 2 billion and 4 billion points are magic numbers for software falling over as they correspond to 2^31 and 2^32 which is the default size of integers in many programming environments.
As per my previous post, 2 billion and 4 billion points are magic numbers for software falling over as they correspond to 2^31 and 2^32 which is the default size of integers in many programming environments.
-
- V.I.P Member
- Posts: 846
- Joined: Tue Feb 26, 2013 9:32 pm
- 11
- Full Name: Massimo De Marchi
- Company Details: Massimo De Marchi
- Company Position Title: freelancer
- Country: Italy
- Skype Name: massimo_de_marchi
- Has thanked: 15 times
- Been thanked: 53 times
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
Cloud compare has a very powerful command line.
You can filter, resample, cut, and many other things form command line using much less resources.
Massimo
You can filter, resample, cut, and many other things form command line using much less resources.
Massimo
ing. Massimo De Marchi - +39 347 32 17 049 - www.studiodemarchi.net
- Mortum
- I have made 40-50 posts
- Posts: 49
- Joined: Fri Aug 03, 2018 7:48 am
- 5
- Full Name: Robin van der Molen
- Company Details: ----
- Company Position Title: 3D Scanmonkey
- Country: Netherlands
- Has thanked: 3 times
- Been thanked: 2 times
Re: Geomagic Design X - Big .pts file (127gb) not importing
Well, CC died trying to work with the pointcloud (even with 64Gb RAM)
Thanks for the offer Shane, really appreciated!! and yeah i've read that most software don't like 1 billion+ points. (This file had 3.4 Billion points)smacl wrote: ↑Tue Feb 05, 2019 11:59 am I can send you out a 30 day demo license to SCC which could take the in the PTS and spit it out as a E57, LAS or LAZ. We also have tools to ditch very close points on import which can dramatically reduce the size of terrestrial scans where there are a massive number of redundant points very close to the setup position. In addition we support numerous automated tiling methods that will break your point cloud into a number of smaller and more manageable files.
As per my previous post, 2 billion and 4 billion points are magic numbers for software falling over as they correspond to 2^31 and 2^32 which is the default size of integers in many programming environments.
unfortunately the deadline for me to proof it could be done was yesterday evening.. so this morning the project manager rejected the cloud (which was made by a thirth party) and I got pulled from this case.
I will pick this file up again in downtime, but for now it has to go into the freezer.
Sincerely, Robin van der Molen
Gear and Software:
Ye olde: Faro Photon 120
Faro Scene: 2023
Geomagic Design X
Autodesk Recap
Gear and Software:
Ye olde: Faro Photon 120
Faro Scene: 2023
Geomagic Design X
Autodesk Recap
- smacl
- Global Moderator
- Posts: 1409
- Joined: Tue Jan 25, 2011 5:12 pm
- 13
- Full Name: Shane MacLaughlin
- Company Details: Atlas Computers Ltd
- Company Position Title: Managing Director
- Country: Ireland
- Linkedin Profile: Yes
- Location: Ireland
- Has thanked: 627 times
- Been thanked: 657 times
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
Sorry that the time ran out on you Robin, let me know if you hit this problem again in the future. Point clouds just seem to be getting bigger and bigger and where a couple of billion points used to be big once, it is pretty normal these days, particularly with dense clouds taken from photogrammetry, mobile mapping and some of the newer scanners. Planning and refining streamlined workflows for processing, storage and transfer seem to have become an ever increasing part of our work.
- Mortum
- I have made 40-50 posts
- Posts: 49
- Joined: Fri Aug 03, 2018 7:48 am
- 5
- Full Name: Robin van der Molen
- Company Details: ----
- Company Position Title: 3D Scanmonkey
- Country: Netherlands
- Has thanked: 3 times
- Been thanked: 2 times
Re: Geomagic Design X - Big .pts file (127gb) not importing
Thanks for the info Shane,smacl wrote: ↑Wed Feb 06, 2019 9:13 am Sorry that the time ran out on you Robin, let me know if you hit this problem again in the future. Point clouds just seem to be getting bigger and bigger and where a couple of billion points used to be big once, it is pretty normal these days, particularly with dense clouds taken from photogrammetry, mobile mapping and some of the newer scanners. Planning and refining streamlined workflows for processing, storage and transfer seem to have become an ever increasing part of our work.
Right now I am looking to improve our workflow for thirt party scan files (Mostly handed over as a .rcp file with support folder)
I get the best succes when i export from recap to .pts (.e57 export in recap crashes often/ is unreliable) and then import directly to GDX.
But this also was kind of a freak accident because normally it would work without a problem..
In this case GDX crashes during import, it also doesnt understand the ASCII format of this particular scan but I clicked the ignore function on the RGB & scalar values (while a other file from the same customer loaded without a problem/error message)
I tried to load it in cloud compare, but it freezes completely as well when the scan was loaded, so that didnt give any succes as well.
To be continued..
Sincerely, Robin van der Molen
Gear and Software:
Ye olde: Faro Photon 120
Faro Scene: 2023
Geomagic Design X
Autodesk Recap
Gear and Software:
Ye olde: Faro Photon 120
Faro Scene: 2023
Geomagic Design X
Autodesk Recap
- lastools
- V.I.P Member
- Posts: 144
- Joined: Tue Mar 16, 2010 3:06 am
- 14
- Full Name: Martin Isenburg
- Company Details: rapidlasso - fast tools to catch reality
- Company Position Title: creators of LAStools and LASzip
- Country: Germany
- Skype Name: isenburg
- Linkedin Profile: Yes
- Been thanked: 1 time
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
Hello from @LAStools,
you could try the free and open source txt2las from LAStools which can convert PTS to LAS or LAZ. In case you run into issues you could chime in on this discussion here where we are trying to turn a 315 GB (approximately 4.8 Billion points) .pts file to .las file.
Unfortunately the pointzip.exe and pointunzip.exe tools do not support such large files at the moments as they were created before the LAS 1.4 specification was ratified.
Regards,
Martin @rapidlasso
you could try the free and open source txt2las from LAStools which can convert PTS to LAS or LAZ. In case you run into issues you could chime in on this discussion here where we are trying to turn a 315 GB (approximately 4.8 Billion points) .pts file to .las file.
Unfortunately the pointzip.exe and pointunzip.exe tools do not support such large files at the moments as they were created before the LAS 1.4 specification was ratified.
Regards,
Martin @rapidlasso
- lastools
- V.I.P Member
- Posts: 144
- Joined: Tue Mar 16, 2010 3:06 am
- 14
- Full Name: Martin Isenburg
- Company Details: rapidlasso - fast tools to catch reality
- Company Position Title: creators of LAStools and LASzip
- Country: Germany
- Skype Name: isenburg
- Linkedin Profile: Yes
- Been thanked: 1 time
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
Hello from @LAStools,
the conversion issue was solved. If you have a huge PTS file without RGB you can run the free and open source txt2las from LAStools as follows:
if you have a huge PTS file with RGB you can run
Clayton successfully turned his 315 GB PTS file containing 6,379,507,497 points in ASCII format without RGB into 118 GB binary LAS file. After running LASzip on 118 GB LAS file it went down to a 13.4 GB LAZ file and apparently the Recap software he intends to import this point cloud into does support LAZ. Going from a 315 GB PTS file to a 13.4 GB LAZ file is a reduction in size by a factor of more than 23. Are there any Leica Cyclone or Geomagic developers on this list? Maybe adding LAZ to the list of supported Cyclone and/or Geomagic output formats might be worthwhile to consider.
Thanks for working with me through that, Clayton.
Martin @rapidlasso
the conversion issue was solved. If you have a huge PTS file without RGB you can run the free and open source txt2las from LAStools as follows:
Code: Select all
txt2las -i huge.pts -ipts -parse xyzi -set_scale 0.001 0.001 0.001 -o tiny.laz
txt2las -i huge.pts -ipts -parse xyzi -set_scale 0.001 0.001 0.001 -o small.las
Code: Select all
txt2las -i huge.pts -ipts -parse xyziRGB -set_scale 0.001 0.001 0.001 -o tiny.laz
txt2las -i huge.pts -ipts -parse xyziRGB -set_scale 0.001 0.001 0.001 -o small.las
Thanks for working with me through that, Clayton.
Martin @rapidlasso
-
- I have made 10-20 posts
- Posts: 19
- Joined: Tue Nov 20, 2018 10:26 pm
- 5
- Full Name: Sean Parker
- Company Details: 3D Systems Geomagic
- Company Position Title: Senior Applications Engineer
- Country: United States
- Linkedin Profile: Yes
- Has thanked: 2 times
Re: Geomagic Design X - Big .pts file (127gb) not importing
You shouldn't have an issue with a file that size in DX, the computer is well spec'd for it.
For point clouds, we keep the data in a temp cache folder on the HDD (meshes are loaded in RAM). You can change where that cache location is by going to Menu-->File-->Preferences
You'll also want to probably drop the undo depth down so that it's not caching multiple versions of the same file for the undo operation to run while you're in there.
If you're still having an issue, try to import the file with the ASCII converter which is usually a more robust solution when input errors are being experienced. What other export options do you have access to?
For point clouds, we keep the data in a temp cache folder on the HDD (meshes are loaded in RAM). You can change where that cache location is by going to Menu-->File-->Preferences
You'll also want to probably drop the undo depth down so that it's not caching multiple versions of the same file for the undo operation to run while you're in there.
If you're still having an issue, try to import the file with the ASCII converter which is usually a more robust solution when input errors are being experienced. What other export options do you have access to?
-
- V.I.P Member
- Posts: 401
- Joined: Mon Mar 23, 2009 4:04 pm
- 15
- Full Name: SAttaya
- Company Details: Sev1Tech
- Company Position Title: Sr Software Analyst-RemoteSensingEngr
- Country: USA
- Linkedin Profile: No
- Has thanked: 127 times
- Been thanked: 17 times
Re: Geomagic Design X - Big .pts file (127gb) not importing
1: what version of designX - idle curiosity.
----------------------
2: maybe divide & conquer will help ?
split .pts into multiple pieces (2 to start with)
if both come in, you're good.
if not, one works and other doesn't, split the one that doesn't work, and so on...
import one, save
in same project, import other one
if fails, new project and import 2nd one that failed
if works, save
if not do the split thing above.
You might have to put a header with number of lines,
alternatively, use the ASCII import and tell it to skip
the first line for the first 1/2 and 2nd (and succeeding) won't have line counts.
split it with something like "notepad++" or one of the unix-like utilities (tail, etc)
----------------------
2: maybe divide & conquer will help ?
split .pts into multiple pieces (2 to start with)
if both come in, you're good.
if not, one works and other doesn't, split the one that doesn't work, and so on...
import one, save
in same project, import other one
if fails, new project and import 2nd one that failed
if works, save
if not do the split thing above.
You might have to put a header with number of lines,
alternatively, use the ASCII import and tell it to skip
the first line for the first 1/2 and 2nd (and succeeding) won't have line counts.
split it with something like "notepad++" or one of the unix-like utilities (tail, etc)
- NOVAMECH
- V.I.P Member
- Posts: 279
- Joined: Wed Aug 04, 2010 5:43 am
- 13
- Full Name: Nick Bush
- Company Details: NOVAMECH
- Company Position Title: Director
- Country: New Zealand
- Skype Name: novamech5
- Linkedin Profile: Yes
- Location: Auckland, New Zealand
- Has thanked: 9 times
- Been thanked: 9 times
- Contact:
Re: Geomagic Design X - Big .pts file (127gb) not importing
Don't use ReCap - simple - Problem Solved