We dream a magic button for 3-D point cloud processing

aurivus|REVIT, 3D Studio MAX, 3D Coat, Lightwave, ZBrush, VRMesh, TopoGun, Blender, Rhino, Trimble Sketchup Etc.
Post Reply
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Cylindrical Bench Seat - Apple iPad Pro LiDAR

A large cylinder is extracted from the measurement points that cover only a small portion of the cylinder.
The virtual cylinder is well on the real cylinder.
The RMS error-of-fit is 3.6 mm.

Tools used:
- Apple iPad Pro LiDAR
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface Web.


youtu.be/6RaJyDF9qKs
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Virtual Advertising - Apple iPhone 12 Pro Max

Every real surface is a potential advertising space.

Tools used:
- Apple iPhone 12 Pro Max
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.


youtu.be/WkcjzYsKDkI
User avatar
gord
I have made 20-30 posts
I have made 20-30 posts
Posts: 29
Joined: Tue Dec 22, 2020 9:30 pm
3
Full Name: Gord Anderson
Company Details: tiyuti
Company Position Title: developer
Country: Australia
Linkedin Profile: No
Has thanked: 39 times
Been thanked: 10 times

Re: We dream a magic button for 3-D point cloud processing

Post by gord »

Some very cool 3D demos .. interesting to see whats possible in realtime,

Thanks for sharing these.
gord anderson
quato.xyz
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

An old prediction "AI/ML could learn and understand the basic geometric elements extracted from point cloud much more easily than the raw point cloud itself" is now confirmed through an academic research work,
S.-H. Cho, "Deep learning based 3D object recognition using geometric shapes and sizes”, Jun. 2020.

Future Developments.png
You do not have the required permissions to view the files attached to this post.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

2011 WSJ,
"Software Is Eating The World"
https://www.wsj.com/articles/SB10001424 ... 0915629460

2021 ACM,
"Point Clouds are Eating the World"
https://www.sigarch.org/point-clouds-ar ... -the-world

2001 IEEE,
"Orthogonal distance fitting"
https://ieeexplore.ieee.org/document/1000237

CurvSurf FindSurface is a software for point cloud processing.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

The App 'ARKitDepthFindSurfaceWeb' is not to be released to App Store by CurvSurf.

But, the source codes of the App 'ARKitDepthFindSurfaceWeb' are available on GitHub CurvSurf.

The source codes are under MIT license and App developers are allowed to use and modify the source codes in any ways and methods, and to release their own Apps.

The App 'ARKitDepthFindSurfaceWeb' is running on iPad Pro 2020 or iPhone 12 Pro (Max) with LiDAR 3-D camera.

The device of use must can access to the FindSurface Web API via internet.

The FindSurface Web Demo is a useful tool of learning the functionality of FindSurface Web API.

A YouTube video showing a working example of the App 'ARKitDepthFindSurfaceWeb':

youtu.be/6RaJyDF9qKs
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Smart AR Signage - Apple iPhone 12 Pro

A smart AR signage is displayed virtually on a real object surface and its contents are adapted to the person, object, time, place and view.

Noisy 12,672 points are taken from a cylindrical sculpture.
CurvSurf FindSurface is about 300 kB small runtime library for extracting plane, sphere, cylinder, cone and torus from point cloud.

Tools used:
- Apple iPhone 12 Pro
- Apple ARKit 4
- Apple Metal API
- CurvSurf FindSurface.


youtu.be/bs72vWRGDg0
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

The current state-of-the-development in 3-D point cloud processing


We are living in 3-D reality, i.e., 3-D space.

The stakes are huge. Every movement, determination is performed in 3-D space. We see, feel, measure, analyze, decide, act and get.

The visual raw data of 3-D space are colors and depths (point cloud). Computer Vision is all about them.

The computer scientist/engineer are taming the raw data to the 'data structure' invented for computing machine, a bed of Procrustes.

Mesh and k-d tree are the typical data structure into which the raw data of 3-D space should be tamed to.

The raw data of 3-D space have to be processed and understood by vector & matrix, geometry, the proved tools of analyzing dimensional space.

AI may help fill the last gap.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

The automatic (then, real-time is a matter of time) 3D reconstruction (meshing) is the state of the art; 2-3 scene/sec on mobile device.

Apple has now both technologies of multi-view photogrammetry and dToF.
Create 3D content with Object Capture


CurvSurf will show in 2021:
The real-time scene CAD-modelling on mobile device, 1 scene/sec.

3D point cloud, RGB image --> scene CAD-modelling.
User avatar
Joon
V.I.P Member
V.I.P Member
Posts: 335
Joined: Wed Aug 21, 2013 8:01 pm
10
Full Name: Sung Joon Ahn
Company Details: CurvSurf
Company Position Title: Founder + CEO
Country: Republic of Korea
Linkedin Profile: Yes
Location: Seongnam-si, Korea
Has thanked: 7 times
Been thanked: 35 times
Contact:

Re: We dream a magic button for 3-D point cloud processing

Post by Joon »

Advance notice


CurvSurf is preparing a big release on CurvSurf GitHub.

1. The runtime library FindSurface (single binary files of about 300 kB each for Windows/UWP, iOS, Android, and Linux). The runtime library FindSurface is the property of CurvSurf. You can use it for non-commercial purpose.

2. The source codes of applications utilizing the runtime library FindSurface. The source codes of applications are under MIT license. You can use, modify, and distribute the source codes.

Due late August 2021.
Post Reply

Return to “Modeling Software”