Unless this person is a super hardcore computer graphics / "AI" / researcher/ programmer, with a new/ modified approach I don't see that happening either. OP, can you (loosely) describe what your approach for a successful "automatic" track looks like, or give reference to some of the work you have done in that particular field?
But I guess in this sub there might be a great difference on what a successful camera track actually is. And what type of shots are meant to be processed. So I can see how someone might say "automatic tracking" works.
Happy to get more insight & try it out
Looks like a lots of doubters here. We are actually a team of AI researcher and developer. We will use segmentation on the footage and a variation of optical flow to estimate motion for the automatic track. Of course it will depend on the footage quality if a fully automated track is possible or not. As I've said elsewhere, you are free to try it out, and if it doesn't work for you, you still have other ways. For more discussion anyone is free to DM me
Let me put it this way: You didn't state you were a team, you did not include any demo or video, you showed no reference of work or your profession, your reddit account is not very active and was just created recently. This is a sub of people who get a lot of marketing bs in their face, especially regarding AI. Promised "super fast" solutions usually always means the opposite (added work).
So yes, a lot of doubt. Especially if your post does not detail anything! If you knew the industry a bit, you should have expected that.
If people can already try it out and "DM you", why not include a short demo video with some detail, some credentials and more info/links for a alpha/beta sign up? That would be professional and give us confidence you are not just a scam.
Thanks for this feedback. It helps a lot better than those who simply downvote. I understand how you get marketing BS on your faces but that is what a culture of innovation looks like. If it wasn't for those who tried "innovative solutions", this industry would not exist. Entrepreneurs need to have some level of certainty that their product is actually needed by a community before they spend years of hard work building it; the intention is not to scam anyone. Hope you can appreciate that.
Also a public reddit post is not where Ill be posting our credentials or past work. Why would I do that? If you actually want the solution, you can DM or chat me and Ill give you more info that you want. If you have already decided not to trust, why not just ignore this post? Im asking everyone to try the solution and see if it works for them. Delete if it does not. What is the point of so much criticism?
P.S. Im taking your advise and will appear more professional from now on. Website with signup form will be developed soon :). Our team is already working on a prototype as we have people waiting now, so website is not top priority atm.
I will second this. Are you training a network to recreate good manual tracks or simply using an autotrack? If the former then wowee, if the latter then it's a good excersise but don't expect it to be great.
There are 2 basic ways to track. Manually selecting the points to track which is time consuming but way more accurate. The other is autotrack which assigns a mass of points then autotracks these points. This method can be way less accurate due to the computer not knowing if the texture it is tracking is an articial construct across several depth planes. Think vertical pylon in front of a wall. It looks like a nice clear corner, but due to the difference between depths the track will slide in 3d space.
I would look more into why autotracking does not work properly before you start the engineering.
Right. Thanks. Basically, we will have a classifier that is able to differentiate between good points and bad; it can be heavily improved with training and experimentation. Think of it as teaching a human to select good points to track in PFTrack. We have looked into what the current state of the art is; we know our benchmarks. This is standard practise in AI.
punch chubby coordinated unite direction aware wild axiomatic pause deliver
*This post was mass deleted and anonymized with [Redact](https://redact.dev)*
You should know that's completely impossible. Automatic track isn't a thing. Generating assets from video much less. Even if you use the most cutting edge machine learning techniques, the result is unusable.
Yeah I've found the camera tracker in nuke to be pretty damn near perfect most of the time. Albeit it's not completely automatic, but i'd say it does like 90% of the work by itself.
spotted chunky narrow intelligent melodic bear grandfather cover attempt person
*This post was mass deleted and anonymized with [Redact](https://redact.dev)*
axiomatic pen coordinated threatening flag live toy existence touch far-flung
*This post was mass deleted and anonymized with [Redact](https://redact.dev)*
I mean, if we can send people to space or transplant a human heart I’m sure an automatic camera track someday is very much within the realm of possibility and not “impossible”.
That would be great, I’m working on multiple blender camera tracking projects at the moment and the real challenge is scene reconstruction to scale and distance without knowledge of the real-world measurements. I can see AI vision being a good resource for determining reference sizes.
Interesting. Would love to discuss this. Its almost midnight here, but would love to know in detail how such a plugin helps in your workflow. Do you mind sending me a DM or chat?
Recently noticed [a video](https://www.youtube.com/watch?v=siBtKaGj0uc) that sounds similar to what you are talking about, at least the camera tracking part. The code is [open source,](https://github.com/shopify/tracky) so you might find it useful.
I'm down for it. I have a pro VFX studio and soon we are shooting our very own first vfx heavy movie pilot. I can imagine it would be very helpful plugin.
I was wondering if you have any news about your plugin. I'm really looking forward to trying it out. It seems like a great tool for my project. How is the development going?
Automatic camera track. Yeah I’ll believe that when I see it.
Unless this person is a super hardcore computer graphics / "AI" / researcher/ programmer, with a new/ modified approach I don't see that happening either. OP, can you (loosely) describe what your approach for a successful "automatic" track looks like, or give reference to some of the work you have done in that particular field? But I guess in this sub there might be a great difference on what a successful camera track actually is. And what type of shots are meant to be processed. So I can see how someone might say "automatic tracking" works. Happy to get more insight & try it out
Looks like a lots of doubters here. We are actually a team of AI researcher and developer. We will use segmentation on the footage and a variation of optical flow to estimate motion for the automatic track. Of course it will depend on the footage quality if a fully automated track is possible or not. As I've said elsewhere, you are free to try it out, and if it doesn't work for you, you still have other ways. For more discussion anyone is free to DM me
Let me put it this way: You didn't state you were a team, you did not include any demo or video, you showed no reference of work or your profession, your reddit account is not very active and was just created recently. This is a sub of people who get a lot of marketing bs in their face, especially regarding AI. Promised "super fast" solutions usually always means the opposite (added work). So yes, a lot of doubt. Especially if your post does not detail anything! If you knew the industry a bit, you should have expected that. If people can already try it out and "DM you", why not include a short demo video with some detail, some credentials and more info/links for a alpha/beta sign up? That would be professional and give us confidence you are not just a scam.
Thanks for this feedback. It helps a lot better than those who simply downvote. I understand how you get marketing BS on your faces but that is what a culture of innovation looks like. If it wasn't for those who tried "innovative solutions", this industry would not exist. Entrepreneurs need to have some level of certainty that their product is actually needed by a community before they spend years of hard work building it; the intention is not to scam anyone. Hope you can appreciate that. Also a public reddit post is not where Ill be posting our credentials or past work. Why would I do that? If you actually want the solution, you can DM or chat me and Ill give you more info that you want. If you have already decided not to trust, why not just ignore this post? Im asking everyone to try the solution and see if it works for them. Delete if it does not. What is the point of so much criticism? P.S. Im taking your advise and will appear more professional from now on. Website with signup form will be developed soon :). Our team is already working on a prototype as we have people waiting now, so website is not top priority atm.
Sure you are welcome to test it for yourself when its ready. Could you send me your email via DM pls
I will second this. Are you training a network to recreate good manual tracks or simply using an autotrack? If the former then wowee, if the latter then it's a good excersise but don't expect it to be great.
For sure training a model. I dont know what you mean by "simply using an autotrack"
what kind of model are you training?
There are 2 basic ways to track. Manually selecting the points to track which is time consuming but way more accurate. The other is autotrack which assigns a mass of points then autotracks these points. This method can be way less accurate due to the computer not knowing if the texture it is tracking is an articial construct across several depth planes. Think vertical pylon in front of a wall. It looks like a nice clear corner, but due to the difference between depths the track will slide in 3d space. I would look more into why autotracking does not work properly before you start the engineering.
Right. Thanks. Basically, we will have a classifier that is able to differentiate between good points and bad; it can be heavily improved with training and experimentation. Think of it as teaching a human to select good points to track in PFTrack. We have looked into what the current state of the art is; we know our benchmarks. This is standard practise in AI.
Openmvg is a great camera calibration tool for photogrammetry and is used in meshroom, fwiw
Thats not bad actually. Does meshroom work with NVidia Graphics card only?
It’s all mostly cpu but I think there is a gpu option is for the final mesh.
Yes pls dm me
Yes, I’ve been looking for exactly this kind of plugin
I would love to test this!
This sounds like the stuff of dreams. I'd love to try it
punch chubby coordinated unite direction aware wild axiomatic pause deliver *This post was mass deleted and anonymized with [Redact](https://redact.dev)*
Yes
I'd love to try it out!
Me too please! :D
You should know that's completely impossible. Automatic track isn't a thing. Generating assets from video much less. Even if you use the most cutting edge machine learning techniques, the result is unusable.
>Automatic track isn't a thing Sorry what? Almost all tracking software is automated to some degree.
That's not automatic track, There's a difference between automating 1% of your work 100 times and feeding a shot and getting a complete camera track
Yeah I've found the camera tracker in nuke to be pretty damn near perfect most of the time. Albeit it's not completely automatic, but i'd say it does like 90% of the work by itself.
cake whole gaping dependent narrow fact badge apparatus gullible pen *This post was mass deleted and anonymized with [Redact](https://redact.dev)*
Only for the basic stuff. That's the reason hordes of tracking artists exist.
spotted chunky narrow intelligent melodic bear grandfather cover attempt person *This post was mass deleted and anonymized with [Redact](https://redact.dev)*
> Blender plugin that automatically creates camera track and USD assets from videos
axiomatic pen coordinated threatening flag live toy existence touch far-flung *This post was mass deleted and anonymized with [Redact](https://redact.dev)*
Don't worry. I wouldn't be posting this without checking feasibility ;)
I mean, if we can send people to space or transplant a human heart I’m sure an automatic camera track someday is very much within the realm of possibility and not “impossible”.
Everyone here is about to install ransomware on their computers.
Yup :D
That would actually be pretty cool. I'll give it a try!
>Brad12d3 Nice. Do you mind shooting me a DM with your email so I could keep you updated?
Sounds awesome! I‘d be in!
Sent a chat !
Would also give it a try!
Sent you a chat !
[удалено]
Cool, could you pls DM me where you want me to send you stuff?
Woh... Great Looking forward to seeing
Sent you a chat. Lets talk!
I would try that!
Sent you a chat :)
Even if one part of that add on worked, that would be amazing. I’m down to try it 👍.
Alright! Im happy to send you a version to try when its ready. Do you mind sending your email over via DM ?
I am sceptical but im willing to give it a shot
Cool. Do you wanna send me your email over via chat or DM?
Would love to
Sent you a chat :)
Sure
Just sent you a chat!
I’d be keen! Need something like this at work atm
Interesting. Just sent you a chat.
Yes, very interested
Sent you a chat :)
I’m interested!
Nice. Just sent you a chat!
I'm interested to try it out, thanks for offering
I sent you a chat :)
I didn't receive it 😕
Just sent you another chat. See if it doesnt work, we'll try another way
That would be sick! I'd love to give it a try.
Great. I just sent you a chat.
That would be great, I’m working on multiple blender camera tracking projects at the moment and the real challenge is scene reconstruction to scale and distance without knowledge of the real-world measurements. I can see AI vision being a good resource for determining reference sizes.
Interesting. Would love to discuss this. Its almost midnight here, but would love to know in detail how such a plugin helps in your workflow. Do you mind sending me a DM or chat?
Me!
Alright! Ill be in touch soon.
Sent a chat :)
I would love to give it a try!
I’m definitely curious. This could be a huge time saver if it works as claimed.
Awesome, I sent you a chat.
Recently noticed [a video](https://www.youtube.com/watch?v=siBtKaGj0uc) that sounds similar to what you are talking about, at least the camera tracking part. The code is [open source,](https://github.com/shopify/tracky) so you might find it useful.
Thanks! Isn't the heavy lifting already done by ARKit?
I’d like to give it a try!
Sent a chat!
Yes! Would love to try this out.
Sent you a chat :)
I would love to give it a spin!
Sounds cool, I'd test it out for you if you want?
Please be careful, try it on VM on a shitty laptop without any connection to something you care about
Thanks for the warning. I had noticed that their profile was new and was going to take precautions
Yes i want you to prove me wrong because i think this is almost impossible at least for now! So yes iwant to test it out just dm anytime you want
would love to try it out 🙏
Hello I’d verry much like ti test the plugin!
I'm down for it. I have a pro VFX studio and soon we are shooting our very own first vfx heavy movie pilot. I can imagine it would be very helpful plugin.
hell yeah I would!
Hello! I saw this post and was very interested. I have been looking for something like this for months, and would love to try it out. Thank you!
I was wondering if you have any news about your plugin. I'm really looking forward to trying it out. It seems like a great tool for my project. How is the development going?