"When working with projects that had thousands of runs, loading the interface and sorting through data was super slow in Weights & Biases. Neptune is better at handling large-scale. We’re happy with this choice."
“Without information I have in the Monitoring section I wouldn’t know that my experiments are running 10 times slower as they could. All of my experiments are being trained on separate machines which I can access only via ssh. If I would need to download and check all of this separately I would be rather discouraged. When I want to share my results I’m simply sending a link.“
"I’ve used Neptune from 2019, first for my personal projects and now within the company. During this time, I saw changes and improvements in UI, but also performance and reliability. But at the same time, I always appreciated that it never became too cluttered with too many things. It’s straight to the point and it’s very effective in what it does."
"We’ve got a few teams across different countries and different time zones and prior to Neptune, we were just shipping each other zips of like TensorBoard logs, so being able to see it all in space and it’s all just logged to the central area is really great and has helped us compare our results a lot faster and a lot more efficiently."
“What we like about Neptune is that it easily hooks into multiple frameworks. Keeping track of machine learning experiments systematically over time and visualizing the output adds a lot of value for us.”
“I didn’t expect this level of support.”
“The problem with training models on remote clusters is that every time you want to see what is going on, you need to get your FTP client up, download the logs to a machine with a graphical interface, and plot it. I tried using TensorBoard but it was painful to set up in my situation. With Neptune, seeing training progress was as simple as hitting refresh. The feedback loop between changing the code and seeing whether anything changed is just so much shorter. Much more fun and I get to focus on what I want to do. I really wish that it existed 10 years ago when I was doing my PhD.”
"At some point, one of my students tried doing the tracking process manually, and he was very frustrated after one project. Any manual change can mess up information organization and how you track it. And if you do not build it well, then you suffer, you need to recode, etc. I think it’s just a waste of time."
"We use Neptune for keeping track of all our research work and monitoring of on-going model training. Since everything is tracked in Neptune it is super easy to keep track of what we did, how we did it, and what the results were. It makes it a lot easier also direct future research directions."
“Within the first few tens of runs, I realized how complete the tracking was – not just one or two numbers, but also the exact state of the code, the best-quality model snapshot stored to the cloud, the ability to quickly add notes on a particular experiment. My old methods were such a mess by comparison.”
"We primarily use Neptune for training monitoring, particularly for loss tracking, which is crucial to decide whether to stop training if it’s not converging properly. It’s also invaluable for comparing experiments and presenting key insights through an intuitive dashboard to our managers and product owners."
"Versioning jupyter notebooks is a great and unique feature."
"No more DevOps needed for logging. No more starting VMs just to look at some old logs. No more moving data around to compare TensorBoards."
"I used Weights & Biases before Neptune. It’s impressive at the beginning, it works out of the box, and the UI is quite nice. But during the four years I used it, it didn’t improve —they didn’t fully develop the features they were working on. So I appreciate that Neptune has been noticably improved during the whole time I’ve been using it."
"With Neptune, I have a mature observability layer to access and gain all the information. I can check any model’s performance very quickly. It would take me around a minute to figure out this information. I don’t have to go deeper and waste a lot of time. I have the results right in front of me. The time we have gained back played a significant part."