We're ringing in the new year with a suite of powerful updates to Moonshine, designed to streamline your video analysis workflows and unlock deeper insights than ever before. These enhancements focus on improved prompt handling, simplified video uploads, a novel embeddings viewer, and expanded API access. Whether you're a seasoned developer or just beginning your journey with video understanding, these updates will significantly impact your ability to extract meaningful information from video content.

Goodbye Guidance Limits, Hello Half a Million Tokens

One of the most significant changes is the removal of the Guidance block limitation within the Inquire console. Previously, prompt length was a constraint, potentially hindering complex queries. Now, you can input up to half a million tokens directly into the prompt, enabling far more nuanced and comprehensive searches. This expanded capacity allows for highly specific queries, capturing intricate details within your videos. While the Guidance parameter remains supported on the API for backward compatibility with older systems, we strongly encourage refactoring your code to leverage this new, more powerful direct input method.

Seamless Video Uploads from Anywhere:

Moonshine now supports remote video URLs for direct upload to your index. This eliminates the cumbersome requirement of having videos physically stored on your device before uploading. Simply navigate to the "Remote Upload" option within the client, paste the URL of a publicly accessible video file, and Moonshine's server will handle the rest. This feature drastically simplifies the ingestion process, particularly for users working with large video datasets distributed across various locations. For enterprise clients managing extensive video libraries on other cloud platforms, we offer tailored cloud-to-cloud integration solutions. Contact us directly to discuss your specific needs and optimize your video upload pipeline.

Navigating the Embedding Space: A New Era of Prompt Engineering

Prompt engineering is crucial for effective video analysis, but crafting the perfect prompt can be challenging, especially when dealing with unfamiliar content. Consider a scenario where you have hours of security camera footage. Generic prompts like "What is this video about?" offer limited value. To address this, we've introduced the Embeddings Viewer. This innovative tool provides a visual representation of the embeddings generated by Moonshine. Embeddings clustered together represent similar video segments, while those further apart indicate greater dissimilarity.

By exploring this embedding space, you can quickly identify key themes and events within your video data. For instance, in our security footage example, the Embeddings Viewer might reveal clusters related to a gray truck, a red car, and pedestrians. Armed with this information, you can refine your prompts for more targeted queries, such as "I see a red car and a gray truck. Do any people exit these vehicles, and if so, how many?" This approach allows for iterative refinement of your queries, leading to more precise and actionable insights.

Beyond the Surface: Enhanced Observability and Analytics

The updated Moonshine platform provides enhanced observability into the inner workings of the system. This transparency offers valuable insights into the analysis process, aiding in debugging and optimization. Developers gain access to more detailed analytics, including information on potential issues and performance metrics. This improved observability empowers developers to fine-tune their workflows and ensure optimal performance.

Expanding Horizons: API Access Across Multiple Platforms

Previously, the Moonshine API was limited to Python. Recognizing the diverse needs of our community, we've expanded API access to a wider range of coding platforms. This broadened support empowers developers to integrate Moonshine into their preferred development environments, fostering greater flexibility and innovation. Visit our documentation at docs.usemoonshine.com to explore the expanded API options and begin building your next video understanding project.

Join the Moonshine Community

We're incredibly excited about these updates and the potential they unlock for video understanding. We encourage you to explore these new features and share your feedback. Join our Discord community to connect with other users, stay informed about the latest developments, and contribute to the future of Moonshine. We can't wait to see what you build!