To ensure the high efficiency of automated material handling equipment, our company offers an all-in-one turn-key solution: cameras with MIPI interface paired with the neural processing compute module. The system is purpose-built for automated loader robots, as well as for developing intelligent digital optical systems with on-board AI video processing capabilities.
MIPI CSI-2 Interface
Streaming video over MIPI (typically MIPI CSI-2 for camera modules) provides significant advantages over USB, GigE, and other interfaces, particularly when developing embedded software. Supporting up to four MIPI CSI-2 connections effortlessly ensures high-frame-rate transmission of raw video streams up to 4K and even 8K resolutions, leveraging multiple high-speed differential lanes. This enables uncompressed, full RAW stream output directly to an AI accelerator or CPU, which is crucial for precise processing and detailed AI analysis.
On-Board Computing
Featuring a performance output of 6 TOPS (Tera Operations Per Second), the microcomputer hits the sweet spot for most computer vision tasks and real-time data analytics.
Key applications include:
-
Real-time object detection and classification
-
Multi-stream processing (e.g., 2 to 4 cameras) with AI video analytics enabled
-
Obstacle avoidance (processing sensor and camera feed data)
-
Autonomous object tracking
IMU module is directly integrated into the compute board to expand the capabilities of mobile smart systems without requiring external sensors:
-
Accelerometer: Detects board tilt (angle relative to the ground), vibration, shock, and movement/rest states.
-
Gyroscope: Tracks turns, rotational movement, and micro-motions.
-
Magnetometer: Functions as a digital compass, determining heading relative to the board.
Out-of-the-Box Software Stack
For software developers, the Linux operating system provides open-source flexibility, stability, and robust development tools, allowing precise adaptation to project-specific requirements. Lightweight and modular, Linux is ideal for building embedded software tailored to resource-constrained systems.
The neural processing unit is tailored specifically for our MIPI camera lineup, featuring pre-installed MIPI CSI-2 drivers for seamless microcomputer integration. Connecting third-party camera modules via MIPI CSI-2 is technically feasible, though it will require custom driver development and an adapter board.
Note: Integrators who design and perform the final assembly of automated forklifts are responsible for flashing and deploying their own software software stack to the microcomputer memory ROM.
Application Examples for the Turn-Key Kit:
-
High-Speed Obstacle Avoidance: Uncompressed, high-frame-rate video stream processing allows the neural network to instantaneously detect obstacles, personnel, and other automated loader robots in its path.
-
Redundant Inertial Measurement: The onboard IMU module (accelerometer, gyroscope, and magnetometer) estimates device orientation and spatial position.
-
Autonomous Target Tracking: The object tracking feature enables loader robot to autonomously follow moving vehicles, vessels, or individuals without operator intervention.
By leveraging our turn-key solution, automated loader robots and platforms achieve even greater operational efficiency and autonomy, minimizing the need for constant human supervision.
