MIS5001 5MP Camera (A)
| ||
| ||
Overview
It currently only supports mainboards like Luckfox Pico Pro / Max / Ultra that are equipped with RV1106 chips
Module Parameters
- 5 million pixels
- Photosensitive chip: MIX5001
- Resolution: 2592 x 1944
- Camera parameters:
- CMOS size: 1/2.7inch
- Optional Wide-angle lens or Wide-angle distortion-free lens
- 4 screw holes:
- Can be used for fixing positions
- Size: 25mm × 24mm
Lens Parameters
| Wide-angle lens | Wide-angle distortion-free lens | |
 |
| |
| Focal Length | 4.15mm | 2.88mm |
| Aperture (F) | 1.6 | 2.4 |
| Diagonal Field of View (DFOV) | 93° | 95.5° |
| Horizontal Field of View (HFOV) | 78.2° | 87.5° |
| Vertical Field of View (VFOV) | 41° | 56.5° |
| Distortion | <-10.7% | <1% |
| Relative illumination | >68.4% | >65% |
Interfaces
| NO. | SYMBOL |
| 1 | GND |
| 2 | XCLK |
| 3 | GND |
| 4 | MDP0 |
| 5 | MDN0 |
| 6 | GND |
| 7 | MCP |
| 8 | MCN |
| 9 | GND |
| 10 | MDP1 |
| 11 | MDN1 |
| 12 | GND |
| 13 | SIO-C |
| 14 | SIO-D |
| 15 | GND |
| 16 | RESET |
| 17 | GND |
| 18 | GND |
| 19 | +3.3V |
| 20 | +3.3V |
Hardware Connection
- Connect to Luckox Pico Pro / Luckfox Pico Max
- Ensure that the metal side of the camera cable faces the main control chip
- Connect to Luckfox Pico Ultra / Luckfox Pico Ultra W
- Ensure that the metal side of the camera cable faces the main control chip
User Guide
The user guide is only applicable to buildroot system
V4L2 Read Raw Image
Note: The data captured using V4l2 is raw images that have not been processed by ISP
v4l2-utils is a set of utilities for testing and configuring V4L2 devices, providing access to the V4L2 interface through a command-line interface. v4l2-utils tools are included by default in the buildroot configuration of the Luckfox Pico SDK.
Capture Image
- List all video devices
v4l2-ctl --list-devices
# v4l2-ctl --list-devices
rkisp-statistics (platform: rkisp):
/dev/video23
/dev/video24
rkcif-mipi-lvds (platform:rkcif):
/dev/media2
rkcif (platform:rkcif-mipi-lvds):
/dev/video4
/dev/video5
/dev/video6
/dev/video7
/dev/video8
/dev/video9
/dev/video10
/dev/video11
/dev/video12
/dev/video13
/dev/video14
rkisp_mainpath (platform:rkisp-vir0):
/dev/video15
/dev/video16
/dev/video17
/dev/video18
/dev/video19
/dev/video20
/dev/video21
/dev/video22
/dev/media3
USB Camera: USB Camera (usb-xhci-hcd.0.auto-1.1):
/dev/video0
/dev/video1
/dev/media0
USB 2.0 Camera: USB Camera (usb-xhci-hcd.0.auto-1.2):
/dev/video2
/dev/video3
/dev/media1
USB Camera: USB Camera
- List the formats supported by video devices
v4l2-ctl --device=/dev/video15 --list-formats-ext
- Display camera parameters
v4l2-ctl --device=/dev/video15 --list-ctrls
- Capture images
- -device: The device file corresponding to the camera
- --set-fmt-video: Specifies the width, height, and pxiel format (indicating the pixel format)
- --stream-mmap: Specifies that the type of buffer is mmap, i.e., a physically contiguous or iommu-mapped buffer allocated by the kernel
- --stream-to: Specifies the file path where the frame data is saved
- --stream-count: Specify the number of frames captured, excluding the number discarded by--stream-skip
#CSI Camera (need to disable the built-in RKIPC first) RkLunch-stop.sh v4l2-ctl --device=/dev/video15 --set-fmt-video=width=640,height=480,pixelformat=NV12 --stream-mmap --stream-to=video50.yuv --stream-count=30
- If the message "The pixelformat 'UYVY' is invalid" appears, it indicates that the camera does not support this format. Use the method from the second step to check the formats supported by the camera
- If the message "<<<<<<<<25 fps" appears, it indicates successful image capture
Display Image
The captured images can be copied to a computer and viewed using the ffplay tool. ffplay is a command-line tool in the FFmpeg toolkit used to play audio and video files, allowing real-time playback or preview of multimedia content from the command line.
- Play video
- -video_size: Sets frame size
- -pixel_format: Sets the pixel format
- -framerate 10: Set the frame rate of the video to 10 frames per second
ffplay -video_size 640x480 -pixel_format nv12 -framerate 10 -i video50.yuv
RTSP Streaming
Get IP Address
The board obtains the IP address of the camera, records the IP address of USB0 as 172.32.0.93, or you can choose to use the IP address of network port eth0
# ifconfig
eth0 Link encap:Ethernet HWaddr 82:D8:B7:D8:94:5A
inet addr:192.168.10.86 Bcast:192.168.11.255 Mask:255.255.252.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:144 errors:0 dropped:0 overruns:0 frame:0
TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:11210 (10.9 KiB) TX bytes:684 (684.0 B)
Interrupt:51
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
UP LOOPBACK RUNNING MTU:65536 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
usb0 Link encap:Ethernet HWaddr F2:84:8E:BA:A0:E8
inet addr:172.32.0.93 Bcast:172.32.255.255 Mask:255.255.0.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:85 errors:0 dropped:39 overruns:0 frame:0
TX packets:4 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:13126 (12.8 KiB) TX bytes:1544 (1.5 KiB)
Configure RNDIS Virtual NIC
Configure the RNDIS virtual NIC on your computer to ensure that the NIC places the computer on the same LAN as the board.
- Windows Security—> Firewall & Network Protection—> Turn off firewall
- To configure the static IP of the RNDIS network card, open Settings - > Advanced Network Settings - > Change adapter options
- The NIC is generally named Remote NDIS based nternet Sharing Device, right-click Properties
- Double-click Internet Protocol Version (TCP/IPv4), set the IPv4 address to 172.32.0.100, to avoid conflicts with other network devices
Run Streaming Program
The default image on the board will automatically run the rkipc demo, and the motherboard will be set as a streaming server after booting up.
- Start rkipc (it is already started by default, so there is no need to execute it again)
RkLunch.sh
- Close rkipc
RkLunch-stop.sh
Pull Video Stream
- Download and install VLC media player on your computer
- Open VLC media player software, go to Media ->Open Network Streaming
- Enter the streaming address corresponding to the IP address on the board, taking the USB0 IP address 172.32.0.93 on the board as an example: rtsp://172.32.0.93/live/0
- Click Play and view the live camera feed. You can rotate the lens to adjust the focus
Optimize VLC Network Streaming Delay
VLC software defaults to caching 1 second (1000ms=1s) of video. The cache time can be appropriately reduced based on network conditions to improve real-time performance. If the cache time is too short, it may cause packet loss or stuttering. It is recommended to be not less than 300ms.
Resources
Related Links
- Introduction to the Luckfox Pico Series
- Luckfox Pico Pro Max CSI Camera
- Luckfox Pico Ultra CSI Camera
FAQ
Use luckfox-config to enable the CSI interface and reboot.
Rotate the camera manually to focus according to the actual shooting situation, and be careful not to turn it too much and cause the lens to fall off.