Great research starts with great data.

Learn More
More >
Patent Analysis of

Fisheye image display method

Updated Time 12 June 2019

Patent Registration Data

Publication Number

US10002305

Application Number

US15/450014

Application Date

05 March 2017

Publication Date

19 June 2018

Current Assignee

VIVOTEK INC.

Original Assignee (Applicant)

VIVOTEK INC.

International Classification

G06K9/20,G06T3/00,G09G5/14,G06F3/0486,G06F3/0484

Cooperative Classification

G06K9/2081,G06F3/0486,G06F3/04845,G06T3/0018,G06T3/0093

Inventor

SHIH, YI-HSUEN,LIU, CHIEN-WEN

Patent Images

This patent contains figures and images illustrating the invention and its embodiment.

US10002305 Fisheye image display 1 US10002305 Fisheye image display 2 US10002305 Fisheye image display 3
See all images <>

Abstract

A fisheye image display method is adapted to a display device, wherein a display screen of the display device is divided into a plurality of view cells. The fisheye image display method includes steps of receiving a fisheye image; generating an original image and a plurality of regional images according to the fisheye image, wherein the regional images are corresponding to a plurality of regions of interest in the original image; and arranging the regional images in at least two of the view cells, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells includes at least two of the regional images.

Read more

Claims

1. A fisheye image display method adapted to a display device, a display screen of the display device being divided into a plurality of view cells, the fisheye image display method comprising steps of: receiving a fisheye image; generating an original image and a plurality of regional images according to the fisheye image, wherein the regional images are corresponding to a plurality of regions of interest in the original image; and arranging the regional images in at least two of the view cells, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells comprises at least two of the regional images.

2. The fisheye image display method of claim 1, further comprising step of: when a cursor moves into one of the at least two view cells, displaying the original image at a position corresponding to the cursor or at a predetermined position.

3. The fisheye image display method of claim 2, further comprising step of: allowing the original image to be dragged to a random position within the at least two view cells.

4. The fisheye image display method of claim 2, further comprising step of: allowing the original image to be dragged to any view cell beyond the at least two view cells.

5. The fisheye image display method of claim 2, further comprising step of: zooming and/or rotating one of the regions of interest, so as to zoom and/or rotate one of the regional images correspondingly.

6. The fisheye image display method of claim 1, further comprising step of: displaying a frame around the at least two view cells, so as to indicate that the regional images in the at least two view cells are corresponding to the original image.

7. The fisheye image display method of claim 1, further comprising step of: allowing at least one of the regional images to be dragged to any view cell beyond the at least two view cells.

8. The fisheye image display method of claim 1, further comprising step of: rotating and calibrating directions of the regional images before displaying the regional images.

9. The fisheye image display method of claim 1, further comprising step of: dewarping the regional images before displaying the regional images.

Read more

Claim Tree

  • 1
    1. A fisheye image display method adapted to a display device, a display screen of the display device being divided into a plurality of view cells, the fisheye image display method comprising
    • steps of: receiving a fisheye image
    • generating an original image and a plurality of regional images according to the fisheye image, wherein the regional images are corresponding to a plurality of regions of interest in the original image
    • and arranging the regional images in at least two of the view cells, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells comprises at least two of the regional images.
    • 2. The fisheye image display method of claim 1, further comprising
      • step of: when a cursor moves into one of the at least two view cells, displaying the original image at a position corresponding to the cursor or at a predetermined position.
    • 6. The fisheye image display method of claim 1, further comprising
      • step of: displaying a frame around the at least two view cells, so as to indicate that the regional images in the at least two view cells are corresponding to the original image.
    • 7. The fisheye image display method of claim 1, further comprising
      • step of: allowing at least one of the regional images to be dragged to any view cell beyond the at least two view cells.
    • 8. The fisheye image display method of claim 1, further comprising
      • step of: rotating and calibrating directions of the regional images before displaying the regional images.
    • 9. The fisheye image display method of claim 1, further comprising
      • step of: dewarping the regional images before displaying the regional images.
See all independent claims <>

Description

CROSS REFERENCE TO RELATED APPLICATION

This application claims the benefit of Taiwan Application No. 105106834, which was filed on Mar. 7, 2016, and is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention relates to a fisheye image display method and, more particularly, to a fisheye image display method arranging a plurality of regional images of a fisheye image in at least two adjacent view cells.

2. Description of the Prior Art

Since safety awareness is being raised gradually, people pay much attention to safety surveillance application. So far in many public or non-public places, there are always one or more cameras installed for safety surveillance. Since a fisheye lens has a characteristic of ultra-wide-angle, many cameras usually use the fisheye lens to capture an image of overall space. After the camera receives a fisheye image, a display device generates an original image according to the fisheye image. A user can select a plurality of regions of interest (ROI) from the original image, so as to monitor the selected regions of interest. At this time, the display device will dewarp the regions of interest, so as to further generate a plurality of regional images corresponding to the regions of interest.

Referring to FIG. 1, FIG. 1 is a schematic diagram illustrating a display device 1 of the prior art. As shown in FIG. 1, eight regional images R1-R8 are corresponding to eight regions of interest ROI1-ROI8 in an original image O and a display screen 10 of the display device 1 is divided into nine view cells 10a-10i. The prior art arranges one original image O and eight regional images R1-R8 in a 3×3 matrix and displays all of the nine images in one single view cell 10a. Furthermore, the other eight view cells 10b-10i display other monitored images I1-I8 transmitted from other cameras, respectively.

The size of the view cell 10a is one ninth of the display screen 10. If one original image O and eight regional images R1-R8 are displayed in one single view cell 10a, all images are packed with each other, such that the user cannot watch the details of each image clearly. Still further, since the user has selected the regions of interest ROI1-ROI8 from the original image O, it means that the regional images R1-R8 corresponding to the regions of interest ROI1-ROI8 are very important and the user needs not to watch the original image O temporarily. If the original image O is still displayed in the view cell 10a, the space for displaying the regional images R1-R8 is reduced and the screen is in a disorderly state accordingly. Moreover, since the regional images R1-R8 are arranged around the original image O circularly, the user has to watch the regional images R1-R8 in different lines, such that the user may feel visual fatigue easily due to discontinuous visual effect and cannot promptly perceive that each of the regional images R1-R8 is corresponding to which region of interest in the original image O.

SUMMARY OF THE INVENTION

An objective of the invention is to provide a fisheye image display method arranging a plurality of regional images of a fisheye image in at least two adjacent view cells, so as to solve the aforesaid problems.

According to an embodiment of the invention, a fisheye image display method is adapted to a display device, wherein a display screen of the display device is divided into a plurality of view cells. The fisheye image display method comprises steps of receiving a fisheye image; generating an original image and a plurality of regional images according to the fisheye image, wherein the regional images are corresponding to a plurality of regions of interest in the original image; and arranging the regional images in at least two of the view cells, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells comprises at least two of the regional images.

As mentioned in the above, the invention arranges a plurality of regional images of the fisheye image in at least two adjacent view cells, so as to magnify each of the regional images, such that a user can watch the details of each regional image clearly. Furthermore, since the regional images are arranged in horizontal or vertical adjacent view cells, the user can watch each of the regional images directly in horizontal or vertical direction without skipping a line and the visual effect is continuous. Accordingly, the user can watch the regional images easily and can directly perceive that each of the regional images is corresponding to which region of interest in the original image.

These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram illustrating a display device of the prior art.

FIG. 2 is a schematic diagram illustrating an original image generated according to a fisheye image.

FIG. 3 is a schematic diagram illustrating a display device according to an embodiment of the invention.

FIG. 4 is a flowchart illustrating a fisheye image display method according to an embodiment of the invention.

FIG. 5 is a schematic diagram illustrating a frame displayed around two view cells.

FIG. 6 is a schematic diagram illustrating the regional image dragged to a position beyond two view cells.

FIG. 7 is a schematic diagram illustrating the original image displayed at a position corresponding to the cursor.

FIG. 8 is a schematic diagram illustrating the original image displayed at a predetermined position.

FIG. 9 is a schematic diagram illustrating the original image dragged to a position beyond two view cells.

FIG. 10 is a schematic diagram illustrating the regional images arranged in two vertical adjacent view cells.

DETAILED DESCRIPTION

Referring to FIGS. 2 to 4, FIG. 2 is a schematic diagram illustrating an original image O generated according to a fisheye image, FIG. 3 is a schematic diagram illustrating a display device 3 according to an embodiment of the invention, and FIG. 4 is a flowchart illustrating a fisheye image display method according to an embodiment of the invention. The fisheye image display method shown in FIG. 4 is adapted to the display device 3 shown in FIG. 3, wherein the display device 3 may be a computer screen, a monitor, a television, a tablet computer or other electronic devices with display function. As shown in FIG. 3, a display screen 30 of the display device 3 is divided into a plurality of view cells 30a-30i . In this embodiment, the display screen 30 is divided into nine view cells 30a-30i. However, in another embodiment, the display screen 30 may also be divided into other number of view cells according to practical applications.

When the display device 3 is monitoring a place, first of all, the display device 3 receives a fisheye image from a camera (not shown) equipped with a fisheye lens (step S10 in FIG. 4). Then, the display device 3 generates an original image O and a plurality of regional images R1-R8 according to the fisheye image, wherein the regional images R1-R8 are corresponding to a plurality of regions of interest ROI1-ROI8 in the original image O (step S12 in FIG. 4). In this embodiment, after receiving the fisheye image from the camera, the display device 3 generates the original image O according to the fisheye image first, as shown in FIG. 2. A user may select eight regions of interest ROI1-ROI8 from the original image O, so as to monitor the regions of interest ROI1-ROI8. At this time, the display device 3 will dewarp the regions of interest ROIL-ROI8, so as to further generate eight regional images R1-R8 corresponding to the regions of interest ROI1-ROI8, as shown in FIG. 3. It should be noted that the user may also select other number of regions of interest from the original image O according to practical applications, so as to generate other number of region images. In practical applications, the invention may rotate and calibrate directions of the regional images R1-R8 before displaying the regional images R1-R8, so as to rotate the regional images R1-R8 to a correct direction capable of being directly perceived by human eyes. Furthermore, the invention may dewarp the regional images R1-R8 before displaying the regional images R1-R8.

Then, the display device 3 arranges the regional images R1-R8 in at least two of the view cells 30a-30i, wherein the at least two view cells are adjacent to each other horizontally or vertically, and one of the at least two view cells comprises at least two of the regional images R1-R8 (step S14 in FIG. 4). In this embodiment, the display device 3 arranges the regional images R1-R8 in two horizontal adjacent view cells 30a, 30b of the view cells 30a-30i, wherein the view cell 30a comprises four regional images R1-R4 of the regional images R1-R8 and the view cell 30b comprises four regional images R5-R8 of the regional images R1-R8. Furthermore, the other seven view cells 30c-30i display other monitored images I1-I7 transmitted from other cameras, respectively.

Comparing the prior art shown in FIG. 1 with the embodiment of the invention shown in FIG. 3, each of the regional images R1-R8 can be magnified since the invention arranges the regional images R1-R8 in two adjacent view cells 30a, 30b, such that the user can watch the details of each regional image R1-R8 clearly. Furthermore, since the regional images R1-R8 are arranged in horizontal adjacent view cells 30a, 30b, the user can watch each of the regional images R1-R8 directly in horizontal direction without skipping a line and the visual effect is continuous. Accordingly, the user can watch the regional images R1-R8 easily and can directly perceive that each of the regional images R1 -R8 is corresponding to which region of interest in the original image O. Moreover, the original image O shown in FIG. 2 is not displayed in the display screen 30 shown in FIG. 3, so the user will not be interfered by the original image O when the user is watching the regional images R1-R8.

It should be noted that the arrangement of the regional images R1-R8 is not limited to the embodiment shown in FIG. 3. For example, the invention may also arrange the regional images R1-R8 in three horizontal adjacent view cells 30a, 30b, 30c, wherein the view cell 30a may comprise three regional images R1-R3, the view cell 30b may comprise three regional images R4-R6, and the view cell 30c may comprise two regional images R7-R8. Accordingly, the arrangement of the regional images R1-R8 may be determined according to practical applications.

Referring to FIG. 5, FIG. 5 is a schematic diagram illustrating a frame 32 displayed around two view cells 30a, 30b. As shown in FIG. 5, since the regional images R1-R8 in the two view cells 30a, 30b are corresponding to the original image O, the invention may display a frame 32 around the two view cells 30a, 30b, so as to indicate that the regional images R1-R8 in the two view cells 30a, 30b are corresponding to the original image O for the user. In this embodiment, the frame 32 is rectangular. However, in another embodiment, the frame 32 may also be oval-shaped or other shapes according to practical applications.

Referring to FIG. 6, FIG. 6 is a schematic diagram illustrating the regional image R4 dragged to a position beyond two view cells 30a, 30b. In this embodiment, the invention allows at least one of the regional images R1-R8 to be dragged to any view cell 30c-30i beyond the two view cells 30a, 30b. As shown in FIG. 6, the user may use a cursor 34 to drag the regional image R4 to the view cell 30d beyond the two view cells 30a, 30b, so as to magnify the regional image R4 in the view cell 30d. At this time, the monitored image 12 originally shown in the view cell 30d is covered by the regional image R4. In another embodiment, the invention may also display the monitored images I2-I6 in the view cells 30e-30i and hide the monitored image I7.

Referring to FIGS. 7 and 8, FIG. 7 is a schematic diagram illustrating the original image O displayed at a position corresponding to the cursor 34 and FIG. 8 is a schematic diagram illustrating the original image O displayed at a predetermined position. As shown in FIG. 7, when the cursor 34 moves into one of the two view cells 30a, 30b, the invention may display the original image O at a position corresponding to the cursor 34. As shown in FIG. 8, when the cursor 34 moves into one of the two view cells 30a, 30b, the invention may display the original image O at a predetermined position, e.g. a lower right corner of the view cell 30b.

In other words, when the user wants to recognize that the regional images R1-R8 are located at which position of the original image O, the user may move the cursor 34 into one of the two view cells 30a, 30b, so as to bring out the original image O. After bringing out the original image O, the user may further zoom and/or rotate one of the regions of interest ROI1-ROI8, so as to zoom and/or rotate one of the regional images R1-R8 correspondingly. Needless to say, the user may also add/delete a region of interest and/or modify a range covered by a region of interest within the original image O, so as to add/delete a regional image and/or modify a range covered by a regional image correspondingly. Furthermore, the invention may further allow the original image O to be dragged to a random position within the two view cells 30a, 30b. As shown in FIG. 7, since the original image O covers parts of the regional images R4, R5, the user may operate the cursor 34 to drag the original image O to other positions within the two view cells 30a, 30b, so as to expose the regional images R4, R5 completely.

Referring to FIG. 9, FIG. 9 is a schematic diagram illustrating the original image O dragged to a position beyond two view cells 30a, 30b. In this embodiment, the invention allows the original image O to be dragged to any view cell 30c-30i beyond the two view cells 30a, 30b. As shown in FIG. 9, the user may use the cursor 34 to drag the original image O to the view cell 30c beyond the two view cells 30a, 30b, so as to magnify the original image O in the view cell 30c. At this time, the monitored image I1 originally shown in the view cell 30c is covered by the original image O. In another embodiment, the invention may also display the monitored images I1-I6 in the view cells 30d-30i and hide the monitored image I7.

Referring to FIG. 10, FIG. 10 is a schematic diagram illustrating the regional images R1-R8 arranged in two vertical adjacent view cells 30a, 30d. As shown in FIG. 10, the invention may also arrange the regional images R1-R8 in two vertical adjacent view cells 30a, 30d of the view cells 30a-30i, wherein the view cell 30a comprises four regional images R1-R4 of the regional images R1-R8 and the view cell 30d comprises four regional images R5-R8 of the regional images R1-R8. Since the regional images R1-R8 are arranged in vertical adjacent view cells 30a, 30d, the user can watch each of the regional images R1-R8 directly in vertical direction without skipping a line and the visual effect is continuous. Accordingly, the user can watch the regional images R1-R8 easily. The arrangement shown in FIG. 10 is adapted to a narrow and long scene, e.g. a lane or a corridor.

Therefore, the user may display the regional images R1-R8 by the horizontal arrangement shown in FIG. 3 or the vertical arrangement shown in FIG. 10 according to practical requirement of the scene. Furthermore, the embodiments shown in FIGS. 5 to 9 are also adapted to the embodiment shown in FIG. 10.

It should be noted that the control logic of the fisheye image display method of the invention can be implemented by software. The software can be executed in a display device. Needless to say, each part or function of the control logic may be implemented by software, hardware or the combination thereof.

As mentioned in the above, the invention arranges a plurality of regional images of the fisheye image in at least two adjacent view cells, so as to magnify each of the regional images, such that a user can watch the details of each regional image clearly. Furthermore, since the regional images are arranged in horizontal or vertical adjacent view cells, the user can watch each of the regional images directly in horizontal or vertical direction without skipping a line and the visual effect is continuous. Accordingly, the user can watch the regional images easily and can directly perceive that each of the regional images is corresponding to which region of interest in the original image. Moreover, the original image is not displayed in the display screen before the user brings out the original image, so the user will not be interfered by the original image when the user is watching the regional images.

Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Read more
PatSnap Solutions

Great research starts with great data.

Use the most comprehensive innovation intelligence platform to maximise ROI on research.

Learn More

Patent Valuation

$

Reveal the value <>

32.9/100 Score

Market Attractiveness

It shows from an IP point of view how many competitors are active and innovations are made in the different technical fields of the company. On a company level, the market attractiveness is often also an indicator of how diversified a company is. Here we look into the commercial relevance of the market.

38.0/100 Score

Market Coverage

It shows the sizes of the market that is covered with the IP and in how many countries the IP guarantees protection. It reflects a market size that is potentially addressable with the invented technology/formulation with a legal protection which also includes a freedom to operate. Here we look into the size of the impacted market.

73.26/100 Score

Technology Quality

It shows the degree of innovation that can be derived from a company’s IP. Here we look into ease of detection, ability to design around and significance of the patented feature to the product/service.

55.0/100 Score

Assignee Score

It takes the R&D behavior of the company itself into account that results in IP. During the invention phase, larger companies are considered to assign a higher R&D budget on a certain technology field, these companies have a better influence on their market, on what is marketable and what might lead to a standard.

17.0/100 Score

Legal Score

It shows the legal strength of IP in terms of its degree of protecting effect. Here we look into claim scope, claim breadth, claim quality, stability and priority.

Citation

Patents Cited in This Cited by
Title Current Assignee Application Date Publication Date
Panoramic vision system and method GEO SEMICONDUCTOR INC. 26 July 2004 26 January 2006
Display device, computer program, and computer-implemented method PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD. 09 December 2014 02 April 2015
影像處理器及其魚眼影像顯示方法 晶睿通訊股份有限公司 02 January 2013 16 July 2014
Image processor and fisheye image display method thereof VIVOTEK INC. 30 December 2013 03 July 2014
會議系統、監視系統、影像處理裝置、影像處理方法及影像處理程式等 大日本印刷股份有限公司 14 October 2011 16 July 2012
See full citation <>

More like this

Title Current Assignee Application Date Publication Date
Image display method, user terminal and video receiving equipment HUAWEI TECHNOLOGIES CO.,LTD. 27 October 2014 06 May 2016
Method and device for image display BEIJING QIHOO TECHNOLOGY COMPANY LIMITED,QIZHI SOFTWARE (BEIJING) COMPANY LIMITED 29 July 2016 16 February 2017
Apparatuses, methods and systems for pre-warping images for a display system with a distorting optical component META COMPANY 06 January 2017 13 July 2017
Electronic device and control method thereof SAMSUNG ELECTRONICS CO., LTD. 17 August 2017 22 February 2018
Display compensating method, display compensating module and display device BOE TECHNOLOGY GROUP CO., LTD. 23 October 2015 24 November 2016
Method and device for rectifying image photographed by fish-eye lens SHENZHEN ARASHI VISION COMPANY LIMITED 31 August 2016 27 July 2017
Browser based display system for displaying image data BARCO N.V. 13 April 2016 20 October 2016
Virtual, augmented, and mixed reality systems and methods MAGIC LEAP, INC. 22 August 2017 01 March 2018
Electronic device and method for managing the display of data for controlling a nuclear power plant, associated control system and computer program product AREVA NP 15 December 2016 22 June 2017
Wide view image display system, information processing apparatus, and image display method RICOH COMPANY, LTD.,OGAWARA, OSAMU,SUGIURA, YOKO 10 August 2016 23 February 2017
System and Method for Displaying Annotated Capsule Images CAPSO VISION INC. 23 February 2016 16 June 2016
Display device and display method MAXELL, LTD. 03 August 2016 08 February 2018
Display system for displaying image data BARCO N.V.,BARCO ELECTRONICS SYSTEMS PVT. LTD. 12 April 2017 19 October 2017
Method and device for displaying a front-view of a vehicle's surrounding and respective vehicle CONTINENTAL AUTOMOTIVE GMBH 07 December 2016 20 July 2017
Image processing device, image processing system, image processing method, and program RICOH COMPANY, LIMITED,OHMURA, KEIJI,HASEGAWA, TAKESHI 25 December 2015 11 August 2016
Dual fisheye image stitching for spherical image content QUALCOMM INCORPORATED 24 January 2017 12 October 2017
An imaging device and method for generating an undistorted wide view image ESSENTIAL PRODUCTS, INC. 28 October 2016 04 May 2017
See all similar patents <>

More Patents & Intellectual Property

PatSnap Solutions

PatSnap solutions are used by R&D teams, legal and IP professionals, those in business intelligence and strategic planning roles and by research staff at academic institutions globally.

PatSnap Solutions
Search & Analyze
The widest range of IP search tools makes getting the right answers and asking the right questions easier than ever. One click analysis extracts meaningful information on competitors and technology trends from IP data.
Business Intelligence
Gain powerful insights into future technology changes, market shifts and competitor strategies.
Workflow
Manage IP-related processes across multiple teams and departments with integrated collaboration and workflow tools.
Contact Sales
Clsoe
US10002305 Fisheye image display 1 US10002305 Fisheye image display 2 US10002305 Fisheye image display 3