基于特征点的电影字幕提取

doi:10.3969/j.issn.2095-2198.2023.02.013

下载:

PDF (2270KB)
输出: BibTeX | EndNote (RIS)

摘要

电影字幕作为电影图像的解释文本，可以帮助观众更好地理解电影剧情.针对在复杂背景下提取字幕困难的问题，提出基于特征点、颜色等多特征融合的电影中英文字幕同时提取算法.该算法首先通过帧间差分算法进行运动目标检测，提取电影图像中的字幕帧；然后通过运用ORB特征点检测技术、启发式筛选、形态学处理等方法定位字幕，对准确定位的文本区域通过颜色聚类提取字幕文本，实现文本分割；最后通过OCR文字识别技术实现对字幕帧文本的识别.实验结果表明：该方法将处理帧数减少到与字幕条数相同，将字幕提取的准确率提高到95%，提高了字幕检测效率，验证了多特征融合技术的有效性.

	服务
	把本文推荐给朋友
	加入引用管理器
	E-mail Alert
	RSS
	（）
	作者相关文章

关键词: 字幕定位')" href="#">

字幕定位文本提取颜色聚类多特征融合

Abstract:

As the explanatory text of movie images,movie subtitle can help audiences to better understand the plot of a movie.To address the difficulty of extracting subtitles in complex backgrounds,a simultaneous extraction algorithm for Chinese and English subtitles in movies is proposed based on the fusion of multiple features such as feature points and colors.In this algorithm,the moving target is detected by inter-frame difference algorithm,and the subtitle frame in the movie image is extracted.Then,by using ORB feature point detection technology,heuristic filtering,morphological processing,and other methods to locate subtitles,color clustering is used to extract subtitle text from the accurately located text area,achieving text segmentation.Finally,OCR text recognition technology is used to recognize the subtitle frame text.The experimental results show that this method reduces the number of frames processed to the same as the number of caption bars,the accuracy of subtitle extraction was improved to 95%,improves the efficiency of subtitle detection,and verifies the effectiveness of multi-feature fusion technology.

Key words: subtitle positioning')" href="#">

subtitle positioning text extraction color clustering multifeature fusion

出版日期: 2023-04-29 发布日期: 2024-06-06 整期出版日期: 2023-04-29

基金资助:

辽宁省教育厅科学研究项目（LQ2017008）

引用本文:

路鑫, 杨硕.

基于特征点的电影字幕提取 [J]. 沈阳化工大学学报, 2023, 37(2): 178-185.
LU Xin, YANG Shuo.

Movie Subtitle Extraction Based on Feature Points . Journal of Shenyang University of Chemical Technology, 2023, 37(2): 178-185.

链接本文:

https://xuebao.syuct.edu.cn/CN/10.3969/j.issn.2095-2198.2023.02.013 或 https://xuebao.syuct.edu.cn/CN/Y2023/V37/I2/178

［1］纵蕴瑞.复杂背景下视频字幕文字的提取与去除的研究［D］.天津:天津大学,2014:20-31.

［2］章东平.视频文本的提取［D］.浙江:浙江大学,2006:38-58.

［3］尹芳,郑亮,陈田田.基于Adaboost算法的场景中文文本定位［J］.计算机工程与应用,2017,53(4):200-204,208.

［4］乔平安,刘佩龙.基于SWT法网络社交平台图像文本检测［J］.现代电子技术,2019,42(20):48-52.

［5］张进,王贵成,汪滢.基于模糊聚类的谷氨酸发酵过程故障诊断研究［J］.沈阳化工大学学报,2017,31(2):182-187.

［6］曹鲁慧,邓玉香,陈通，等.一种基于深度学习的中文文本特征提取与分类方法［J］.山东科学,2019,32(6):106-111.

［7］孙增友,段玉帅,李亚.基于中心环绕滤波器检测的图像特征点匹配算法［J］.计算机应用,2017,37(12)：3547-3553.

［8］杨硕,张波,张志杰.多特征融合的车牌定位算法［J］.计算机应用,2016,36(6):1730-1734.

［9］XU Y P,JI H B,ZHANG W B.Coarse-to-Fine Sample-Based Background Subtraction for Moving Object Detection［J］.Optik，2020,207：164195.

［10］CHANG Y C.Improving the Otsu Method for MRA Image Vessel Extraction Via Resampling and Ensemble Learning［J］.Healthcare Technology Letters.2019,6(4):115-120.

［11］ISLAM M Z，ESTIVILL-CASTRO V，RAHMAN M A，et al.Combining K-Means and a Genetic Algorithm Through a Novel Arrangement of Genetic Operators for High Quality Clustering［J］.Expert Systems with Applications,2018,91:402-417.

［12］苏秋丹.基于SVM的视频中文本的检测与提取方法研究［D］.哈尔滨:哈尔滨工程大学,2008:23-42.