mirror of
https://github.com/opencv/opencv.git
synced 2026-07-30 07:43:03 +04:00
Merge pull request #29300 from vpisarev:add_harfbuzz
Added harfbuzz; use it instead of STB to render text #29300 Merge with https://github.com/opencv/opencv_extra/pull/1378. This is the next big step to improve font rendering in OpenCV 5.x. See #18760, #26301. See also OpenCV 5.0 release notes, where it was pointed out that complex scripts are not rendered correctly, and HarfBuzz integration is needed to fix it. So, here it is — HarfBuzz integration: * Removed tweaked STB engine. STB truetype rendering engine was included into OpenCV 5.0-pre/5.0 and it was extended to instantiate and render variable fonts, but the support was incomplete and immature. * Instead, we now use [HarfBuzz](https://github.com/harfbuzz/harfbuzz) — famous font shaping library and now also font rendering library, used by many big companies and organizations. * As a result, we now correctly render complex scripts, such as arabic or devanagari, correctly handle font ligatures (ff, fi, ft etc.) <img width="1300" height="600" alt="text_test" src="https://github.com/user-attachments/assets/a7d2c754-0fcf-40f8-8104-578f3a14850b" /> * Potentially, we could also support color emoji, but that would be a next step. * As with STB-based engine, glyphs are cached (the same glyph from the same font is not rendered twice), so the performance should be on par with the previous engine. * When OpenCV is built with `-DWITH_HARFBUZZ=ON`, which is set by default, it tries to detect HarfBuzz in the system and use it. If it's not detected, OpenCV builds our own small subset of HarfBuzz. The following table compares size of libopencv_imgproc.dylib.5.0.0 (Release mode) in different configurations: | Configuration | libopencv_imgproc (stripped) | delta vs 5.0 | |----------------------------------------|------------------------------|----------| | imgproc without text rendering (`-DWITH_HARFBUZZ=OFF`) | 4.27 MB | −2.35 MB | | imgproc with stb-based engine (5.0) | 6.62 MB | 0.0 Mb | | imgproc with HarfBuzz-based engine (this PR) | 7.07 MB | +0.45 MB | The biggest source of the size increase when OpenCV is built with text rendering support (STB- or Harfbuzz-based) is that imgproc in this case includes .ttf fonts (Rubik and 'Wen Quan Yi Micro Hei'), which are gzip-compressed, but still have noticeable size, especially 'Wen Quan Yi' (~2Mb). HarfBuzz itself, compared to STB engine, adds just 0.45Mb, or ~7% to imgproc size. On other platforms (Linux x64, Windows), where IPP or other acceleration libraries are linked into libopencv_imgproc, the harfbuzz footprint is even less noticeable. ### Pull Request Readiness Checklist See details at https://github.com/opencv/opencv/wiki/How_to_contribute#making-a-good-pull-request - [x] I agree to contribute to the project under Apache 2 License. - [x] To the best of my knowledge, the proposed patch is not based on a code under GPL or another license that is incompatible with OpenCV - [x] The PR is proposed to the proper branch - [x] There is a reference to the original bug report and related work - [x] There is accuracy test, performance test and test data in opencv_extra repository, if applicable Patch to opencv_extra has the same branch name. - [x] The feature is well documented and sample code can be built with the project CMake
This commit is contained in:
@@ -779,6 +779,7 @@ TEST(Drawing, ttf_text)
|
||||
"historia, ruégote que no te olvides de mi buen Rocinante,\n"
|
||||
"compañero eterno mío en todos mis caminos y carreras!\n", false, 300, false},
|
||||
{"Ταχίστη αλώπηξ βαφής ψημένη γη, δρασκελίζει υπέρ νωθρού κυνός.", false, 400, false},
|
||||
{"العربية لغة جميلة، والخط العربي فن.", false, 400, false},
|
||||
{"春眠不觉晓,\n处处闻啼鸟。\n夜来风雨声,\n花落知多少。\n"
|
||||
" あなたはそれが困難見つけた場合 — あなたは正しい方向に向かっている。\n"
|
||||
" 넌 모든 꽃들을 다 꺾어버릴 수는 있겠지만, 봄이 오는 걸 막을 수는 없어。 ", false, 400, false}
|
||||
@@ -841,10 +842,12 @@ TEST(Drawing, ttf_text)
|
||||
}
|
||||
|
||||
#if 0
|
||||
//imwrite(ts_data_path + "../highgui/drawing/text_test.png", img);
|
||||
//imwrite(ts_data_path + "../highgui/drawing/text_test_new.png", img);
|
||||
imshow("test", img);
|
||||
waitKey();
|
||||
#else
|
||||
// Always dump the rendered image for visual inspection (HarfBuzz engine bring-up).
|
||||
//imwrite("ttf_text_actual.png", img);
|
||||
Mat refimg = imread(ts_data_path + "../highgui/drawing/text_test.png", IMREAD_UNCHANGED);
|
||||
//imshow("ref", refimg);
|
||||
//imshow("actual", img);
|
||||
@@ -857,6 +860,32 @@ TEST(Drawing, ttf_text)
|
||||
}
|
||||
#endif
|
||||
|
||||
// Experiment (not a regression test): render Arabic + Devanagari with FiraGO,
|
||||
// which covers both scripts, and dump a PNG for visual inspection.
|
||||
TEST(Drawing, DISABLED_firago_experiment)
|
||||
{
|
||||
// FiraGO covers both Arabic and Devanagari. It is optional test data:
|
||||
// findDataFile(..., /*required=*/false) throws SkipTestException when the
|
||||
// font is absent, so the test is reported as skipped rather than failing.
|
||||
string fontpath = findDataFile("../highgui/drawing/FiraGo-Book.ttf", false);
|
||||
FontFace fira(fontpath);
|
||||
|
||||
Mat img(360, 1000, CV_8UC3, Scalar::all(255));
|
||||
Scalar color(40, 40, 40);
|
||||
int x0 = 40, y = 70;
|
||||
|
||||
putText(img, "FiraGO: Arabic + Devanagari", Point(x0, y), color, fira, 30, 500,
|
||||
PUT_TEXT_ALIGN_LEFT, Range());
|
||||
y += 90;
|
||||
putText(img, "العربية لغة جميلة، والخط العربي فن.", Point(x0, y), color, fira, 48, 400,
|
||||
PUT_TEXT_ALIGN_LEFT, Range());
|
||||
y += 100;
|
||||
putText(img, "नमस्ते दुनिया — संस्कृतम् सुन्दरम् अस्ति।", Point(x0, y), color, fira, 48, 400,
|
||||
PUT_TEXT_ALIGN_LEFT, Range());
|
||||
|
||||
imwrite("firago_experiment.png", img);
|
||||
}
|
||||
|
||||
TEST(Drawing, fillpoly_contours)
|
||||
{
|
||||
const int imgSize = 50;
|
||||
|
||||
Reference in New Issue
Block a user