loosing some content in the pdf

[kvrameshreddy]

Hi @JorjMcKie ,

Some of the content on a pdf is missing while I am applying rectangle over, where as add_highlight_annot is giving correct result

Can you please have a look into it and help me

import fitz

pdf1 = fitz.open(r"D:\logs\8.pdf")
for page1 in pdf1:
    shape = page1.new_shape()
    words = page1.get_text("words")
    for word in words:
        shape.draw_rect(word[:4])
    shape.finish(fill=(1, 1, 0), fill_opacity=0.65)
    shape.commit()
    print(f"Added {len(words)} rectangles on page {page1.number}.")
pdf1.save(r"D:\logs\8_out.pdf", garbage=3, deflate=True)

the above code is resulting in missing some info on the page
8_out.pdf

pdf1 = fitz.open(r"D:\logs\8.pdf")
for page1 in pdf1:
    shape = page1.new_shape()
    words = page1.get_text("words")
    print(words)
    for j in range(len(words)):
        page1.add_highlight_annot(words[j][0:4])
    print(f"Added {len(words)} rectangles on page {page1.number}.")
pdf1.save(r"D:\logs\8_out1.pdf", garbage=3, deflate=True)

this has all the info of the original pdf, but size increases
8_out1.pdf

For your reference original PDF
8.pdf

[JorjMcKie]

That PDF contains sloppy handling of geometry changes. Cleaning it first thing after reading it will solve the problem:

import fitz

pdf1 = fitz.open("8.pdf")
for page1 in pdf1:
    page1.clean_contents()  # <=== do this before anything else with the page
    shape = page1.new_shape()
    words = page1.get_text("words")
    for w in words:
        shape.draw_rect(w[:4])
    shape.finish(fill=(1, 1, 0), fill_opacity=0.3)
    shape.commit()
    print(f"Added {len(words)} rectangles on page {page1.number}.")
pdf1.save("8_out1.pdf", garbage=3, deflate=True)

[kvrameshreddy]

Thanks @JorjMcKie,